{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T05:46:59Z","timestamp":1681969619940},"reference-count":57,"publisher":"ASME International","issue":"3","license":[{"start":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T00:00:00Z","timestamp":1681862400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,1]]},"abstract":"Abstract<\/jats:title>\n We investigate speech-based input as a means to enable reflective thinking for younger individuals (middle- and high-school students) during design iterations. Verbalization offers a unique way to externalize ideas in early design and could therefore lead to new pathways for exploration and iteration, especially for K-12 students who possess the creative potential but are not technically trained in the design process. Interactive design systems, however, by-and-large utilize sketching, multitouch, and gestural inputs. As a result, (1) there is little know-how regarding how to operationalize verbal inputs as a meaningful way to facilitate idea exploration and (2) there is little fundamental understanding of the underlying cognitive mechanisms for iteration through verbal communication. We take the initial steps toward these gaps by first designing and implementing the ShapOrator interface that takes verbal descriptions of geometric parameters (shape, size, instances) in a semi-natural language form and determines the appropriate transformations to a given design artifact modeled as a shape assembly. By using ShapOrator as our experimental setup, we conducted an in-depth observational study on ten middle- and high-school students tasked with designing spaceships. Our study revealed that participants were able to create a variety of designs while associating functional and topical contexts to their spaceships throughout the design iteration process.<\/jats:p>","DOI":"10.1115\/1.4062230","type":"journal-article","created":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T07:23:04Z","timestamp":1680074584000},"update-policy":"http:\/\/dx.doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":0,"title":["Reflect\u2013Express\u2013Transform: Investigating Speech-Based Iterative Digital Design for Young Designers"],"prefix":"10.1115","volume":"23","author":[{"given":"Shantanu","family":"Vyas","sequence":"first","affiliation":[{"name":"Texas A&M University J.Mike Walker \u201866 Department of Mechanical Engineering, , College Station, TX 77843"}]},{"given":"Ting-Ju","family":"Chen","sequence":"additional","affiliation":[{"name":"Texas A&M University J.Mike Walker \u201866 Department of Mechanical Engineering, , College Station, TX 77843"}]},{"given":"Jay","family":"Woodward","sequence":"additional","affiliation":[{"name":"Texas A&M University Department of Educational Psychology, , College Station, TX 77843"}]},{"given":"Vinayak R.","family":"Krishnamurthy","sequence":"additional","affiliation":[{"name":"Texas A&M University J.Mike Walker \u201966 Department of Mechanical Engineering, , College Station, TX 77843;"},{"name":"Texas A&M University Department of Computer Science and Engineering, , College Station, TX 77843"}]}],"member":"33","published-online":{"date-parts":[[2023,4,19]]},"reference":[{"issue":"3","key":"2023041914001075400_CIT0001","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/BF01580516","article-title":"Designing as Reflective Conversation With the Materials of a Design Situation","volume":"3","author":"Schon","year":"1992","journal-title":"Res. Eng. Des."},{"issue":"2","key":"2023041914001075400_CIT0002","first-page":"77","article-title":"An Ontological Account of Donald Sch\u00f6n\u2019s Reflection in Designing","volume":"15","author":"Gero","year":"2008","journal-title":"Int. J. Des. Sci. Technol."},{"key":"2023041914001075400_CIT0003","doi-asserted-by":"crossref","volume-title":"Sketches of Thought","author":"Goel","year":"1995","DOI":"10.7551\/mitpress\/6270.001.0001"},{"key":"2023041914001075400_CIT0004","doi-asserted-by":"crossref","article-title":"Teddy: A Sketching Interface for 3D Freeform Design","author":"Igarashi","year":"2006","DOI":"10.1145\/1185657.1185772"},{"key":"2023041914001075400_CIT0005","first-page":"1235","article-title":"skwiki: A Multimedia Sketching System for Collaborative Creativity","author":"Zhao","year":"2014"},{"key":"2023041914001075400_CIT0006","first-page":"6581","article-title":"Co-3deator: A Team-First Collaborative 3D Design Ideation Tool","author":"Piya","year":"2017"},{"key":"2023041914001075400_CIT0007","first-page":"387","article-title":"Bodyavatar: Creating Freeform 3D Avatars Using First-Person Body Gestures","author":"Zhang","year":"2013"},{"key":"2023041914001075400_CIT0008","doi-asserted-by":"crossref","article-title":"Mobisweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-Held Reference Plane","author":"Vinayak","year":"2016","DOI":"10.1145\/2839462.2839490"},{"issue":"4","key":"2023041914001075400_CIT0009","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1016\/0361-476X(86)90030-5","article-title":"Verbalization and Children\u2019s Self-Regulated Learning","volume":"11","author":"Schunk","year":"1986","journal-title":"Contemp. Educ. Psychol."},{"key":"2023041914001075400_CIT0010","doi-asserted-by":"publisher","first-page":"100987","DOI":"10.1016\/j.destud.2020.100987","article-title":"Analysing Frequent Natural Language Expressions From Design Conversations","volume":"72","author":"Ungureanu","year":"2021","journal-title":"Des. Stud."},{"issue":"4","key":"2023041914001075400_CIT0011","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.destud.2011.03.002","article-title":"Shape Language: How People Describe Shapes and Shape Operations","volume":"32","author":"Wiegers","year":"2011","journal-title":"Des. Stud."},{"issue":"07380895","key":"2023041914001075400_CIT0012","first-page":"319","article-title":"The Design Life Space: Verbal Communication in the Architectural Design Studio","volume":"12","author":"Wendler","year":"1995","journal-title":"J. Archit. Plan. Res."},{"issue":"3","key":"2023041914001075400_CIT0013","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1080\/01587910500167985","article-title":"Online Learning: Constructivism and Conversation as an Approach to Learning","volume":"42","author":"Allen","year":"2005","journal-title":"Innov. Educ. Teach. Int."},{"issue":"3","key":"2023041914001075400_CIT0014","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1207\/s15327957pspr1003_1","article-title":"How the Group Affects the Mind: A Cognitive Model of Idea Generation in Groups","volume":"10","author":"Nijstad","year":"2006","journal-title":"Pers. Soc. Psychol. Rev."},{"key":"2023041914001075400_CIT0015","first-page":"103","article-title":"Idea Expander: Supporting Group Brainstorming With Conversationally Triggered Visual Thinking Stimuli","author":"Wang","year":"2010"},{"key":"2023041914001075400_CIT0016","first-page":"594","article-title":"Ideawall: Improving Creative Collaboration Through Combinatorial Visual Stimuli","author":"Shi","year":"2017"},{"issue":"4","key":"2023041914001075400_CIT0017","first-page":"JCMC442","article-title":"Visualizing Conversation","volume":"4","author":"Donath","year":"1999","journal-title":"J. Comput. Mediat. Commun."},{"issue":"1","key":"2023041914001075400_CIT0018","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/15710880802492870","article-title":"Aspects of Language Use in Design Conversation","volume":"5","author":"Glock","year":"2009","journal-title":"CoDesign"},{"issue":"1","key":"2023041914001075400_CIT0019","doi-asserted-by":"publisher","first-page":"125","DOI":"10.3722\/cadaps.2009.125-136","article-title":"Natural Voice-Enabled Cad: Modeling Via Natural Discourse","volume":"6","author":"Xue","year":"2009","journal-title":"Comput. Aided Des. Appl."},{"key":"2023041914001075400_CIT0020","first-page":"83","article-title":"Speech and Sketching: An Empirical Study of Multimodal Interaction","author":"Adler","year":"2007"},{"key":"2023041914001075400_CIT0021","first-page":"307","article-title":"Mozart: A Multimodal Interface for Conceptual 3D Modeling","author":"Sharma","year":"2011"},{"issue":"2","key":"2023041914001075400_CIT0022","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/S0097-8493(99)00154-5","article-title":"An Approach to Solid Modeling in a Semi-Immersive Virtual Environment","volume":"24","author":"Gao","year":"2000","journal-title":"Comput. Graph."},{"key":"2023041914001075400_CIT0023","doi-asserted-by":"crossref","article-title":"Shaporator: Enabling Design Iteration for Young Designers Through Shape Verbalization","author":"Vyas","year":"2022","DOI":"10.1115\/DETC2022-90176"},{"issue":"3","key":"2023041914001075400_CIT0024","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1016\/0142-694X(92)90216-W","article-title":"An Evolutionary Process Model of Design","volume":"13","author":"Hybs","year":"1992","journal-title":"Des. Stud."},{"key":"2023041914001075400_CIT0025","doi-asserted-by":"crossref","article-title":"Cognitive Processes in Iterative Design Behavior","author":"Adams","year":"1999","DOI":"10.1109\/FIE.1999.839114"},{"key":"2023041914001075400_CIT0026","first-page":"3403","article-title":"Intuition in Design: Reflections on the Iterative Aesthetics of Form","author":"Faste","year":"2017"},{"issue":"10","key":"2023041914001075400_CIT0027","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1145\/570907.570941","article-title":"Characteristics of Applications That Support Creativity","volume":"45","author":"Greene","year":"2002","journal-title":"Commun. ACM"},{"key":"2023041914001075400_CIT0028","article-title":"Integration of Sketch-Based Ideation and 3D Modeling With CAD Systems","author":"Gharib","year":"2013"},{"issue":"2","key":"2023041914001075400_CIT0029","doi-asserted-by":"publisher","first-page":"021008","DOI":"10.1115\/1.4052293","article-title":"Engineering Knowledge Graph From Patent Database","volume":"22","author":"Siddharth","year":"2022","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"2","key":"2023041914001075400_CIT0030","doi-asserted-by":"publisher","first-page":"021017","DOI":"10.1115\/1.4039432","article-title":"Automated Discovery of Product Feature Inferences Within Large-Scale Implicit Social Media Data","volume":"18","author":"Tuarob","year":"2018","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2023041914001075400_CIT0031","first-page":"262","article-title":"\u2018Put-That-There\u2019: Voice and Gesture at the Graphics Interface","author":"Bolt","year":"1980"},{"issue":"10","key":"2023041914001075400_CIT0032","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1016\/S0010-4485(97)00021-3","article-title":"Multi-Sensory User Interface for a Virtual-Reality-Based Computeraided Design System","volume":"29","author":"Chu","year":"1997","journal-title":"Comput. Aided Des."},{"issue":"1","key":"2023041914001075400_CIT0033","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/S0166-3615(98)00104-3","article-title":"An Interactive Environment for Virtual Manufacturing: The Virtual Workbench","volume":"38","author":"Weyrich","year":"1999","journal-title":"Comput. Ind."},{"key":"2023041914001075400_CIT0034","doi-asserted-by":"crossref","article-title":"Intuitive 3D Computer-Aided Design (CAD) System With Multimodal Interfaces","author":"Nanjundaswamy","year":"2013","DOI":"10.1115\/DETC2013-12277"},{"issue":"2","key":"2023041914001075400_CIT0035","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1002\/acp.949","article-title":"Reflective Verbalization Improves Solutions\u2014The Effects of Question-Based Reflection in Design Problem Solving","volume":"18","author":"Wetzstein","year":"2004","journal-title":"Appl. Cogn. Psychol."},{"issue":"5","key":"2023041914001075400_CIT0036","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1007\/s11423-011-9202-9","article-title":"Three Dimensions of Reflective Thinking in Solving Design Problems: A Conceptual Model","volume":"59","author":"Hong","year":"2011","journal-title":"Educ. Technol. Res. Dev."},{"issue":"5","key":"2023041914001075400_CIT0037","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1016\/j.destud.2006.02.002","article-title":"To Sketch or Not to Sketch? That Is the Question","volume":"27","author":"Bilda","year":"2006","journal-title":"Des. Stud."},{"issue":"6","key":"2023041914001075400_CIT0038","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1016\/j.destud.2005.03.001","article-title":"Design Ideation: The Conceptual Sketch in the Digital Age","volume":"26","author":"Jonson","year":"2005","journal-title":"Des. Stud."},{"key":"2023041914001075400_CIT0039","doi-asserted-by":"publisher","first-page":"102847","DOI":"10.1016\/j.autcon.2019.102847","article-title":"Gesture and Speech Elicitation for 3D Cad Modeling in Conceptual Design","volume":"106","author":"Khan","year":"2019","journal-title":"Autom. Constr."},{"issue":"3","key":"2023041914001075400_CIT0040","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1017\/s0890060419000015","article-title":"Speech Analysis for Conceptual CAD Modeling Using Multi-Modal Interfaces: An Investigation Into Architects\u2019 and Engineers\u2019 Speech Preferences","volume":"33","author":"Khan","year":"2019","journal-title":"AI EDAM"},{"key":"2023041914001075400_CIT0041","article-title":"3D CAD Modeling Using Gestures and Speech: Investigating CAD Legacy and Non-Legacy Procedures","author":"Khan","year":"2019"},{"issue":"2","key":"2023041914001075400_CIT0042","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1080\/21573727.2011.569929","article-title":"Messy Talk and Clean Technology: Communication, Problem-Solving and Collaboration Using Building Information Modelling","volume":"1","author":"Dossick","year":"2011","journal-title":"Eng. Proj. Organ. J."},{"issue":"2","key":"2023041914001075400_CIT0043","first-page":"163","article-title":"The Methodology of Participatory Design","volume":"52","author":"Spinuzzi","year":"2005","journal-title":"Technic. Commun."},{"key":"2023041914001075400_CIT0044","first-page":"1776","article-title":"Spaceship Launch: Designing a Collaborative Exergame for Families","author":"Saksono","year":"2015"},{"key":"2023041914001075400_CIT0045","first-page":"85","article-title":"Participatory Design Strategies to Enhance the Creative Contribution of Children With Special Needs","author":"Malinverni","year":"2014"},{"issue":"4","key":"2023041914001075400_CIT0046","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2185520.2185551","article-title":"A Probabilistic Model for Component-Based Shape Synthesis","volume":"31","author":"Kalogerakis","year":"2012","journal-title":"Acm Trans. Graph. (TOG)"},{"key":"2023041914001075400_CIT0047","first-page":"1","article-title":"Probabilistic Reasoning for Assembly-Based 3D Modeling","author":"Chaudhuri","year":"2011"},{"issue":"2","key":"2023041914001075400_CIT0048","doi-asserted-by":"publisher","first-page":"021008","DOI":"10.1115\/1.4023588","article-title":"Handy-Potter: Rapid Exploration of Rotationally Symmetric Shapes Through Natural Hand Motions","volume":"13","author":"Vinayak","year":"2013","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"6","key":"2023041914001075400_CIT0049","doi-asserted-by":"publisher","first-page":"064501","DOI":"10.1115\/1.4055239","article-title":"Making-a-Scene: A Preliminary Case Study on Speech-Based 3D Shape Exploration Through Scene Modeling","volume":"22","author":"Vyas","year":"2022","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"3","key":"2023041914001075400_CIT0050","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3732\/ajb.90.3.333","article-title":"A Generic Geometric Transformation That Unifies a Wide Range of Natural and Abstract Shapes","volume":"90","author":"Gielis","year":"2003","journal-title":"Am. J. Bot."},{"issue":"6245","key":"2023041914001075400_CIT0051","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1126\/science.aaa8685","article-title":"Advances in Natural Language Processing","volume":"349","author":"Hirschberg","year":"2015","journal-title":"Science"},{"issue":"4","key":"2023041914001075400_CIT0052","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2617588","article-title":"Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index","volume":"21","author":"Cherry","year":"2014","journal-title":"ACM Trans. Comput. Human Interact. (TOCHI)"},{"key":"2023041914001075400_CIT0053","first-page":"1877","article-title":"Language Models Are Few-Shot Learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inform. Process. Syst."},{"issue":"11","key":"2023041914001075400_CIT0054","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1145\/219717.219748","article-title":"Wordnet: A Lexical Database for English","volume":"38","author":"Miller","year":"1995","journal-title":"Commun. ACM"},{"key":"2023041914001075400_CIT0055","author":"Chang","year":"2015"},{"issue":"1","key":"2023041914001075400_CIT0056","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/s00163-014-0186-4","article-title":"Design-by-Analogy: Experimental Evaluation of a Functional Analogy Search Methodology for Concept Generation Improvement","volume":"26","author":"Fu","year":"2015","journal-title":"Res. Eng. Des."},{"issue":"11","key":"2023041914001075400_CIT0057","doi-asserted-by":"publisher","first-page":"111102","DOI":"10.1115\/1.4028289","article-title":"Bio-inspired Design: An Overview Investigating Open Questions From the Broader Field of Design-by-Analogy","volume":"136","author":"Fu","year":"2014","journal-title":"ASME J. Mech. Des."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/23\/3\/030905\/7009309\/jcise_23_3_030905.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/23\/3\/030905\/7009309\/jcise_23_3_030905.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T14:00:44Z","timestamp":1681912844000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/23\/3\/030905\/1160384\/Reflect-Express-Transform-Investigating-Speech"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,19]]},"references-count":57,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,6,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4062230","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,19]]}}}