{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,6]],"date-time":"2024-10-06T01:08:08Z","timestamp":1728176888331},"reference-count":102,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,4,28]],"date-time":"2021-04-28T00:00:00Z","timestamp":1619568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000943","name":"Commonwealth Scientific and Industrial Research Organization","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000943","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"The future of work and workplace is very much in flux. A vast amount has been written about artificial intelligence (AI) and its impact on work, with much of it focused on automation and its impact in terms of potential job losses. This review will address one area where AI is being added to creative and design practitioners\u2019 toolbox to enhance their creativity, productivity, and design horizons. A designer\u2019s primary purpose is to create, or generate, the most optimal artifact or prototype, given a set of constraints. We have seen AI encroaching into this space with the advent of generative networks and generative adversarial networks (GANs) in particular. This area has become one of the most active research fields in machine learning over the past number of years, and a number of these techniques, particularly those around plausible image generation, have garnered considerable media attention. We will look beyond automatic techniques and solutions and see how GANs are being incorporated into user pipelines for design practitioners. A systematic review of publications indexed on ScienceDirect, SpringerLink, Web of Science, Scopus, IEEExplore, and ACM DigitalLibrary was conducted from 2015 to 2020. Results are reported according to PRISMA statement. From 317 search results, 34 studies (including two snowball sampled) are reviewed, highlighting key trends in this area. The studies\u2019 limitations are presented, particularly a lack of user studies and the prevalence of toy-examples or implementations that are unlikely to scale. Areas for future study are also identified.<\/jats:p>","DOI":"10.3389\/frai.2021.604234","type":"journal-article","created":{"date-parts":[[2021,4,28]],"date-time":"2021-04-28T05:33:52Z","timestamp":1619588032000},"update-policy":"http:\/\/dx.doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Generative Adversarial Networks\u2013Enabled Human\u2013Artificial Intelligence Collaborative Applications for Creative and Design Industries: A Systematic Review of Current Approaches and Trends"],"prefix":"10.3389","volume":"4","author":[{"given":"Rowan T.","family":"Hughes","sequence":"first","affiliation":[]},{"given":"Liming","family":"Zhu","sequence":"additional","affiliation":[]},{"given":"Tomasz","family":"Bednarz","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2021,4,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1007\/s11831-019-09388-y","article-title":"Applications of generative adversarial networks (gans): an updated review","volume":"28","author":"Alqahtani","year":"2019","journal-title":"Arch. Computat Methods Eng."},{"key":"B2","doi-asserted-by":"crossref","DOI":"10.1109\/CVPRW.2019.00359","article-title":"Social ways: learning multi-modal distributions of pedestrian trajectories with GANs","author":"Amirian","year":"2019"},{"key":"B3","article-title":"Wasserstein GAN","author":"Arjovsky","year":"2017"},{"key":"B4","article-title":"Gan dissection: visualizing and understanding generative adversarial networks","author":"Bau","year":"2019"},{"key":"B5","article-title":"Explanation and justification in machine learning: a survey","author":"Biran","year":"2017"},{"key":"B6","doi-asserted-by":"crossref","DOI":"10.1145\/3359997.3365731","article-title":"Multi\u2013modal high\u2013end visualization system","author":"Bourke","year":"2019"},{"key":"B7","first-page":"17","article-title":"Following behaviors: a model for computing following distances based on prediction","author":"Bruneau","year":"2014"},{"key":"B8","volume-title":"How to generate (almost) anything: episode 3: human-ai collaborated fashion","author":"Cameron","year":"2018"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00009","article-title":"Using artificial intelligence to augment human intelligence","volume":"2","author":"Carter","year":"2017","journal-title":"Distill"},{"key":"B10","article-title":"Top 10 strategic technology trends for 2020","volume":"10","author":"Cearley","year":"2019","journal-title":"Top."},{"key":"B11","doi-asserted-by":"crossref","DOI":"10.1145\/3209693.3209695","article-title":"Doodle master: a doodle beautification system based on auto-encoding generative adversarial networks","author":"Chen","year":"2018"},{"key":"B12","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.jvcir.2019.02.009","article-title":"An artificial intelligence based data-driven approach for design ideation","volume":"61","author":"Chen","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"B13","volume-title":"Infogan: interpretable representation learning by information maximizing generative adversarial nets","author":"Chen","year":"2016"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2816795.2818066","article-title":"Wetbrush","volume":"34","author":"Chen","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"B15","first-page":"4383","article-title":"Sequential attention GAN for interactive image editing","author":"Cheng","year":"2020"},{"key":"B16","first-page":"1536","article-title":"User-guided deep anime line art colourization with conditional adversarial networks","author":"Ci","year":"2018"},{"key":"B17","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1111\/cgf.13552","article-title":"FashionGAN: display your fashion design using conditional generative adversarial nets","volume":"37","author":"Cui","year":"2018","journal-title":"Comp. Graphics Forum"},{"key":"B18","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1162\/neco.1995.7.5.889","article-title":"The Helmholtz machine","volume":"7","author":"Dayan","year":"1995","journal-title":"Neural Comput."},{"key":"B19","first-page":"8117","article-title":"Fashion editing with adversarial parsing learning","author":"Dong","year":"2020"},{"key":"B20","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1016\/s0142-694x(01)00009-6","article-title":"Creativity in the design process: co-evolution of problem-solution","volume":"22","author":"Dorst","year":"2001","journal-title":"Des. Stud."},{"key":"B21","first-page":"278","article-title":"Ux design innovation: challenges for working with machine learning as a design material","author":"Dove","year":"2017"},{"key":"B22","article-title":"CAN: creative adversarial networks, generating \u201cart\u201d by learning about styles and deviating from style norms","author":"Elgammal","year":"2017","journal-title":"ICCC"},{"key":"B23","first-page":"2020","volume-title":"Principled artificial intelligence: mapping consensus in ethical and rights based approaches to principles for AI","author":"Fjeld","year":"2020"},{"key":"B24","first-page":"143","article-title":"The impact of culture on crowd dynamics: an empirical approach","author":"Fridman","year":"2013","journal-title":"AAMAS"},{"key":"B25","volume-title":"NIPS 2016 tutorial: generative adversarial networksCoRR abs\/1701","author":"Goodfellow","year":"2017"},{"key":"B26","first-page":"2672","article-title":"Generative adversarial nets","author":"Goodfellow","year":"2014"},{"key":"B27","volume-title":"Logicgan: logic-guided generative adversarial networks","author":"Graves","year":"2020"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1064","DOI":"10.1136\/bmj.38636.593461.68","article-title":"Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources","volume":"331","author":"Greenhalgh","year":"2005","journal-title":"BMJ"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3130800.3130804","article-title":"Interactive example-based terrain authoring with conditional generative adversarial networks","volume":"36","author":"Gu\u00e9rin","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1109\/cvpr.2018.00240","article-title":"Social GAN: socially acceptable trajectories with generative adversarial networks","author":"Gupta","year":"2018"},{"key":"B31","doi-asserted-by":"crossref","DOI":"10.1109\/CEC48606.2020.9185631","volume-title":"Generative adversarial network rooms in generative graph grammar dungeons for the legend of zelda","author":"Gutierrez","year":"2020"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/106365603321828970","article-title":"Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES)","volume":"11","author":"Hansen","year":"2003","journal-title":"Evol. Comput."},{"key":"B33","doi-asserted-by":"crossref","DOI":"10.1145\/3359998.3369401","article-title":"Paintstorch: a user-guided anime line art colourization tool with double generator conditional adversarial network","volume-title":"European conference on visual media production","author":"Hati","year":"2019"},{"key":"B34","article-title":"Beta-vae: learning basic visual concepts with a constrained variational framework","author":"Higgins","year":"2017","journal-title":"Iclr"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3396237","article-title":"Sketch-guided deep portrait generation","volume":"16","author":"Ho","year":"2020","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"B36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3301282","article-title":"How generative adversarial networks and their variants work","volume":"52","author":"Hong","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"B37","first-page":"720","article-title":"Basketballgan: generating basketball play simulation through sketching","author":"Hsieh","year":"2019"},{"key":"B38","doi-asserted-by":"crossref","DOI":"10.1145\/3415263.3419166","article-title":"Explainable AI (XAI): an introduction to the XAI landscape with practical examples","volume-title":"SIGGRAPH asia 2020 courses","author":"Hughes","year":"2020"},{"key":"B39","first-page":"79","volume-title":"Davis: density-adaptive synthetic-vision based steering for virtual crowds","author":"Hughes","year":"2015"},{"key":"B40","volume-title":"Image-to-image translation with conditional adversarial networks","author":"Isola","year":"2016"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00183","article-title":"SC-FEGAN: face editing generative adversarial network with user\u2019s sketch and color","author":"Jo","year":"2019"},{"key":"B42","volume-title":"Acm calls for governments and businesses to stop using facial recognition","author":"Johnson","year":"2020"},{"key":"B43","volume-title":"Progressive growing of gans for improved quality, stability, and variation","author":"Karras","year":"2017"},{"key":"B44","first-page":"AH2019","article-title":"GANs-based clothes design: pattern maker is all you need to design clothing","author":"Kato","year":"2019"},{"key":"B45","first-page":"401","article-title":"Dreamsketch: early stage 3D design explorations with sketching and generative design","author":"Kazi","year":"2017"},{"key":"B46","first-page":"154","volume-title":"Visual analytics: definition, process, and challenges","author":"Keim","year":"2008"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3272127.3275065","article-title":"FrankenGAN","volume":"37","author":"Kelly","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"B48","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1007\/978-3-030-24643-3_58","article-title":"Generative adversarial networks: a survey of techniques and methods","volume-title":"Proceeding of the international conference on computer networks, big data and IoT (ICCBI - 2018)","author":"Khursheed","year":"2020"},{"key":"B49","volume-title":"Auto-encoding variational bayes","author":"Kingma","year":"2013"},{"key":"B50","volume-title":"On convergence and stability of gans","author":"Kodali","year":"2017"},{"key":"B51","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1016\/j.cad.2010.09.009","article-title":"A practical generative design method","volume":"43","author":"Krish","year":"2011","journal-title":"Comput. Aided Des."},{"key":"B52","volume-title":"A large-scale study on regularization and normalization in gans","author":"Kurach","year":"2018"},{"key":"B53","first-page":"1558","article-title":"Autoencoding beyond pixels using a learned similarity metric","volume":"48","author":"Larsen","year":"2016"},{"key":"B54","volume-title":"Controllable generative adversarial network","author":"Lee","year":"2017"},{"key":"B55","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1109\/3DV.2017.00024","article-title":"Interactive 3D modeling with a generative adversarial network","author":"Liu","year":"2017"},{"key":"B56","article-title":"Challenging common assumptions in the unsupervised learning of disentangled representations","author":"Locatello","year":"2019"},{"key":"B57","doi-asserted-by":"crossref","DOI":"10.1145\/3284398.3284412","article-title":"Visual analytics of single cell microscopy data using a collaborative immersive environment","author":"Lock","year":"2018"},{"key":"B58","first-page":"4768","article-title":"A unified approach to interpreting model predictions","author":"Lundberg","year":"2017"},{"key":"B59","volume-title":"Semi-adversarial networks: convolutional autoencoders for imparting privacy to face images","author":"Mirjalili","year":"2017"},{"key":"B60","volume-title":"Conditional generative adversarial nets","author":"Mirza","year":"2014"},{"key":"B61","volume-title":"Machine learning: a probabilistic perspective","author":"Murphy","year":"2012"},{"key":"B62","volume-title":"House-gan: relational generative adversarial networks for graph-constrained house layout generation","author":"Nauata","year":"2020"},{"key":"B63","first-page":"1","article-title":"Deepscope: HCI platform for generative cityscape visualization","author":"Noyman","year":"2020"},{"key":"B64","first-page":"432","article-title":"Arthur I. Miller: the artist in the machine: the world of AI-powered creativity","volume-title":"Genetic programming and evolvable machines","author":"Olszewska","year":"2020"},{"key":"B65","first-page":"4797","article-title":"Conditional image generation with pixelcnn decoders","author":"Oord","year":"2016"},{"key":"B66","doi-asserted-by":"publisher","first-page":"36322","DOI":"10.1109\/access.2019.2905015","article-title":"Recent progress on generative adversarial networks (GANs): a survey","volume":"7","author":"Pan","year":"2019","journal-title":"IEEE Access"},{"key":"B67","doi-asserted-by":"publisher","first-page":"2332","DOI":"10.1109\/cvpr.2019.00244","article-title":"Semantic image synthesis with spatially-adaptive normalization","author":"Park","year":"2019","journal-title":"IEEE"},{"key":"B68","volume-title":"Interaction design: beyond human-computer interaction","author":"Preece","year":"2015"},{"key":"B69","doi-asserted-by":"publisher","first-page":"44599","DOI":"10.1109\/ACCESS.2019.2962579","article-title":"Two-stage sketch colourization with color parsing","volume":"8","author":"Ren","year":"2020","journal-title":"IEEE Access"},{"key":"B70","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1147\/rd.33.0210","article-title":"Some studies in machine learning using the game of checkers","volume":"3","author":"Samuel","year":"1959","journal-title":"IBM J. Res. Dev."},{"key":"B71","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-030-11015-4_5","article-title":"Design: design inspiration from generative networks","volume-title":"Computer vision \u2013 ECCV 2018 workshops","author":"Sbai","year":"2019"},{"key":"B72","first-page":"148","article-title":"Interactive evolution and exploration within latent level-design space of generative adversarial networks","author":"Schrum","year":"2020"},{"key":"B73","doi-asserted-by":"publisher","first-page":"g7647","DOI":"10.1136\/bmj.g7647","article-title":"Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-p) 2015: elaboration and explanation","volume":"349","author":"Shamseer","year":"2015","journal-title":"BMJ"},{"key":"B74","volume-title":"Designing the user interface: strategies for effective human-computer interaction","author":"Shneiderman","year":"2016"},{"key":"B75","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3132703","article-title":"Mastering sketching","volume":"37","author":"Simo-Serra","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"B76","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3203186","article-title":"Interactive sketch-based normal map generation with deep neural networks","volume":"1","author":"Su","year":"2018","journal-title":"Proc. ACM Comput. Graph. Interact. Tech."},{"key":"B77","doi-asserted-by":"publisher","first-page":"1644","DOI":"10.1631\/FITEE.1900386","article-title":"Smartpaint: a co-creative drawing system based on generative adversarial networks","volume":"20","author":"Sun, L.","year":"2019","journal-title":"Front. Inform. Technol. Electron. Eng."},{"key":"B78","first-page":"683","article-title":"Adversarial colourization of icons based on contour and color conditions","author":"Sun, T.-H.","year":"2019"},{"key":"B79","volume-title":"The design process","author":"Uk","year":"2005"},{"key":"B80","volume-title":"Pixel recurrent neural networksCoRR abs\/1601","author":"van den Oord","year":"2016"},{"key":"B81","first-page":"221","article-title":"Evolving Mario levels in the latent space of a deep convolutional generative adversarial network","author":"Volz","year":"2018"},{"key":"B82","doi-asserted-by":"publisher","first-page":"8798","DOI":"10.1109\/cvpr.2018.00917","article-title":"High-resolution image synthesis and semantic manipulation with conditional gans","author":"Wang","year":"2018","journal-title":"IEEE"},{"key":"B83","volume-title":"Generative adversarial networks in computer vision: a survey and taxonomy","author":"Wang","year":"2019"},{"key":"B84","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1109\/ms.2019.2897397","article-title":"Is your software valueless?","volume":"36","author":"Whittle","year":"2019","journal-title":"IEEE Softw."},{"key":"B85","volume-title":"Stabilizing generative adversarial networks: a survey","author":"Wiatrak","year":"2019"},{"key":"B86","volume-title":"Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling","author":"Wu","year":"2016"},{"key":"B87","doi-asserted-by":"crossref","DOI":"10.1145\/3229147.3229150","article-title":"Brush stroke synthesis with a generative adversarial network driven by physically based simulation","author":"Wu","year":"2018"},{"key":"B88","doi-asserted-by":"publisher","first-page":"660","DOI":"10.23919\/tst.2017.8195348","article-title":"A survey of image synthesis and editing with generative adversarial networks","volume":"22","author":"Wu","year":"2017","journal-title":"Tinshhua Sci. Technol."},{"key":"B89","article-title":"Machine learning as a UX design material: how can we imagine beyond automation, recommenders, and reminders?","author":"Yang","year":"2018"},{"key":"B90","first-page":"1","article-title":"Re-examining whether, why, and how human-AI interaction is uniquely difficult to design","author":"Yang","year":"2020"},{"key":"B91","doi-asserted-by":"publisher","DOI":"10.1109\/iccv.2017.310","article-title":"DualGAN: unsupervised dual learning for image-to-image translation","author":"Yi","year":"2017"},{"key":"B92","article-title":"Visualizing and understanding convolutional neural networks","volume-title":"Lecture Notes in Computer Science","author":"Zeiler","year":"2013"},{"key":"B93","first-page":"400","article-title":"Artificial intelligence augments design creativity: a typeface family design experiment","volume-title":"Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 11584 LNCS","author":"Zeng","year":"2019"},{"key":"B94","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1109\/SMC.2018.00080","article-title":"Autoencoder and its various variants","author":"Zhai","year":"2018"},{"key":"B95","doi-asserted-by":"publisher","DOI":"10.21900\/iconf.2019.103376","article-title":"Conv-MPN: convolutional message passing neural network for structured outdoor architecture reconstruction","author":"Zhang","year":"2019"},{"key":"B96","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3072959.3073703","article-title":"Real-time user-guided image colourization with learned deep priors","volume":"36","author":"Zhang","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"B97","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3355089.3356553","article-title":"Multi-theme generative adversarial terrain amplification","volume":"38","author":"Zhao","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"B98","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/AIVR.2018.00018","article-title":"A compensation method of two-stage image generation for human-ai collaborated in-situ fashion design in augmented reality environment","author":"Zhao","year":"2018"},{"key":"B99","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-46454-1_36","article-title":"Generative visual manipulation on the natural image manifold","author":"Zhu","year":"2016"},{"key":"B100","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV.2017.244","article-title":"Unpaired image-to-image translation using cycle-consistent adversarial networks","author":"Zhu","year":""},{"key":"B101","article-title":"Toward multimodal image-to-image translation","author":"Zhu","year":""},{"key":"B102","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3355089.3356561","article-title":"Language-based colourization of scene sketches","volume":"38","author":"Zou","year":"2019","journal-title":"ACM Trans. Graph."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2021.604234\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,25]],"date-time":"2022-12-25T17:01:32Z","timestamp":1671987692000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2021.604234\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,28]]},"references-count":102,"alternative-id":["10.3389\/frai.2021.604234"],"URL":"https:\/\/doi.org\/10.3389\/frai.2021.604234","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,28]]}}}