{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T18:18:16Z","timestamp":1732040296013,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":60,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3442188.3445870","type":"proceedings-article","created":{"date-parts":[[2021,2,25]],"date-time":"2021-02-25T01:45:48Z","timestamp":1614217548000},"page":"52-63","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Designing an Online Infrastructure for Collecting AI Data From People With Disabilities"],"prefix":"10.1145","author":[{"given":"Joon Sung","family":"Park","sequence":"first","affiliation":[{"name":"Microsoft Research - Redmond, Stanford University, Stanford, CA, USA"}]},{"given":"Danielle","family":"Bragg","sequence":"additional","affiliation":[{"name":"Microsoft Research - New England Cambridge, MA, USA"}]},{"given":"Ece","family":"Kamar","sequence":"additional","affiliation":[{"name":"Microsoft Research - Redmond Redmond, WA, USA"}]},{"given":"Meredith Ringel","family":"Morris","sequence":"additional","affiliation":[{"name":"Microsoft Research - Redmond Redmond, WA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,3]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Facebook AI. 2019. Does object recognition work for everyone? A new method to assess bias in CV systems. https:\/\/ai.facebook.com\/blog\/new-wayto-assess-ai-bias-in-object-recognition-systems\/ Facebook AI. 2019. Does object recognition work for everyone? A new method to assess bias in CV systems. https:\/\/ai.facebook.com\/blog\/new-wayto-assess-ai-bias-in-object-recognition-systems\/"},{"key":"e_1_3_2_2_2_1","unstructured":"Google AI. 2020. Google Euphonia. https:\/\/sites.google.com\/view\/project-euphonia\/ Google AI. 2020. Google Euphonia. https:\/\/sites.google.com\/view\/project-euphonia\/"},{"volume-title":"Introducing Voice Control. Your all-access to all devices. Retrieved","year":"2020","key":"e_1_3_2_2_3_1","unstructured":"Apple. 2019. Introducing Voice Control. Your all-access to all devices. Retrieved Aug 1, 2020 from www.apple.com\/macos\/catalina-preview\/#accessibility Apple. 2019. Introducing Voice Control. Your all-access to all devices. Retrieved Aug 1, 2020 from www.apple.com\/macos\/catalina-preview\/#accessibility"},{"key":"e_1_3_2_2_4_1","unstructured":"Yochai Benkler. 2019. Don't let industry write the rules for AI. https:\/\/go.gale.com\/ps\/anonymous?id=GALE%7CA584200722&sid=googleScholar&v=2.1&it=r&linkaccess=abs&issn=00280836&p=HRCA&sw=w Yochai Benkler. 2019. Don't let industry write the rules for AI. https:\/\/go.gale.com\/ps\/anonymous?id=GALE%7CA584200722&sid=googleScholar&v=2.1&it=r&linkaccess=abs&issn=00280836&p=HRCA&sw=w"},{"volume-title":"ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility.","author":"Bennett Cynthia L.","key":"e_1_3_2_2_5_1","unstructured":"Cynthia L. Bennett , Erin Brady , and Stacy M. Branham . 2018. Interdependence as a Frame for Assistive Technology Research and Design . In ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. Cynthia L. Bennett, Erin Brady, and Stacy M. Branham. 2018. Interdependence as a Frame for Assistive Technology Research and Design. In ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility."},{"key":"e_1_3_2_2_6_1","volume-title":"Bennett and Os Keyes","author":"Cynthia","year":"2020","unstructured":"Cynthia L. Bennett and Os Keyes . 2020 . What is the Point of Fairness? Disability, AI and the Complexity of Justice. In SIGACCESS Access , Vol. 125 . https:\/\/doi.org\/10.1145\/3386296.3386301 10.1145\/3386296.3386301 Cynthia L. Bennett and Os Keyes. 2020. What is the Point of Fairness? Disability, AI and the Complexity of Justice. In SIGACCESS Access, Vol. 125. https:\/\/doi.org\/10.1145\/3386296.3386301"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866080"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353774"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373625.3417024"},{"key":"e_1_3_2_2_10_1","volume-title":"In Conference on Fairness, Accountability and Transparency. 77--91","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In In Conference on Fairness, Accountability and Transparency. 77--91 . Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In In Conference on Fairness, Accountability and Transparency. 77--91."},{"key":"e_1_3_2_2_11_1","unstructured":"Wikipedia Commons. 2020. Dragon NaturallySpeaking. https:\/\/en.wikipedia.org\/wiki\/Dragon_NaturallySpeaking Wikipedia Commons. 2020. Dragon NaturallySpeaking. https:\/\/en.wikipedia.org\/wiki\/Dragon_NaturallySpeaking"},{"key":"e_1_3_2_2_12_1","unstructured":"Wikipedia Commons. 2020. Seeing AI. https:\/\/en.wikipedia.org\/wiki\/Seeing_AI Wikipedia Commons. 2020. Seeing AI. https:\/\/en.wikipedia.org\/wiki\/Seeing_AI"},{"key":"e_1_3_2_2_13_1","unstructured":"Wikipedia Commons. 2020. Synthetic Data. https:\/\/en.wikipedia.org\/wiki\/Synthetic_data Wikipedia Commons. 2020. Synthetic Data. https:\/\/en.wikipedia.org\/wiki\/Synthetic_data"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_2_15_1","volume-title":"Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems.","author":"Downs Julie S.","year":"2010","unstructured":"Julie S. Downs , Mandy B. Holbrook , Steve Sheng , and Lorrie Faith Cranor . 2010 . Are Your Participants Gaming the System? Screening Mechanical Turk Workers . In Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems. Julie S. Downs, Mandy B. Holbrook, Steve Sheng, and Lorrie Faith Cranor. 2010. Are Your Participants Gaming the System? Screening Mechanical Turk Workers. In Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems."},{"key":"e_1_3_2_2_16_1","unstructured":"Equality and Human Rights Commission. 2020. Disability discrimination. https:\/\/www.equalityhumanrights.com\/en\/advice-and-guidance\/disability-discrimination Equality and Human Rights Commission. 2020. Disability discrimination. https:\/\/www.equalityhumanrights.com\/en\/advice-and-guidance\/disability-discrimination"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386296.3386304"},{"key":"e_1_3_2_2_18_1","unstructured":"Krzysztof Gajos. 2016. Lab in the Wild and Other Tools for Large-scale Behavioral Research. http:\/\/www.eecs.harvard.edu\/~kgajos\/research\/ Krzysztof Gajos. 2016. Lab in the Wild and Other Tools for Large-scale Behavioral Research. http:\/\/www.eecs.harvard.edu\/~kgajos\/research\/"},{"volume-title":"YouTube Help - Use automatic captioning. Retrieved","year":"2020","key":"e_1_3_2_2_19_1","unstructured":"Google. 2019. YouTube Help - Use automatic captioning. Retrieved Aug 1, 2020 from https:\/\/support.google.com\/youtube\/answer\/6373554?hl=en Google. 2019. YouTube Help - Use automatic captioning. Retrieved Aug 1, 2020 from https:\/\/support.google.com\/youtube\/answer\/6373554?hl=en"},{"key":"e_1_3_2_2_20_1","unstructured":"Google. 2020. Google Play. https:\/\/play.google.com\/store\/apps\/details?id=com.google.android.apps.accessibility.reveal&hl=en_US Google. 2020. Google Play. https:\/\/play.google.com\/store\/apps\/details?id=com.google.android.apps.accessibility.reveal&hl=en_US"},{"key":"e_1_3_2_2_21_1","first-page":"20","article-title":"User Evaluation of Automatic Speech Recognition Systems for Deaf-Hearing Interactions at School and Work","volume":"28","author":"Gottermeier Linda G","year":"2016","unstructured":"Linda G Gottermeier and S Kushalnagar Raja . 2016 . User Evaluation of Automatic Speech Recognition Systems for Deaf-Hearing Interactions at School and Work . In Audiology Today , Vol. 28. 20 -- 34 . Linda G Gottermeier and S Kushalnagar Raja. 2016. User Evaluation of Automatic Speech Recognition Systems for Deaf-Hearing Interactions at School and Work. In Audiology Today, Vol. 28. 20--34.","journal-title":"Audiology Today"},{"key":"e_1_3_2_2_22_1","volume-title":"How a Self-Driving Uber Killed a Pedestrian in Arizona. The New York Times","author":"Griggs Troy","year":"2018","unstructured":"Troy Griggs and Daisuke Wakabayashi . 2018. How a Self-Driving Uber Killed a Pedestrian in Arizona. The New York Times ( 2018 ). https:\/\/www.nytimes.com\/interactive\/2018\/03\/20\/us\/self-driving-uber-pedestrian-killed.html Troy Griggs and Daisuke Wakabayashi. 2018. How a Self-Driving Uber Killed a Pedestrian in Arizona. The New York Times (2018). https:\/\/www.nytimes.com\/interactive\/2018\/03\/20\/us\/self-driving-uber-pedestrian-killed.html"},{"key":"e_1_3_2_2_23_1","volume-title":"Hanna Wallach, Sasa Junuzovic, Besmira Nushi, Jacquelyn Krones, and Meredith Ringel Morris.","author":"Guo Anhong","year":"2020","unstructured":"Anhong Guo , Ece Kamar , Jennifer Wortman Vaughan , Hanna Wallach, Sasa Junuzovic, Besmira Nushi, Jacquelyn Krones, and Meredith Ringel Morris. 2020 . Evaluating Face-Based AI Systems for Fairness: Challenges and Tradeoffs . (2020). Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, Sasa Junuzovic, Besmira Nushi, Jacquelyn Krones, and Meredith Ringel Morris. 2020. Evaluating Face-Based AI Systems for Fairness: Challenges and Tradeoffs. (2020)."},{"key":"e_1_3_2_2_24_1","volume-title":"Hanna Wallach, and Meredith Ringel Morris.","author":"Guo Anhong","year":"2020","unstructured":"Anhong Guo , Ece Kamar , Jennifer Wortman Vaughan , Hanna Wallach, and Meredith Ringel Morris. 2020 . Toward Fairness in AI for People with Disabilities : A Research Roadmap. In SIGACCESS Access. Comput , Vol. 125 . https:\/\/doi.org\/10.1145\/3386296.3386298 10.1145\/3386296.3386298 Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, and Meredith Ringel Morris. 2020. Toward Fairness in AI for People with Disabilities: A Research Roadmap. In SIGACCESS Access. Comput, Vol. 125. https:\/\/doi.org\/10.1145\/3386296.3386298"},{"key":"e_1_3_2_2_25_1","volume-title":"Bigham","author":"Gurari Danna","year":"2018","unstructured":"Danna Gurari , Qing Li , Abigale J. Stangl , Anhong Guo , Chi Lin , Kristen Grauman , Jiebo Luo , and Jefrey P . Bigham . 2018 . VizWiz Grand Challenge: Answering Visual Questions from Blind People. In Computer Vision and Pattern Recognition . Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, and Jefrey P. Bigham. 2018. VizWiz Grand Challenge: Answering Visual Questions from Blind People. In Computer Vision and Pattern Recognition."},{"volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Gurari Gurari","key":"e_1_3_2_2_26_1","unstructured":"Gurari Gurari , Qing Li , Chi Lin , Yinan Zhao , Anhong Guo , Abigale Stangl , and Jefrey P. Bigham . 2019. VizWiz-Priv: A Dataset for Recognizing the Presence and Purpose of Private Visual Information in Images Taken by Blind People . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Gurari Gurari, Qing Li, Chi Lin, Yinan Zhao, Anhong Guo, Abigale Stangl, and Jefrey P. Bigham. 2019. VizWiz-Priv: A Dataset for Recognizing the Presence and Purpose of Private Visual Information in Images Taken by Blind People. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_2_2_27_1","unstructured":"Sara Hussein. 2018. 'Citizen scientists' track radiation seven years after Fukushima. (2018). https:\/\/phys.org\/news\/2018-03-citizen-scientists-track-years-fukushima.html Sara Hussein. 2018. 'Citizen scientists' track radiation seven years after Fukushima. (2018). https:\/\/phys.org\/news\/2018-03-citizen-scientists-track-years-fukushima.html"},{"key":"e_1_3_2_2_28_1","volume-title":"SIGACCESS Access","volume":"125","author":"Hutchinson Ben","year":"2020","unstructured":"Ben Hutchinson , Vinodkumar Prabhakaran , Emily Denton , Kellie Webster , Yu Zhong , and Stephen Denuyl . 2020 . Unintended Machine Learning Biases as Social Barriers for Persons with Disabilities . In SIGACCESS Access , Vol. 125 . Ben Hutchinson, Vinodkumar Prabhakaran, Emily Denton, Kellie Webster, Yu Zhong, and Stephen Denuyl. 2020. Unintended Machine Learning Biases as Social Barriers for Persons with Disabilities. In SIGACCESS Access, Vol. 125."},{"key":"e_1_3_2_2_29_1","unstructured":"Joke Kenens Michiel Van Oudheusden Go Yoshizawa and Ine Van Hoyweghen. [n.d.]. Science by with and for citizens: rethinking 'citizen science' after the 2011 Fukushima disaster. ([n. d.]). Joke Kenens Michiel Van Oudheusden Go Yoshizawa and Ine Van Hoyweghen. [n.d.]. Science by with and for citizens: rethinking 'citizen science' after the 2011 Fukushima disaster. ([n. d.])."},{"key":"e_1_3_2_2_30_1","volume-title":"FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age. arXiv preprint","author":"Kimmo Karkkainen Jungseock Joo","year":"2019","unstructured":"Jungseock Joo Kimmo Karkkainen . 2019. FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age. arXiv preprint ( 2019 ). Jungseock Joo Kimmo Karkkainen. 2019. FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age. arXiv preprint (2019)."},{"key":"e_1_3_2_2_31_1","volume-title":"International Conference on Wirtschaftsinformatik","author":"Krasnova Hanna","year":"2013","unstructured":"Hanna Krasnova , Helena Wenninger , Thomas Widjaja , and Peter Buxmann . 2013 . Envy on Facebook: a hidden threat to users' life satisfaction? International Conference on Wirtschaftsinformatik (2013). Hanna Krasnova, Helena Wenninger, Thomas Widjaja, and Peter Buxmann. 2013. Envy on Facebook: a hidden threat to users' life satisfaction? International Conference on Wirtschaftsinformatik (2013)."},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Petrinovich L O'Neill P and Jorgensen M. 1993. An empirical study of moral intuitions: Toward an evolutionary ethics. Journal of Personality and Social Psychology (1993). Petrinovich L O'Neill P and Jorgensen M. 1993. An empirical study of moral intuitions: Toward an evolutionary ethics. Journal of Personality and Social Psychology (1993).","DOI":"10.1037\/0022-3514.64.3.467"},{"key":"e_1_3_2_2_33_1","unstructured":"Jaron Lanier. 2019. Jaron Lanier Fixes the Internet. https:\/\/www.nytimes.com\/interactive\/2019\/09\/23\/opinion\/data-privacy-jaron-lanier.html Jaron Lanier. 2019. Jaron Lanier Fixes the Internet. https:\/\/www.nytimes.com\/interactive\/2019\/09\/23\/opinion\/data-privacy-jaron-lanier.html"},{"key":"e_1_3_2_2_34_1","volume-title":"Facial Recognition Is Accurate, if You're a White Guy. The New York Times","author":"Lohr Steve","year":"2018","unstructured":"Steve Lohr . 2018. Facial Recognition Is Accurate, if You're a White Guy. The New York Times ( 2018 ). https:\/\/www.nytimes.com\/2018\/02\/09\/technology\/facial-recognition-race-artificial-intelligence.html Steve Lohr. 2018. Facial Recognition Is Accurate, if You're a White Guy. The New York Times (2018). https:\/\/www.nytimes.com\/2018\/02\/09\/technology\/facial-recognition-race-artificial-intelligence.html"},{"key":"e_1_3_2_2_35_1","volume-title":"Uber's Self-Driving Car Didn't Know Pedestrians Could Jaywalk. Wired","author":"Marshall Aarian","year":"2019","unstructured":"Aarian Marshall and Alex Davies . 2019. Uber's Self-Driving Car Didn't Know Pedestrians Could Jaywalk. Wired ( 2019 ). https:\/\/www.wired.com\/story\/ubers-self-driving-car-didnt-know-pedestrians-could-jaywalk\/ Aarian Marshall and Alex Davies. 2019. Uber's Self-Driving Car Didn't Know Pedestrians Could Jaywalk. Wired (2019). https:\/\/www.wired.com\/story\/ubers-self-driving-car-didnt-know-pedestrians-could-jaywalk\/"},{"key":"e_1_3_2_2_36_1","unstructured":"Sharan B. Merriam and Associates. 2002. Introduction to qualitative research. Qualitative research in practice: Examples for discussion and analysis. Jossey-Bass. Sharan B. Merriam and Associates. 2002. Introduction to qualitative research. Qualitative research in practice: Examples for discussion and analysis. Jossey-Bass."},{"volume-title":"2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies.","author":"Mirri S.","key":"e_1_3_2_2_37_1","unstructured":"S. Mirri , C. Prandi , P. Salomoni , F. Callegati , and A. Campi . 2014. On Combining Crowdsourcing, Sensing and Open Data for an Accessible Smart City . In 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies. S. Mirri, C. Prandi, P. Salomoni, F. Callegati, and A. Campi. 2014. On Combining Crowdsourcing, Sensing and Open Data for an Accessible Smart City. In 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies."},{"key":"e_1_3_2_2_38_1","unstructured":"Meredith Ringel Morris. [n.d.]. AI and Accessibility: A Discussion of Ethical Considerations. ([n. d.]). Meredith Ringel Morris. [n.d.]. AI and Accessibility: A Discussion of Ethical Considerations. ([n. d.])."},{"key":"e_1_3_2_2_39_1","unstructured":"Meredith Ringel Morris Shaun Kane and Anhong Guo. [n.d.]. Sense and Accessibility. ([n. d.]). Meredith Ringel Morris Shaun Kane and Anhong Guo. [n.d.]. Sense and Accessibility. ([n. d.])."},{"key":"e_1_3_2_2_40_1","unstructured":"Craig S. Mullins. 2020. Data Management Today by Craig Mullins. https:\/\/web.archive.org\/web\/20090721111006\/http:\/\/www.neon.com\/blog\/blogs\/cmullins\/archive\/2009\/02\/05\/What-is-Production-Data_3F00_.aspx Craig S. Mullins. 2020. Data Management Today by Craig Mullins. https:\/\/web.archive.org\/web\/20090721111006\/http:\/\/www.neon.com\/blog\/blogs\/cmullins\/archive\/2009\/02\/05\/What-is-Production-Data_3F00_.aspx"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353812"},{"key":"e_1_3_2_2_42_1","volume-title":"Children are ready for speech technology-but is the technology ready for them. Interaction Design and Children","author":"Nicol Antony","year":"2002","unstructured":"Antony Nicol , Christopher Casey , and Stuart J MacFarlane . 2002. Children are ready for speech technology-but is the technology ready for them. Interaction Design and Children ( 2002 ). https:\/\/www.researchgate.net\/publication\/228574580_Children_are_ready_for_speech_technology-but_is_the_technology_ready_for_them Antony Nicol, Christopher Casey, and Stuart J MacFarlane. 2002. Children are ready for speech technology-but is the technology ready for them. Interaction Design and Children (2002). https:\/\/www.researchgate.net\/publication\/228574580_Children_are_ready_for_speech_technology-but_is_the_technology_ready_for_them"},{"volume-title":"The Quest for Artificial Intelligence: A History of Ideas and Achievements","author":"Nilsson Nils J.","key":"e_1_3_2_2_43_1","unstructured":"Nils J. Nilsson . 2010. The Quest for Artificial Intelligence: A History of Ideas and Achievements . Cambridge University Press , Cambridge, UK . Nils J. Nilsson. 2010. The Quest for Artificial Intelligence: A History of Ideas and Achievements. Cambridge University Press, Cambridge, UK."},{"key":"e_1_3_2_2_44_1","volume-title":"On Disability and on Facebook? Uncle Sam Wants to Watch What You Post. The New York Times","author":"Pear Robert","year":"2019","unstructured":"Robert Pear . 2019. On Disability and on Facebook? Uncle Sam Wants to Watch What You Post. The New York Times ( 2019 ). https:\/\/www.nytimes.com\/2019\/03\/10\/us\/politics\/social-security-disability-trump-facebook.html Robert Pear. 2019. On Disability and on Facebook? Uncle Sam Wants to Watch What You Post. The New York Times (2019). https:\/\/www.nytimes.com\/2019\/03\/10\/us\/politics\/social-security-disability-trump-facebook.html"},{"key":"e_1_3_2_2_45_1","volume-title":"Mitigating Bias in AI Models. Retrieved","author":"Puri Ruchir","year":"2020","unstructured":"Ruchir Puri . 2018. Mitigating Bias in AI Models. Retrieved Aug 1, 2020 from https:\/\/www.ibm.com\/blogs\/research\/2018\/02\/mitigating-bias-ai-models\/ Ruchir Puri. 2018. Mitigating Bias in AI Models. Retrieved Aug 1, 2020 from https:\/\/www.ibm.com\/blogs\/research\/2018\/02\/mitigating-bias-ai-models\/"},{"key":"e_1_3_2_2_46_1","volume-title":"Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. In AAAI\/ACM AI Ethics and Society conference.","author":"Raji Inioluwa Deborah","year":"2010","unstructured":"Inioluwa Deborah Raji , Timnit Gebru , Margaret Mitchell , Joy Buolamwini , Joonseok Lee , and Emily Denton . 2010 . Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. In AAAI\/ACM AI Ethics and Society conference. Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell, Joy Buolamwini, Joonseok Lee, and Emily Denton. 2010. Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. In AAAI\/ACM AI Ethics and Society conference."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2003.09.005"},{"key":"e_1_3_2_2_48_1","unstructured":"Bill Schackner. 2020. Pitt benches food-delivery robots after complaint from a student. https:\/\/www.post-gazette.com\/business\/tech-news\/2019\/10\/23\/robot-starship-university-of-pittsburgh-disabilities-higher-education-campus-life\/stories\/201910230137 Bill Schackner. 2020. Pitt benches food-delivery robots after complaint from a student. https:\/\/www.post-gazette.com\/business\/tech-news\/2019\/10\/23\/robot-starship-university-of-pittsburgh-disabilities-higher-education-campus-life\/stories\/201910230137"},{"key":"e_1_3_2_2_49_1","volume-title":"Artificial Intelligence and Life","author":"Stone Peter","year":"2030","unstructured":"Peter Stone , Rodney Brooks , Erik Brynjolfsson , Ryan Calo , Oren Etzioni , Greg Hager , Julia Hirschberg , Shivaram Kalyanakrishnan , Ece Kamar , Sarit Kraus , Kevin Leyton-Brown , David Parkes , William Press , AnnaLee Saxenian , Julie Shah , Milind Tambe , and Astro Teller . 2016. Artificial Intelligence and Life in 2030 . One Hundred Year Study on Artificial Intelligence : Report of the 2015-2016 Study Panel. Retrieved Aug 1, 2020 from http:\/\/ai100.stanford.edu\/2016-report Peter Stone, Rodney Brooks, Erik Brynjolfsson, Ryan Calo, Oren Etzioni, Greg Hager, Julia Hirschberg, Shivaram Kalyanakrishnan, Ece Kamar, Sarit Kraus, Kevin Leyton-Brown, David Parkes, William Press, AnnaLee Saxenian, Julie Shah, Milind Tambe, and Astro Teller. 2016. Artificial Intelligence and Life in 2030. One Hundred Year Study on Artificial Intelligence: Report of the 2015-2016 Study Panel. Retrieved Aug 1, 2020 from http:\/\/ai100.stanford.edu\/2016-report"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1606"},{"key":"e_1_3_2_2_51_1","volume-title":"Sidewalk Toronto and Why Smarter Is Not Better. Retrieved","author":"Treviranus Jutta","year":"2020","unstructured":"Jutta Treviranus . 2018. Sidewalk Toronto and Why Smarter Is Not Better. Retrieved Aug 1, 2020 from https:\/\/medium.com\/datadriveninvestor\/sidewalk-toronto-and-why-smarter-is-not-better-b233058d01c8 Jutta Treviranus. 2018. Sidewalk Toronto and Why Smarter Is Not Better. Retrieved Aug 1, 2020 from https:\/\/medium.com\/datadriveninvestor\/sidewalk-toronto-and-why-smarter-is-not-better-b233058d01c8"},{"key":"e_1_3_2_2_52_1","volume-title":"AI Fairness for People with Disabilities: Point of View. arXiv preprint arXiv","author":"Trewin Shari","year":"2018","unstructured":"Shari Trewin . 2018. AI Fairness for People with Disabilities: Point of View. arXiv preprint arXiv ( 2018 ). https:\/\/arxiv.org\/pdf\/1811.10670.pdf Shari Trewin. 2018. AI Fairness for People with Disabilities: Point of View. arXiv preprint arXiv (2018). https:\/\/arxiv.org\/pdf\/1811.10670.pdf"},{"key":"e_1_3_2_2_53_1","unstructured":"Aimee Valeras. 2020. \"We don't have a box\": Understanding Hidden Disability Identity Utilizing Narrative Research Methodology. https:\/\/dsq-sds.org\/article\/view\/1267 Aimee Valeras. 2020. \"We don't have a box\": Understanding Hidden Disability Identity Utilizing Narrative Research Methodology. https:\/\/dsq-sds.org\/article\/view\/1267"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"crossref","unstructured":"Luis von Ahn and Laura Dabbish. 2004. Labeling Images with a Computer Game. In CHI. Luis von Ahn and Laura Dabbish. 2004. Labeling Images with a Computer Game. In CHI.","DOI":"10.1145\/985692.985733"},{"volume-title":"Designing Games With A Purpose. In communications of the acm","author":"von Ahn Luis","key":"e_1_3_2_2_55_1","unstructured":"Luis von Ahn and Laura Dabbish . 2008. Designing Games With A Purpose. In communications of the acm , Vol. 51 . Luis von Ahn and Laura Dabbish. 2008. Designing Games With A Purpose. In communications of the acm, Vol. 51."},{"key":"e_1_3_2_2_56_1","volume-title":"Android Q's Live Caption feature adds real-time subtitles to any audio or video playing on your phone. The Verge","author":"Welch Chris","year":"2019","unstructured":"Chris Welch . 2019. Android Q's Live Caption feature adds real-time subtitles to any audio or video playing on your phone. The Verge ( 2019 ). https:\/\/www.theverge.com\/2019\/5\/7\/18528447\/google-android-q-live-caption-video-transcription-io-2019 Chris Welch. 2019. Android Q's Live Caption feature adds real-time subtitles to any audio or video playing on your phone. The Verge (2019). https:\/\/www.theverge.com\/2019\/5\/7\/18528447\/google-android-q-live-caption-video-transcription-io-2019"},{"key":"e_1_3_2_2_57_1","volume-title":"Joy Rankin, Emily Rogers, Marcel Salas, and Sarah Myers West.","author":"Whittaker Meredith","year":"2019","unstructured":"Meredith Whittaker , Meryl Alper , Cynthia L. Bennett , Sara Hendren , Liz Kaziunas , Mara Mills , Meredith Ringel Morris , Joy Rankin, Emily Rogers, Marcel Salas, and Sarah Myers West. 2019 . Disability, Bias , and AI. AI Now Institute ( 2019). https:\/\/ainowinstitute.org\/disabilitybiasai-2019.pdf Meredith Whittaker, Meryl Alper, Cynthia L. Bennett, Sara Hendren, Liz Kaziunas, Mara Mills, Meredith Ringel Morris, Joy Rankin, Emily Rogers, Marcel Salas, and Sarah Myers West. 2019. Disability, Bias, and AI. AI Now Institute (2019). https:\/\/ainowinstitute.org\/disabilitybiasai-2019.pdf"},{"key":"e_1_3_2_2_58_1","volume-title":"In: Proceedings of 9th IEEE international workshop on advanced motion control.","author":"Woods S.N.","year":"2006","unstructured":"S.N. Woods , Michael Leonard Walters , Kheng Lee Koay , and Kerstin Dautenhahn . 2006 . Comparing human robot interaction scenarios using live and video based methods: Towards a novel methodological approach . In In: Proceedings of 9th IEEE international workshop on advanced motion control. S.N. Woods, Michael Leonard Walters, Kheng Lee Koay, and Kerstin Dautenhahn. 2006. Comparing human robot interaction scenarios using live and video based methods: Towards a novel methodological approach. In In: Proceedings of 9th IEEE international workshop on advanced motion control."},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979187"},{"key":"e_1_3_2_2_60_1","volume-title":"Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work Social Computing.","author":"Zyskowski Kathryn","year":"2015","unstructured":"Kathryn Zyskowski , Meredith Ringel Morris , Jeffrey P Bigham , Mary L Gray , and Shaun K Kane . 2015 . Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities . In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work Social Computing. Kathryn Zyskowski, Meredith Ringel Morris, Jeffrey P Bigham, Mary L Gray, and Shaun K Kane. 2015. Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work Social Computing."}],"event":{"name":"FAccT '21: 2021 ACM Conference on Fairness, Accountability, and Transparency","sponsor":["ACM Association for Computing Machinery"],"location":"Virtual Event Canada","acronym":"FAccT '21"},"container-title":["Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442188.3445870","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T19:18:55Z","timestamp":1675365535000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445870"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3]]},"references-count":60,"alternative-id":["10.1145\/3442188.3445870","10.1145\/3442188"],"URL":"https:\/\/doi.org\/10.1145\/3442188.3445870","relation":{},"subject":[],"published":{"date-parts":[[2021,3]]},"assertion":[{"value":"2021-03-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}