{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:10:58Z","timestamp":1732036258505},"publisher-location":"New York, New York, USA","reference-count":27,"publisher":"ACM Press","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":192,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016]]},"DOI":"10.1145\/2938503.2938511","type":"proceedings-article","created":{"date-parts":[[2016,9,12]],"date-time":"2016-09-12T13:33:45Z","timestamp":1473687225000},"page":"70-76","source":"Crossref","is-referenced-by-count":9,"title":["The Influence of Crowd Type and Task Complexity on Crowdsourced Work Quality"],"prefix":"10.1145","author":[{"given":"Ria Mae","family":"Borromeo","sequence":"first","affiliation":[{"name":"Keio University, Yokohama, Japan"}]},{"given":"Thomas","family":"Laurent","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}]},{"given":"Motomichi","family":"Toyama","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}]}],"member":"320","reference":[{"key":"key-10.1145\/2938503.2938511-1","unstructured":"Microworker. http:\/\/www.microworker.com. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-2","unstructured":"Zooniverse. http:\/\/www.zooniverse.org. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-3","unstructured":"A. Aker, M. El-Haj, M.-D. Albakour, U. Kruschwitz, et al. Assessing crowdsourcing quality through objective tasks. In LREC, pages 1456--1461. Citeseer, 2012."},{"key":"key-10.1145\/2938503.2938511-4","doi-asserted-by":"crossref","unstructured":"V. Ambati, S. Vogel, and J. Carbonell. Collaborative workow for crowdsourcing translation. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, pages 1191--1194. ACM, 2012.","DOI":"10.1145\/2145204.2145382"},{"key":"key-10.1145\/2938503.2938511-5","unstructured":"D. J. Campbell. Task complexity: A review and analysis. Academy of management review, 13(1):40--52, 1988."},{"key":"key-10.1145\/2938503.2938511-6","unstructured":"C. Community. Introducing contributor performance levels! http:\/\/crowdowercommunity.tumblr.com\/post\/80598014542\/introducing-contributor-performance-levels, 2014. [Online; accessed 24-Mar-2016]."},{"key":"key-10.1145\/2938503.2938511-7","unstructured":"Crowd4U. Crowd4u: A nonprofit open crowd platform for microvolunteering and crowdsourcing - crowd4u. https:\/\/crowd4u.org\/en\/, 2015. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-8","unstructured":"Crowdcrafting. Crowdcrafting. http:\/\/www.crowdcrafting.org\/, 2015. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-9","unstructured":"CrowdFlower. Crowflower company. http:\/\/www.crowdower.com\/company, 2015. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-10","doi-asserted-by":"crossref","unstructured":"A. Doan, R. Ramakrishnan, and A. Y. Halevy. Crowdsourcing systems on the world-wide web. Communications of the ACM, 54(4):86--96, 2011.","DOI":"10.1145\/1924421.1924442"},{"key":"key-10.1145\/2938503.2938511-11","doi-asserted-by":"crossref","unstructured":"A. Finnerty, P. Kucherbaev, S. Tranquillini, and G. Convertino. Keep it simple: Reward and task design in crowdsourcing. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, page 14. ACM, 2013.","DOI":"10.1145\/2499149.2499168"},{"key":"key-10.1145\/2938503.2938511-12","doi-asserted-by":"crossref","unstructured":"J. Goncalves, D. Ferreira, S. Hosio, Y. Liu, J. Rogstadius, H. Kukka, and V. Kostakos. Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, pages 753--762. ACM, 2013.","DOI":"10.1145\/2493432.2493481"},{"key":"key-10.1145\/2938503.2938511-13","doi-asserted-by":"crossref","unstructured":"W. Ling, L. Marujo, C. Dyer, A. Black, and I. Trancoso. Crowdsourcing high-quality parallel data extraction from twitter. In In Proceedings of the Ninth Workshop on Statistical Machine Translation (WMT. Citeseer, 2014.","DOI":"10.3115\/v1\/W14-3356"},{"key":"key-10.1145\/2938503.2938511-14","doi-asserted-by":"crossref","unstructured":"G. Little, L. B. Chilton, M. Goldman, and R. C. Miller. Exploring iterative and parallel human computation processes. In Proceedings of the ACM SIGKDD workshop on human computation, pages 68--76. ACM, 2010.","DOI":"10.1145\/1837885.1837907"},{"key":"key-10.1145\/2938503.2938511-15","doi-asserted-by":"crossref","unstructured":"C. Lofi, J. Selke, and W.-T. Balke. Information extraction meets crowdsourcing: A promising couple. Datenbank-Spektrum, 12(2):109--120, 2012.","DOI":"10.1007\/s13222-012-0092-8"},{"key":"key-10.1145\/2938503.2938511-16","doi-asserted-by":"crossref","unstructured":"A. Mao, E. Kamar, Y. Chen, E. Horvitz, M. E. Schwamb, C. J. Lintott, and A. M. Smith. Volunteering versus work for pay: Incentives and tradeoffs in crowdsourcing. In First AAAI Conference on Human Computation and Crowdsourcing, 2013.","DOI":"10.1609\/hcomp.v1i1.13075"},{"key":"key-10.1145\/2938503.2938511-17","doi-asserted-by":"crossref","unstructured":"W. Mason and D. J. Watts. Financial incentives and the performance of crowds. ACM SigKDD Explorations Newsletter, 11(2):100--108, 2010.","DOI":"10.1145\/1809400.1809422"},{"key":"key-10.1145\/2938503.2938511-18","unstructured":"Mturk.com. Amazon mechanical turk - welcome. http:\/\/www.mturk.com\/, 2015. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-19","doi-asserted-by":"crossref","unstructured":"R. T. Nakatsu, E. B. Grossman, and C. L. Iacovou. A taxonomy of crowdsourcing based on task complexity. Journal of Information Science, 40(6):823--834, 2014.","DOI":"10.1177\/0165551514550140"},{"key":"key-10.1145\/2938503.2938511-20","unstructured":"D. Oleson, A. Sorokin, G. P. Laughlin, V. Hester, J. Le, and L. Biewald. Programmatic gold: Targeted and scalable quality assurance in crowdsourcing. Human computation, 11(11), 2011."},{"key":"key-10.1145\/2938503.2938511-21","unstructured":"PHP.net. Php: similar text - manual. http:\/\/php.net\/manual\/en\/function.similar-text.php, 2016. [Online; accessed 24-Mar-2016]."},{"key":"key-10.1145\/2938503.2938511-22","unstructured":"PyBossa. Pybossa. http:\/\/www.pybossa.com, 2015. [Online; accessed 31-Mar-2015]."},{"key":"key-10.1145\/2938503.2938511-23","doi-asserted-by":"crossref","unstructured":"P. Robinson. Task complexity, cognitive resources, and syllabus design: A triadic framework for examining task influences on sla. Cognition and second language instruction, pages 287--318, 2001.","DOI":"10.1017\/CBO9781139524780.012"},{"key":"key-10.1145\/2938503.2938511-24","doi-asserted-by":"crossref","unstructured":"P. Robinson. Task complexity, task difficulty, and task production: Exploring interactions in a componential framework. Applied linguistics, 22(1):27--57, 2001.","DOI":"10.1093\/applin\/22.1.27"},{"key":"key-10.1145\/2938503.2938511-25","unstructured":"J. Vuurens, A. P. de Vries, and C. Eickhoff. How much spam can you take? an analysis of crowdsourcing results to increase accuracy. In Proc. ACM SIGIR Workshop on Crowdsourcing for Information Retrieval (CIRâĂŹ11), pages 21--26, 2011."},{"key":"key-10.1145\/2938503.2938511-26","unstructured":"J. Wang, P. G. Ipeirotis, and F. Provost. Quality-based pricing for crowdsourced workers. NYU Working Paper, 2013."},{"key":"key-10.1145\/2938503.2938511-27","doi-asserted-by":"crossref","unstructured":"M.-C. Yuen, I. King, and K.-S. Leung. A survey of crowdsourcing systems. In Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), 2011 IEEE Third International Conference on, pages 766--773. IEEE, 2011.","DOI":"10.1109\/PASSAT\/SocialCom.2011.203"}],"event":{"number":"20","sponsor":["Keio University"],"acronym":"IDEAS '16","name":"the 20th International Database Engineering & Applications Symposium","start":{"date-parts":[[2016,7,11]]},"location":"Montreal, QC, Canada","end":{"date-parts":[[2016,7,13]]}},"container-title":["Proceedings of the 20th International Database Engineering & Applications Symposium on - IDEAS '16"],"original-title":[],"link":[{"URL":"http:\/\/dl.acm.org\/ft_gateway.cfm?id=2938511&ftid=1786976&dwn=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,20]],"date-time":"2023-08-20T02:17:58Z","timestamp":1692497878000},"score":1,"resource":{"primary":{"URL":"http:\/\/dl.acm.org\/citation.cfm?doid=2938503.2938511"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016]]},"references-count":27,"URL":"https:\/\/doi.org\/10.1145\/2938503.2938511","relation":{},"subject":[],"published":{"date-parts":[[2016]]}}}