{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:47:22Z","timestamp":1732038442922},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T00:00:00Z","timestamp":1561075200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,6,21]]},"abstract":"Traditional urban-scale crowdsourcing approaches suffer from three caveats - lack of complete spatiotemporal coverage, lack of accurate information and lack of sustained engagement of crowd workers. In this paper, we argue that these caveats can be addressed by embedding crowdsourcing tasks into the daily routine of mobile workforces that roam around an urban area. As a use case, we take the bpost who deliver the letters and parcels to the citizens across entire Belgium. We present a study that explores the behavioural attributes of these mobile postal workers both quantitatively (6.3K) and qualitatively (6) to assess the opportunity of leveraging them for crowdsourcing tasks. We report their mobility pattern, workflow, and behavioural traits which collectively inform the design of a purpose-built crowdsourcing solution. In particular, our solution operates on two key techniques - route augmentation, and on-wearable interruptibility management. Together, these mechanisms enhance the spatial coverage, response accuracy and increase workers' engagement with crowdsourcing tasks. We describe these principal components in a wearable smartwatch application supported by a data management infrastructure. Finally, we report a first-of-its-kind real-world trial with ten postal workers for two weeks to assess the quality of road signs at the city centre of Antwerp. Our findings suggest that our solution was effective in achieving 89% spatial coverage and increasing response rate (83.6%) and accuracy (100%) of the crowdsourcing tasks. Although limited in scale, these and the rest of our findings highlight the way of building an efficient and purposeful crowdsourcing solution of the future.<\/jats:p>","DOI":"10.1145\/3328906","type":"journal-article","created":{"date-parts":[[2019,6,24]],"date-time":"2019-06-24T13:45:01Z","timestamp":1561383901000},"page":"1-32","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Scaling Crowdsourcing with Mobile Workforce"],"prefix":"10.1145","volume":"3","author":[{"given":"Utku G\u00fcnay","family":"Acer","sequence":"first","affiliation":[{"name":"Nokia Bell Labs, Antwerp, Belgium"}]},{"given":"Marc van den","family":"Broeck","sequence":"additional","affiliation":[{"name":"Nokia Bell Labs, Antwerp, Belgium"}]},{"given":"Claudio","family":"Forlivesi","sequence":"additional","affiliation":[{"name":"ING, Belgium"}]},{"given":"Florian","family":"Heller","sequence":"additional","affiliation":[{"name":"Hasselt University - tUL - Flanders Make, Belgium"}]},{"given":"Fahim","family":"Kawsar","sequence":"additional","affiliation":[{"name":"Nokia Bell Labs, Cambridge, UK and TU Delft, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2019,6,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868914.1868921"},{"key":"e_1_2_1_2_1","volume-title":"2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS). IEEE, 86--91","author":"Aubry E."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173945"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2013.6525603"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2012.70"},{"key":"e_1_2_1_6_1","volume-title":"TRACCS: A Framework for Trajectory-Aware Coordinated Urban Crowd-Sourcing. In Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP","author":"Chen Cen","year":"2014"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI'15)","author":"Chen Cen","year":"2015"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078842"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of INTERACT","author":"Cutrell E.","year":"2001"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378600.1378605"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-010-0293-9"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037373.2037402"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989331"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05)","author":"Ho Joyce"},{"key":"e_1_2_1_15_1","volume-title":"TruCentive: A Game-theoretic Incentive Platform for Trustworthy Mobile Crowdsourcing Parking Services. In 2012 15th International IEEE Conference on Intelligent Transportation Systems. IEEE, 160--166","author":"Hoh B."},{"key":"e_1_2_1_16_1","volume-title":"Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business (1 ed.)","author":"Howe Jeff","year":"2008"},{"key":"e_1_2_1_17_1","volume-title":"Proc. When the City Meets the Citizen Workshop (WCMCW). AAAI","author":"Hristova Desislava","year":"2012"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868521.1868526"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173641"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3144457.3144502"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971690"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998311"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2011.16"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2424321.2424346"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2525314.2525346"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1999995.2000008"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968585"},{"key":"e_1_2_1_28_1","volume-title":"Information Technologies in Environmental Engineering, Ioannis N","author":"Maisonneuve Nicolas"},{"key":"e_1_2_1_29_1","unstructured":"B. Martin B. Hanington and B.M. Hanington. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems Develop Innovative Ideas and Design Effective Solutions. Rockport Publishers Beverly MA USA. B. Martin B. Hanington and B.M. Hanington. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems Develop Innovative Ideas and Design Effective Solutions. Rockport Publishers Beverly MA USA."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971760"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971747"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460412.1460444"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470745"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173795"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632062"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804252"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675235"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1791212.1791226"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2015.7060488"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785830.2785837"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675278"},{"key":"e_1_2_1_42_1","volume-title":"The Vehicle Routing Problem","author":"Toth Paolo"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820783.2820870"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556996"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-015-1395-y"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3328906","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T09:31:19Z","timestamp":1672565479000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3328906"}},"subtitle":["A Case Study with Belgian Postal Service"],"short-title":[],"issued":{"date-parts":[[2019,6,21]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6,21]]}},"alternative-id":["10.1145\/3328906"],"URL":"https:\/\/doi.org\/10.1145\/3328906","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,21]]},"assertion":[{"value":"2018-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}