{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:08:41Z","timestamp":1732036121814},"reference-count":46,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2016,6,15]],"date-time":"2016-06-15T00:00:00Z","timestamp":1465948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"Due to the decrease of sensor and actuator prices and their ease of installation, smart homes and smart environments are more and more exploited in automation and health applications. In these applications, activity recognition has an important place. This article presents a general architecture that is responsible for adapting automation for the different users of the smart home while recognizing their activities. For that, semi-supervised learning algorithms and Markov-based models are used to determine the preferences of the user considering a combination of: (1) observations of the data that have been acquired since the start of the experiment and (2) feedback of the users on decisions that have been taken by the automation. We present preliminarily simulated experimental results regarding the determination of preferences for a user.<\/jats:p>","DOI":"10.3390\/info7020035","type":"journal-article","created":{"date-parts":[[2016,6,15]],"date-time":"2016-06-15T18:11:19Z","timestamp":1466014279000},"page":"35","source":"Crossref","is-referenced-by-count":18,"title":["User in the Loop: Adaptive Smart Homes Exploiting User Feedback\u2014State of the Art and Future Directions"],"prefix":"10.3390","volume":"7","author":[{"given":"Abir","family":"Karami","sequence":"first","affiliation":[{"name":"University of Lille, F-59000 Lille and Mines Douai, URIA, F-90508 Douai, France"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-0175-3181","authenticated-orcid":false,"given":"Anthony","family":"Fleury","sequence":"additional","affiliation":[{"name":"University of Lille, F-59000 Lille and Mines Douai, URIA, F-90508 Douai, France"}]},{"given":"Jacques","family":"Boonaert","sequence":"additional","affiliation":[{"name":"University of Lille, F-59000 Lille and Mines Douai, URIA, F-90508 Douai, France"}]},{"given":"St\u00e9phane","family":"Lecoeuche","sequence":"additional","affiliation":[{"name":"University of Lille, F-59000 Lille and Mines Douai, URIA, F-90508 Douai, France"}]}],"member":"1968","published-online":{"date-parts":[[2016,6,15]]},"reference":[{"key":"ref_1","unstructured":"GhaffarianHoseini, A., GhaffarianHoseini, A., Tookey, J., Omrany, H., Fleury, A., Naismith, N., and Ghaffarianhoseini, M. (2016). Handbook of Research on Creative Technologies for Multidisciplinary Applications, IGI Global. Chapter 14."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/MIS.2015.57","article-title":"Bridging e-Health and the Internet of Things: The SPHERE project","volume":"30","author":"Zhu","year":"2015","journal-title":"IEEE Intell. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.cmpb.2008.02.001","article-title":"A review of smart homes\u2014Present state and future challenges","volume":"91","author":"Chan","year":"2008","journal-title":"Comput. Methods Progr. Biomed."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1016\/j.engappai.2012.05.002","article-title":"State of the art of smart homes","volume":"25","author":"Morikawa","year":"2012","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Solaimani, S., Keijzer-Broers, W., and Bouwman, H. (2013). What we do-and don\u2019t-know about the Smart Home: An analysis of the Smart Home literature. Indoor Built Environ.","DOI":"10.1177\/1420326X13516350"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1109\/TSMCC.2012.2189204","article-title":"A review of smart homes\u2014Past, present, and future","volume":"42","author":"Alam","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. C Appl. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/s00779-014-0813-0","article-title":"Smart homes and their users: A systematic analysis and key challenges","volume":"19","author":"Wilson","year":"2014","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_8","first-page":"21","article-title":"The concept of environmental comfort in workplace performance","volume":"7","author":"Vischer","year":"2007","journal-title":"Ambient. Constr."},{"key":"ref_9","unstructured":"Allameh, E., Heidari Jozam, M., Vries, B.D., Timmermans, H., and Beetz, J. (2011, January 16\u201318). Smart Home as a smart real estate: A state-of-the-art review. Proceedings of the 18th International Conference of European Real Estate Society, ERES 2011, Eindhoven, The Netherlands."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1007\/s11948-014-9552-x","article-title":"A review of contemporary work on the ethics of ambient assisted living technologies for people with Dementia","volume":"21","author":"Novitzky","year":"2014","journal-title":"Sci. Eng. Ethics"},{"key":"ref_11","unstructured":"Cook, D.J., and Krishnan, N.C. (2015). Activity Learning: Discovering, Recognizing, and Predicting Human Behavior from Sensor Data, John Wiley & Sons."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kim, J.K. (2015). Information Science and Applications, Springer.","DOI":"10.1007\/978-3-662-46578-3"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11953","DOI":"10.3390\/s150511953","article-title":"User activity recognition in smart homes using pattern clustering applied to temporal ANN algorithm","volume":"15","author":"Bourobou","year":"2015","journal-title":"Sensors"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"253","DOI":"10.3233\/AIS-2010-0071","article-title":"Activity recognition using temporal evidence theory","volume":"2","author":"Mckeever","year":"2010","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1109\/TITB.2009.2037317","article-title":"SVM-based multimodal classification of activities of daily living in health smart homes: Sensors, algorithms, and first experimental results","volume":"14","author":"Fleury","year":"2010","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1109\/TKDE.2011.51","article-title":"A knowledge-driven approach to activity recognition in smart homes","volume":"24","author":"Chen","year":"2012","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.artint.2008.12.005","article-title":"Efficient duration and hierarchical modeling for human activity recognition","volume":"173","author":"Duong","year":"2009","journal-title":"Artif. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nazerfard, E., Das, B., Holder, L.B., and Cook, D.J. (2010, January 11\u201312). Conditional random fields for activity recognition in smart environments. Proceedings of the 1st ACM International Health Informatics Symposium, IHI \u201910, New York, NY, USA.","DOI":"10.1145\/1882992.1883032"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chahuara, P., Fleury, A., Portet, F., and Vacher, M. (2016). On-line human activity recognition from audio and home automation sensors: Comparison of sequential and non-sequential models in realistic Smart Homes. J. Ambient Intell. Smart Environ., in press.","DOI":"10.3233\/AIS-160386"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hoque, E., and Stankovic, J. (2012, January 21\u201324). AALO: Activity recognition in smart homes using Active Learning in the presence of Overlapped activities. Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), San Diego, CA, USA.","DOI":"10.4108\/icst.pervasivehealth.2012.248600"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yala, N., Fergani, B., and Fleury, A. (2015, January 1\u20133). Feature extraction and incremental learning to improve activity recognition on streaming data. Proceedings of the 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS), Douai, France.","DOI":"10.1109\/EAIS.2015.7368787"},{"key":"ref_22","unstructured":"Rashidi, P. (2007). Smart Home Adaptation Based on Explicit and Implicit User Feedback. [Master\u2019s Thesis, Washington State University]."},{"key":"ref_23","unstructured":"Aztiria, A., Izaguirre, A., Basagoiti, R., and Augusto, J.C. (2009). Learning about Preferences and Common Behaviours of the User in an Intelligent Environment, Book Manufacturers\u2019 Institue."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MIS.2008.33","article-title":"Proactive fuzzy control and adaptation methods for smart homes","volume":"23","author":"Vainio","year":"2008","journal-title":"IEEE Intell. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Herczeg, M. (2010, January 27\u201330). The smart, the intelligent and the wise: Roles and values of interactive technologies. Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia, Allahabad, India.","DOI":"10.1145\/1963564.1963567"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Knox, W.B., and Stone, P. (2009, January 1\u20134). Interactively shaping agents via human reinforcement: The TAMER framework. Proceedings of the Fifth International Conference on Knowledge Capture, K-CAP \u201909, Redondo Beach, CA, USA.","DOI":"10.1145\/1597735.1597738"},{"key":"ref_27","unstructured":"Knox, W.B., Stone, P., and Breazeal, C. (2013). Social Robotics, Springer."},{"key":"ref_28","first-page":"116","article-title":"APRIL: Active Preference-Learning Based Reinforcement Learning","volume":"Volume 7524","author":"Akrour","year":"2012","journal-title":"Machine Learning and Knowledge Discovery in Databases"},{"key":"ref_29","unstructured":"Nick, M. (2006, January 11\u201313). Reducing the Case acquisition and maintenance bottleneck with user-feedback-driven case base maintenance. Proceedings of the FLAIRS Conference, Melbourne Beach, FL, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nick, M., and Becker, M. (2007, January 17\u201319). A hybrid approach to intelligent living assistance. Proceedings of the 7th International Conference on Hybrid Intelligent Systems, HIS 2007, Kaiserlautern, Germany.","DOI":"10.1109\/HIS.2007.69"},{"key":"ref_31","unstructured":"Khalili, A., Wu, C., and Aghajan, H. (2009, January 15\u201318). Autonomous learning of user\u2019s preference of music and light services in smart home applications. Proceedings of the Behavior Monitoring and Interpretation Workshop at German AI Conference, Paderborn, Germany."},{"key":"ref_32","unstructured":"Gil, M., and Pelechano, V. (2012). Ubiquitous Computing and Ambient Intelligence, Springer."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1109\/TSMCA.2009.2025137","article-title":"Keeping the resident in the loop: Adapting the smart home to the user","volume":"39","author":"Rashidi","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern. A Syst. Hum."},{"key":"ref_34","unstructured":"ZigBee. Available online: https:\/\/en.wikipedia.org\/wiki\/ZigBee."},{"key":"ref_35","unstructured":"Cleobee. Available online: http:\/\/www.cleode.fr\/en\/produits.php?page=cleobee."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1037\/0278-7393.10.4.598","article-title":"Analysis of response time distributions in the study of cognitive processes","volume":"10","author":"Hockley","year":"1984","journal-title":"J. Exp. Psychol. Learn. Mem. Cognit."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s12193-012-0104-x","article-title":"A french corpus of audio and multimodal interactions in a health smart home","volume":"7","author":"Fleury","year":"2013","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_38","unstructured":"Vacher, M., Lecouteux, B., Chahuara, P., Portet, F., Meillon, B., and Bonnefond, N. (2014, January 26\u201331). The Sweet-Home speech and multimodal corpus for home automation interaction. Proceedings of the 9th Edition of the Language Resources and Evaluation Conference (LREC), Reykjavik, Iceland."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/S0004-3702(98)00023-X","article-title":"Planning and acting in partially observable stochastic domains","volume":"101","author":"Kaelbling","year":"1998","journal-title":"Artif. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Loftin, R., MacGlashan, J., Peng, B., Taylor, M.E., Littman, M.L., Huang, J., and Roberts, D.L. (2014, January 27\u201331). A strategy-aware technique for learning behaviors from discrete human feedback. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI-14), Qu\u00e9bec City, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8839"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1512\/iumj.1957.6.56038","article-title":"A Markovian Decision Process","volume":"6","author":"Bellman","year":"1957","journal-title":"Indiana Univ. Math. J."},{"key":"ref_42","unstructured":"Howard, R.A. (1960). Dynamic Programming and Markov Processes, The MIT Press."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1177\/1059712316634062","article-title":"Adaptive artificial companions learning from users\u2019 feedback","volume":"24","author":"Karami","year":"2016","journal-title":"Adapt. Behav."},{"key":"ref_44","unstructured":"Russell, S.J., and Norvig, P. (2003). Artificial Intelligence: A Modern Approach, Pearson Education. [2nd ed.]."},{"key":"ref_45","unstructured":"Langford, J., and Zhang, T. (2008, January 8\u201310). The epoch-greedy algorithm for multi-armed bandits with side information. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/s10458-006-0005-z","article-title":"Cobot in LambdaMOO: An adaptive social statistics agent","volume":"13","author":"Isbell","year":"2006","journal-title":"Auton. Agents Multi-Agent Syst."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/7\/2\/35\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T04:53:50Z","timestamp":1717563230000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/7\/2\/35"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,15]]},"references-count":46,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["info7020035"],"URL":"https:\/\/doi.org\/10.3390\/info7020035","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,6,15]]}}}