{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T05:14:20Z","timestamp":1746249260865,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,9]]},"DOI":"10.1145\/3563357.3564075","type":"proceedings-article","created":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T18:31:36Z","timestamp":1670524296000},"page":"262-265","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Adversarial poisoning attacks on reinforcement learning-driven energy pricing"],"prefix":"10.1145","author":[{"given":"Sam","family":"Gunn","sequence":"first","affiliation":[{"name":"University of California"}]},{"given":"Doseok","family":"Jang","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Orr","family":"Paradise","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Lucas","family":"Spangher","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Costas J.","family":"Spanos","sequence":"additional","affiliation":[{"name":"University of California"}]}],"member":"320","published-online":{"date-parts":[[2022,12,8]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Spanos","author":"Agwan Utkarsha","year":"2021","unstructured":"Utkarsha Agwan , Lucas Spangher , William Arnold , Tarang Srivastava , Kameshwar Poolla , and Costas J . Spanos . 2021 . Pricing in Prosumer Aggregations using Reinforcement Learning. In e-Energy '21: The Twelfth ACM International Conference on Future Energy Systems, Virtual Event, Torino, Italy, 28 June - 2 July, 2021, Herman de Meer and Michela Meo (Eds.). ACM , 220--224. Utkarsha Agwan, Lucas Spangher, William Arnold, Tarang Srivastava, Kameshwar Poolla, and Costas J. Spanos. 2021. Pricing in Prosumer Aggregations using Reinforcement Learning. In e-Energy '21: The Twelfth ACM International Conference on Future Energy Systems, Virtual Event, Torino, Italy, 28 June - 2 July, 2021, Herman de Meer and Michela Meo (Eds.). ACM, 220--224."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.egyai.2020.100020"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3360849"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447555.3464874"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2013.2248175"},{"key":"e_1_3_2_1_6_1","volume-title":"Explaining and harnessing adversarial examples. arXiv preprint arXiv: 1412.6572","author":"Goodfellow Ian J","year":"2014","unstructured":"Ian J Goodfellow , Jonathon Shlens , and Christian Szegedy . 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv: 1412.6572 ( 2014 ). Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv: 1412.6572 (2014)."},{"key":"e_1_3_2_1_7_1","volume-title":"Decarbonizing Buildings via Energy Demand Response and Deep Reinforcement Learning: The Deployment Value of Supervisory Planning and Guardrails. Available at SSRN 4078206","author":"Jang Doseok","year":"2022","unstructured":"Doseok Jang , Lucas Spangher , Selvaprabu Nadarajah , and Costas Spanos . 2022. Decarbonizing Buildings via Energy Demand Response and Deep Reinforcement Learning: The Deployment Value of Supervisory Planning and Guardrails. Available at SSRN 4078206 ( 2022 ). Doseok Jang, Lucas Spangher, Selvaprabu Nadarajah, and Costas Spanos. 2022. Decarbonizing Buildings via Energy Demand Response and Deep Reinforcement Learning: The Deployment Value of Supervisory Planning and Guardrails. Available at SSRN 4078206 (2022)."},{"key":"e_1_3_2_1_8_1","first-page":"91","article-title":"Hacking Power Grids","volume":"50","author":"Kshetri Nir","year":"2017","unstructured":"Nir Kshetri and Jeffrey M. Voas . 2017 . Hacking Power Grids : A Current Problem. Computer 50 , 12 (2017), 91 -- 95 . Nir Kshetri and Jeffrey M. Voas. 2017. Hacking Power Grids: A Current Problem. Computer 50, 12 (2017), 91--95.","journal-title":"A Current Problem. Computer"},{"key":"e_1_3_2_1_9_1","volume-title":"6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. Open-Review.net.","author":"Madry Aleksander","year":"2018","unstructured":"Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , and Adrian Vladu . 2018 . Towards Deep Learning Models Resistant to Adversarial Attacks . In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. Open-Review.net. Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. 2018. Towards Deep Learning Models Resistant to Adversarial Attacks. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. Open-Review.net."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2021.120725"},{"key":"e_1_3_2_1_11_1","volume-title":"Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments. CoRR abs\/2102.08492","author":"Rakhsha Amin","year":"2021","unstructured":"Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , and Adish Singla . 2021. Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments. CoRR abs\/2102.08492 ( 2021 ). arXiv:2102.08492 Amin Rakhsha, Xuezhou Zhang, Xiaojin Zhu, and Adish Singla. 2021. Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments. CoRR abs\/2102.08492 (2021). arXiv:2102.08492"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3486611.3492387"},{"key":"e_1_3_2_1_13_1","volume-title":"Spanos","author":"Spangher Lucas","year":"2020","unstructured":"Lucas Spangher , Akash Gokul , Manan Khattar , Joseph Palakapilly , Akaash Tawade , Adam Bouyamourn , Alex Devonport , and Costas J . Spanos . 2020 . Prospective Experiment for Reinforcement Learning on Demand Response in a Social Game Framework. In e-Energy '20: The Eleventh ACM International Conference on Future Energy Systems, Virtual Event, Australia, June 22--26, 2020. ACM , 438--444. Lucas Spangher, Akash Gokul, Manan Khattar, Joseph Palakapilly, Akaash Tawade, Adam Bouyamourn, Alex Devonport, and Costas J. Spanos. 2020. Prospective Experiment for Reinforcement Learning on Demand Response in a Social Game Framework. In e-Energy '20: The Eleventh ACM International Conference on Future Energy Systems, Virtual Event, Australia, June 22--26, 2020. ACM, 438--444."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3360998"},{"key":"e_1_3_2_1_15_1","volume-title":"Reinforcement learning for demand response: A review of algorithms and modeling techniques. Applied energy 235","author":"V\u00e1zquez-Canteli Jos\u00e9 R","year":"2019","unstructured":"Jos\u00e9 R V\u00e1zquez-Canteli and Zolt\u00e1n Nagy . 2019. Reinforcement learning for demand response: A review of algorithms and modeling techniques. Applied energy 235 ( 2019 ), 1072--1089. Jos\u00e9 R V\u00e1zquez-Canteli and Zolt\u00e1n Nagy. 2019. Reinforcement learning for demand response: A review of algorithms and modeling techniques. Applied energy 235 (2019), 1072--1089."},{"key":"e_1_3_2_1_16_1","volume-title":"Adversarial Attack for Deep Reinforcement Learning Based Demand Response. In 2021 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 1--5.","author":"Wan Zhiqiang","year":"2021","unstructured":"Zhiqiang Wan , Hepeng Li , Hang Shuai , Yan Lindsay Sun , and Haibo He . 2021 . Adversarial Attack for Deep Reinforcement Learning Based Demand Response. In 2021 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 1--5. Zhiqiang Wan, Hepeng Li, Hang Shuai, Yan Lindsay Sun, and Haibo He. 2021. Adversarial Attack for Deep Reinforcement Learning Based Demand Response. In 2021 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 1--5."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3427773.3427865"},{"key":"e_1_3_2_1_18_1","first-page":"114416","article-title":"Machine-learning based hybrid demand-side controller for high-rise office buildings with high energy flexibilities","volume":"262","author":"Zhou Yuekuan","year":"2020","unstructured":"Yuekuan Zhou and Siqian Zheng . 2020 . Machine-learning based hybrid demand-side controller for high-rise office buildings with high energy flexibilities . AppliedEnergy 262 (2020), 114416 . Yuekuan Zhou and Siqian Zheng. 2020. Machine-learning based hybrid demand-side controller for high-rise office buildings with high energy flexibilities. AppliedEnergy 262 (2020), 114416.","journal-title":"AppliedEnergy"}],"event":{"name":"BuildSys '22: The 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation","sponsor":["SIGEnergy ACM Special Interest Group on Energy Systems and Informatics"],"location":"Boston Massachusetts","acronym":"BuildSys '22"},"container-title":["Proceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3563357.3564075","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T11:23:20Z","timestamp":1699529000000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3563357.3564075"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,9]]},"references-count":18,"alternative-id":["10.1145\/3563357.3564075","10.1145\/3563357"],"URL":"https:\/\/doi.org\/10.1145\/3563357.3564075","relation":{},"subject":[],"published":{"date-parts":[[2022,11,9]]},"assertion":[{"value":"2022-12-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}