{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T13:22:48Z","timestamp":1725024168478},"reference-count":12,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T00:00:00Z","timestamp":1593561600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Internet Technology Letters"],"published-print":{"date-parts":[[2020,9]]},"abstract":"This work proposes an algorithm to optimize the positioning and the transmit power of Drone Small Cells (DSCs) based on Q<\/jats:italic>\u2010learning, a technique where the agents learn to maximize a given reward. We consider two different rewards in this work, the first focusing on coverage, while the second maximizes the lifetime. Then, the Q<\/jats:italic>\u2010learning solution determines the best positioning of the DSC in the 3D space, as well as the optimal transmit power. Results show that the optimization of the transmit power is of paramount importance to reduce the outage probability. In addition, we show that the second reward can considerably increase the network lifetime with a small penalty to the coverage.<\/jats:p>","DOI":"10.1002\/itl2.166","type":"journal-article","created":{"date-parts":[[2020,5,1]],"date-time":"2020-05-01T06:13:25Z","timestamp":1588313605000},"update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Energy efficiency analysis of Drone Small Cells positioning based on reinforcement learning"],"prefix":"10.1002","volume":"3","author":[{"given":"Ana Fl\u00e1via","family":"dos Reis","sequence":"first","affiliation":[{"name":"Federal University of Technology \u2010 Paran\u00e1 (UTFPR) Curitiba Brazil"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6006-4274","authenticated-orcid":false,"given":"Glauber","family":"Brante","sequence":"additional","affiliation":[{"name":"Federal University of Technology \u2010 Paran\u00e1 (UTFPR) Curitiba Brazil"}]},{"given":"Rafaela","family":"Parisotto","sequence":"additional","affiliation":[{"name":"Federal University of Santa Catarina (UFSC) Florian\u00f3polis Brazil"}]},{"given":"Richard D.","family":"Souza","sequence":"additional","affiliation":[{"name":"Federal University of Santa Catarina (UFSC) Florian\u00f3polis Brazil"}]},{"given":"Paulo H. V.","family":"Klaine","sequence":"additional","affiliation":[{"name":"University of Glasgow Glasgow UK"}]},{"given":"Jo\u00e3o Pedro","family":"Battistella","sequence":"additional","affiliation":[{"name":"University of Glasgow Glasgow UK"}]},{"given":"Muhammad A.","family":"Imran","sequence":"additional","affiliation":[{"name":"University of Glasgow Glasgow UK"}]}],"member":"311","published-online":{"date-parts":[[2020,7]]},"reference":[{"key":"e_1_2_1_6_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2688328"},{"key":"e_1_2_1_6_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/LWC.2017.2700840"},{"key":"e_1_2_1_6_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2019.2902559"},{"key":"e_1_2_1_6_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12559-018-9559-8"},{"key":"e_1_2_1_6_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2019.2940191"},{"key":"e_1_2_1_6_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2019.2900035"},{"key":"e_1_2_1_6_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/LWC.2019.2916549"},{"key":"e_1_2_1_6_9_1","unstructured":"ParisottoRP KlainePV NadasJPB SouzaRD BranteG ImranMA. Drone base station positioning and power allocation using reinforcement learning. In: International Symposium on Wireless Communication Systems;2019:213\u2010217."},{"key":"e_1_2_1_6_10_1","unstructured":"ITU\u2010R. Propagation data and prediction methods for the design of terrestrial broadband millimetric radio access systems. 2003: 1410\u20132."},{"key":"e_1_2_1_6_11_1","doi-asserted-by":"crossref","unstructured":"Al\u2010HouraniA KandeepanS JamalipourA. Modeling air\u2010to\u2010ground path loss for low altitude platforms in urban environments. In: IEEE Global Communications Conference;2014:2898\u20102904.","DOI":"10.1109\/GLOCOM.2014.7037248"},{"key":"e_1_2_1_6_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2016.2531652"},{"key":"e_1_2_1_6_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2019.1800545"}],"container-title":["Internet Technology Letters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fitl2.166","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/itl2.166","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/itl2.166","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/itl2.166","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T23:22:56Z","timestamp":1693956176000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/itl2.166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7]]},"references-count":12,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["10.1002\/itl2.166"],"URL":"https:\/\/doi.org\/10.1002\/itl2.166","archive":["Portico"],"relation":{},"ISSN":["2476-1508","2476-1508"],"issn-type":[{"value":"2476-1508","type":"print"},{"value":"2476-1508","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7]]},"assertion":[{"value":"2020-03-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-22","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}