{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,7]],"date-time":"2025-05-07T05:02:15Z","timestamp":1746594135045,"version":"3.37.3"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","funder":[{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["825258"],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,26]]},"DOI":"10.1145\/3437984.3458834","type":"proceedings-article","created":{"date-parts":[[2021,4,25]],"date-time":"2021-04-25T09:56:04Z","timestamp":1619344564000},"page":"55-61","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["AutoAblation"],"prefix":"10.1145","author":[{"given":"Sina","family":"Sheikholeslami","sequence":"first","affiliation":[{"name":"KTH Royal Institute of Technology"}]},{"given":"Moritz","family":"Meister","sequence":"additional","affiliation":[{"name":"Logical Clocks AB"}]},{"given":"Tianze","family":"Wang","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology"}]},{"given":"Amir H.","family":"Payberah","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology"}]},{"given":"Vladimir","family":"Vlassov","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology"}]},{"given":"Jim","family":"Dowling","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology Logical Clocks AB"}]}],"member":"320","published-online":{"date-parts":[[2021,4,26]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)","author":"Abadi M.","year":"2016","unstructured":"M. Abadi 2016 . TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) . 265--283. M. Abadi et al. 2016. TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). 265--283."},{"key":"e_1_3_2_1_2_1","unstructured":"D. Berthelot etal 2019. MixMatch: A Holistic Approach to Semi-Supervised Learning. arXiv preprint arXiv:1905.02249 (2019). D. Berthelot et al. 2019. MixMatch: A Holistic Approach to Semi-Supervised Learning. arXiv preprint arXiv:1905.02249 (2019)."},{"key":"e_1_3_2_1_3_1","unstructured":"N. Carlson etal 2009. Psychology: the Science of Behavior. Pearson. N. Carlson et al. 2009. Psychology: the Science of Behavior. Pearson."},{"key":"e_1_3_2_1_4_1","volume-title":"Spark: The Definitive Guide: Big Data Processing Made Simple","author":"Chambers B.","year":"2018","unstructured":"B. Chambers and M. Zaharia . 2018 . Spark: The Definitive Guide: Big Data Processing Made Simple . O'Reilly Media, Inc. B. Chambers and M. Zaharia. 2018. Spark: The Definitive Guide: Big Data Processing Made Simple. O'Reilly Media, Inc."},{"key":"e_1_3_2_1_5_1","unstructured":"F. Chollet etal 2015. Keras. F. Chollet et al. 2015. Keras."},{"key":"e_1_3_2_1_6_1","volume-title":"Imagenet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 248--255","author":"Deng J.","year":"2009","unstructured":"J. Deng 2009 . Imagenet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 248--255 . J. Deng et al. 2009. Imagenet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 248--255."},{"key":"e_1_3_2_1_7_1","unstructured":"A. Erdem etal 2019. Leave One Feature Out Importance. https:\/\/github.com\/aerdem4\/lofo-importance. A. Erdem et al. 2019. Leave One Feature Out Importance. https:\/\/github.com\/aerdem4\/lofo-importance."},{"key":"e_1_3_2_1_8_1","unstructured":"W. A. Falcon etal 2019. PyTorch Lightning. GitHub. https:\/\/github.com\/PyTorchLightning\/pytorch-lightning 3 (2019). W. A. Falcon et al. 2019. PyTorch Lightning. GitHub. https:\/\/github.com\/PyTorchLightning\/pytorch-lightning 3 (2019)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_3_2_1_10_1","volume-title":"33 AAAI Conference on Artificial Intelligence.","author":"Hessel M.","year":"2018","unstructured":"M. Hessel 2018 . Rainbow: Combining improvements in deep reinforcement learning . In 33 AAAI Conference on Artificial Intelligence. M. Hessel et al. 2018. Rainbow: Combining improvements in deep reinforcement learning. In 33 AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/958432.958440"},{"key":"e_1_3_2_1_12_1","unstructured":"Y. LeCun. 1998. The MNIST Database of Handwritten Digits. http:\/\/yann.lecun.com\/exdb\/mnist\/. Y. LeCun. 1998. The MNIST Database of Handwritten Digits. http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"e_1_3_2_1_13_1","unstructured":"Z. C. Lipton and J. Steinhardt. 2018. Troubling trends in machine learning scholarship. arXiv preprint arXiv:1807.03341 (2018). Z. C. Lipton and J. Steinhardt. 2018. Troubling trends in machine learning scholarship. arXiv preprint arXiv:1807.03341 (2018)."},{"key":"e_1_3_2_1_14_1","first-page":"4765","article-title":"2017. A Unified Approach to Interpreting Model Predictions","volume":"30","author":"Lundberg S. M.","year":"2017","unstructured":"S. M. Lundberg and SI. Lee . 2017. A Unified Approach to Interpreting Model Predictions . Advances in Neural Information Processing Systems 30 ( 2017 ), 4765 -- 4774 . S. M. Lundberg and SI. Lee. 2017. A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems 30 (2017), 4765--4774.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3426745.3431338"},{"key":"e_1_3_2_1_16_1","volume-title":"Towards Distribution Transparency for Supervised ML With Oblivious Training Functions. In Workshop on MLOps Systems.","author":"Meister M.","year":"2020","unstructured":"M. Meister 2020 . Towards Distribution Transparency for Supervised ML With Oblivious Training Functions. In Workshop on MLOps Systems. M. Meister et al. 2020. Towards Distribution Transparency for Supervised ML With Oblivious Training Functions. In Workshop on MLOps Systems."},{"key":"e_1_3_2_1_17_1","unstructured":"R. Meyes etal 2019. Ablation Studies in Artificial Neural Networks. arXiv preprint arXiv:1901.08644 (2019). R. Meyes et al. 2019. Ablation Studies in Artificial Neural Networks. arXiv preprint arXiv:1901.08644 (2019)."},{"key":"e_1_3_2_1_18_1","volume-title":"Ray: A Distributed Framework for Emerging AI Applications. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)","author":"Moritz P.","year":"2018","unstructured":"P. Moritz 2018 . Ray: A Distributed Framework for Emerging AI Applications. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) . 561--577. P. Moritz et al. 2018. Ray: A Distributed Framework for Emerging AI Applications. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). 561--577."},{"key":"e_1_3_2_1_19_1","volume-title":"O'Malley et al","author":"T.","year":"2019","unstructured":"T. O'Malley et al . 2019 . Keras Tuner . https:\/\/github.com\/keras-team\/keras-tuner. T. O'Malley et al. 2019. Keras Tuner. https:\/\/github.com\/keras-team\/keras-tuner."},{"key":"e_1_3_2_1_20_1","first-page":"8026","article-title":"2019. PyTorch: An Imperative Style","volume":"32","author":"Paszke A.","year":"2019","unstructured":"A. Paszke 2019. PyTorch: An Imperative Style , High-Performance Deep Learning Library. Advances in Neural Information Processing Systems 32 ( 2019 ), 8026 -- 8037 . A. Paszke et al. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. Advances in Neural Information Processing Systems 32 (2019), 8026--8037.","journal-title":"High-Performance Deep Learning Library. Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1135777.1135881"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300073"},{"key":"e_1_3_2_1_24_1","unstructured":"S. Sheikholeslami. 2019. Ablation Programming for Machine Learning. Master's thesis. S. Sheikholeslami. 2019. Ablation Programming for Machine Learning. Master's thesis."},{"key":"e_1_3_2_1_25_1","volume-title":"Rethinking the Inception Architecture for Computer Vision. In IEEE Conference on Computer Vision and Pattern Recognition. 2818--2826","author":"Szegedy C.","year":"2016","unstructured":"C. Szegedy 2016 . Rethinking the Inception Architecture for Computer Vision. In IEEE Conference on Computer Vision and Pattern Recognition. 2818--2826 . C. Szegedy et al. 2016. Rethinking the Inception Architecture for Computer Vision. In IEEE Conference on Computer Vision and Pattern Recognition. 2818--2826."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/gdj3.73"},{"key":"e_1_3_2_1_27_1","unstructured":"J. Wexler etal 2019. The What-If Tool: Interactive Probing of Machine Learning Models. arXiv preprint arXiv:1907.04135 (2019). J. Wexler et al. 2019. The What-If Tool: Interactive Probing of Machine Learning Models. arXiv preprint arXiv:1907.04135 (2019)."},{"key":"e_1_3_2_1_28_1","unstructured":"L. Yang etal 2017. Open Sourcing TensorFlowOnSpark: Distributed Deep Learning on Big-Data Clusters. L. Yang et al. 2017. Open Sourcing TensorFlowOnSpark: Distributed Deep Learning on Big-Data Clusters."},{"key":"e_1_3_2_1_29_1","first-page":"10","article-title":"2010. Spark","volume":"10","author":"Zaharia M.","year":"2010","unstructured":"M. Zaharia 2010. Spark : Cluster Computing with Working Sets. HotCloud 10 , 10 -- 10 ( 2010 ), 95. M. Zaharia et al. 2010. Spark: Cluster Computing with Working Sets. HotCloud 10, 10--10 (2010), 95.","journal-title":"Cluster Computing with Working Sets. HotCloud"}],"event":{"name":"EuroSys '21: Sixteenth European Conference on Computer Systems","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"],"location":"Online United Kingdom","acronym":"EuroSys '21"},"container-title":["Proceedings of the 1st Workshop on Machine Learning and Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437984.3458834","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T12:43:15Z","timestamp":1673354595000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437984.3458834"}},"subtitle":["Automated Parallel Ablation Studies for Deep Learning"],"short-title":[],"issued":{"date-parts":[[2021,4,26]]},"references-count":29,"alternative-id":["10.1145\/3437984.3458834","10.1145\/3437984"],"URL":"https:\/\/doi.org\/10.1145\/3437984.3458834","relation":{},"subject":[],"published":{"date-parts":[[2021,4,26]]},"assertion":[{"value":"2021-04-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}