{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,29]],"date-time":"2024-08-29T17:54:29Z","timestamp":1724954069809},"reference-count":76,"publisher":"MIT Press","issue":"1","license":[{"start":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T00:00:00Z","timestamp":1666224000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,1]]},"abstract":"Abstract<\/jats:title>Against the backdrop of the ever-improving Natural Language Inference (NLI) models, recent efforts have focused on the suitability of the current NLI datasets and on the feasibility of the NLI task as it is currently approached. Many of the recent studies have exposed the inherent human disagreements of the inference task and have proposed a shift from categorical labels to human subjective probability assessments, capturing human uncertainty. In this work, we show how neither the current task formulation nor the proposed uncertainty gradient are entirely suitable for solving the NLI challenges. Instead, we propose an ordered sense space annotation, which distinguishes between logical and common-sense inference. One end of the space captures non-sensical inferences, while the other end represents strictly logical scenarios. In the middle of the space, we find a continuum of common-sense, namely, the subjective and graded opinion of a \u201cperson on the street.\u201d To arrive at the proposed annotation scheme, we perform a careful investigation of the SICK corpus and we create a taxonomy of annotation issues and guidelines. We re-annotate the corpus with the proposed annotation scheme, utilizing four symbolic inference systems, and then perform a thorough evaluation of the scheme by fine-tuning and testing commonly used pre-trained language models on the re-annotated SICK within various settings. We also pioneer a crowd annotation of a small portion of the MultiNLI corpus, showcasing that it is possible to adapt our scheme for annotation by non-experts on another NLI corpus. Our work shows the efficiency and benefits of the proposed mechanism and opens the way for a careful NLI task refinement.<\/jats:p>","DOI":"10.1162\/coli_a_00465","type":"journal-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T14:32:38Z","timestamp":1666276358000},"page":"199-243","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Curing the SICK and Other NLI Maladies"],"prefix":"10.1162","volume":"49","author":[{"given":"Aikaterini-Lida","family":"Kalouli","sequence":"first","affiliation":[{"name":"Center for Information and Language Processing (CIS), LMU Munich. kalouli@cis.lmu.de"}]},{"given":"Hai","family":"Hu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University School of Foreign Languages. hu.hai@sjtu.edu.cn"}]},{"given":"Alexander F.","family":"Webb","sequence":"additional","affiliation":[{"name":"Indiana University Bloomington Department of Philosophy. afwebb@iu.edu"}]},{"given":"Lawrence S.","family":"Moss","sequence":"additional","affiliation":[{"name":"Indiana University Bloomington Department of Mathematics. lmoss@indiana.edu"}]},{"given":"Valeria","family":"de Paiva","sequence":"additional","affiliation":[{"name":"Topos Institute. valeria.depaiva@gmail.com"}]}],"member":"281","published-online":{"date-parts":[[2023,3,1]]},"reference":[{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1007\/978-3-662-48119-6_6","article-title":"Towards a wide-coverage tableau method for natural logic","volume-title":"New Frontiers in Artificial Intelligence - JSAI-isAI 2014 Workshops, LENLS, JURISIN, and GABA, Kanagawa, Japan, October 27\u201328, 2014, Revised Selected Papers","author":"Abzianidze","year":"2014"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"2492","DOI":"10.18653\/v1\/D15-1296","article-title":"A tableau prover for natural logic and language","volume-title":"Proceedings of EMNLP","author":"Abzianidze","year":"2015"},{"key":"2023030119555550400_","unstructured":"Abzianidze, Lasha . 2016. A Natural Proof System for Natural Language. Ph.D. thesis, Tilburg University."},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"115","DOI":"10.18653\/v1\/D17-2020","article-title":"LangPro: Natural language theorem prover","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing: System Demonstrations","author":"Abzianidze","year":"2017"},{"key":"2023030119555550400_","first-page":"1","article-title":"The second PASCAL recognising textual entailment challenge","volume-title":"Proceedings of the Second PASCAL Recognising Textual Entailment Challenge Workshop","author":"Bar-Haim","year":"2006"},{"key":"2023030119555550400_","first-page":"18","article-title":"The sixth PASCAL recognizing textual entailment challenge","volume-title":"Proceedings of the 10th Text Analysis Conference (TAC)","author":"Bentivogli","year":"2010"},{"key":"2023030119555550400_","first-page":"16","article-title":"The seventh PASCAL recognizing textual entailment challenge","volume-title":"Proceedings of the 11th Text Analysis Conference (TAC)","author":"Bentivogli","year":"2011"},{"key":"2023030119555550400_","first-page":"15","article-title":"The fifth PASCAL recognizing textual entailment challenge","volume-title":"Proceedings of the 9th Text Analysis Conference (TAC)","author":"Bentivogli","year":"2009"},{"key":"2023030119555550400_","first-page":"18","article-title":"Abductive commonsense reasoning","volume-title":"8th International Conference on Learning Representations, ICLR 2020","author":"Bhagavatula","year":"2020"},{"key":"2023030119555550400_","first-page":"46","article-title":"PARC\u2019s bridge and question answering system","volume-title":"Proceedings of the Grammar Engineering Across Frameworks Workshop (GEAF 2007)","author":"Bobrow","year":"2007"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"632","DOI":"10.18653\/v1\/D15-1075","article-title":"A large annotated corpus for learning Natural Language Inference","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Bowman","year":"2015"},{"key":"2023030119555550400_","first-page":"9539","article-title":"e-SNLI: Natural Language Inference with natural language explanations","volume-title":"NeurIPS","author":"Camburu","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"8772","DOI":"10.18653\/v1\/2020.acl-main.774","article-title":"Uncertain Natural Language Inference","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Chen","year":"2020"},{"key":"2023030119555550400_","volume-title":"Meaning and Grammar: An Introduction to Semantics","author":"Chierchia","year":"2001","edition":"2"},{"issue":"4","key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1162\/coli.2007.33.4.493","article-title":"Wide-coverage efficient statistical parsing with CCG and log-linear models","volume":"33","author":"Clark","year":"2007","journal-title":"Computational Linguistics"},{"key":"2023030119555550400_","article-title":"Testing the FraCaS test suite","volume-title":"Proceedings of the Logic and Engineering of Natural Language Semantics Workshop","author":"Cooper","year":"2016"},{"key":"2023030119555550400_","article-title":"Circumscribing is not excluding: A response to Manning","author":"Crouch","year":"2006","journal-title":"Unpublished manuscript"},{"key":"2023030119555550400_","article-title":"Systems and methods for detecting entailment and contradiction","author":"Crouch","year":"2007"},{"key":"2023030119555550400_","first-page":"177","article-title":"The PASCAL recognising textual entailment challenge","volume-title":"Proceedings of the Machine Learning Challenges Workshop","author":"Dagan","year":"2005"},{"key":"2023030119555550400_","article-title":"Evaluating compositionality in sentence embeddings","author":"Dasgupta","year":"2018","journal-title":"CoRR"},{"key":"2023030119555550400_","first-page":"1039","article-title":"Finding contradictions in text","volume-title":"Proceedings of ACL-08: HLT","author":"de Marneffe","year":"2008"},{"key":"2023030119555550400_","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin","year":"2019"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4684-0357-2","volume-title":"First-order Logic and Automated Theorem Proving","author":"Fitting","year":"1990"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.18653\/v1\/D19-1107","article-title":"Are we modeling the task or the annotator? An investigation of annotator bias in natural language understanding datasets","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Geva","year":"2019"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3115\/1654536.1654538","article-title":"The fourth PASCAL recognizing textual entailment challenge","volume-title":"Proceedings of the 8th Text Analysis Conference (TAC)","author":"Giampiccolo","year":"2008"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3115\/1654536.1654538","article-title":"The third PASCAL recognizing textual entailment challenge","volume-title":"Proceedings of the Workshop on Textual Entailment and Paraphrasing","author":"Giampiccolo","year":"2007"},{"key":"2023030119555550400_","first-page":"1050","article-title":"A probabilistic classification approach for lexical textual entailment","volume":"3","author":"Glickman","year":"2005","journal-title":"Proceedings of the National Conference on Artificial Intelligence"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"650","DOI":"10.18653\/v1\/P18-2103","article-title":"Breaking NLI systems with sentences that require simple lexical inferences","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Glockner","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"2786","DOI":"10.18653\/v1\/P19-1267","article-title":"We need to talk about standard splits","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Gorman","year":"2019"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"107","DOI":"10.18653\/v1\/N18-2017","article-title":"Annotation artifacts in Natural Language Inference data","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)","author":"Gururangan","year":"2018"},{"key":"2023030119555550400_","volume-title":"A Natural History of Negation","author":"Horn","year":"1989"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"8","DOI":"10.18653\/v1\/W19-0502","article-title":"Natural Language Inference with monotonicity","volume-title":"Proceedings of the 13th International Conference on Computational Semantics - Short Papers","author":"Hu","year":"2019"},{"key":"2023030119555550400_","first-page":"334","article-title":"MonaLog: A lightweight system for Natural Language Inference based on monotonicity","volume-title":"Proceedings of SCiL","author":"Hu","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"124","DOI":"10.18653\/v1\/S18-2015","article-title":"Polarity computations in flexible categorial grammar","volume-title":"Proceedings of *SEM","author":"Hu","year":"2018"},{"key":"2023030119555550400_","unstructured":"Kalouli, Aikaterini Lida . 2021. Hy-NLI: A Hybrid system for state-of-the-art Natural Language Inference. Ph.D. thesis, Universit\u00e4t Konstanz, Konstanz."},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"132","DOI":"10.18653\/v1\/W19-4016","article-title":"Explaining simple Natural Language Inference","volume-title":"Proceedings of the 13th Linguistic Annotation Workshop","author":"Kalouli","year":"2019"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"27","DOI":"10.18653\/v1\/W18-1304","article-title":"GKR: The Graphical Knowledge Representation for semantic parsing","volume-title":"Proceedings of the Workshop on Computational Semantics beyond Events and Roles","author":"Kalouli","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"5235","DOI":"10.18653\/v1\/2020.coling-main.459","article-title":"Hy-NLI: A hybrid system for Natural Language Inference","volume-title":"Proceedings of the 28th International Conference on Computational Linguistics","author":"Kalouli","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"247","DOI":"10.5753\/stil.2021.17804","article-title":"Annotation difficulties in Natural Language Inference","volume-title":"Proceedings of the Symposium in Information and Human Language Technology","author":"Kalouli","year":"2021"},{"key":"2023030119555550400_","first-page":"6","article-title":"Correcting contradictions","volume-title":"Proceedings of Computing Natural Language Inference (CONLI) Workshop","author":"Kalouli","year":"2017"},{"key":"2023030119555550400_","first-page":"7","article-title":"Textual inference: Getting logic from humans","volume-title":"Proceedings of the 12th International Conference on Computational Semantics (IWCS)","author":"Kalouli","year":"2017"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1609\/aaai.v32i1.12022","article-title":"WordNet for \u201ceasy\u201d textual inferences","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)","author":"Kalouli","year":"2018"},{"key":"2023030119555550400_","first-page":"5189","article-title":"SciTaiL: A textual entailment dataset from science question answering","volume-title":"AAAI","author":"Khot","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"990","DOI":"10.3115\/v1\/D14-1107","article-title":"A* CCG parsing with a supertag-factored model","volume-title":"Proceedings of EMNLP","author":"Lewis","year":"2014"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"4487","DOI":"10.18653\/v1\/P19-1441","article-title":"Multi-task deep neural networks for natural language understanding","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Liu","year":"2019"},{"key":"2023030119555550400_","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","volume":"abs\/1907.11692","author":"Liu","year":"2019","journal-title":"CoRR"},{"key":"2023030119555550400_","unstructured":"MacCartney, Bill . 2009. Natural Language Inference. Ph.D. thesis, Stanford University. AAI3364139."},{"key":"2023030119555550400_","article-title":"Local textual inference: It\u2019s hard to circumscribe, but you know it when you see it\u2014and NLP needs it","author":"Manning","year":"2006"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3115\/v1\/S14-2001","article-title":"SemEval-2014 task 1: Evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment","volume-title":"Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014)","author":"Marelli","year":"2014"},{"key":"2023030119555550400_","first-page":"216","article-title":"A SICK cure for the evaluation of compositional distributional semantic models","volume-title":"Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC\u201914)","author":"Marelli","year":"2014"},{"key":"2023030119555550400_","volume-title":"Elementary Logic","author":"Mates","year":"1972"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"3428","DOI":"10.18653\/v1\/P19-1334","article-title":"Right for the wrong reasons: Diagnosing syntactic heuristics in Natural Language Inference","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"McCoy","year":"2019"},{"key":"2023030119555550400_","first-page":"2340","article-title":"Stress test evaluation for Natural Language Inference","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics","author":"Naik","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"6867","DOI":"10.1609\/aaai.v33i01.33016867","article-title":"Analyzing compositionality-sensitivity of NLI models","volume":"abs\/1811.07033","author":"Nie","year":"2018","journal-title":"CoRR"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"4885","DOI":"10.18653\/v1\/2020.acl-main.441","article-title":"Adversarial NLI: A new benchmark for natural language understanding","volume-title":"Proceedings of ACL","author":"Nie","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"9131","DOI":"10.18653\/v1\/2020.emnlp-main.734","article-title":"What can we learn from collective human opinions on Natural Language Inference data?","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Nie","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1163\/9789004253162_011","article-title":"Privative adjectives: Subsective plus coercion","volume-title":"Presuppositions and Discourse: Essays Offered to Hans Kamp","author":"Partee","year":"2010"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"2164","DOI":"10.18653\/v1\/P16-1204","article-title":"Most \u201cbabies\u201d are \u201clittle\u201d and most \u201cproblems\u201d are \u201chuge\u201d: Compositional entailment in adjective-nouns","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Pavlick","year":"2016"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1162\/tacl_a_00293","article-title":"Inherent disagreements in human textual inferences","volume":"7","author":"Pavlick","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2023030119555550400_","article-title":"Conditionally adaptive multi-task learning: Improving transfer learning in NLP using fewer parameters & less data","author":"Pilault","year":"2020","journal-title":"arXiv preprint arXiv:2009.09139v1"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"76","DOI":"10.3115\/1608829.1608840","article-title":"The reliability of anaphoric annotation, reconsidered: Taking ambiguity into account","volume-title":"Proceedings of the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky","author":"Poesio","year":"2005"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"180","DOI":"10.18653\/v1\/S18-2023","article-title":"Hypothesis only baselines in Natural Language Inference","volume-title":"Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics","author":"Poliak","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"133","DOI":"10.18653\/v1\/2021.law-1.14","article-title":"On releasing annotator-level labels and information in datasets","volume-title":"Proceedings of the Joint 15th Linguistic Annotation Workshop (LAW) and 3rd Designing Meaning Representations (DMR) Workshop","author":"Prabhakaran","year":"2021"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"8713","DOI":"10.1609\/aaai.v34i05.6397","article-title":"Probing Natural Language Inference models through semantic fragments","volume-title":"Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020","author":"Richardson","year":"2020"},{"key":"2023030119555550400_","unstructured":"S\u00e1nchez-Valencia, Victor . 1991. Studies on Natural Logic and Categorial Grammar. Ph.D. thesis, University of Amsterdam."},{"key":"2023030119555550400_","article-title":"A brief history of natural logic","volume-title":"Logic, Navya-Nyaya and Applications: Homage to Bimal Matilal","author":"van Benthem","year":"2008"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"4485","DOI":"10.18653\/v1\/2021.emnlp-main.368","article-title":"We need to talk about train-dev-test splits","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"van der Goot","year":"2021"},{"key":"2023030119555550400_","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s11168-008-9059-1","article-title":"Vagueness and referential ambiguity in a large-scale annotated corpus","volume":"6","author":"Versley","year":"2008","journal-title":"Research on Language and Computation"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.18653\/v1\/N18-1101","article-title":"A broad-coverage challenge corpus for sentence understanding through inference","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Williams","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"38","DOI":"10.18653\/v1\/2020.emnlp-demos.6","article-title":"Transformers: State-of-the-art natural language processing","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations","author":"Wolf","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"6105","DOI":"10.18653\/v1\/2020.acl-main.543","article-title":"Do neural models learn systematicity of monotonicity inference in natural language?","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Yanaka","year":"2020"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"31","DOI":"10.18653\/v1\/W19-4804","article-title":"Can neural networks understand monotonicity reasoning?","volume-title":"Proceedings of BlackboxNLP","author":"Yanaka","year":"2019"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"250","DOI":"10.18653\/v1\/S19-1027","article-title":"Help: A dataset for identifying shortcomings of neural models in monotonicity reasoning","volume-title":"Proceedings of *SEM","author":"Yanaka","year":"2019"},{"key":"2023030119555550400_","first-page":"756","article-title":"Acquisition of phrase correspondences using natural deduction proofs","volume-title":"Proceedings of NAACL","author":"Yanaka","year":"2018"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"31","DOI":"10.3115\/1631862.1631868","article-title":"Local textual inference: Can it be defined or circumscribed?","volume-title":"Proceedings of the ACL Workshop on Empirical Modeling of Semantic Equivalence and Entailment","author":"Zaenen","year":"2005"},{"key":"2023030119555550400_","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1162\/tacl_a_00068","article-title":"Ordinal common-sense inference","volume":"5","author":"Zhang","year":"2017","journal-title":"Transactions of the Association for Computational Linguistics"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/49\/1\/199\/2073105\/coli_a_00465.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/49\/1\/199\/2073105\/coli_a_00465.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,9]],"date-time":"2023-03-09T08:52:08Z","timestamp":1678351928000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/49\/1\/199\/113488\/Curing-the-SICK-and-Other-NLI-Maladies"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":76,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,3,1]]},"published-print":{"date-parts":[[2023,3,1]]}},"URL":"https:\/\/doi.org\/10.1162\/coli_a_00465","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}