<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="garneau-lamontagne-2023-guided">
    <titleInfo>
        <title>Guided Beam Search to Improve Generalization in Low-Resource Data-to-Text Generation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Nicolas</namePart>
        <namePart type="family">Garneau</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Luc</namePart>
        <namePart type="family">Lamontagne</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 16th International Natural Language Generation Conference</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">C</namePart>
            <namePart type="given">Maria</namePart>
            <namePart type="family">Keet</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Hung-Yi</namePart>
            <namePart type="family">Lee</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sina</namePart>
            <namePart type="family">Zarrieß</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Prague, Czechia</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we introduce a new beam search algorithm that improves the generalization of neural generators to unseen examples, especially in low-resource data-to-text settings. Our algorithm aims to reduce the number of omissions and hallucinations during the decoding process. For this purpose, it relies on two regression models to explicitly characterize factual errors. We explain how to create a new dataset to train these models given an original training set of less than a thousand data points. We apply our approach in the low-resource, legal setting using the French Plum2Text dataset, as well as in English using WebNLG. We observe in our experiment that this combination improves the faithfulness of pre-trained neural text generators using both human and automatic evaluation. Moreover, our approach offers a level of interpretability by predicting the number of omissions and hallucinations present in a given generation with respect to the input data. Finally, we visualize our algorithm’s exploration of the hypothesis space at different steps during the decoding process.</abstract>
    <identifier type="citekey">garneau-lamontagne-2023-guided</identifier>
    <identifier type="doi">10.18653/v1/2023.inlg-main.1</identifier>
    <location>
        <url>https://aclanthology.org/2023.inlg-main.1</url>
    </location>
    <part>
        <date>2023-09</date>
        <extent unit="page">
            <start>1</start>
            <end>14</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Guided Beam Search to Improve Generalization in Low-Resource Data-to-Text Generation
%A Garneau, Nicolas
%A Lamontagne, Luc
%Y Keet, C. Maria
%Y Lee, Hung-Yi
%Y Zarrieß, Sina
%S Proceedings of the 16th International Natural Language Generation Conference
%D 2023
%8 September
%I Association for Computational Linguistics
%C Prague, Czechia
%F garneau-lamontagne-2023-guided
%X In this paper, we introduce a new beam search algorithm that improves the generalization of neural generators to unseen examples, especially in low-resource data-to-text settings. Our algorithm aims to reduce the number of omissions and hallucinations during the decoding process. For this purpose, it relies on two regression models to explicitly characterize factual errors. We explain how to create a new dataset to train these models given an original training set of less than a thousand data points. We apply our approach in the low-resource, legal setting using the French Plum2Text dataset, as well as in English using WebNLG. We observe in our experiment that this combination improves the faithfulness of pre-trained neural text generators using both human and automatic evaluation. Moreover, our approach offers a level of interpretability by predicting the number of omissions and hallucinations present in a given generation with respect to the input data. Finally, we visualize our algorithm’s exploration of the hypothesis space at different steps during the decoding process.
%R 10.18653/v1/2023.inlg-main.1
%U https://aclanthology.org/2023.inlg-main.1
%U https://doi.org/10.18653/v1/2023.inlg-main.1
%P 1-14

Markdown (Informal)

[Guided Beam Search to Improve Generalization in Low-Resource Data-to-Text Generation](https://aclanthology.org/2023.inlg-main.1) (Garneau & Lamontagne, INLG-SIGDIAL 2023)

• Guided Beam Search to Improve Generalization in Low-Resource Data-to-Text Generation (Garneau & Lamontagne, INLG-SIGDIAL 2023)

ACL

• Nicolas Garneau and Luc Lamontagne. 2023. Guided Beam Search to Improve Generalization in Low-Resource Data-to-Text Generation. In Proceedings of the 16th International Natural Language Generation Conference, pages 1–14, Prague, Czechia. Association for Computational Linguistics.