Browsing Congressos (Departament de Traducció i Ciències del Llenguatge) by Author "Kervadec, Corentin"

Now showing items 1-2 of 2

Bridging information-theoretic and geometric compression in language models

Cheng, Emily; Kervadec, Corentin; Baroni, Marco (ACL (Association for Computational Linguistics), 2023)

For a language model (LM) to faithfully model human language, it must compress vast, potentially infinite information into relatively few dimensions. We propose analyzing compression in (pre-trained) LMs from two points ...
Unnatural language processing: how do language models handle machine-generated prompts?

Kervadec, Corentin; Franzon, Francesca; Baroni, Marco (ACL (Association for Computational Linguistics), 2023)

Language model prompt optimization research has shown that semantically and grammatically well-formed manually crafted prompts are routinely outperformed by automatically generated token sequences with no apparent meaning ...

Now showing items 1-2 of 2

Search DSpace

In collaboration with Compliant to Partaking