Benchmarking Natural Language Inference and Semantic Textual Similarity for Portuguese

Two sentences can be related in many different ways. Distinct tasks in natural language processing aim to identify different semantic relations between sentences. We developed several models for natural language inference and semantic textual similarity for the Portuguese language. We took advantage...

Full description

Bibliographic Details
Main Authors: Pedro Fialho, Luísa Coheur, Paulo Quaresma
Format: Article
Language:English
Published: MDPI AG 2020-10-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/11/10/484
Description
Summary:Two sentences can be related in many different ways. Distinct tasks in natural language processing aim to identify different semantic relations between sentences. We developed several models for natural language inference and semantic textual similarity for the Portuguese language. We took advantage of pre-trained models (BERT); additionally, we studied the roles of lexical features. We tested our models in several datasets—ASSIN, SICK-BR and ASSIN2—and the best results were usually achieved with ptBERT-Large, trained in a Brazilian corpus and tuned in the latter datasets. Besides obtaining state-of-the-art results, this is, to the best of our knowledge, the most all-inclusive study about natural language inference and semantic textual similarity for the Portuguese language.
ISSN:2078-2489