Article | REF: IN195 V1

Transformer: neural networks for automatic language processing

Author: François YVON

Publication date: March 10, 2022

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


Français

5. Glossary

Annotation; Labeling

Annotated data is needed to guide supervised learning. Annotations can relate to a text, a sentence, or even isolated words; they can be linguistic in nature (morphological, syntactic, semantic), or represent the output of a processing task (e.g. the polarity of a text, or the semantic equivalence between two sentences).

Refining; Finetuning

A model trained for a particular task (e.g. one on a language model task) can be transferred to another task by extending the training with other types of data or annotations: this is the refinement stage. In this way, the parameters of a model like BERT can be specialized using a few examples from a sentiment analysis task. Model refinement is one method of transfer learning.

Transfer Learning

Transfer learning...

You do not have access to this resource.

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


The Ultimate Scientific and Technical Reference

A Comprehensive Knowledge Base, with over 1,200 authors and 100 scientific advisors
+ More than 10,000 articles and 1,000 how-to sheets, over 800 new or updated articles every year
From design to prototyping, right through to industrialization, the reference for securing the development of your industrial projects

This article is included in

Digital documents and content management

This offer includes:

Knowledge Base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

Practical Path

Operational and didactic, to guarantee the acquisition of transversal skills

Doc & Quiz

Interactive articles with quizzes, for constructive reading

Subscribe now!

Ongoing reading
Glossary