3. Basic automatic text processing techniques

A wide range of processing operations are carried out on the texts as they are processed. Delimiting the words in the text, assigning them a linguistic label and identifying the syntactic relationships between them are the prerequisites for processing the data in the applications we have just described . The standard processing chain transforms the raw text into a list of forms presented line by line (segmented and verticalized text), to which morphological, grammatical and possibly semantic linguistic properties are associated.

The techniques developed are generally characterized by a combination...

You do not have access to this resource.

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!

The Ultimate Scientific and Technical Reference

A Comprehensive Knowledge Base, with over 1,200 authors and 100 scientific advisors

+ More than 10,000 articles and 1,000 how-to sheets, over 800 new or updated articles every year

From design to prototyping, right through to industrialization, the reference for securing the development of your industrial projects

This article is included in

Digital documents and content management

This offer includes:

Knowledge Base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

Practical Path

Operational and didactic, to guarantee the acquisition of transversal skills

Doc & Quiz

Interactive articles with quizzes, for constructive reading

Subscribe now!

Ongoing reading
Basic automatic text processing techniques

Previous
page Search and retrieval of textual information

Resources for automatic text processing

Bibliography

(1) - JURAFSKY (D.), MARTIN (J.H.) - Speech and language processing – An introduction to natural language processing, computational linguistics, and speech recognition. - (2009).
(2) - LALLICH-BOIDIN (G.), MARET (D.) - Recherche d'information et traitement...

Software tools

References for tools and resources cited in the article :

TreeTagger: morpho-syntactic labeling and lemmatization. University of Stuttgart http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/

Lexico: text statistics tool. Paris 3 University

Websites

Portals on language technologies and language resources

CNRTL Centre National de Ressources Textuelles et Lexicales http://www.cnrtl.fr/

ELRA – European Language Resources Association http://www.elra.info/

Language Technology World, DFKI...

Standards and norms

TEI (Text Encoding Initiative) consortium created in 1987 to produce recommendations for standardizing the encoding of digital documents http://www.tei-c.org

Events

TALN (Traitement Automatique des Langues Naturelles) international French-language conference organized annually since 1994 by the ATALA Association pour le Traitement Automatique des Langues.