Article | REF: R727 V1

Artificial intelligence evaluation

Author: Guillaume AVRIN

Publication date: February 10, 2023

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


Français

4. Evaluation campaigns: benchmarking, challenges and competitions

4.1 Benchmarking campaign

The aim of a benchmarking campaign is to carry out a comparative evaluation (parangonnage) of the performance of different AI systems designed to automate a specific task, at a given time and place.

  • LNE's past experience in organizing assessment campaigns has led to the identification of best practices for guaranteeing the value of the results obtained. In particular, this means ensuring that the campaign is :

    • scientific: while preserving the demonstration aspect typically associated with evaluation campaigns, these must be based on the scientific criteria of objectivity of evaluation, repeatability of performance measurement and reproducibility of experiments,...

You do not have access to this resource.

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


The Ultimate Scientific and Technical Reference

A Comprehensive Knowledge Base, with over 1,200 authors and 100 scientific advisors
+ More than 10,000 articles and 1,000 how-to sheets, over 800 new or updated articles every year
From design to prototyping, right through to industrialization, the reference for securing the development of your industrial projects

This article is included in

Software technologies and System architectures

This offer includes:

Knowledge Base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

Practical Path

Operational and didactic, to guarantee the acquisition of transversal skills

Doc & Quiz

Interactive articles with quizzes, for constructive reading

Subscribe now!

Ongoing reading
Evaluation campaigns: benchmarking, challenges and competitions