ISO/IEC AWI 23282

A working group has prepared a draft.

Abstract

This document specifies the evaluation of natural language processing systems, in the sense of measuring the quality of a system’s results to assess its functional suitability. It provides a definition of evaluation methods for those systems, together with guidance on how to select, implement and interpret those evaluation methods. This document covers quantitative metrics as well as other evaluation methods. It includes requirements on the implementation of the described metrics, and further requirements on the technical resources involved in the evaluation process.

General information

Status
: Under development

Stage
: New project registered in TC/SC work programme [20.00]
Edition
: 1
Technical Committee :
ISO/IEC JTC 1/SC 42
RSS updates