Annex XI Technical documentation referred to in Article 53(1), point (a) — technical documentation for providers of general-purpose AI models


  1. Section 1 Information to be provided by all providers of general-purpose AI models

    1. The technical documentation referred to in Article 53(1), point (a) shall contain at least the following information as appropriate to the size and risk means the combination of the probability of an occurrence of harm and the severity of that harm; profile of the model:

      1. A general description of the general-purpose AI model means an AI model, including where such an AI model is trained with a large amount of data using self-supervision at scale, that displays significant generality and is capable of competently performing a wide range of distinct tasks regardless of the way the model is placed on the market and that can be integrated into a variety of downstream systems or applications, except AI models that are used for research, development or prototyping activities before they are placed on the market; including:

        1. the tasks that the model is intended to perform and the type and nature of AI systems means a machine-based system that is designed to operate with varying levels of autonomy and that may exhibit adaptiveness after deployment, and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments; in which it can be integrated;

        2. the acceptable use policies applicable;

        3. the date of release and methods of distribution;

        4. the architecture and number of parameters;

        5. the modality (e.g. text, image) and format of inputs and outputs;

        6. the licence.

      2. A detailed description of the elements of the model referred to in point 1, and relevant information of the process for the development, including the following elements:

        1. the technical means (e.g. instructions of use, infrastructure, tools) required for the general-purpose AI model means an AI model, including where such an AI model is trained with a large amount of data using self-supervision at scale, that displays significant generality and is capable of competently performing a wide range of distinct tasks regardless of the way the model is placed on the market and that can be integrated into a variety of downstream systems or applications, except AI models that are used for research, development or prototyping activities before they are placed on the market; to be integrated in AI systems means a machine-based system that is designed to operate with varying levels of autonomy and that may exhibit adaptiveness after deployment, and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments;;

        2. the design specifications of the model and training process, including training methodologies and techniques, the key design choices including the rationale and assumptions made; what the model is designed to optimise for and the relevance of the different parameters, as applicable;

        3. information on the data used for training, testing and validation, where applicable, including the type and provenance of data and curation methodologies (e.g. cleaning, filtering, etc.), the number of data points, their scope and main characteristics; how the data was obtained and selected as well as all other measures to detect the unsuitability of data sources and methods to detect identifiable biases, where applicable;

        4. the computational resources used to train the model (e.g. number of floating point operations), training time, and other relevant details related to the training;

        5. known or estimated energy consumption of the model.

        With regard to point (e), where the energy consumption of the model is unknown, the energy consumption may be based on information about computational resources used.

  2. Section 2 Additional information to be provided by providers of general-purpose AI models with systemic risk

    1. A detailed description of the evaluation strategies, including evaluation results, on the basis of available public evaluation protocols and tools or otherwise of other evaluation methodologies. Evaluation strategies shall include evaluation criteria, metrics and the methodology on the identification of limitations.

    2. Where applicable, a detailed description of the measures put in place for the purpose of conducting internal and/or external adversarial testing (e.g. red teaming), model adaptations, including alignment and fine-tuning.

    3. Where applicable, a detailed description of the system architecture explaining how software components build or feed into each other and integrate into the overall processing.

We're continuously improving our platform to serve you better.

Your feedback matters! Let us know how we can improve.

Found a bug?

Springflod is a Swedish boutique consultancy firm specialising in cyber security within the financial services sector.

We offer professional services concerning information security governance, risk and compliance.

Crafted with ❤️ by Springflod