Tool
Compar:ia, the AI comparator
Edited by :
Ministère de la Culture et la Direction interministérielle du numérique (DINUM)
Summary
Compar:IA is a free tool developed by the French Ministry of Culture’s digital service.
According to the Ministry, Compar:IA aims to address three major issues:
1. Raising citizen awareness about generative AI and its challenges
2. Ensuring diversity in francophone cultures within AI conversational models
3. Promoting transparency in generative AI models
Compar:IA uses the Ecologits methodology, developed by GenAI Impact, to calculate the footprint of each generative AI service.
The editorial perspective
This tool is very interesting and comprehensive for analysts and commentators.
In a few words, I am rather convinced by it.
The educational effort behind it is laudable, as it allows users to assess and compare AI models and often realize that less energy-intensive models can produce equally relevant results.
Compar:IA is an excellent tool for encouraging critical thinking about the AI tools we use.
However, its target audience remains unclear:
- It is too broad for a highly technical audience
- It is too technical for the general public
- It does not fit into regular user workflows
This remark is offset by the addition, in the second phase, of a selector when launching the comparison. The selector provides the ability to "filter" according to relevant choices that particularly highlight the frugality (or, conversely, the excessive energy consumption) of certain languages. Users can choose to compare energy-efficient models with each other, contrast large models against smaller ones, or directly select the models they want to compare.
Educational tools help gradually inform public opinion about the environmental footprint of products and services. However, raising awareness alone is not enough—these efforts must be integrated into everyday behaviors to be effective.
For example, repairability scores and energy efficiency labels on products provide clear and simple consumer information. For this awareness website to be useful, used, and usable, distribution and adoption will be crucial.
A related concern is the potential rebound effect of this initiative—since each prompt generates two AI responses, this doubles the computational workload.
In brief, the editorial perspective
The most
- The ability to compare two AIs
- The educational effort with a clear interface encouraging reflection
- The detailed results presentation and the impact of generating them
- The ability to choose the types of models to compare using highly relevant filters to highlight frugality.
The least
- The energy consumption of the interface, which processes two language models per prompt; one can imagine potential misuse where people use it to access more results
- It is unclear whether the target audience is well-defined: who will use this service? What is the tool’s capacity to reach a broad audience?
Publication date
October 2024
Available in
- French
License
Etalab-2.0 license