Motif Technologies disputes South Korean AI model evaluation results

Motif Technologies has filed a formal objection regarding its exclusion from the second stage of the government’s independent AI foundation model project. Despite its ‘Motif3’ model ranking first among four elite teams in the global ‘Intelligence Index’ benchmark by Artificial Analysis, the company received low scores in expert and user evaluations during the South Korean government’s assessment.

Motif is demanding that the Ministry of Science and ICT disclose detailed evaluation scores, specific criteria, and the methodology used for user and blind evaluations. The company specifically questioned the scoring conversion process, noting that a significant 16-point gap in global benchmark scores was reduced to only a 4-point difference when converted to the government’s 25-point scale. Motif stated that its goal is to seek transparency and improvements in the evaluation process rather than simply demanding selection.