Contact
Assess · EuroLLM

Can you own it?

Ownership levelSubstantialnone·limited·partial·substantial·fullAnalytical input C · 69.2/100

This page is a projection of the one entry record, the Use & modify and Transparency factors that Assess covers. The full verdict is set by all four factors together, floor-weighted so the weakest caps the whole.

Which domain expands which factor
  • AssessUse & modify + Transparency
  • ImplementData control + Doesn't fail you
  • UseDoesn't fail you
  • SupportTransparency

Intended & out-of-scope use

Deploy EuroLLM for multilingual, EU-facing text generation, assistant workloads and machine translation across all 24 official EU languages plus roughly 11 more - its realistic differentiator is language breadth in a genuinely European, Apache-2.0 model, not raw capability. It is an EU-funded, open-weight family - EuroLLM-9B and EuroLLM-1.7B, each in base and instruction-tuned form - built by a European consortium (Unbabel, Instituto Superior Técnico / Instituto de Telecomunicações, the University of Edinburgh and partners) on EuroHPC compute under Horizon Europe.

For adoption, deploy the Instruct (safety-tuned) variant; the base checkpoints are untuned research artifacts and are out of scope for customer-facing use. EuroLLM is not a frontier model and is not positioned for high-stakes, autonomous, or safety-critical decision-making without the external control stack described in the Implement domain. Because per-language quality and safety are uneven, treat any single target language as unverified until you evaluate it.

Known limitations, bias & failure modes

  • 9B capability ceiling. EuroLLM-9B leads its size class for multilingual EU coverage, but a 9B model's raw single-language reasoning is well below frontier; do not expect category-topping performance on hard English reasoning.
  • Short 4k context. Both sizes use a 4,096-token context window, short by current standards - chunk or retrieve rather than relying on long-context recall.
  • Uneven per-language quality and safety. With 35 languages sharing capacity, quality and safety behaviour vary by language and are not uniformly evaluated.
  • Base checkpoints are untuned. No safety tuning; treat them as research artifacts.

The offsetting advantage is EU-native multilingual breadth under a clean open licence.

Openness tier & components

EuroLLM earns open_weights_recipe. The weights (base + Instruct) are Apache-2.0 and the documentation is genuinely open: a detailed technical report (arXiv 2506.04079) covers the tokenizer, architecture, the ~4T-token data mixture and the training procedure, and the team additionally releases the EuroFilter multilingual data-filter classifier and the EuroBlocks-Synthetic post-training dataset. It stops short of the top "fully open" tier because the complete pre-training corpus and an end-to-end training repository are not published as downloadable artifacts (training was run on the open Megatron-LM codebase), so training_data, training_code and evaluation are partial rather than open. This is more open than a plain open-weights release but short of a full open-science reproduction.

License terms & permitted use

Apache-2.0 across base and Instruct weights. It is OSI-approved, with no field-of-use restriction and unconditional commercial use - no "community licence" caveats. You may use, modify, redistribute, and commercialize derivatives, subject only to the standard Apache attribution/notice terms. This clean licence is a load-bearing input to the openness (4) and legal (4) scores.

Supply-chain & provenance

Weights are distributed from the verified utter-project org on Hugging Face in safetensors (no pickle requirement) with per-file checksums. The technical report documents the pipeline and names the data sources, so provenance is well-described. The checkpoint trust checklist scores 5/8; the missing controls are cryptographic weight signing (Sigstore/model-signing), SLSA build attestation, and full-corpus publication for independent reconstruction - which is why provenance is a 4, not a 5. No incidents or malicious-mirror findings are on record for the canonical org. Pin the exact revision and verify checksums on download.

EU AI Act posture

EuroLLM is a GPAI model but sits well under the 10²⁵-FLOPs systemic-risk threshold (a 9B model trained on ~4T tokens is on the order of 10²³ FLOPs), so no Article 55 regime applies. It is EU-domiciled, released under a genuine OSI free/open-source licence and not monetised, so it plausibly qualifies for the Article 53 open-source exemption from the Annex XI/XII technical-documentation duties. The two obligations that survive the exemption - a copyright policy and a public training-content summary - are partly dischargeable from the technical report, which documents the data mixture (FineWeb-edu, HPLT, MADLAD-400, CulturaX, mC4, The Stack) and the EuroFilter pipeline, though not from a fully published corpus. Combined with EU domicile and Apache licensing, this gives EuroLLM one of the cleanest EU AI Act postures in the registry. A fine-tuner who places a derivative on the EU market may become a provider for that derivative, but inherits an unusually clean and well-documented upstream package.

Benchmarks & evaluation

OneHill did not run its own benchmarks this session; the figures below are aggregated from the EuroLLM-9B technical report (ev-tech-report) and independent reviews (ev-moonlight, ev-index-bench). The consistent picture: EuroLLM-9B is on par with Gemma-2-9B on multilingual EU-language benchmarks (Arc-challenge, Hellaswag, MMLU via Okapi), ahead on WMT24++ translation (COMET), and matches Mistral-7B on English. Its value proposition is breadth of EU-language coverage at 9B, not category-topping raw capability. Treat published scores as third-party/in-class rather than a claim of frontier leadership.

How this scores

The ownership factors this domain covers, drawn from the one entry record.

1

Use and modify freelyCan you run, modify and adapt it with no gate and no field-of-use trap?

Strong

OSI-approved Apache-2.0 across base and Instruct weights with unconditional commercial use and no field-of-use limits - run, fine-tune, redistribute and commercialise it freely.

How this scores (AOI sub-dimensions)
Openness4/5how much is released - weights, data, code, licence - and how freelyGenuinely open-weight-plus-recipe: Apache-2.0 base and Instruct weights, a detailed technical report (arXiv 2506.04079) documenting tokenizer, architecture, the data mixture and training procedure, plus the released EuroFilter classifier and the EuroBlocks-Synthetic post-training dataset.
Legal4/5how permissive and clean the licence is for real commercial useOSI-approved Apache-2.0 with unconditional commercial use and no field-of-use limits, across base and Instruct weights; EU-domiciled and well under the systemic-risk compute threshold, giving a clean Article 53 open-source-exemption posture.
2

TransparencyDo you know what it is: weights, training, behaviour, and legible terms?

Moderate

Open-weights-plus-recipe, but only partial data openness: the technical report documents the tokenizer, architecture, data mixture and training procedure, and the released SFT dataset (EuroBlocks-SFT-2512) plus the EuroFilter artifact make the recipe inspectable - yet the ~4T-token pre-training corpus is described, not published as one dataset, so this is stronger than weights-only but weaker than a fully-open model (cf. OLMo) and not reproducible from a released corpus.

How this scores (AOI sub-dimensions)
Provenance3/5how well we can trace and verify what went into the modelDistributed from the verified utter-project org on Hugging Face in safetensors with per-file checksums (checklist ~5/8); the technical report makes the pipeline well-documented and the data sources are named.
Governance3/5how accountable and well-documented the publisher isAn EU-funded consortium with named academic and industrial partners, detailed technical reports and a clear release cadence (1.7B -> 9B -> 22B).
What this means for adoptionYou fully own the use of these Apache-2.0 weights - clean across 9B, 1.7B and 22B-Instruct-2512, with unconditional commercial use and no field-of-use limits - and, self-hosted and EU-domiciled, you keep your data entirely. It stays short of full because data openness is partial, not full: the SFT set (EuroBlocks-SFT-2512) is released but the ~4T-token pre-training corpus is only described, so you can inspect the recipe but not reproduce it from a released corpus as with a fully-open model; the 9B size, 4k context and uneven multilingual safety also cap reliability. Adopt it for multilingual EU-facing work that fits inside 4k, behind your own guardrails; look elsewhere for a long-context or frontier engine.

Sources

The same evidence records as the entry sheet. Read means the text was verified; unverified means it is known to exist but not yet read.

Vendor announcementunverified2026-07-25
EuroLLM is presented as an open-source European multilingual LLM suite covering all 24 official EU languages plus additional strategic languages, developed by an EU-funded consortium.
Model cardread2026-07-25
EuroLLM-9B-Instruct model card, read verbatim: hosted on the verified utter-project org on Hugging Face in safetensors under Apache-2.0, trained on 4T tokens, instruction-tuned on EuroBlocks, a 4k context and a documented chat template (BOS id 1 / EOS id 4); noted as not preference-aligned (may hallucinate or produce harmful content); comparable to Gemma-2-9B on EU languages and Mistral-7B on English.
Model cardread2026-07-25
EuroLLM-1.7B-Instruct model card, read verbatim: 1.7B parameters, a 4,096-token context, coverage of 35 languages, Apache-2.0, and comparable to Gemma-7B on machine-translation benchmarks.
Technical_reportread2026-07-25
EuroLLM-9B: Technical Report (arXiv 2506.04079), read verbatim: EuroLLM is trained from scratch to cover all 24 official EU languages plus 11 more, and documents the tokenizer, architecture, ~4T-token data mixture, EuroFilter pipeline, EuroBlocks-Synthetic post-training set and Megatron-LM training; the report frames its "Open release" as the "Public availability of models, filters, and datasets."
Documentationread2026-07-25
EuroLLM-22B-Instruct-2512 model card, read verbatim: openness is PARTIAL, not fully-open - the SFT dataset EuroBlocks-SFT-2512 IS released (utter-project/EuroBlocks-SFT-2512), but the ~4T-token pretraining corpus (web, parallel, Wikipedia, Arxiv, books, math, code, Apollo) is only described, not published as one downloadable dataset.
Vendor announcementunverified2026-07-25
The EuroLLM team's release blog describes EuroLLM-9B, its EU consortium and EU funding (EuroHPC / Horizon Europe), multilingual coverage, Apache-2.0 licensing and the release of the models, filter and synthetic post-training data.
Licenceread2026-07-25
EuroLLM base and Instruct weights - 9B, 1.7B and 22B-Instruct-2512 - are distributed under OSI-approved Apache-2.0 with unconditional commercial use and no field-of-use limits (the licence is not a preference-alignment/safety grant, and the cards warn the models may hallucinate).
Third-party analysisunverified2026-07-25
The European Commission's Open Source Observatory profiles EuroLLM as EU-funded pioneering European open-source AI released under an open licence.
Third-party analysisunverified2026-07-25
An independent review of the EuroLLM-9B technical report reports it on par with Gemma-2-9B on multilingual benchmarks, ahead on WMT24++ translation, and matching Mistral-7B on English.
Third-party analysisunverified2026-07-25
Independent coverage ranks EuroLLM among the leading European-developed open models for multilingual EU-language performance.
Third-party analysisunverified2026-07-25
EuroLLM safetensors checkpoints load on mainstream serving stacks (vLLM, llama.cpp, Ollama, TGI, transformers), with community GGUF/MLX/GPTQ quants and a hosted NVIDIA NIM endpoint available.