InternLM team for shipping such brilliant model checkpoints!
Let's gooo! Intern LM 2.5 20B with Apache 2.0 license, up-to 1M context window & trained on copious amounts of synthetic data! ⚡️
> Beats Gemma 27B IT; MMLU: 73.5, MATH: 64.7
> Up-to 20% increase in the reasoning tasks from last iteration
> Support function calling and tool use
> Base & Instruct models released
> Along with the 20B they release 1.8B and 7B (both looking incredibly strong)
> Uses the same architecture as InternLM2
> Integrated with Transformers (remote code) 🤗
> Interesting bit: they use some form of iterative process to generate synthetic data, train and improve (would love to know more about this)https://huggingface.co/collections/internlm/internlm25-66853f32717072d17581bc13
Let's gooo! Intern LM 2.5 20B with Apache 2.0 license, up-to 1M context window & trained on copious amounts of synthetic data! ⚡️
> Beats Gemma 27B IT; MMLU: 73.5, MATH: 64.7
> Up-to 20% increase in the reasoning tasks from last iteration
> Support function calling and tool use
> Base & Instruct models released
> Along with the 20B they release 1.8B and 7B (both looking incredibly strong)
> Uses the same architecture as InternLM2
> Integrated with Transformers (remote code) 🤗
> Interesting bit: they use some form of iterative process to generate synthetic data, train and improve (would love to know more about this)https://huggingface.co/collections/internlm/internlm25-66853f32717072d17581bc13
huggingface.co
InternLM2.5 - a internlm Collection
We’re on a journey to advance and democratize artificial intelligence through open source and open science.