大规模基础模型：表格中只罗列出参数量
大于7B以上模型。
| 模型 | 大小 | 时间 | 语言 | 架构 | 下载 | 项目 | 机构 | 备注 |
|---|---|---|---|---|---|---|---|---|
| XVERSE-MoE | 255B / A36B | 2024-09 | 中英 | MoE | 🤗HF | GitHub | xverse-ai | - |
| Qwen-2.5 | 0.5~72B (7档) | 2024-09 | 中英 | CD | 🤗HF | GitHub | QwenLM | Blog |
| Tele-FLM | 52B / 102B / 1TB | 2024-07 | 多语 | CD | 🤗HF | - | CofeAI | Paper |
| meta-llama-3.1 | 8B / 70B / 405B | 2024-07 | 多语 | CD | 🤗HF | GitHub | meta-llama | - |
| internlm2.5-Base | 7B | 2024-07 | 中英 | CD | 🤗HF | GitHub | InternLM | Technical Report |
| MAP-NEO-Base | 2B / 7B | 2024-06 | 中英 | CD | 🤗HF | GitHub | multimodal-art-projection | Paper |
| Nemotron-4-Base | 340B | 2024-06 | 多语 | CD | 🤗HF | - | NVIDIA | Technical Report |
| Index-Base | 1.9B | 2024-06 | 中英 | CD | 🤗HF | GitHub | bilibili | Report |
| Qwen2-Base | 0.5B / 2B / 5B / 7B / 72B | 2024-06 | 多语 | CD | 🤗HF | GitHub | QwenLM | Blog |
| GLM-4-Base | 9B | 2024-06 | 多语 | - | 🤗HF | GitHub | THUDM | - |
| Yi-1.5-Base | 6B / 9B / 34B | 2024-05 | 中英 | CD | 🤗HF | GitHub | 01-ai | Paper |
| DeepSeek-V2-Base | A21B / 236B | 2024-05 | 中英 | MoE | 🤗HF | GitHub | deepseek-ai | Paper |
| Llama-3-Base | 8B / 70B | 2024-04 | 多语 | CD | 🤗HF | GitHub | Meta Llama | - |
| Zhinao-Base | 7B | 2024-04 | 中英 | CD | 🤗HF · ModelScope | - | 奇虎科技 | - |
| XVERSE-MoE | A4.2B / 25.8B | 2024-04 | 中英 | MoE | 🤗HF | GitHub | xverse-ai | - |
| SoftTiger-Base | 13B / 70B | 2024-04 | 中英 | CD | 🤗HF | GitHub | TigerResearch | - |
| HammerLLM | 1.4B | 2024-04 | 中英 | - | 🤗HF | GitHub | DataHammer | - |
| Mengzi3-Base | 13B | 2024-04 | 中英 | CD | 🤗HF | GitHub | Langboat | - |
| Breeze-Base | 7B | 2024-02 | 中英 | - | 🤗HF | - | MediaTek Research | - |
| TowerBase | 7B / 13B | 2024-02 | 多语 | CD | 🤗HF | - | Unbabel | - |
| Qwen1.5-Base | 0.5~110B (7档) | 2024-02 | 中英 | - | 🤗HF | GitHub | Qwen | Blog |
| LongAlign-Base | 6B / 7B / 13B | 2024-02 | 中英 | - | 🤗HF | GitHub | THUDM | Paper |
| Chinese-Mixtral-Base | 8x7B | 2024-02 | 中英 | MoE | Baidu · 🤗HF | GitHub | Yiming Cui | - |
| iFlytekSpark-Base | 13B | 2024-01 | 中英 | CD | MindSpore | - | 科大讯飞 | - |
| Orion-Base | 14B | 2024-01 | 多语 | CD | 🤗HF | GitHub | OrionStarAI | Paper |
| YaYi2-Base | 30B | 2023-12 | 多语 | CD | 🤗HF | GitHub | wenge-research | Paper |
| Aquila2-Base | 7B / 34B / 70B | 2023-12 | 中英 | CD | 🤗HF | GitHub | FlagAI | - |
| Alaya-Base | 7B | 2023-12 | 中英 | CD | 🤗HF | GitHub | DataCanvas | - |
| Qwen-Base | 1.8B / 7B / 14B / 72B | 2023-12 | 中英 | CD | 🤗HF | GitHub | 阿里云 | Paper |
| DeepSeek-Base | 7B / 67B | 2023-11 | 中英 | CD | 🤗HF | GitHub | deepseek-ai | - |
| Yuan-2.0 | 2B / 51B / 102B | 2023-11 | 中英 | CD | GitHub · 🤗HF | GitHub | IEIT-Yuan | - |
| Yi-Base | 6B / 9B / 34B | 2023-11 | 中英 | CD | 🤗HF | GitHub | 01.AI | - |
| XVERSE-Base | 7B / 13B / 65B | 2023-11 | 多语 | CD | 🤗HF | GitHub | 元象科技 | - |
| Nanbeige-Base | 16B | 2023-11 | 中英 | CD | 🤗HF | GitHub | Nanbeige LLM Lab | - |
| LingoWhale | 8B | 2023-11 | 中英 | CD | 🤗HF | GitHub | DeepLang AI | - |
| Skywork-Base | 13B | 2023-10 | 中文 | CD | 🤗HF | GitHub | SkyworkAI | Paper |
| BlueLM-Base | 7B | 2023-11 | 中英 | CD | 🤗HF | GitHub | vivo AI Lab | - |
| ChatGLM3-Base | 6B | 2023-10 | 中英 | ND | 🤗HF | GitHub | THUDM | - |
| Ziya2-Base | 13B | 2023-10 | 中英 | CD | 🤗HF | GitHub | IDEA研究院 | - |
| OpenBA-LM | 15B | 2023-09 | 中英 | ED | 🤗HF | GitHub | OpenNLG Group | Paper |
| TigerBot-Base-70B | 80B | 2023-09 | 多语 | CD | 🤗HF | GitHub | 虎博科技 | Paper |
| FLM | 101B | 2023-09 | 中英 | CD | 🤗HF | - | CofeAI | - |
| Yuan-1.0 | 245B | 2021-09 | 中文 | CD | API | GitHub | 浪潮 | Paper |
| CPM-2 | 10B / 11B / 200B | 2021-06 | 中文 | ED | 申请 | GitHub | 智源研究院 | Paper |
| PanGu-Alpha | 13B / 200B | 2021-05 | 中文 | CD | 🤗HF | OpenI | 鹏城实验室 | Paper |
| PLUG | 27B | 2021-04 | 中文 | ED | 申请 | GitHub | 阿里巴巴 | - |
| GPT-3 | 13B / 30B | 2021-04 | 中文 | CD | TODO | ModelScope | 达摩院 | - |