
Moonshot AI 公开 Kimi K3.1 Pro 模型权重
来源标题:Kimi K3.1 Pro model weights are out
Moonshot AI 已在 Hugging Face 发布 Kimi K3.1 Pro 的模型权重,采用 kimi-k3.1-pro 许可证。该模型为图文到文本(Image-Text-to-Text)模型,支持 Transformers、vLLM 等框架及推理服务商调用,并提供 8-bit 量化版本。
以下正文同步自 Hacker News,版权归原站所有,已转换为易读排版。
Like 214
Follow
Moonshot AI 20.4k
Image-Text-to-Text
Transformers
Safetensors
kimi_k31
text-generation
compressed-tensors
conversational
custom_code
Eval Results
8-bit precision
License: kimi-k3.1-pro
Model card Files Files and versions xet
Community 1
Deploy
Copy to bucket
Use this model Instructions to use moonshotai/Kimi-K3.1-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Libraries
Transformers How to use moonshotai/Kimi-K3.1-Pro with Transformers:
Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-text-to-text", model="moonshotai/Kimi-K3.1-Pro", trust_remote_code=True)
pip install -U transformers accelerate
Load model directly
from transformers import AutoModelForSeq2SeqLM model = AutoModelForSeq2SeqLM.from_pretrained("moonshotai/Kimi-K3.1-Pro", trust_remote_code=True, device_map="auto")
Inference
Inference Providers
HuggingChat
Notebooks
Google Colab
Kaggle
Local Apps Settings
vLLM How to use moonshotai/Kimi-K3.1-Pro with vLLM:
Install vLLM from pip:
pip install vllm
Start the vLLM server:
vllm serve "moonshotai/Kimi-K3.1-Pro"
Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions"
-H "Content-Type: application/json"
--data '{
"model": "moonshotai/Kimi-K3.1-Pro",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'
Use Docker
docker model run hf.co/moonshotai/Kimi-K3.1-Pro
SGLang How to use moonshotai/Kimi-K3.1-Pro with SGLang:
Install SGLang from pip:
pip install sglang
Start the SGLang server:
python3 -m sglang.launch_server
--model-path "moonshotai/Kimi-K3.1-Pro"
--host 0.0.0.0
--port 30000
Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions"
-H "Content-Type: application/json"
--data '{
"model": "moonshotai/Kimi-K3.1-Pro",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'
Use Docker images
docker run --gpus all
--shm-size 32g
-p 30000:30000
-v ~/.cache/huggingface:/root/.cache/huggingface
--env "HF_TOKEN=<secret>"
--ipc=host
lmsysorg/sglang:latest
python3 -m sglang.launch_server
--model-path "moonshotai/Kimi-K3.1-Pro"
--host 0.0.0.0
--port 30000
Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions"
-H "Content-Type: application/json"
--data '{
"model": "moonshotai/Kimi-K3.1-Pro",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "Describe this image in one sentence."
},
{
"type": "image_url",
"image_url": {
"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
}
}
]
}
]
}'
Docker Model Runner How to use moonshotai/Kimi-K3.1-Pro with Docker Model Runner:
docker model run hf.co/moonshotai/Kimi-K3.1-Pro
- Model Introduction Coding benchmarks
Agentic benchmarks
Reasoning, knowledge, and multimodal benchmarks
Cybersecurity benchmarks
- Model Summary Coding benchmarks
Agentic benchmarks
Reasoning, knowledge, and multimodal benchmarks
Cybersecurity benchmarks
- Evaluation Results Coding benchmarks
Agentic benchmarks
Reasoning, knowledge, and multimodal benchmarks
Cybersecurity benchmarks
-
Deployment and Availability
-
Model Usage
-
License
-
Contact Us
📰 Tech Blog | 🚀 API Quickstart
- Model Introduction
Kimi K3.1 Pro is an open-weight, natively multimodal agentic model, and our most capable 3T-class model to date. Post-trained from Kimi K3 with large-scale joint reinforcement learning across hundreds of downstream domains, it is the first model in the K3.1 series. With a 1-million-token context window, Kimi K3.1 Pro delivers substantial improvements in coding, 3D creation, financial research, factual accuracy, and other agentic capabilities.
- Model Summary
Architecture Mixture-of-Experts (MoE)
Total Parameters 2.8T
Activated Parameters 104B
Number of Layers 93
Number of Dense Layers 1
Attention-Layer Composition 69 KDA + 24 Gated DSA*
Attention Hidden Dimension 7168
Number of Attention Heads 96
DSA Index Head Dimension 128
DSA Index Number of Heads 32
DSA Index Top-K 2048
Latent MoE Dimension 3584
MoE Hidden Dimension (per Expert) 3072
Number of Experts 896
Selected Experts per Token 16
Number of Shared Experts 2
Vocabulary Size 160K
Context Length 1048576
Attention Mechanism KDA & Gated DSA
Activation Function SiTU-GLU
Vision Encoder MoonViT-V2
Parameters of Vision Encoder 401M
Quantization MXFP4 weights / MXFP8 activations (quantization-aware training)
Modality Text, Image
- Compared with Kimi K3, we replace the full-attention Gated MLA layers with Gated DeepSeek Sparse Attention (Gated DSA) layers for more efficient long-context modeling.
- Evaluation Results
Unless otherwise specified, all Kimi K3.1 Pro results use reasoning effort max, temperature = 1.0, and top-p = 0.95. A dash (—) means that the source table does not report a score. Higher scores are better except where the benchmark name explicitly states lower is better; Elo scores and other benchmark-specific metrics are not directly comparable with accuracy or pass-rate scores.
Coding benchmarks
Terminal-Bench 4.0. Kimi K3.1 Pro is evaluated with the Claude Code harness. The DeepSeek-V4.1-Flash-1017 score is taken from its release blog. All remaining scores are the maximum values reported in model blog posts or on the official Terminal-Bench leaderboard.
Terminal-Bench-Science 0.1. Kimi K3.1 Pro is evaluated with Claude Code. Internal evaluation of DeepSeek-V4.1-Flash-1017 yields 9.3; the table instead reports 15.7 for the older DeepSeek-V4.1-Flash from the official leaderboard. All remaining scores are from the Terminal-Bench-Science leaderboard.
SWE-Marathon v1.1. Kimi K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated with Claude Code. Other scores are from the official leaderboard.
ProgramBench. The table reports binary scores: a task receives 1 if its ProgramBench score is at least 95%, and 0 otherwise. K3.1 Pro is evaluated with Claude Code. DeepSeek and GLM scores are taken from the DeepSeek release blog; remaining scores are from Vals AI.
DeepSWE v1.1. K3.1 Pro is evaluated with Claude Code. Other scores come from the respective technical reports for GPT-6 Astra, Claude Opus 5.5, Claude Fable 5.1, DeepSeek-V4.1-Flash-1017, and GLM-5.3.
PostTrainBench. K3.1 Pro and DeepSeek-V4.1-Flash-1017 are evaluated internally on v1.2 with Claude Code and H20 GPUs rather than H100 GPUs. For stable evaluation, all judge models use DeepSeek-V4.1-Flash-1017 at maximum effort, which best matched the official GPT-5.6-Terra (xhigh) judge in testing. Other scores are from the official leaderboard.
Kimi Code Bench 2.0 and Kimi Code Bench 3.0 Long-horizon. These are internal benchmarks. K3.1 Pro is evaluated with Claude Code; all other models use their maximum-effort setting. Proprietary-model testing may involve fallback behavior.
BenchCAD. Open models are evaluated on 1,000-case subsets randomly sampled from the 17,900-case Vision2Code dataset at maximum reasoning effort. With-tools results use Claude Code; without-tools results use single-shot generation with official prompts and scoring. Claude scores are from the Opus 5.5 System Card, and GPT-6 Astra's with-tools score is from its official report. GPT-6 Astra has no reported without-tools score.
Agentic benchmarks
BioMysteryBench. Uses the official v11 release, with Kimi K3 as judge. K3.1 Pro uses Kimi Code; GLM-5.3 and DeepSeek-V4.1-Flash-1017 use Claude Code; GPT-6 Astra uses Codex. Claude scores are from official system cards.
Agents' Last Exam. Uses the official v1.1 release, comprising 122 tasks, including 86 CLI tasks. Runs that bypass stated requirements receive zero. DeepSeek and Kimi are evaluated with Claude Code and Kimi Code, respectively; other results are from the official benchmark website.
OfficeQA Pro and OfficeQA Pro v2. GPT-6 Astra uses Codex; other models use Claude Code. Each task provides the complete PDF corpus as page images without machine-readable text. External-model trajectories that retrieve reference answers online receive zero for those tasks.
Frontier Finance. Evaluated with the official Finance Agent v2 harness.
HANDBOOK.md. Evaluated with the official OpenHands-based harness, using tasks from the benchmark's early open-source v1 release.
Harvey Legal Agent. Evaluated on 1,251 public tasks with Artificial Analysis's Stirrup harness. The reported score is the all-pass rate: the percentage of tasks passing every rubric criterion.
OSWorld V2.1. Kimi models use the Kimi Agent harness in the official OSWorld v2 repository. GPT-6 Astra's score is taken from Muse Wonder's technical report.
DECK-Arena and Design Bench. DECK-Arena evaluates presentation generation on real-world queries; Design Bench covers graphic design through direct and reference-image few-shot prompting. Both evaluate python-pptx, pptxjs, and Kimi's in-house DSL in a harness with integrated search and image generation. The automated grader is calibrated on more than 10,000 human judgments.
BrowseComp. Uses context compaction triggered at 200K tokens and a 500-step maximum. If the limit is reached, the agent is forced to answer before judging. All runs use temperature = 1.0 and top-p = 1.0.
GDPval-AA v2.1, AA-Briefcase v1.1, and AutomationBench-AA. Scores are cited from Artificial Analysis. APEX-Agents. Scores are cited from the official leaderboard.
Tool-augmented multimodal evaluations. GDP.pdf w/ python, ZeroBench w/ python, and ChartoGraphy w/ python are averaged over five runs; other multimodal benchmarks with Python are averaged over four. For GDP.pdf w/ python, each original PDF is sent to a sandbox for IPython processing. Responses are graded against each rubric criterion using Gemini-3.5-Flash at medium reasoning effort and the official judging prompt. The reported score is the task-macro mean rubric pass rate.
Reasoning, knowledge, and multimodal benchmarks
GDP.pdf. Each PDF is provided as page images resized to a longest edge of 1,152 pixels, interleaved with Docling-extracted text in page order. Responses are graded against each rubric criterion using Gemini-3.5-Flash Medium and the official judging prompt. The table reports the strict pass rate among fully scored responses. GLM-5.3 Max and DeepSeek-V4.1-Flash-1017 Max scores are cited from Artificial Analysis.
HLE-Full and HLE-Diamond. The full evaluation sets contain 2,500 and 1,000 questions, respectively. For scores marked *, accuracy is reported on the text-only subset.
Run counts. GDP.pdf, ZeroBench, and ChartoGraphy are averaged over five runs; other multimodal benchmarks are averaged over four.
MMMU-Pro. Evaluated using the official protocol, preserving the original input order and prepending images to the text input.
PerceptionBench. An in-house benchmark focused on atomic visual perception capabilities.
Kimi Hallucination Benchmark. Evaluates factual accuracy on an internal set of challenging, de-identified prompts drawn from practical work tasks. The table reports claim-level hallucination rates assessed by fact-checking agents.
Cybersecurity benchmarks
ExploitBench. K3.1 Pro is evaluated with the official har
正文由 探How 从来源站点 RSS 同步,内容未经改写;遇到排版缺失或需要图片、视频时请以原文为准。