Text Generation
Transformers
Safetensors
hy_v3
hunyuan
hy3
Mixture of Experts
conversational
Eval Results
Instructions to use tencent/Hy3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tencent/Hy3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="tencent/Hy3") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("tencent/Hy3") model = AutoModelForCausalLM.from_pretrained("tencent/Hy3") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use tencent/Hy3 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "tencent/Hy3" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/tencent/Hy3
- SGLang
How to use tencent/Hy3 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "tencent/Hy3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "tencent/Hy3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use tencent/Hy3 with Docker Model Runner:
docker model run hf.co/tencent/Hy3
Upload folder using huggingface_hub
Browse files- README.md +12 -13
- README_CN.md +6 -6
README.md
CHANGED
|
@@ -7,7 +7,6 @@ tags:
|
|
| 7 |
- hy3
|
| 8 |
- moe
|
| 9 |
- text-generation
|
| 10 |
-
inference: false
|
| 11 |
---
|
| 12 |
<p align="left">
|
| 13 |
<a href="https://huggingface.co/tencent/Hy3/blob/main/README_CN.md">中文</a> | English
|
|
@@ -42,8 +41,8 @@ inference: false
|
|
| 42 |
## Table of Contents
|
| 43 |
|
| 44 |
- [Model Introduction](#model-introduction)
|
| 45 |
-
- [Stronger Agent
|
| 46 |
-
- [
|
| 47 |
- [Benchmark Appendix](#benchmark-appendix)
|
| 48 |
- [News](#news)
|
| 49 |
- [Model Links](#model-links)
|
|
@@ -60,7 +59,7 @@ inference: false
|
|
| 60 |
|
| 61 |
## Model Introduction
|
| 62 |
|
| 63 |
-
**Hy3** is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+
|
| 64 |
|
| 65 |
|
| 66 |
| Property | Value |
|
|
@@ -79,27 +78,27 @@ inference: false
|
|
| 79 |
| Number of Experts | 192 experts, top-8 activated |
|
| 80 |
| Supported Precisions | BF16 |
|
| 81 |
|
| 82 |
-
## Stronger Agent
|
| 83 |
|
| 84 |
-
Building on Hy3 Preview, we improved
|
| 85 |
|
| 86 |
<p align="center">
|
| 87 |
<img src="assets/benchmark.png" width="100%"/>
|
| 88 |
</p>
|
| 89 |
|
| 90 |
-
In productivity scenarios such as coding,
|
| 91 |
|
| 92 |
-
We don't think public benchmark scores tell the full story. So we ran a blind
|
| 93 |
|
| 94 |
-
##
|
| 95 |
|
| 96 |
-
|
| 97 |
|
| 98 |
-
**
|
| 99 |
|
| 100 |
-
**
|
| 101 |
|
| 102 |
-
**Complex
|
| 103 |
|
| 104 |
## Benchmark Appendix
|
| 105 |
|
|
|
|
| 7 |
- hy3
|
| 8 |
- moe
|
| 9 |
- text-generation
|
|
|
|
| 10 |
---
|
| 11 |
<p align="left">
|
| 12 |
<a href="https://huggingface.co/tencent/Hy3/blob/main/README_CN.md">中文</a> | English
|
|
|
|
| 41 |
## Table of Contents
|
| 42 |
|
| 43 |
- [Model Introduction](#model-introduction)
|
| 44 |
+
- [Stronger Agent Capabilities](#stronger-agent-capabilities)
|
| 45 |
+
- [More Reliable Product Experiences](#more-reliable-product-experiences)
|
| 46 |
- [Benchmark Appendix](#benchmark-appendix)
|
| 47 |
- [News](#news)
|
| 48 |
- [Model Links](#model-links)
|
|
|
|
| 59 |
|
| 60 |
## Model Introduction
|
| 61 |
|
| 62 |
+
**Hy3** is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters. It also shows significant gains in utility across various products and productivity tasks.
|
| 63 |
|
| 64 |
|
| 65 |
| Property | Value |
|
|
|
|
| 78 |
| Number of Experts | 192 experts, top-8 activated |
|
| 79 |
| Supported Precisions | BF16 |
|
| 80 |
|
| 81 |
+
## Stronger Agent Capabilities
|
| 82 |
|
| 83 |
+
Building on Hy3 Preview, we further improved the quality and diversity of post-training data while scaling up RL training. Hy3 shows solid gains across reasoning, agentic, and long-context tasks, competitive with much larger flagship models.
|
| 84 |
|
| 85 |
<p align="center">
|
| 86 |
<img src="assets/benchmark.png" width="100%"/>
|
| 87 |
</p>
|
| 88 |
|
| 89 |
+
In productivity scenarios such as coding, office work, financial modeling, frontend design, and game development, Hy3 has made remarkable progress and can now serve as a reliable, cost-effective model option.
|
| 90 |
|
| 91 |
+
We don't think public benchmark scores tell the full story. So we ran a blind evaluation with 270 experts using tasks from their work, and Hy3 scored 2.67/4, outperforming GLM-5.1 at 2.51/4. The advantage was most substantial in frontend development, data & storage, and CI/CD tasks.
|
| 92 |
|
| 93 |
+
## More Reliable Product Experiences
|
| 94 |
|
| 95 |
+
Model usefulness is not fully captured by benchmarks. Based on extensive product feedback, we identified and fixed the following issues, receiving consistently positive feedback from product teams.
|
| 96 |
|
| 97 |
+
**Stability of tool calls and output formats**: We fixed multiple baseline reliability issues, bringing the model to production-grade standards across tool configurations and output constraints. Tool-call error recovery and overall efficiency improved. Hy3 also generalizes across different agent scaffoldings. On SWE-Bench Verified, accuracy variance across scaffoldings like CodeBuddy, Cline, and KiloCode remains within 4%.
|
| 98 |
|
| 99 |
+
**Knowledge and anti-hallucination**: Guided by the ideal of "answer when grounded, state when evidence is missing, do not conflate sources or fabricate data," we implemented fine-grained data cleaning and training constraints. In internal evaluations based on real-world scenarios, Hy3's hallucination rate dropped from 12.5% to 5.4%, and commonsense error rates fell from 25.4% to 12.7%. These improvements materially reduce fact conflation, fabrication, and logical contradiction.
|
| 100 |
|
| 101 |
+
**Complex context retention and multi-turn intent tracking**: Through joint optimization of SFT and RL, Hy3 improved on operational pain points like coreference resolution, ellipsis recovery, and multi-turn constraint inheritance. On internal comprehensive multi-turn tests, the issue rate dropped from 17.4% to 7.9%. Hy3 also improved markedly on long-dialogue evals like MRCR. Its outputs are more concise while ensuring complex intents do not decay or drift over long-horizon interactions.
|
| 102 |
|
| 103 |
## Benchmark Appendix
|
| 104 |
|
README_CN.md
CHANGED
|
@@ -49,7 +49,7 @@
|
|
| 49 |
|
| 50 |
## 模型介绍
|
| 51 |
|
| 52 |
-
**Hy3** 是由腾讯混元团队研发的快慢思考融合的混合专家模型,总参数量 295B,激活参数 21B,MTP 层参数 3.8B。4 月底发布 Hy3 Preview 后,我们在 50 多个业务中获得了广泛的反馈,修复了各种体验问题,进一步提升了后训练的质量和规模。今天,我们发布 Hy3。它展现出显著强于同尺寸并比肩旗舰
|
| 53 |
|
| 54 |
|
| 55 |
| 属性 | 值 |
|
|
@@ -70,23 +70,23 @@
|
|
| 70 |
|
| 71 |
## 更强大的智能体能力
|
| 72 |
|
| 73 |
-
Hy3 基于 Preview 进一步提升了后训练数据的质量和多样性,扩大了 RL 算力规模,在推理、智能体、长上下文等任务上显著进步,取得了比肩国内外更大尺寸旗舰模型的效果。
|
| 74 |
|
| 75 |
<p align="center">
|
| 76 |
<img src="assets/benchmark.png" width="100%"/>
|
| 77 |
</p>
|
| 78 |
|
| 79 |
-
在
|
| 80 |
|
| 81 |
## 更可靠的产品体验
|
| 82 |
|
| 83 |
模型的实用体验不完全与榜单成绩挂钩。基于广泛的用户反馈和分析,我们定位并优化了一系列体验向能力,获得了产品侧一致且积极的评价。
|
| 84 |
|
| 85 |
-
**输出格式和工具调用稳定性**:我们显著改善了一系列基础底线问题,确保模型在各种工具设置和输出要求下达到生产级标准,工具调用的错误恢复能力和效率大幅提升。另外,Hy3 还增强了跨
|
| 86 |
|
| 87 |
-
**知识常识和抗幻觉能力**:
|
| 88 |
|
| 89 |
-
**复杂上下文承接与多轮意图保持能力**:Hy3 在 SFT 与 RL 阶段联合优化了指代消解、省略还原
|
| 90 |
|
| 91 |
## Benchmark 附录
|
| 92 |
|
|
|
|
| 49 |
|
| 50 |
## 模型介绍
|
| 51 |
|
| 52 |
+
**Hy3** 是由腾讯混元团队研发的快慢思考融合的混合专家模型,总参数量 295B,激活参数 21B,MTP 层参数 3.8B。4 月底发布 Hy3 Preview 后,我们在 50 多个业务中获得了广泛的反馈,修复了各种体验问题,进一步提升了后训练的质量和规模。今天,我们正式发布 Hy3。它展现出显著强于同尺寸模型的智能水平,并比肩更大尺寸旗舰模型的效果,大幅提升了在各类产品和生产力任务中的实用价值。
|
| 53 |
|
| 54 |
|
| 55 |
| 属性 | 值 |
|
|
|
|
| 70 |
|
| 71 |
## 更强大的智能体能力
|
| 72 |
|
| 73 |
+
Hy3 基于 Preview 进一步提升了后训练数据的质量和多样性,扩大了 RL 算力规模,在推理、智能体、长上下文等任务上显著进步,取得了比肩国内外更大尺寸旗舰模型(参数规模往往是 Hy3 的 2~5 倍)的效果。
|
| 74 |
|
| 75 |
<p align="center">
|
| 76 |
<img src="assets/benchmark.png" width="100%"/>
|
| 77 |
</p>
|
| 78 |
|
| 79 |
+
Hy3 在软件开发、办公生产、金融建模、前端设计、游戏制作等生产力任务上的进步尤其显著,可以成为高性价比的可靠选择。在内部组织的 270 位专家基于真实工作的模型盲测中,Hy3(均分 2.67 / 4)展现出优于 GLM5.1(均分 2.51 / 4)的表现,尤其在前端、数据与存储、CI/CD 等类别优势显著。
|
| 80 |
|
| 81 |
## 更可靠的产品体验
|
| 82 |
|
| 83 |
模型的实用体验不完全与榜单成绩挂钩。基于广泛的用户反馈和分析,我们定位并优化了一系列体验向能力,获得了产品侧一致且积极的评价。
|
| 84 |
|
| 85 |
+
**输出格式和工具调用稳定性**:我们显著改善了一系列基础底线问题,确保模型在各种工具设置和输出要求下达到生产级标准,工具调用的错误恢复能力和效率大幅提升。另外,Hy3 还增强了跨脚手架泛化性,不同脚手架(如 CodeBuddy、Cline、KiloCode)在 SWE Bench Verified 上的分数标准差控制在 4 个百分点以内。
|
| 86 |
|
| 87 |
+
**知识常识和抗幻觉能力**:基于“有依据才回答、无依据明示缺失,多来源信息不乱拼,数据和状态不乱编”的理想态,我们进行了细粒度的数据清洗和训练约束。在基于真实产品的内部评测中,Hy3 的幻觉率从 12.5% 降至 5.4%,常识错误率从 25.4% 降至 12.7%,显著改善了“张冠李戴”、无中生有、逻辑矛盾等问题。
|
| 88 |
|
| 89 |
+
**复杂上下文承接与多轮意图保持能力**:Hy3 在 SFT 与 RL 阶段联合优化了指代消解、省略还原���多轮约束继承等业务痛点问题,内部评测的多轮问题率从 17.4% 降至 7.9%。同时 Hy3 在长对话理解基准中取得显著跨越(如 MRCR 从 42.9% 升至 75.1%),输出更精炼的同时确保复杂意图在长程交互中不衰减、不跑偏。
|
| 90 |
|
| 91 |
## Benchmark 附录
|
| 92 |
|