Tencent Releases Hy4 Model Weights, Supporting One Million Token Context

By: x.com|

Tencent's Hunyuan team has released the model weights for its native multimodal flagship model, Hy4. Hy4 utilizes a mixture of experts (MoE) architecture, with a total parameter count of 770 billion, activating 49 billion parameters per token, and a context length of one million tokens. The Tencent Hunyuan team has published the Hy4 system card, which includes a security assessment report, and plans to hold an online Q&A session on Reddit's r/LocalLLaMA community this Friday from 8 AM to 10 AM Pacific Time to address questions regarding the Hy series models.

-- Price

--
--
--

This content is provided for general informational purposes only and doesn't constitute financial, investment, legal, or tax advice. Any events, rewards, online promotions, or related information mentioned herein should not be considered a recommendation, solicitation, or invitation to purchase, sell, trade, or otherwise deal in any crypto assets. Crypto assets are highly volatile and may result in loss. The availability of WEEX services, products, and related events may vary by region. You are responsible for ensuring that your participation is in accordance with applicable local laws and regulations.

You may also like

iconiconiconiconiconiconiconiconicon
Customer Support:@weikecs
Business Cooperation:@weikecs
Quant Trading & MM:bd@weex.com
VIP Program:support@weex.com