top of page
Image: Soramimi / Wikimedia Commons (CC BY-SA 4.0). Tencent's headquarters in Shenzhen, where the Hunyuan models are built

Tencent Puts Hy4 Flash Weights Online, With a Licence Attached

Writer: Marcus Tan
Marcus Tan
11 minutes ago
2 min read

Tencent has published downloadable weights for Hy4 flash, two days after putting the model behind an API. The release covers three checkpoints, the instruction tuned model, a quantised FP8 version, and a pretrained base that is meant for further training rather than chatting.


Image: Soramimi / Wikimedia Commons (CC BY-SA 4.0). Tencent's headquarters in Shenzhen, where the Hunyuan models are built
Image: Soramimi / Wikimedia Commons (CC BY-SA 4.0). Tencent's headquarters in Shenzhen, where the Hunyuan models are built

The change is access rather than new capability. Nothing about the model's specifications or pricing has moved since the API launch, so what a developer gains here is a copy they can run on their own hardware, which is a different proposition from calling someone else's endpoint.


And the sizes explain who this is for. The standard checkpoint's index records roughly 440 gigabytes of tensor data and the FP8 version about 287, and those are weight sizes rather than memory requirements, so the gap between quantised and unquantised is storage rather than a route onto smaller hardware, and a full run still assumes a multi node cluster.


And the deployment paperwork is part of the release. Tencent ships container images for vLLM and SGLang with examples that use eight way tensor parallelism, and its Transformers instructions point at a pending pull request rather than an ordinary package, which tells you the tooling is fresh.


And there is a memory detail worth flagging. The vLLM recipe offloads Engram tables to host RAM by default, so a server needs system memory as well as GPU memory, and the starting configuration uses 8,192 tokens of context even though the model advertises a capacity of one million.


And the licence is where the download stops being simple. The checkpoints use Tencent Hy License 1.0, which says outright that it is not Apache 2.0 despite deriving from it, and section 10 requires a separate written licence for operators running the model as a service above 50 million US dollars in yearly revenue, or in products with more than 100 million monthly users, with a narrow exception for internal use where neither the model nor its outputs reach third parties.


So this is open weight under conditions rather than open source. Tencent says the larger Hy4 model's weights are still being prepared, which makes the flash release a first step rather than the full opening.


  • Three checkpoints are available, instruct, FP8 and base

  • The standard weights index at about 440 gigabytes, FP8 at about 287

  • Deployment needs vLLM or SGLang containers and eight way tensor parallelism

  • Default serving context is 8,192 tokens, well short of the advertised million

  • The Tencent Hy Licence adds revenue and user thresholds for commercial serving


Source: Pandaily

 
 

Technology increasingly permeates every facet of our lives, making informed decision making an essential pursuit. We bridge this gap by combining the precision of AI with the irreplaceable discernment of human expertise. Our team produces rigorous product reviews that offer unique insights, honest critiques, and trustworthy recommendations. We also leverage AI to synthesise complex news from reliable sources into clear, actionable updates, ensuring that every story is carefully fact checked by our editorial staff before publication. Accuracy remains our priority. Should you identify any discrepancies, please contact us at editorial@tech360.tv. Your feedback is a vital part of our process in maintaining the high standards our readers deserve.

Tech360tv is Singapore's Tech News and Gadget Reviews platform. Join us for our in depth PC reviews, Smartphone reviews, Audio reviews, Camera reviews and other gadget reviews.

  • YouTube
  • Facebook
  • TikTok
  • Instagram
  • Twitter
  • LinkedIn

© 2021 tech360.tv. All rights reserved.

bottom of page