top of page
Ming-3.0-tts architecture diagram showing text and control tokens feeding a large language model, a DiT patch head and an audio decoder that produces speech

Ant Group Opens Ming-3.0 Speech Models to Outside Developers

Writer: tech360.tv
tech360.tv
11 minutes ago
3 min read

Ant Group's BaiLing team has released its Ming-3.0 speech models as open source, five models that fall into speech synthesis, audio understanding and dialogue, and speech recognition. Developers can take one for a single job or chain several into a workflow. According to Ifeng Tech, the release notice carries no parameter counts, no benchmark scores and no licence terms.


Ming-3.0-tts architecture diagram showing text and control tokens feeding a large language model, a DiT patch head and an audio decoder that produces speech
Image: Ant Group inclusionAI

The synthesis family is where most of the control sits. Ming-3.0-tts accepts a written description of the voice a developer wants, and it also takes a reference clip when copying a real timbre is the point. A director mode goes further, letting a creator describe how a line should be performed, down to where the emotion shifts, which words carry stress and how the pacing should run.


And that is a different proposition from picking among preset voices. Inside Ant the model already carries the main conversation and voice calls in the company's Afu app, clones the voices of doctors, and works in its Xiaohu office assistant. A team can use it to voice a script alone, or pair it with the recognition model so that spoken input and a spoken reply run through one stack.


The middle family, Ming-3.0-audio-flash and a smaller companion, is built for understanding rather than producing speech. It transcribes long recordings, then summarises them, pulls out opinions and returns structured output rather than a wall of text. The approach differs from pipelines that transcribe first and analyse second, because the model tracks emotion, the identity of each speaker and the sound of the room while it works through a long context, and Ant notes that this calls for fast inference.


The recognition model, Ming-3.0-asr-tiny, is the smallest piece and the most deeply embedded. Ant built training corpora from Mandarin, English, regional dialects and hotwords specific to particular industries, then had the model lean on candidate hotword lists and the surrounding conversation as it transcribes. Inside the company it already handles search in Alipay, a real time voice agent called Yixiaobao, the Afu doctor assistant and security checks that confirm who is speaking.


But those deployments say more about internal confidence than about outside performance. Every claim in the release is Ant's own, and none of it arrives with a figure a reader can check. There are no word error rates, no comparison against other open speech families and no statement of how much audio the models were trained on.


What the release does make clear is the shape of the offer. Ant presents the five models as selectable by task, which puts the work of stitching them together on whoever adopts them. A voice agent becomes something a team assembles from parts rather than something it licenses whole.


For anyone weighing the stack, the missing pieces are the ones that decide adoption. A team needs licence terms, weight locations, latency figures and accuracy on its own audio before it can plan around a model. The release gives none of those four.


So the near term question is not whether the speech is good, but whether the open release includes the things that make open weights usable. Ant says developers can combine the models as they see fit. It does not yet say what they may do with them afterwards.


  • Ant's BaiLing team released five Ming-3.0 speech models covering synthesis, audio understanding and recognition.

  • The synthesis model accepts a written description of a voice and a director mode for performance detail.

  • Long audio understanding keeps speaker, emotion and room context instead of transcribing first.

  • The recognition model uses hotword lists and dialogue context, and already runs in Alipay and Ant's doctor assistant.

  • Parameter counts, benchmark results and licence terms were not disclosed.


Source: Ifeng Tech

 
 

Technology increasingly permeates every facet of our lives, making informed decision making an essential pursuit. We bridge this gap by combining the precision of AI with the irreplaceable discernment of human expertise. Our team produces rigorous product reviews that offer unique insights, honest critiques, and trustworthy recommendations. We also leverage AI to synthesise complex news from reliable sources into clear, actionable updates, ensuring that every story is carefully fact checked by our editorial staff before publication. Accuracy remains our priority. Should you identify any discrepancies, please contact us at editorial@tech360.tv. Your feedback is a vital part of our process in maintaining the high standards our readers deserve.

Tech360tv is Singapore's Tech News and Gadget Reviews platform. Join us for our in depth PC reviews, Smartphone reviews, Audio reviews, Camera reviews and other gadget reviews.

  • YouTube
  • Facebook
  • TikTok
  • Instagram
  • Twitter
  • LinkedIn

© 2021 tech360.tv. All rights reserved.

bottom of page