top of page
Twin glass towers of Tencent's Shenzhen headquarters rising behind trees

Tencent Gives Its Office Agent the Keys to Desktop Apps

Writer: Marcus Tan
Marcus Tan
2 minutes ago
2 min read

Tencent has opened a public beta of a Computer Use feature for WorkBuddy, its office agent, aimed at the software that has no API, no connector and no browser version. The feature reads a program's interface and then clicks, types and scrolls on the user's behalf, according to Chinese reports of the announcement.


Twin glass towers of Tencent's Shenzhen headquarters rising behind trees
Image: Chainwit. / Wikimedia Commons (CC BY 4.0). Tencent's Seafront Towers headquarters in Shenzhen

The scope is the point. Most of the business software inside Chinese companies, from education administration systems to warehouse records, sits in desktop programs built years ago by vendors who never imagined an agent would need to drive them, and bridging those gaps currently means a person copying data between windows.


And the requirements are modest on paper. The beta runs on Windows and macOS, needs WorkBuddy client version 5.11.0 or later, and has to be switched on, with the user granting accessibility and screen recording permissions before the agent can see or act on anything.


Tencent's own caveats carry the real information. It says interface recognition varies between applications, so the feature should not be assumed to work simply because a program opens on the desktop, which is another way of saying success depends on how a piece of software was written rather than on the model.


The examples in the announcement are ordinary office work. One is looking up records in an education administration system, the other matching warehouse and asset information across clients using an incoming stock reference, both cases where the agent replaces copying rather than judgement.


And supervision is written into the design. A picture in picture window lets the user watch progress while working elsewhere, and Tencent warns that changing a program's input focus or page state can interrupt the agent mid task, a limitation that matters anywhere a click depends on the current window, selection or form.


The advice on risk is explicit. For signing in, granting authorisation, paying, submitting information or deleting records, Tencent tells users to stay present and watch what happens, and to return to the original system to verify the result once a task finishes.


One clarification worth keeping. This is a client level capability rather than a new model release, and it is separate from the vision and computer use work described for Tencent's Hy4 model earlier this month, so the two should not be read as the same product.


  • Tencent has opened a public beta of WorkBuddy's Computer Use feature

  • It targets desktop apps that offer no API, connector or browser version

  • The beta needs WorkBuddy client 5.11.0 or later, plus accessibility and screen recording permissions

  • Tencent warns interface recognition varies between applications

  • Users are told to supervise sign ins, payments and deletions, and to verify results afterwards


Source: Pandaily

 
 

Technology increasingly permeates every facet of our lives, making informed decision making an essential pursuit. We bridge this gap by combining the precision of AI with the irreplaceable discernment of human expertise. Our team produces rigorous product reviews that offer unique insights, honest critiques, and trustworthy recommendations. We also leverage AI to synthesise complex news from reliable sources into clear, actionable updates, ensuring that every story is carefully fact checked by our editorial staff before publication. Accuracy remains our priority. Should you identify any discrepancies, please contact us at editorial@tech360.tv. Your feedback is a vital part of our process in maintaining the high standards our readers deserve.

Tech360tv is Singapore's Tech News and Gadget Reviews platform. Join us for our in depth PC reviews, Smartphone reviews, Audio reviews, Camera reviews and other gadget reviews.

  • YouTube
  • Facebook
  • TikTok
  • Instagram
  • Twitter
  • LinkedIn

© 2021 tech360.tv. All rights reserved.

bottom of page