
Tencent Gives Its Office Agent the Keys to Desktop Apps

Tencent has opened a public beta of a Computer Use feature for WorkBuddy, its office agent, aimed at the software that has no API, no connector and no browser version. The feature reads a program's interface and then clicks, types and scrolls on the user's behalf, according to Chinese reports of the announcement.

The scope is the point. Most of the business software inside Chinese companies, from education administration systems to warehouse records, sits in desktop programs built years ago by vendors who never imagined an agent would need to drive them, and bridging those gaps currently means a person copying data between windows.
And the requirements are modest on paper. The beta runs on Windows and macOS, needs WorkBuddy client version 5.11.0 or later, and has to be switched on, with the user granting accessibility and screen recording permissions before the agent can see or act on anything.
Tencent's own caveats carry the real information. It says interface recognition varies between applications, so the feature should not be assumed to work simply because a program opens on the desktop, which is another way of saying success depends on how a piece of software was written rather than on the model.
The examples in the announcement are ordinary office work. One is looking up records in an education administration system, the other matching warehouse and asset information across clients using an incoming stock reference, both cases where the agent replaces copying rather than judgement.
And supervision is written into the design. A picture in picture window lets the user watch progress while working elsewhere, and Tencent warns that changing a program's input focus or page state can interrupt the agent mid task, a limitation that matters anywhere a click depends on the current window, selection or form.
The advice on risk is explicit. For signing in, granting authorisation, paying, submitting information or deleting records, Tencent tells users to stay present and watch what happens, and to return to the original system to verify the result once a task finishes.
One clarification worth keeping. This is a client level capability rather than a new model release, and it is separate from the vision and computer use work described for Tencent's Hy4 model earlier this month, so the two should not be read as the same product.
Tencent has opened a public beta of WorkBuddy's Computer Use feature
It targets desktop apps that offer no API, connector or browser version
The beta needs WorkBuddy client 5.11.0 or later, plus accessibility and screen recording permissions
Tencent warns interface recognition varies between applications
Users are told to supervise sign ins, payments and deletions, and to verify results afterwards
Source: Pandaily


