"Last year in October, Anthropic became the first LLM provider to showcase the possibility of controlling a computer or some parts of its operating system. That ability, which Anthropic had termed " computer use," enabled developers to instruct Claude 3.5 Sonnet, through the Anthropic API, to read and interpret what's on the display, type text, move the cursor, click buttons, and switch between windows or applications."
"It caught the attention of experts and enterprises as the ability was a major step up from more traditional automation practices, such as robotic process automation (RPA) tools, which required more time and labor to set up and yet would require constant maintenance."
"The idea of automating tasks for desktop users is not entirely novel."
Automating desktop user tasks extends beyond traditional approaches. Last October, Anthropic demonstrated LLM-driven control over a computer or parts of its operating system. The capability, termed "computer use," allowed developers to instruct Claude 3.5 Sonnet via the Anthropic API to read displays, type text, move the cursor, click buttons, and switch windows or applications. The functionality drew attention from experts and enterprises because it represented a significant advance over robotic process automation tools, which typically require extensive setup, labor, and ongoing maintenance.
Read at InfoWorld
Unable to calculate read time
Collection
[
|
...
]