Technologist Mag
  • Home
  • Tech News
  • AI
  • Apps
  • Gadgets
  • Gaming
  • Guides
  • Laptops
  • Mobiles
  • Wearables
  • More
    • Web Stories
    • Trending
    • Press Release

Subscribe to Updates

Get the latest tech news and updates directly to your inbox.

What's On

DOGE Has Achieved Its Final Form

23 May 2025

What Google’s I/O 2025 keynote tells us about the Google Pixel 10

23 May 2025

Trump Threatens 25 Percent Tariffs on Apple If iPhones Not Made in US

23 May 2025

Our Favorite Computer Monitors for Gaming

23 May 2025

Marvel’s movie schedule after delays to Avengers: Doomsday & Secret Wars

23 May 2025
Facebook X (Twitter) Instagram
Facebook X (Twitter) Instagram
Technologist Mag
SUBSCRIBE
  • Home
  • Tech News
  • AI
  • Apps
  • Gadgets
  • Gaming
  • Guides
  • Laptops
  • Mobiles
  • Wearables
  • More
    • Web Stories
    • Trending
    • Press Release
Technologist Mag
Home » Meet The AI Agent With Multiple Personalities
Tech News

Meet The AI Agent With Multiple Personalities

By technologistmag.com16 April 20253 Mins Read
Share
Facebook Twitter Reddit Telegram Pinterest Email

In the coming years, agents are widely expected to take over more and more chores on behalf of humans, including using computers and smartphones. For now, though, they’re too error prone to be much use.

A new agent called S2, created by the startup Simular AI, combines frontier models with models specialized for using computers. The agent achieves state-of-the-art performance on tasks like using apps and manipulating files—and suggests that turning to different models in different situations may help agents advance.

“Computer-using agents are different from large language models and different from coding,” says Ang Li, cofounder and CEO of Simular. “It’s a different type of problem.”

In Simular’s approach, a powerful general-purpose AI model, like OpenAI’s GPT-4o or Anthropic’s Claude 3.7, is used to reason about how best to complete the task at hand—while smaller open source models step in for tasks like interpreting web pages.

Li, who was a researcher at Google DeepMind before founding Simular in 2023, explains that large language models excel at planning but aren’t as good at recognizing the elements of a graphical user interface.

S2 is designed to learn from experience with an external memory module that records actions and user feedback and uses those recordings to improve future actions.

On particularly complex tasks, S2 performs better than any other model on OSWorld, a benchmark that measures an agent’s ability to use a computer operating system.

For example, S2 can complete 34.5 percent of tasks that involve 50 steps, beating OpenAI’s Operator, which can complete 32 percent. Similarly, S2 scores 50 percent on AndroidWorld, a benchmark for smartphone-using agents, while the next best agent scores 46 percent.

Victor Zhong, a computer scientist at the University of Waterloo in Canada and one of the creators of OSWorld, believes that future big AI models may incorporate training data that helps them understand the visual world and make sense of graphical user interfaces.

“This will help agents navigate GUIs with much higher precision,” Zhong says. “I think in the meantime, before such fundamental breakthroughs, state-of-the-art systems will resemble Simular in that they combine multiple models to patch the limitations of single models.”

To prepare for this column, I used Simular to book flights and scour Amazon for deals, and it seemed better than some of the open source agents I tried last year, including AutoGen and vimGPT.

But even the smartest AI agents are, it seems, still troubled by edge cases and occasionally exhibit odd behavior. In one instance, when I asked S2 to help find contact information for the researchers behind OSWorld, the agent got stuck in a loop hopping between the project page and the login for OSWorld’s Discord.

OSWorld’s benchmarks show why agents remain more hype than reality for now. While humans can complete 72 percent of OSWorld tasks, agents are foiled 38 percent of the time on complex tasks. That said, when the benchmark was introduced in April 2024, the best agent could complete only 12 percent of the tasks.

Share. Facebook Twitter Pinterest LinkedIn Telegram Reddit Email
Previous ArticleKingdom Come: Deliverance 2’s hardcore mode is out now and it’s no joke
Next Article Infinix Note 40 Series Confirmed to Get Android 15-Based XOS 15 Update in This Quarter

Related Articles

DOGE Has Achieved Its Final Form

23 May 2025

What Google’s I/O 2025 keynote tells us about the Google Pixel 10

23 May 2025

Our Favorite Computer Monitors for Gaming

23 May 2025

Marvel’s movie schedule after delays to Avengers: Doomsday & Secret Wars

23 May 2025

Kentucky’s Bitcoin Boom Has Gone Bust

23 May 2025

Microsoft Build summary: 4 big announcements you’ll want to know

23 May 2025
Stay In Touch
  • Facebook
  • Twitter
  • Pinterest
  • Instagram
  • YouTube
  • Vimeo

Subscribe to Updates

Get the latest tech news and updates directly to your inbox.

Don't Miss

What Google’s I/O 2025 keynote tells us about the Google Pixel 10

By technologistmag.com23 May 2025

If it wasn’t already evident, this year’s Google I/O proved that AI is very much…

Trump Threatens 25 Percent Tariffs on Apple If iPhones Not Made in US

23 May 2025

Our Favorite Computer Monitors for Gaming

23 May 2025

Marvel’s movie schedule after delays to Avengers: Doomsday & Secret Wars

23 May 2025

Check Out Metal Gear Solid Delta’s Remade Version Of The Iconic ‘Snake Eater’ Opening Movie

23 May 2025
Technologist Mag
Facebook X (Twitter) Instagram Pinterest
  • Privacy
  • Terms
  • Advertise
  • Contact
© 2025 Technologist Mag. All Rights Reserved.

Type above and press Enter to search. Press Esc to cancel.