Search
Close this search box.
Search
Close this search box.

Twin Labs Helps You Automate Repetitive Tasks with AI by Taking Control of Your Mouse

Image Credits: iStock.com/ipuwadol
By: Headliners News / February 16, 2024

Meet Twin Labs, a Paris-based tech startup, who is on a mission to streamline and automate repetitive tasks through an innovative approach—allowing artificial intelligence (AI) to take control of the mouse cursor.

Unlike traditional automation products that rely on APIs and intricate multi-step processes, Twin Labs utilizes multimodal models with vision capabilities, such as GPT-4 with Vision (GPT-4V), to replicate human tasks. The co-founders, Hugo Mercier and Joao Justi, emphasize the importance of using GPT-4V, which has been trained on various software interfaces and code bases, enabling it to understand features behind buttons and perform tasks more reliably than traditional large language models (LLMs).

The startup aims to create an automation product for tasks like onboarding new employees, inventory management, financial reporting, and outreach efforts. Instead of relying on APIs, Twin Labs operates similarly to a web browser, automatically loading web pages, clicking buttons, and entering text. The ultimate vision is to enable users to train Twin Labs’ AI assistant using screen recording and natural language descriptions, allowing it to learn and replicate specific tasks according to user needs.

While the company has faced challenges in terms of the costs associated with completing tasks, it has raised $3 million in pre-seed funding from investors such as Betaworks, Motier Ventures, Factorial, and several angel investors. This innovative startup plans to first release a product with a library of pre-trained tasks and later open up the platform for clients to create their own tasks.

Twin Labs’ innovative approach focuses on the intricate details of day-to-day tasks, offering a promising alternative to traditional AI products with a chatbot interface. As businesses seek more efficient and reliable ways to handle routine tasks, Twin Labs’ autonomous agent system aims to bring significant advancements in task automation.

What do you think?

3 People voted this article. 3 Upvotes - 0 Downvotes.
Please Share This