Googleā€™s Project Jarvis: The AI Assistant That Does It All šŸŒ

PLUS: Creating My Own Spooky Halloween Story with AI šŸŽƒšŸ‘»

In partnership with

Welcome to AI Entrepreneurs

In this issue, weā€™re exploring how AI is reshaping everything from healthcare and social media to children's storytelling.

Dive in to uncover Appleā€™s groundbreaking Ferret-UI 2, Metaā€™s move into AI search, Googleā€™s Project Jarvis for Chrome, and ReadKidzā€™s transformative platform for childrenā€™s content.

Plus, check out the latest AI innovations in healthcare with AIHealthTech Insider Issue #20, bringing you updates on dementia detection, AI-driven cancer care, and more.

Stay tuned for exciting insights into the future of AI!

AI in UI ControlšŸ

Apple Unveils Ferret-UI 2: The New AI System Mastering Cross-Platform Controls

Apple's latest AI innovation, Ferret-UI 2, sets a new benchmark in UI navigation, allowing seamless control across iPhones, iPads, Android devices, web browsers, and Apple TV. This advanced system scored an impressive 89.73 in UI element recognition tests, outperforming GPT-4oā€™s 77.73, with notable improvements in identifying buttons, text, and even more complex commands. Unlike traditional models that rely on click coordinates, Ferret-UI 2 interprets user intent, effortlessly understanding prompts like ā€œPlease confirm your inputā€ to locate the appropriate button without precise positioning.

Image Source: 2410.18967

Ferret-UI 2ā€™s adaptive design balances image resolution and processing needs for each platform, enhancing efficiency and preserving detail across devices. Testing revealed remarkable cross-platform functionality, with models trained on iPhones achieving 68% accuracy on iPads and 71% on Android. However, accuracy dipped on web and TV interfaces due to layout differences. Appleā€™s research shows Ferret-UI 2 has huge potential in evolving voice assistants like Siri, enabling them to navigate apps, make reservations, and perform tasks entirely through voice.

Breaking Free: Meta Builds Own Search Engine for Conversational AI


Meta Platforms is developing an AI-driven search engine to reduce its reliance on Google and Bing, according to a report by Reuters. The new tool aims to offer conversational responses to user queries on Metaā€™s AI chatbot, available across WhatsApp, Instagram, and Facebook.This move aims to provide more seamless and conversational answers to user queries, giving Meta greater control over the information provided through its platforms .

Image Source: Meta

Key Features:

  • Independence from Google and Bing: By building its own search engine, Meta aims to decrease its dependence on existing services and gain more control over the information provided through its AI platforms.

  • Conversational Answers: The new search engine will provide conversational answers to user queries through Meta AI, making the experience more seamless for users.

  • Partnership with Reuters: Meta has partnered with Reuters to enhance its AI chatbot's news delivery capabilities, allowing users to access timely and accurate information on current events.

The AI search market is highly competitive, with Google, Microsoft, and OpenAI leading. Meta aims to capture more user interactions by developing its own search engine, likely integrating it into WhatsApp, Instagram, and Facebook. This could disrupt the search landscape, offering a more personalized, conversational experience.

Sponsored
GoBeastMode.AIAI news, tools and insights for marketers

AI Assistant for Web šŸŒ

Googleā€™s Project Jarvis: AI Butler for Web Tasks


Google's "Project Jarvis" is an AI assistant designed to independently control Chrome and perform everyday web tasks, such as searching, making purchases, and booking flights, without user intervention. This AI system works by taking regular screenshots of the browser window, analyzing them, and then performing actions like clicking or entering text.

Image Source: Grok

Key Features:

  • Autonomous Browser Control: Project Jarvis can navigate Chrome on its own, automating tasks like research, shopping, and travel booking.

  • Screenshot Analysis: The AI takes regular screenshots of the browser window to determine the next action.

  • Consumer Focus: Unlike similar systems, Jarvis is primarily aimed at average consumers, not developers or office workers.

Launch Plans:

Google plans to announce Project Jarvis alongside its new Gemini language model this December, although the timeline is not yet finalized. The Gemini model might not deliver significant performance improvements over existing AI systems, which could be why Google is focusing on practical applications like Jarvis .

Context:

The "Jarvis" name was previously mentioned in discussions of Google's AI strategy, with former Google UX strategist Scott Jenson criticizing the company's aim to create a Jarvis-like assistant to keep users within Google's ecosystem. This move reflects the growing trend of AI companies shifting focus from raw language model capabilities to practical applications.

Want to get the most out of ChatGPT?

Revolutionize your workday with the power of ChatGPT! Dive into HubSpotā€™s guide to discover how AI can elevate your productivity and creativity. Learn to automate tasks, enhance decision-making, and foster innovation, all through the capabilities of ChatGPT.

Storytelling with AI šŸŽ‡ 

ReadKidz Revolutionizes Childrenā€™s Content Creation

ReadKidz is revolutionizing the way childrenā€™s stories and videos are created. This innovative tool leverages AI-powered technology to help users transform their ideas into engaging and captivating content for kids. With features like multi-language support and an intuitive platform, ReadKidz makes it easier than ever to craft delightful stories that can reach a global audience. Whether they are parents, educators, or aspiring authors, ReadKidz offers a seamless and creative way for individuals to bring their storytelling visions to life

Read More :

Sponsored
GoBeastMode.AIAI news, tools and insights for marketers

AI in Healthcare šŸ„

AIHealthTech Insider: Issue #20

Dive into AIHealthTech Insider Issue #20 to uncover the latest breakthroughs.

In this issue, explore how AI is redefining patient care and diagnosticsā€”from Eye-ADā€™s advanced dementia detection using retinal imaging to NewYork-Presbyterianā€™s $2 billion AI push. We spotlight Aidoc and NVIDIAā€™s new BRIDGE framework, designed to make AI adoption seamless across healthcare systems. Plus, discover Color Healthā€™s AI copilot, powered by OpenAI, which accelerates cancer care to help patients start treatment sooner.

Interested in AIHealthTech Insider?

Are you interested in receiving the AIHealthTech Insider newsletter directly to your inbox? Stay updated on the latest AI-driven healthcare innovations.

Login or Subscribe to participate in polls.

šŸ””AI in Social Media

Catch the Halloween spirit with spooky updates with HailuoAI

Startup Success: Instant Access to AI Entrepreneur Courses!

Reply

or to participate.