Apple researchers have unveiled a new AI model that is not only able to beat OpenAI’s GPT 4, but also represents a much more efficient way to deploy on-device AI. As per the research paper, this new AI is called ReALM and it is able to understand on-screen tasks, conversational context, and background processes.
ReALM has unveiled a groundbreaking technique that translates visual content on screens into text, eliminating the reliance on complex image recognition technologies for enhanced efficiency in AI processing directly on devices. Therefore, it is reasonable to assume that Apple is planning to use ReALM on its future iPhones due to its greater efficiency.
The approach taken by this model involves analyzing the content visible on a user’s screen along with any active tasks, integrating these elements for a more cohesive AI interaction.
Studies have shown that Apple’s advanced ReALM models have outstripped the performance of GPT-4, achieving superior results with fewer parameters involved.
ReALM marks a significant advancement in enhancing the contextual awareness of voice assistants. With the capability to comprehend information displayed on-screen and other contextual details, the upcoming update to Siri could offer a more fluid and hands-free experience for users.
For instance, if a user is scrolling through a website and wants to call the business behind the website, the user could simply tell Siri to “call the business” and the virtual assistant will be able to scan through the entire webpage, find the right contact number, and call it directly.
iOS 18 update
These changes could be part of the upcoming iOS 18 update, which is expected to be the biggest overhaul in the history of iOS thanks to generative AI. iOS 18 will boast on-device AI processing as well as cloud AI powered by Google Gemini and Baidu AI in China.
Apple has reportedly been in talks with tech giant Google and “China’s Google” Baidu AI to run cloud AI processing on its iPhones. This approach is similar to Samsung using Google’s Gemini to power the Galaxy S24 series in the global market but using Baidu AI in China since Google services are banned there.
