Two major Apple Intelligence features have been introduced in iOS 18.1 beta 3, including the much-anticipated ‘Clean Up’ tool, which functions similarly to Google’s Magic Eraser. While these generative AI tools are expected to improve over time, the current performance of Apple’s Clean Up tool is raising eyebrows. Specifically, its ability to detect and fill in faces in the background after removing images from the foreground leaves much to be desired, often resulting in distorted and unsettling results.
On this week’s podcast, we’re ruminating about Apple’s “It’s Glowtime” event, buzzing over the latest Mac rumors, and 🤢 over some of the hideous fails of the Photos app’s new Clean Up tool. #ItsGlowtime https://t.co/q97FVgTwNN
— Cult of Mac (@cultofmac) August 31, 2024
In a side-by-side comparison, Samsung’s Galaxy AI outperforms Apple’s tool significantly in filling in missing pixels. It’s important to note, however, that Apple Intelligence is still in its beta phase and has not been officially launched. Apple’s Clean Up tool, which is capable of proofreading and rewriting large amounts of text directly on the device, appears to struggle with more complex tasks like reconstructing facial features when objects are removed from photos.
A vivid example of this shortcoming was shared by Mukul Sharma on social media, where he demonstrated the Clean Up tool’s attempt to remove a Samsung Galaxy Z Fold 5 from his hand. The process begins promisingly, with a smooth animation showing the device being erased from the image. However, the end result is far from polished: the area where the phone was removed becomes a disfigured blur, with facial features appearing grotesquely melted.
This example highlights the limitations of Apple’s current AI capabilities in this area, emphasizing that while the tool can remove objects, it lacks the precision needed to seamlessly fill in the gaps with realistic imagery. It’s worth noting that this issue is not entirely unexpected. The Clean Up tool is still in its early stages, and there are many parameters and variables that Apple needs to refine before the tool can deliver reliable, high-quality results.
Top Stories: September 9 iPhone Event, iOS 18.1 Photos Clean Up Tool, and More Get ready, Apple fans! The official date for the iPhone 16 event has been announced – it’s happening on September 9! Check out all the juicy details, including new features an… https://t.co/7alea6kXDV
— Munshipremchand (@MunshiPremChnd) August 31, 2024
Conversely, Samsung’s Galaxy AI, which has been available since the release of the Galaxy S25 lineup, manages to produce much more convincing edits, even with blurred or low-quality image data. This more mature AI model has had more time to develop and optimize its image reconstruction algorithms, giving it a significant edge over Apple’s fledgling technology.
Despite the current setbacks, Apple users and developers running the beta version of iOS 18.1 are encouraged to test the Clean Up tool and share their experiences. The feedback from these beta tests will be crucial in helping Apple improve the feature before its official release. As generative AI continues to evolve, Apple will likely make significant strides in enhancing the accuracy and effectiveness of its image editing tools.
Key Points:
i. Apple’s new ‘Clean Up’ tool in iOS 18.1 beta 3 is struggling with accurately filling in backgrounds after removing foreground objects.
ii. The tool’s current performance is notably poor in reconstructing facial features, leading to distorted images.
iii. Samsung’s Galaxy AI has proven more effective in similar tasks due to its longer time on the market and more refined algorithms.
iv. The ‘Clean Up’ tool is still in its beta phase, meaning improvements are expected before its official release.
v. Users are encouraged to test the beta version and provide feedback to help Apple enhance the feature.
TL Holcomb – Reprinted with permission of Whatfinger News
