Apple Intelligence Fails Basic iPhone Automation Tests
Generative prompts on iOS 27 substitute requested system commands with unrelated actions during testing.
Apple’s natural language shortcut generator routinely substitutes requested system commands with unrelated actions, according to testing on devices running iOS 27. The Shortcuts app, which Apple acquired as Workflow in 2017 and rebranded a year later, now accepts plain English prompts to build automation sequences. The output frequently ignores the user’s actual instructions.
A request to automatically power down an iPhone when the battery drops below 20 percent did not trigger a shutdown sequence. The software locked the screen instead. Another attempt to toggle the display to grayscale upon launching Instagram and revert to color upon exiting only completed the first half of the command. The system failed to disable the color filter after the app closed, forcing users to manually split the task into two separate shortcuts.
The generator rarely refuses impossible prompts outright. It strings together available actions that approximate the request, regardless of whether the final sequence performs the intended function. This behavior mirrors broader issues with large language models operating outside controlled text environments. When LLMs interface with executable device logic rather than generating static copy, hallucinations translate directly into broken automations or unintended system states.
Users building automations manually through the traditional block-based editor can route tasks through specific AI infrastructure. The Use Model action directs requests to Cloud, Cloud Pro, On-Device, or OpenAI’s ChatGPT endpoints. These pipelines handle text processing reliably. A manually constructed sequence fetching an article via URL, summarizing the text, and saving it to the Notes app executed without errors. Sorting telephoto images into a dedicated album also functioned as designed.
These manual configurations bypass the natural language interpreter entirely. They rely on explicit action blocks selected by the user, replicating the exact methodology required before Apple introduced generative features to the platform in 2024. Generated shortcuts remain fully editable after creation, requiring manual verification of every step before deployment. Any generated automation can be exposed system-wide by enabling the Show in Share Sheet toggle within the shortcut’s information menu.
