Overview¶

⚠️ Partial

Current state: TalkBack/VoiceOver auto-detection is implemented (via ADB secure settings query, cached with 60s TTL). Tool adaptations for TalkBack mode (ACTION_CLICK, two-finger scroll, etc.) are designed but not yet fully built — see TalkBack/VoiceOver design. iOS VoiceOver support is planned. The auditAccessibility MCP tool for contrast/tap target checks is ✅ Implemented separately. See the Status Glossary for chip definitions.

AutoMobile supports accessibility testing by detecting and adapting to screen readers like TalkBack (Android) and VoiceOver (iOS).

flowchart LR
    subgraph Detection
        Auto["🔍 Auto-detect
TalkBack/VoiceOver"]
        Cache["💾 Cache State
(60s TTL)"]
    end

    subgraph Adaptation
        Tap["👆 tapOn
ACTION_CLICK"]
        Scroll["👉 swipeOn
Two-finger / Scroll Action"]
        Input["⌨️ inputText
ACTION_SET_TEXT"]
    end

    subgraph Result
        Agent["🤖 Agent
(No changes needed)"]
    end

    Auto --> Cache
    Cache --> Tap
    Cache --> Scroll
    Cache --> Input
    Tap --> Agent
    Scroll --> Agent
    Input --> Agent

    classDef detect fill:#CC2200,stroke-width:0px,color:white;
    classDef adapt fill:#525FE1,stroke-width:0px,color:white;
    classDef result fill:#007A3D,stroke-width:0px,color:white;

    class Auto,Cache detect;
    class Tap,Scroll,Input adapt;
    class Agent result;

Design Principles¶

1. Auto-detect and adapt - Tools automatically detect screen readers and adjust behavior
2. Backward compatible - No changes to existing tool interfaces or automation scripts
3. Transparent - Behavior adaptations invisible to MCP consumers (agents)
4. Performance - Detection cached with <50ms overhead

Key Adaptations¶

Topics¶

Platform Support¶