Skip to content

Apple Intelligence — View Annotations + on-device narration (Tier 2, iOS 27) #365

Description

@roznet

Layer the WWDC26 / iOS 27 Apple Intelligence capabilities on top of the Tier-1 App Intents work. Everything here is additive and gated on OS/model availability — the app degrades cleanly to Tier-1 behavior on older devices.

Design: designs/ios-app-intents.md — Phase 2.

Scope (genuinely iOS-27-gated)

  • View Annotations API: annotate advisory rows (AdvisoryEntity) and the briefing container (FlightEntity) so Siri can act on what's on screen:
    • ExplainAdvisoryIntent — "explain this" → advisoryDetail (mirrors MCP get_advisory_detail).
    • ShowCrossSectionIntent — "show me the cross-section" → in-app navigation.
  • App Intents Testing framework — validate Siri / Shortcuts / Spotlight through real system pathways.

Rides along here (packaging choice — iOS-26-capable)

  • On-device narration (Foundation Models) of the cached AdvisoryDetailResponse for offline "explain this". This capability is iOS 26; it's grouped here because its natural UX is the on-screen View-Annotations trigger. ExplainAdvisoryIntent + narration could move to Tier 1 if desired.

Acceptance

  • On an AI-capable device: "explain this" on an advisory speaks the per-model reasoning; "show me the cross-section" navigates there.
  • On non-AI / older-OS devices: everything degrades to Tier-1 behavior with no crash.

Depends on

  • Tier-1 App Intents (entities + intents this builds on).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions