Learning / Handbook
Ask, inspect, then act

What can you ask Sybil to do?

These tool descriptions come from the app’s operator definitions. Ask naturally in the app; exact availability depends on the current build, provider, edition, and permissions.

Try a focused request.

“Open the teleprompter”

“Set brightness to 40 percent”

“Find conversations about the sample project from last week”

“Explain why my routine needs setup”

“Show my available tasks”

The website assistant can explain these requests. It cannot issue them to your app. Speech also needs configured activation and a working microphone.

Learn speech activation ↗

display.set

Glasses display in one call: brightness (0–100, or max/min), silent (true = Silent Mode on), display (false turns the display off until turned back on). Pass only what should change.

Inputs: brightness? · silent? · display?

act · additional confirmation may apply

apps.present

Show a mini-app FULL SCREEN on the glasses (opens its screen, starting it when needed) or put it back in its Layout region while it keeps running. mode: full-screen or layout.

Inputs: app · mode

act · additional confirmation may apply

teleprompter.control

Teleprompter: action start (script by name; the last one when omitted), stop, scroll (lines; negative goes back), mode (speech-follow, automatic, manual), or speed (wpm).

Inputs: action · script? · lines? · mode? · wpm?

act · additional confirmation may apply

shows.control

Run a show by name: action open (show = its title), close, go (fire the next cue), back, hold, duck, panic, undo, top, camera, mic, or list (the saved shows).

Inputs: action · show?

act · additional confirmation may apply

routines.control

Control a routine by name: action arm, disarm, start, stop, rearm (clear its cooldown), reveal (a held live routine), or branch (index, zero-based). Arming and stopping ask the user to confirm.

Inputs: action · name? · index?

act · additional confirmation may apply

help.ai_status

How Sybil gets its AI right now: whether Apple Intelligence can answer on this device (and the steps if not), which keys and Sybil Terminal are set up, the planned execution site, and its context window.

read · additional confirmation may apply

help.overview

What SybilSight can do: every feature area in one list, with the screens for each.

read · additional confirmation may apply

help.screens

Find screens by name, purpose, or keyword; returns title, path, where it lives, and what it is for.

Inputs: query?

read · additional confirmation may apply

help.screen

Details for one screen (by title or path): purpose, breadcrumb, and how to open it.

Inputs: screen

read · additional confirmation may apply

help.whats_new

What changed in the latest update and recent ones, plus the installed version.

read · additional confirmation may apply

help.integrations

List every integration SybilSight supports with the fields each needs and where it is set up.

Inputs: query?

read · additional confirmation may apply

help.integration

Everything needed to set up one integration: each field (required/optional/secure), the setup screen, how to test it, and caveats. Call before integration.configure.

Inputs: integration

read · additional confirmation may apply

help.settings

Search the Settings index: returns each setting's title, the door it lives behind, and its screen path.

Inputs: query

read · additional confirmation may apply

help.brief

The one-page brief about SybilSight: what it is, its surfaces, feature areas, how it is controlled, and its privacy limits.

read · additional confirmation may apply

help.tutorials

The tutorial video lessons and the learn site.

read · additional confirmation may apply

readiness.report

The Ready verdict: every dependency (glasses, ring, mic, AI, integrations, shows) with its state, what uses it, and the screen that fixes it. Use to tell the user what is still missing.

read · additional confirmation may apply

routine.readiness

What a routine still needs before it can be armed: setup issues, advisories, whether it is armed, and its start trigger. Use the routine's id or name.

Inputs: routine

read · additional confirmation may apply

routine.create

Draft a complete routine from a plain-language description with the routine AI and save it DISARMED. Returns the id, a summary, warnings, and what it still needs. Ask the user for missing details first when the description is vague.

Inputs: description · target?

act · additional confirmation may apply

routine.edit

Change an existing routine with the routine AI from a plain-language instruction; the edited routine is saved disarmed.

Inputs: routine · change

confirm · additional confirmation may apply

routine.delete

Delete a routine permanently.

Inputs: routine

confirm · additional confirmation may apply

show.preflight

Pre-show check for the open show (mic, voice triggers, camera, glasses, routines, tones, conditionals, network, output, media) as prep actions; lists saved shows when none is open.

read · additional confirmation may apply

integration.configure

Set up or update an integration from values the user gave you (call help.integration first). values is an object keyed by field. Saves when complete; otherwise returns the missing fields so you can ask for them.

Inputs: integration · values

confirm · additional confirmation may apply

integration.test

Test a saved routine integration by fetching its resolved URL; reports reachable/unreachable and why.

Inputs: integration

read · additional confirmation may apply

integration.remove

Remove a saved routine integration.

Inputs: integration

confirm · additional confirmation may apply

routines.list

Compact list of routines with on/off, ready, section (routines/propless/savant), start phrases, locked, and main-screen visibility. enabled true = only routines that are on; section narrows to one collection.

Inputs: enabled? · section? · filter?

read · additional confirmation may apply

routines.show

Open the Routines library on the phone filtered to armed (on), ready, needs-setup, or all, optionally in one section. Returns the banner line to read back (how many are shown and how many are hidden).

Inputs: filter? · section?

act · additional confirmation may apply

routines.show_hidden

Open the Routines library showing every routine, including the ones hidden from the main screen, and list which ones were hidden.

Inputs: section?

act · additional confirmation may apply

sessions.search

Find moments in Sybil recordings from plain language (time range, emotion, speaker, words): “conversations from last week where someone was angry”. Returns compact hits with a description of each moment.

Inputs: query · limit?

read · additional confirmation may apply

sessions.open

Open Sybil recordings on the phone: a plain-language query opens the best matching moment (or the filtered Sessions list when nothing matches), a session id opens that session (segment id optional). Returns what the user will see.

Inputs: query? · session? · segment?

act · additional confirmation may apply

sessions.overview

How many recordings exist, how much this week, and the newest few.

read · additional confirmation may apply

rehearsal.state

What the running rehearsal is waiting for, what it last heard, the last step, the phrase field a “change the phrase” most likely means, and suggestions comparing what was heard with the expected phrases.

read · additional confirmation may apply

rehearsal.change

During a rehearsal, rewrite one spoken phrase (field keys from rehearsal.state; omit field for the obvious one) to value, save it, swap it into the live rehearsal, and step back (retry: previous, current, or start). If the result carries a question, ask it.

Inputs: value · field? · retry?

act · additional confirmation may apply

rehearsal.retry

Step the running rehearsal back without changing anything (retry: previous, current, or start).

Inputs: retry?

act · additional confirmation may apply

diagnose

Whether a capability works right now and why not: internet, terminal (the paired Mac), mac-apps, ai (or claude/chatgpt), glasses, ring, other-apps-data (sandbox), or a permission (microphone, speech, location, notifications, contacts, calendar, reminders, bluetooth, camera, photos). Returns the sentence to say and whether a fix exists.

Inputs: capability

read · additional confirmation may apply

fix

Run the fix for a capability that diagnose reported unavailable: opens the right Settings page or app on the phone (and the fix-it sheet in the chat) and returns the numbered steps to read back.

Inputs: capability

act · additional confirmation may apply

network.status

The phone's network in one line: interface, VPN, metered/low-data, or why it is offline (Airplane Mode, Wi-Fi off, cellular denied).

read · additional confirmation may apply

glasses.status

The glasses, case, and ring right now (connection, battery, firmware) plus the glasses diagnosis and its fix when disconnected.

read · additional confirmation may apply

unfulfilled.recent

Requests Sybil could not fulfil recently (what was asked, on which screen, and why), newest first.

Inputs: limit?

read · additional confirmation may apply

computer.open

Open an app and/or a URL on the paired Mac through Sybil Terminal (checks the connection first; when the Mac is unreachable the result says why and how to fix it instead of failing).

Inputs: app? · url?

confirm · additional confirmation may apply

computer.ask

Hand a task to the AI on the paired Mac to carry out on the computer (open apps, browse, files). provider picks the Mac's AI CLI: auto, claude, chatgpt/codex, gemini, grok, or muse. Checks the connection first and explains when it cannot reach the Mac.

Inputs: text · provider?

confirm · additional confirmation may apply

apps.list

Every mini-app with its running state, whether it can be opened on the phone (canOpen + screen), and the automation actions that drive it. filter narrows by name; running true lists only running apps.

Inputs: filter? · running?

read · additional confirmation may apply

apps.start

Start a mini-app on the glasses by name or package id (Captions, Status Bar, Teleprompter, Peek Text, …).

Inputs: app

act · additional confirmation may apply

apps.stop

Stop a running mini-app by name or package id.

Inputs: app

act · additional confirmation may apply

apps.open

Open a mini-app's screen on the phone by name or package id (its settings screen when it has no screen of its own).

Inputs: app

act · additional confirmation may apply

settings.get

Read one setting by key, title, or automation key: what it does, its current value, and the screen it lives on.

Inputs: setting

read · additional confirmation may apply

settings.set

Change a setting by key, title, or automation key. Automation-safe settings change immediately; any other setting opens its screen for the user and the result explains why.

Inputs: setting · value

act · additional confirmation may apply

listener.status

How the AI listener works right now, in plain words: input scheme (voice/text/both), when it listens (wake word, push to talk on the ring or temple, always, off), how the conversation closes (double tap, stop word), and the idle timeout.

read · additional confirmation may apply

listener.configure

Change how the AI listener works. Pass the user's sentence as `sentence` and/or fields: activation (wake_word|push_to_talk|always|off), holdGesture (ring_hold|temple_hold), dismissDoubleTap, dismissStopWord, stopWord, idleTimeoutSeconds, inputMode (voice|text|both). Returns the new policy and a `summary` to read back to the user.

Inputs: sentence? · activation? · holdGesture? · dismissDoubleTap? · dismissStopWord? · stopWord? · idleTimeoutSeconds? · inputMode?

act · additional confirmation may apply

help.here

The full guide for the screen the user is on (or the one beneath the chat): purpose, what is on it, its settings with current values, docs, interiors, and related features. Call this for “what is this?”.

read · additional confirmation may apply

help.setting

Explain one setting by its key, title, or automation key: what it does, its current value, the screen that shows it, and the settings.set key when it can be changed by act.

Inputs: setting

read · additional confirmation may apply

context.recent_actions

What the user did recently: screens opened, taps, ring and glasses gestures, actions and their outcomes, and your own tool calls (newest last).

Inputs: limit?

read · additional confirmation may apply

musician.note

Set the Musician tuner's target note and optionally play it: note (A3, A#3, Bb2, "B flat"; no octave = the instrument's matching string or the nearest octave), play=true also sounds the reference tone ("play an A3"), play=false only aims the tuner ("tune to E"). A tone already sounding switches to the new note.

Inputs: note · play?

act · additional confirmation may apply

musician.tune

Open the Musician tuner aimed at one note (A4, C#3, Bb2, or a MIDI number); the glasses show how far off the user is.

Inputs: note

act · additional confirmation may apply

musician.reference

Play a reference note on the glasses' speaker (or the phone): note optional (the current tuner target); stop=true stops it.

Inputs: note? · stop?

act · additional confirmation may apply

musician.open_score

Open a sheet-music score in Musician by title, id, or demo; the glasses follow along as the user plays.

Inputs: score

act · additional confirmation may apply

musician.list_scores

The scores in the Musician library (title, composer, measures) plus the built-in demo.

read · additional confirmation may apply

musician.follow

Score following on the open score: action start, pause, or reset (to measure, 1-based).

Inputs: action · measure?

act · additional confirmation may apply

musician.reading

The tuner's latest reading: note heard, target, cents off, and whether it is in tune.

read · additional confirmation may apply

musician.set

Change a Musician setting: a4 (415–466 Hz), threshold (in-tune cents, 1–50), instrument (chromatic, guitar, guitar-drop-d, bass, ukulele, violin, cello), temperament (equal, just, pythagorean).

Inputs: setting · value

act · additional confirmation may apply

peeks.history

Peek history, newest first: type, preview, sender, origin, and sent/shown/ended times. Filters: since (today, yesterday, or ISO 8601), type, sender, query, limit.

Inputs: since? · type? · sender? · query? · limit?

read · additional confirmation may apply

peeks.open

Open the Peeks app on a tab: send (text), image, queue, or history.

Inputs: tab?

act · additional confirmation may apply

This directory covers 63 static tool definitions. Dynamic context-source tools and universal Integration API actions are also available through the running app’s capability catalog; this is not an exhaustive permission grant.

Read the local API schema ↗