ChatGPT Realtime Connection

Gustavo AmbrozioAgents & Providers
Get it for macOS

Run Voice Mode's voice chats on your ChatGPT subscription instead of a separately billed OpenAI API key. It hands Voice Mode the ChatGPT sign-in that the Codex CLI already keeps on the machine running the bb server, reads it again for every chat, and never renews or rewrites it. Only the plugins you allow, Voice Mode to begin with, receive the token; the bb app, the command line and agents in threads never do. This is an undocumented use of the subscription that OpenAI could stop accepting at any time, nobody has checked whether OpenAI's terms allow it, and voice chats count against your ChatGPT plan. Requires bb 0.46 or later, Voice Mode 0.1.9 or later, and the Codex CLI signed in with Sign in with ChatGPT on a plan that includes Codex.

Overview

View source

Voice Mode normally needs an OpenAI API key, billed separately from your ChatGPT plan. This plugin lets it use the ChatGPT sign-in that the Codex CLI already keeps on the machine running the bb server, so your voice chats run on your ChatGPT subscription instead.

What you get

  • Voice Mode voice chats with no OpenAI API key. Voice Mode stays on its default Connection: auto setting and picks this plugin up by itself.
  • A Realtime model setting, gpt-realtime-2.1 to begin with.
  • A list of the plugins allowed to use your sign-in: only Voice Mode to begin with. The bb app, the command line and agents in threads never receive it.

What it never does

  • It never renews your Codex sign-in and never writes Codex's files. Codex renews its own sign-in; when it has expired, run codex once, or codex login.
  • It never pretends to be the Codex app, and never logs or shows the token.

Read this first

  • This is an undocumented use of the ChatGPT subscription. OpenAI documents its Realtime API for API keys, and already refuses the ChatGPT sign-in for one of its voice models, so this can stop working at any time.
  • OpenAI's terms have not been checked. Whether they allow another program to use the Codex sign-in this way is for you to decide.
  • Voice chats count against your ChatGPT plan.

What you need

  • bb 0.46 or later and Voice Mode 0.1.9 or later.
  • The Codex CLI, signed in with Sign in with ChatGPT, on the machine running the bb server.
  • A ChatGPT plan that includes Codex.

More from Gustavo Ambrozio

Diff ReviewComment on a thread's changes line by line, then send the comments to its agent, which fixes the code and answers each one. A Review tab beside the thread shows the diff of its uncommitted, staged or unstaged changes, its branch, one commit or a range, and each comment follows its code as the code moves. The same tab reviews a GitHub pull request: answer its threads, mark files viewed in step with GitHub, and submit your comments as one review, posted as the GitHub CLI's signed-in account. An AI review leaves comments of its own, @reviewer answers a question inside a comment thread, and Fix in a new thread hands the comments to another agent; these runs start as threads under the one being reviewed, in the permission mode set in the settings (bb's Approve for me by default, or Accept edits), and in full permission mode with a provider that lacks that mode, such as opencode. Follows the review loop of the open-source diffity, credited in the plugin's third-party notices. Needs bb 0.48 or later with bb's Git plugin on, and the signed-in GitHub CLI (gh) for pull request review only; it is built on experimental bb plugin APIs that may change between bb releases.NewFirstMate CrewHand one agent your to-do list and it runs a crew of worker threads, each in its own git worktree, until the work lands. The first mate is a pinned thread in bb's own chat that writes each worker's instructions, supervises it, and brings back branches, pull requests, findings and only the decisions that are yours. A FirstMate tab shows the crew as a board of Queued, Working, Blocked, Parked, Done, Failed and Idle, with Steer, Interrupt, Relaunch and End on every card. A built-in watch tells the first mate within about five minutes when a pull request is merged, reviewed or changes check status. Requires bb 0.47 or later, git, and the logged-in gh CLI for the pull request watch; a capable model such as Claude Sonnet is recommended for the first mate.13GitHub BoardSee your GitHub issues, pull requests and discussions on one board, and hand any of them to an agent thread. Four columns cover what you wrote, what is open on repositories you own and what is assigned to you, and an issue that a pull request closes folds into that pull request's card. Pull request cards show CI checks and branch status, with an Update branch button wherever you can push. A detail panel shows the body, comments and images, and labels are added or removed from a right-click menu. Send to chat opens bb's new-thread composer on a card, with a prompt you set per column and per project, in the bb project that has the repository checked out. Add to chat puts the same prompt, the card's column template with the chat's project override, at the end of a chat's draft without sending it, from a menu of the chats on screen and your recent threads. Requires bb 0.47 or later, and the GitHub CLI (gh) installed and signed in on the machine running the bb server.9HeraldHear one spoken sentence when an agent needs you, and see every waiting thread in one list. When a thread asks a question, waits for a plan or a permission to be approved, finishes its turn or fails, the bb app says which thread it is and what it needs, on whatever page you are on. A Herald page in the sidebar lists every thread waiting on you with its reason and sentence, and the same sentence sits above that thread's composer with a Read again button until you answer. Settings choose which kinds of event are announced, the voice and speed, and where to speak: the desktop app, a browser tab, or the mobile app while it is open. By default the sentence is built from the event itself, with no model or external service; optionally, Claude Code, OpenAI Codex, Gemini CLI or a command of your own, installed and logged in on the Mac running bb, writes it instead, for one short model turn per announcement. The default voice needs bb running on a Mac, and elsewhere each device's own browser voice speaks. Requires bb 0.47 or later.19

More in Agents & Providers 79

Add, choose, configure, route, or coordinate who runs a thread.

View all