Using the app

Browser, annotate, and other panes

Right-hand panes: Browser (and annotate), Thought process, Knowledge, and Git. Resize, hide, or reorder them from the sidebar.

The right side of the window holds extra panes. You can show or hide each one from the sidebar, resize them, and change their order.

Browser

The Workbench has its own browser pane. This is not a second Chrome window. It is the page Grok sees when it needs to open a site — for example to check a local app you are running, read a docs page, or verify a screen after a change.

You can use it yourself too:

  • Type an address in the bar and go.
  • Use back and forward like any browser.
  • Hide the pane when you need the space. Grok can still open it again when a task needs it.

When you ask Grok to look at a website, prefer this pane over an external browser. That way Grok and you are looking at the same page.

Logins and cookies stay saved in this browser. Use Clear in the toolbar if you want to forget them.

YouTube transcript

When the browser is on a YouTube video, a Transcript button appears in the toolbar. Click it to fetch captions and read them in the pane. Click Video to go back to the page. Copy is available when the transcript is loaded.

You can also type /transcribe in a chat with a YouTube URL or video id. Grok pulls the captions into the conversation.

Annotate for Grok

Annotation is how you point at a piece of a page and tell Grok what is wrong with it. Grok gets the element you clicked, a screenshot with that piece outlined, and your note — so you do not have to describe a button in words.

Do this:

  1. Open the page in the browser pane.
  2. Click the crosshair in the toolbar (hover text: Annotate for agent).
  3. Move the mouse. A gold box follows whatever is under the pointer.
  4. Click the thing you want Grok to look at — a button, a heading, a form field, a layout block.
  5. A card opens. Write what is wrong or what you want changed. You can paste or drop a reference screenshot (how it should look).
  6. Click Send. If Grok is already answering, the button says Queue and the note goes out when that turn finishes.

Shortcuts on the card:

  • Enter sends the note. Shift+Enter starts a new line.
  • Escape, Back, or a click on the dimmed page lets you pick a different element.
  • Drag the card by the dotted handle if it covers what you selected.
  • Click the crosshair again to stop annotating.

Open a project chat first. If no chat is open, the Workbench starts one in the current project. The first image Grok sees is the live page with your element outlined. Extra pasted images are treated as design references to match.

Thought process

The pane labeled Thought process in the sidebar is the live log of Grok’s work — thinking, tools, file edits, plans, and errors. Filter to Edits or All, or pick one chat. Full guide: Thought process.

Knowledge

The Knowledge pane is a graph of notes for the current project folder — generated orientation plus your own writing in an Obsidian vault. Full guide: Knowledge.

Arranging panes

Each pane has a small grip so you can swap their order. Drag the inner edge to resize. Hide anything you are not using. The four right-hand panes are Thought process, Knowledge, Browser, and Git.