Google DeepMind Reimagines the Mouse Pointer - Gemini Now Sees What You Point At

Added: 2026-05-17

[00:00:01]Google DeepMind says it's reimagining the mouse monitor for the AI era. The cursor you've used for 50 years now captures visual and semantic [music] context as it moves, so you can point at anything on screen and ask Gemini what to do with it.

[00:00:15]Google DeepMind's new AI-enabled pointer lets you direct Gemini through motion, speech, and natural shorthand. Point at a paragraph and say, "Translate this."

[00:00:25]Point at a chair and say, "Put it there." The pointer figures out what you mean without a written prompt. Two demos are live in Google AI Studio today, one for editing images, one for finding places on a map. Gemini in Chrome also gains a pointer-based query feature starting today, letting users ask about specific parts of a webpage by pointing rather than typing. After 50 years of just clicking, the cursor has finally evolved.