The speaker sets expectations for the talk, assuming basic familiarity with generative AI and JavaScript, and provides links to the presentation materials.
Chrome AI integrates the Gemini Nano model directly into the browser for task-focused operations, requiring progressive enhancement and a one-time model download.
The APIs are available for both browsers and extensions, supporting features like streaming, sessions for conversational context, and multimodal input with images and audio.
The translator API converts text between languages, while the language detector API identifies the language of a given text and provides a confidence score.
The summarizer API can generate different styles of summaries, such as key points or headlines, but may sometimes include external context not present in the original text.
The writer and rewriter APIs generate or transform text based on tone and length, while the new proofreader API identifies spelling and grammar errors.
The prompt API offers a flexible, session-based interface for general-purpose tasks, supporting system instructions, structured output, and multimodal inputs like images and audio.
Implementing any Chrome AI feature involves checking if the API exists, verifying its availability, and then creating an instance while handling the model download progress.
A demonstration shows the translator API converting English to Mandarin and the summarizer API condensing the Gettysburg Address, highlighting its speed and options.
The rewriter API is used to make text more casual and shorter, while the prompt API analyzes the content of images to generate detailed descriptions.
Combining the prompt API with EXIF geolocation data from an image allows the model to generate significantly more context-aware and accurate descriptions.
The presentation concludes with links to official documentation, online playgrounds for testing, and information on joining the early preview program for updates.
Sensory-Minds GmbH
Offenbach am Main, Germany
Hubert Burda Media
München, Germany
33:51Thomas Steiner
44:41
53:46Chris Heilmann, Daniel Cranney & Raymond Camden
38:19
30:36Christian Liebel
32:27Christian Liebel
31:39Rainer Stropek
27:23Nico Martin
.png?w=240&auto=compress,format)
Jobs that call for the skills explored in this talk.
AVEX Automotive GmbH & Co. KG
Hamburg, Germany
Apple
Zürich, Switzerland
Collaboration Betters The World GmbH
KI Group
Berlin, Germany
KI Group
Hamburg, Germany