The Google AI JavaScript SDK enables developers to use Google's state-of-the-art generative AI models (like Gemini) to build AI-powered features and applications. This SDK supports use cases like:
- Generate text from text-only input
- Generate text from text-and-images input (multimodal)
- Build multi-turn conversations (chat)
- (for Node.js) Embedding
You can use this JavaScript SDK for applications built with Node.js or for web apps.
For example, with just a few lines of code, you can access Gemini's multimodal capabilities to generate text from text-and-image input.
For Node.js:
const model = genAI.getGenerativeModel({ model: "gemini-pro-vision" });
const prompt = "Does this look store-bought or homemade?";
const image = {
inlineData: {
data: Buffer.from(fs.readFileSync("cookie.png")).toString("base64"),
mimeType: "image/png",
},
};
const result = await model.generateContent([prompt, image]);
console.log(result.response.text());
For web:
const model = genAI.getGenerativeModel({ model: "gemini-pro-vision" });
const prompt = "Does this look store-bought or homemade?";
const image = {
inlineData: {
data: base64EncodedImage /* see JavaScript quickstart for details */,
mimeType: "image/png",
},
};
const result = await model.generateContent([prompt, image]);
console.log(result.response.text());
This repository contains sample Node and web apps demonstrating how the SDK can access and utilize the Gemini model for various use cases.
To try out the sample Node app, follow these steps:
-
Check out this repository.
git clone https://github.com/google/generative-ai-js
-
Obtain an API key to use with the Google AI SDKs.
-
cd into the
samples/node
folder and runnpm install
. -
Assign your API key to an environment variable:
export API_KEY=MY_API_KEY
. -
Run the sample file you're interested in. Example:
node simple-text.js
.
To try out the sample web app, follow these steps:
-
Check out this repository.
git clone https://github.com/google/generative-ai-js
-
Obtain an API key to use with the Google AI SDKs.
-
cd into the
samples/web
folder and runnpm install
. -
Assign your API key to an environment variable:
export API_KEY=MY_API_KEY
. -
Serve your web app by running:
npm run http-server
. Open the displayed URL in a browser.
- For Node.js (or web projects using NPM), run
npm install @google/generative-ai
. - For web, add
import { GoogleGenerativeAI } from "https://esm.run/@google/generative-ai"
.
For detailed instructions, you can find quickstarts for the Google AI JavaScript SDK in the Google documentation:
These quickstarts describe how to add your API key and the SDK to your app, initialize the model, and then call the API to access the model. It also describes some additional use cases and features, like streaming, counting tokens, and controlling responses. For Node.js, embedding is also available.
Find complete documentation for the Google AI SDKs and the Gemini model in the Google documentation:
https://ai.google.dev/docs
Find reference docs for this SDK here in the repo.
See Contributing for more information on contributing to the Google AI JavaScript SDK.
The contents of this repository are licensed under the Apache License, version 2.0.