This project is a Proof of Concept showcasing the functionality of Google Gemini Nano to provide autocompleted suggestions offline using a local Large Language Model (LLM). This POC demonstrates how to integrate this capability into a simple React application, eliminating the need for expensive alternatives.
- Offline autocomplete suggestions using Google Gemini Nano
- Local LLM integration
- Simple and user-friendly interface using Shadcn for funsies
Follow the instructions below to set up and run the application on your local machine.
Ensure you have the following installed:
- Node.js
- npm (Node Package Manager)
- Google Chrome Dev (127+)
-
Clone the repository:
git clone <repository-url> cd <repository-directory>
-
Install dependencies:
npm install
-
Set up Google Chrome and Gemini Nano:
Follow the installation guide for Chrome to configure Google Gemini Nano on your machine.
-
Start the development server:
npm start
-
Open your browser and navigate to:
http://localhost:3000
- Start typing in the search bar to see autocompleted suggestions provided by the local LLM.
- The suggestions will appear in a dropdown below the search bar.