Deprecation Notice
The versions 2.x and lower are deprecated please use latest.
A simple api for hugging face chat with login caching.
Current stable release (3.x)
npm i huggingface-chatimport { Login ,ChatBot} from "huggingface-chat";
const EMAIL = "email"
const PASSWD = "password"
const cachePath = "./login_cache/"
const signin = new Login(EMAIL, PASSWD)
const res = await signin.login(cachePath) // default path is ./login_cache/
const chat = new ChatBot(res) // res is cookies which is required for subsequent aip calls
await chat.intialize()
const models = chat.listAvilableModels()
console.log(models)
const sessons = chat.listAvilableSesson()
console.log(sessons)
let currentModel = chat.showCurrentModel()
console.log(currentModel)
chat.switchModel("google/gemma-1.1-7b-it")
currentModel = chat.showCurrentModel()
console.log(currentModel)
const currentChat = await chat.getNewChat("you are a drunk person") // optional if you want to set a system prompt
console.log(currentChat)
let data = await chat.chat("hi my name is jhon");
let reader = data.stream.getReader();
while (true) {
const { done, value } = await reader.read();
if (done) break; // The streaming has ended.
process.stdout.write(value)
}
data = await chat.chat("what is my name");
let response = await data.completeResponsePromise() //non streaming response
console.log(response)
data = await chat.chat("what is my name", sessons[0].id); // using existing sessons
response = await data.completeResponsePromise()
console.log(response)
Note: Supported in node 18.x and higher.
Note: In case the package stops working there is most likely a change in hugging face api, if possible please report it and update the package to latest if available.
Full API documentations of both classes can be found here Chat Login
- If you happen to see missing feature or a bug, feel free to open an issue.
- Pull requests are welcomed too!