Nicol is an open-source web service, developed using the Kotlin programming language, that enables streaming Server Stream Events and supports CPU inference for the port of llama2 model.
Primary LanguageKotlinMIT LicenseMIT