Irasutonya

A website to search for Irasutoya pictures with natural languages. Built with Next.js, TailwindCSS and Qdrant.

Features

Search pictures with natural language. Model is finetuned on CLIP to get the vectors of pictures. The incoming query string is computed into a vector and Qdrant outputs the pictures with top similarities.
(Pseudo) Conversational search. We leverage GPT to rephrase the user's query message to get the proper keyword. Here's an example:
```
# Conversation
[User] I want some pictures of cat.
[Bot] ...
[User] Maybe two in the picture?

# Before rephrasing
[Query] Maybe two in the picture?

# After rephrasing
[User] two cats in a picture
```
This feature could be turned on in the Settings - Rephrase (default: false)
Diverse reply. We use GPT to generate a "nekoly" reply based on the searched pictures and the previous conversation. This feature could be turned on in the Settings - Diversity (default: false)