chat_with_docs
sam43b opened this issue · 2 comments
Hi,
i have linux ubuntu 22.04 , i get this error when i use chat with docs
Recovering file from front end
-> Vectorizing the database
Couldn't vectorize /home/sam/appz/llm/lollms-webui/cnf/uploads/chat_with_docs/Ef fective_English_Presentation_and_Communication_i.pdf: The vectorizer threw this exception:'NoneType' object has no attribute 'tokenize'
Traceback (most recent call last):
File "/home/sam/appz/llm/lollms-webui/cnf/personalities_zoo/english/data/chat_ with_docs/scripts/processor.py", line 229, in build_db
self.vector_store.index_document(file, text, chunk_size=chunk_size, overlap_ size=overlap_size)
File "/home/sam/appz/llm/vnv/lib/python3.10/site-packages/lollms/utilities.py" , line 198, in index_document
sentence_tokens = self.model.tokenize(sentence)
AttributeError: 'NoneType' object has no attribute 'tokenize'
This means the model is not even loaded correctly. Make sure you select a binding and then a model, apply configuration then save configuration and verify that there are no errors in console before trying to use chat wxith docs.
thank you for your reply, i will try to check the configuration