[ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node
Opened this issue · 0 comments
I successfully start web UI, but ONNXRuntimeError occurs when I upload a PDF file.
The full log is below:
RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node. Name:'SkipLayerNorm_AddBias_0' Status Message: /onnxruntime_src/include/onnxruntime/core/framework/op_kernel_context.h:42 const T* onnxruntime::OpKernelContext::Input(int) const [with T = onnxruntime::Tensor] Missing Input: encoder.layer.0.attention.output.LayerNorm.weight
Traceback:
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error_handling
result = func()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 541, in code_to_exec
self._session_state.on_script_will_rerun(
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 66, in on_script_will_rerun
self._state.on_script_will_rerun(latest_widget_states)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 559, in on_script_will_rerun
self._call_callbacks()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 572, in _call_callbacks
self._new_widget_state.call_callback(wid)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 273, in call_callback
callback(*args, **kwargs)
File "/data1/RAG/Repos/local-rag/main.py", line 40, in read_and_save_file
st.session_state["assistant"].ingest(file_path)
File "/data1/RAG/Repos/local-rag/rag.py", line 38, in ingest
vector_store = Chroma.from_documents(documents=chunks, embedding=FastEmbedEmbeddings())
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 881, in from_documents
return cls.from_texts(
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 843, in from_texts
chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 277, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in embed_documents
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/text_embedding.py", line 107, in embed
yield from self.model.embed(documents, batch_size, parallel, **kwargs)
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_embedding.py", line 262, in embed
yield from self._embed_documents(
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 118, in _embed_documents
yield from self._post_process_onnx_output(self.onnx_embed(batch))
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 85, in onnx_embed
model_output = self.model.run(self.ONNX_OUTPUT_NAMES, onnx_input)
File "/data1/RAG/env/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 266, in run
return self._sess.run(output_names, input_feed, run_options)
Did I miss something? Any help is appreciated, thanks.