c_transformers is broken

Question

c_transformers is broken

CSnowRules opened this issue a year ago · 14 comments

Expected Behavior

Please describe the behavior you are expecting.
Install LoLLMS, use GGML model, It just works

Current Behavior

Please describe the behavior you are currently experiencing.
Install LoLLMS, use c_transformers for GGML, install GGML, crash app.py

Steps to Reproduce

Please provide detailed steps to reproduce the issue.

Step 1 run webui.sh from arbitrary user folder on clean Ubuntu Server 22.04.2 minimal install +build-essential
Step 2 install c_transformers and any model (tested so far) via web interface/zoo or terminal
Step 3 crash app.py at line 144

Possible Solution

If you have any suggestions on how to fix the issue, please describe them here.

Context

Please provide any additional context about the issue.
Tested on clean Ubuntu server vm no gpu and Manjaro latest (modified webui.sh to accept Python 3.11) with RTX 2060. Localhost was replaced with local IP in local_config.yaml to allow remote access to headless system for vm.

Screenshots

If applicable, add screenshots to help explain the issue.

corey@llm:~/webui$ ./webui.sh 
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH     .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH.     ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.##  HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_*,*,*,*,*,*,*,*,***,*,**#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.*,,***,***,***,***,***,***,*******HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,***,***,***,***,***,***,***,***,***,***_HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,***,***,***,***,***,***,***,***,***,***,***,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*#HHHHHHHHHHHHHHHH
HHHHHHH,,,**,_H*,***,***,***,,,*,***,***,***,**,,,**,***,***,***H,,*,***HHHHHHHH
HHHHHH.*,,,*,,,,,*,*,*,***#HHHHH.,,*,*,*,*,**_HHHHH.,*,*,*,*,*,*,*,*****HHHHHHHH
HHHHHH.*,***,*,*,***,***,.HHHHHHH_**,***,****HHHHHHH.***,***,***,*******HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,***HHHHHHHH
HHHHHH.,,,,,,_H,,,**,***,***,,,*,***,***,***,**,,,,*,***,***,***H***,***HHHHHHHH
HHHHHHH.,,,,*.H,,,,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,***H*,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH*,***,***,**,,***,***,***,***,***,***,***,***,**.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,*,,#H#,,,,,*,,,*,,,,,,,,*#H*,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,*,***,***,**_.HHHHHHHHHHHHH#*,,,*,***,***,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*,*HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH**,***,***,***,***,***,***,***,***,***,***,*.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,*HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH**,***,***,*******_..HHHHHHHHH.#_*,*,,,***,***HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH*,*,*,******#HHHHHHHHHHHHHHHHHHHHHHHHHHHH._**,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,*,***.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.*#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,*.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3.10...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.26)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.215)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (3.0.10)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.33.3)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.6.3)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->lollms->-r requirements.txt (line 10)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->lollms->-r requirements.txt (line 10)) (1.16.0)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.

Current binding: c_transformers
Current model: None
Menu:
1 - wizard-falcon-7b.ggmlv3.q5_0.bin
2 - wizard-falcon40b.ggmlv3.q6_K.bin
3 - Install model
4 - Change binding
5 - Back
Enter your choice: 5
Couldn't build model. Try to reinstall binding c_transformers
 ╔══════════════════════════════════════════════════╗ 
 ║           Building mounted Personalities         ║ 
 ╚══════════════════════════════════════════════════╝ 
* english/generic/lollms
selected : 0
 ╔══════════════════════════════════════════════════╗ 
 ║                      Done                        ║ 
 ╚══════════════════════════════════════════════════╝ 
Checking discussions database... ok
Your personal data is stored here :/home/corey/Documents/lollms
debug mode:false
Please open your browser and go to http://10.105.86.151:9600 to view the ui
Client yzykF6SKfBInYTB9AAAB connected
Install model triggered
Model install requested
Model path : https://huggingface.co/TheBloke/orca_mini_3B-GGML/resolve/main/orca-mini-3b.ggmlv3.q4_0.bin
100%|██████████████████████████████████████| 1.93G/1.93G [02:58<00:00, 10.8MB/s]
File downloaded successfully
Traceback (most recent call last):
  File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/socketio/server.py", line 733, in _handle_event_internal
    r = server._trigger_event(data[0], namespace, sid, *data[1:])
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/socketio/server.py", line 758, in _trigger_event
    return self.handlers[namespace][event](*args)
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/flask_socketio/__init__.py", line 282, in _handler
    return self._handle_event(handler, message, namespace, sid,
  File "/home/corey/webui/lollms-webui/env/lib/python3.10/site-packages/flask_socketio/__init__.py", line 828, in _handle_event
    ret = handler(*args)
  File "/home/corey/webui/lollms-webui/api/__init__.py", line 168, in cancel_install
    model_name = data["model_name"]
KeyError: 'model_name'
2023-06-25T20:37:17Z <Thread at 0x7f5e31992660: <bound method Server._handle_event_internal of <socketio.server.Server object at 0x7f5e31ac25c0>>(<socketio.server.Server object at 0x7f5e31ac25c0>, 'yzykF6SKfBInYTB9AAAB', 'k2DKRbBIWYxfpHnAAAAA', ['cancel_install', {}], '/', None)> failed with KeyError

./webui.sh: line 144: 17897 Illegal instruction     (core dumped) python app.py

Answer 1 · 2023-06-26T20:14:14.000Z

It looks like you pressed cancel_install and i guess there is a little bug in the cancel button frontend code. I'll fix that. Thanks for reporting the bug.

Answer 2 · 2023-06-29T01:47:44.000Z

Hi ParisNeo, thanks for looking into this. The app.py line 144 crash when installing a model for c_transformers is still repeatable via the terminal or web UI, with or without cancelling the install.
Also, commit c56bf45 added a requirement for the python3-tk or python3.10-tk deb package (maybe equivalent for windows, idk) in app.py, line 44.

Is the line 144 crash due to 0 vram usage by chance? This machine is all (dual xeon, server) CPU.

There is one error in the output that remains constant, but I don't THINK it is related. CUDA isn't being used here, only CPU.:

`Collecting lit (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/lit-15.0.7.tar.gz (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.3/132.3 kB 13.3 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [3 lines of output]
Looking in indexes: https://download.pytorch.org/whl/cu117
ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=40.8.0
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Couldn't find Cuda build tools on your PC. Reverting to CPU.`

I've tried many ways, but here's a clean run output with the same result every time (after installing tk)# comments for steps:
`corey@llm:/webui$ rm -rf /Documents/lollms/!("models")#deleted all user files outside of models
corey@llm:/webui$ rm -rf *#deleted all lolms buid files+webui.sh
corey@llm:/webui$ wget https://github.com/ParisNeo/lollms-webui/raw/main/webui.sh
--2023-06-29 00:57:03-- https://github.com/ParisNeo/lollms-webui/raw/main/webui.sh
Resolving github.com (github.com)... 140.82.114.3
Connecting to github.com (github.com)|140.82.114.3|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/ParisNeo/lollms-webui/main/webui.sh [following]
--2023-06-29 00:57:03-- https://raw.githubusercontent.com/ParisNeo/lollms-webui/main/webui.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.109.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.111.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5923 (5.8K) [text/plain]
Saving to: ‘webui.sh’

webui.sh 100%[=====================================================================================================>] 5.78K --.-KB/s in 0s

2023-06-29 00:57:03 (16.3 MB/s) - ‘webui.sh’ saved [5923/5923]

corey@llm:/webui$ chmod +x webui.sh#made webui.sh executable
corey@llm:/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH. ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.## HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Cloning repository...
./webui.sh: line 66: rem: command not found
Cloning into './lollms-webui'...
remote: Enumerating objects: 7023, done.
remote: Counting objects: 100% (7023/7023), done.
remote: Compressing objects: 100% (1968/1968), done.
remote: Total 7023 (delta 4858), reused 7006 (delta 4853), pack-reused 0
Receiving objects: 100% (7023/7023), 14.45 MiB | 9.75 MiB/s, done.
Resolving deltas: 100% (4858/4858), done.
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (22.0.2)
Collecting pip
Using cached pip-23.1.2-py3-none-any.whl (2.1 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 22.0.2
Uninstalling pip-22.0.2:
Successfully uninstalled pip-22.0.2
Successfully installed pip-23.1.2
Collecting tqdm (from -r requirements.txt (line 1))
Using cached tqdm-4.65.0-py3-none-any.whl (77 kB)
Collecting psutil (from -r requirements.txt (line 2))
Using cached psutil-5.9.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
Collecting flask (from -r requirements.txt (line 3))
Using cached Flask-2.3.2-py3-none-any.whl (96 kB)
Collecting flask_socketio (from -r requirements.txt (line 4))
Using cached Flask_SocketIO-5.3.4-py3-none-any.whl (17 kB)
Collecting pytest (from -r requirements.txt (line 5))
Using cached pytest-7.4.0-py3-none-any.whl (323 kB)
Collecting pyyaml (from -r requirements.txt (line 6))
Using cached PyYAML-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (682 kB)
Collecting markdown (from -r requirements.txt (line 7))
Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting gevent (from -r requirements.txt (line 8))
Using cached gevent-22.10.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.4 MB)
Collecting gevent-websocket (from -r requirements.txt (line 9))
Using cached gevent_websocket-0.10.1-py3-none-any.whl (22 kB)
Collecting lollms (from -r requirements.txt (line 10))
Using cached lollms-2.0.28-py3-none-any.whl (518 kB)
Collecting langchain (from -r requirements.txt (line 11))
Using cached langchain-0.0.218-py3-none-any.whl (1.2 MB)
Collecting requests (from -r requirements.txt (line 12))
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Collecting eventlet (from -r requirements.txt (line 13))
Using cached eventlet-0.33.3-py2.py3-none-any.whl (226 kB)
Collecting websocket-client (from -r requirements.txt (line 14))
Using cached websocket_client-1.6.1-py3-none-any.whl (56 kB)
Collecting Werkzeug>=2.3.3 (from flask->-r requirements.txt (line 3))
Using cached Werkzeug-2.3.6-py3-none-any.whl (242 kB)
Collecting Jinja2>=3.1.2 (from flask->-r requirements.txt (line 3))
Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting itsdangerous>=2.1.2 (from flask->-r requirements.txt (line 3))
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from flask->-r requirements.txt (line 3))
Using cached click-8.1.3-py3-none-any.whl (96 kB)
Collecting blinker>=1.6.2 (from flask->-r requirements.txt (line 3))
Using cached blinker-1.6.2-py3-none-any.whl (13 kB)
Collecting python-socketio>=5.0.2 (from flask_socketio->-r requirements.txt (line 4))
Using cached python_socketio-5.8.0-py3-none-any.whl (56 kB)
Collecting iniconfig (from pytest->-r requirements.txt (line 5))
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting packaging (from pytest->-r requirements.txt (line 5))
Using cached packaging-23.1-py3-none-any.whl (48 kB)
Collecting pluggy<2.0,>=0.12 (from pytest->-r requirements.txt (line 5))
Using cached pluggy-1.2.0-py3-none-any.whl (17 kB)
Collecting exceptiongroup>=1.0.0rc8 (from pytest->-r requirements.txt (line 5))
Using cached exceptiongroup-1.1.1-py3-none-any.whl (14 kB)
Collecting tomli>=1.0.0 (from pytest->-r requirements.txt (line 5))
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting zope.event (from gevent->-r requirements.txt (line 8))
Using cached zope.event-5.0-py3-none-any.whl (6.8 kB)
Collecting zope.interface (from gevent->-r requirements.txt (line 8))
Using cached zope.interface-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (246 kB)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Collecting greenlet>=2.0.0 (from gevent->-r requirements.txt (line 8))
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting Pillow (from lollms->-r requirements.txt (line 10))
Using cached Pillow-9.5.0-cp310-cp310-manylinux_2_28_x86_64.whl (3.4 MB)
Collecting flask-cors (from lollms->-r requirements.txt (line 10))
Using cached Flask_Cors-4.0.0-py2.py3-none-any.whl (14 kB)
Collecting simple-websocket (from lollms->-r requirements.txt (line 10))
Using cached simple_websocket-0.10.1-py3-none-any.whl (7.5 kB)
Collecting SQLAlchemy<3,>=1.4 (from langchain->-r requirements.txt (line 11))
Using cached SQLAlchemy-2.0.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
Collecting aiohttp<4.0.0,>=3.8.3 (from langchain->-r requirements.txt (line 11))
Using cached aiohttp-3.8.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)
Collecting async-timeout<5.0.0,>=4.0.0 (from langchain->-r requirements.txt (line 11))
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting dataclasses-json<0.6.0,>=0.5.7 (from langchain->-r requirements.txt (line 11))
Using cached dataclasses_json-0.5.8-py3-none-any.whl (26 kB)
Collecting langchainplus-sdk>=0.0.17 (from langchain->-r requirements.txt (line 11))
Using cached langchainplus_sdk-0.0.17-py3-none-any.whl (25 kB)
Collecting numexpr<3.0.0,>=2.8.4 (from langchain->-r requirements.txt (line 11))
Using cached numexpr-2.8.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (381 kB)
Collecting numpy<2,>=1 (from langchain->-r requirements.txt (line 11))
Using cached numpy-1.25.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.6 MB)
Collecting openapi-schema-pydantic<2.0,>=1.2 (from langchain->-r requirements.txt (line 11))
Using cached openapi_schema_pydantic-1.2.4-py3-none-any.whl (90 kB)
Collecting pydantic<2,>=1 (from langchain->-r requirements.txt (line 11))
Using cached pydantic-1.10.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Collecting tenacity<9.0.0,>=8.1.0 (from langchain->-r requirements.txt (line 11))
Using cached tenacity-8.2.2-py3-none-any.whl (24 kB)
Collecting charset-normalizer<4,>=2 (from requests->-r requirements.txt (line 12))
Using cached charset_normalizer-3.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB)
Collecting idna<4,>=2.5 (from requests->-r requirements.txt (line 12))
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->-r requirements.txt (line 12))
Using cached urllib3-2.0.3-py3-none-any.whl (123 kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 12))
Using cached certifi-2023.5.7-py3-none-any.whl (156 kB)
Collecting dnspython>=1.15.0 (from eventlet->-r requirements.txt (line 13))
Using cached dnspython-2.3.0-py3-none-any.whl (283 kB)
Collecting six>=1.10.0 (from eventlet->-r requirements.txt (line 13))
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting attrs>=17.3.0 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached multidict-6.0.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (114 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached yarl-1.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (268 kB)
Collecting frozenlist>=1.1.1 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached frozenlist-1.3.3-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (149 kB)
Collecting aiosignal>=1.1.2 (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11))
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting marshmallow<4.0.0,>=3.3.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached marshmallow-3.19.0-py3-none-any.whl (49 kB)
Collecting marshmallow-enum<2.0.0,>=1.5.1 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting typing-inspect>=0.4.0 (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached typing_inspect-0.9.0-py3-none-any.whl (8.8 kB)
Collecting MarkupSafe>=2.0 (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3))
Using cached MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting typing-extensions>=4.2.0 (from pydantic<2,>=1->langchain->-r requirements.txt (line 11))
Using cached typing_extensions-4.7.0-py3-none-any.whl (33 kB)
Collecting bidict>=0.21.0 (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4))
Using cached bidict-0.22.1-py3-none-any.whl (35 kB)
Collecting python-engineio>=4.3.0 (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4))
Using cached python_engineio-4.4.1-py3-none-any.whl (53 kB)
Collecting wsproto (from simple-websocket->lollms->-r requirements.txt (line 10))
Using cached wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting mypy-extensions>=0.3.0 (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11))
Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Collecting h11<1,>=0.9.0 (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10))
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Installing collected packages: zope.interface, zope.event, websocket-client, urllib3, typing-extensions, tqdm, tomli, tenacity, six, pyyaml, python-engineio, psutil, pluggy, Pillow, packaging, numpy, mypy-extensions, multidict, MarkupSafe, markdown, itsdangerous, iniconfig, idna, h11, greenlet, frozenlist, exceptiongroup, dnspython, click, charset-normalizer, certifi, blinker, bidict, attrs, async-timeout, yarl, wsproto, Werkzeug, typing-inspect, SQLAlchemy, requests, python-socketio, pytest, pydantic, numexpr, marshmallow, Jinja2, gevent, eventlet, aiosignal, simple-websocket, openapi-schema-pydantic, marshmallow-enum, langchainplus-sdk, gevent-websocket, flask, aiohttp, flask_socketio, flask-cors, dataclasses-json, lollms, langchain
Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.3 Pillow-9.5.0 SQLAlchemy-2.0.17 Werkzeug-2.3.6 aiohttp-3.8.4 aiosignal-1.3.1 async-timeout-4.0.2 attrs-23.1.0 bidict-0.22.1 blinker-1.6.2 certifi-2023.5.7 charset-normalizer-3.1.0 click-8.1.3 dataclasses-json-0.5.8 dnspython-2.3.0 eventlet-0.33.3 exceptiongroup-1.1.1 flask-2.3.2 flask-cors-4.0.0 flask_socketio-5.3.4 frozenlist-1.3.3 gevent-22.10.2 gevent-websocket-0.10.1 greenlet-2.0.2 h11-0.14.0 idna-3.4 iniconfig-2.0.0 itsdangerous-2.1.2 langchain-0.0.218 langchainplus-sdk-0.0.17 lollms-2.0.28 markdown-3.4.3 marshmallow-3.19.0 marshmallow-enum-1.5.1 multidict-6.0.4 mypy-extensions-1.0.0 numexpr-2.8.4 numpy-1.25.0 openapi-schema-pydantic-1.2.4 packaging-23.1 pluggy-1.2.0 psutil-5.9.5 pydantic-1.10.9 pytest-7.4.0 python-engineio-4.4.1 python-socketio-5.8.0 pyyaml-6.0 requests-2.31.0 simple-websocket-0.10.1 six-1.16.0 tenacity-8.2.2 tomli-2.0.1 tqdm-4.65.0 typing-extensions-4.7.0 typing-inspect-0.9.0 urllib3-2.0.3 websocket-client-1.6.1 wsproto-1.2.0 yarl-1.9.2 zope.event-5.0 zope.interface-6.0
Welcome! It seems this is your first use of the new lollms app.
To make it clear where your data are stored, we now give the user the choice where to put its data.
This allows you to mutualize models which are heavy, between multiple lollms compatible apps.
You can change this at any tome using the lollms-update_path script or by simply change the content of the global_paths_cfg.yaml file.
Please provide a folder to store your configurations files, your models and your personal data (database, custom personalities etc).
Folder path: (/home/corey/Documents/lollms):
Selected: /home/corey/Documents/lollms
No personalities found in your personal space.
Cloning the personalities zoo
Cloning into '/home/corey/Documents/lollms/personalities_zoo'...
remote: Enumerating objects: 1559, done.
remote: Counting objects: 100% (788/788), done.
remote: Compressing objects: 100% (433/433), done.
remote: Total 1559 (delta 366), reused 592 (delta 280), pack-reused 771
Receiving objects: 100% (1559/1559), 41.40 MiB | 10.41 MiB/s, done.
Resolving deltas: 100% (513/513), done.
No personalities found in your personal space.
Cloning the personalities zoo
Cloning into '/home/corey/Documents/lollms/bindings_zoo'...
remote: Enumerating objects: 571, done.
remote: Counting objects: 100% (423/423), done.
remote: Compressing objects: 100% (202/202), done.
remote: Total 571 (delta 328), reused 299 (delta 215), pack-reused 148
Receiving objects: 100% (571/571), 2.91 MiB | 7.08 MiB/s, done.
Resolving deltas: 100% (387/387), done.

Current binding: None
Menu:
1 - Lord of LLMs Remote nodes (by ParisNeo)
2 - gpt4all (by Nomic-ai)
3 - Hugging Face (by Hugging face Inc)
4 - Official llamacpp binding (by abetlen)
5 - C Transformer (by marella)
6 - GPT-J (by marella)
7 - The original GPT (by Open AI)
8 - PyLLamaCpp (by abdeladim)
9 - GPT-J (by abdeladim)
10 - AutoGPTQ (by PanQiWei)
11 - This is a binding template (Not usable) (by the binding author)
12 - Back
Enter your choice: 5
You selected binding: c_transformers
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
----------------------*
Installing c_transformers
----------------------*
Checking pytorch
Looking in indexes: https://download.pytorch.org/whl/cu117
Collecting torch
Downloading https://download.pytorch.org/whl/cu117/torch-2.0.1%2Bcu117-cp310-cp310-linux_x86_64.whl (1843.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 GB 12.1 MB/s eta 0:00:00
Collecting torchvision
Downloading https://download.pytorch.org/whl/cu117/torchvision-0.15.2%2Bcu117-cp310-cp310-linux_x86_64.whl (6.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.1/6.1 MB 11.8 MB/s eta 0:00:00
Collecting torchaudio
Downloading https://download.pytorch.org/whl/cu117/torchaudio-2.0.2%2Bcu117-cp310-cp310-linux_x86_64.whl (4.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 11.7 MB/s eta 0:00:00
Collecting filelock (from torch)
Downloading https://download.pytorch.org/whl/filelock-3.9.0-py3-none-any.whl (9.7 kB)
Requirement already satisfied: typing-extensions in ./env/lib/python3.10/site-packages (from torch) (4.7.0)
Collecting sympy (from torch)
Downloading https://download.pytorch.org/whl/sympy-1.11.1-py3-none-any.whl (6.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.5/6.5 MB 11.9 MB/s eta 0:00:00
Collecting networkx (from torch)
Downloading https://download.pytorch.org/whl/networkx-3.0-py3-none-any.whl (2.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 11.8 MB/s eta 0:00:00
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch) (3.1.2)
Collecting triton==2.0.0 (from torch)
Downloading https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.3/63.3 MB 11.5 MB/s eta 0:00:00
Collecting cmake (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/cmake-3.25.0-py2.py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 11.6 MB/s eta 0:00:00
Collecting lit (from triton==2.0.0->torch)
Downloading https://download.pytorch.org/whl/lit-15.0.7.tar.gz (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.3/132.3 kB 13.3 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [3 lines of output]
Looking in indexes: https://download.pytorch.org/whl/cu117
ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=40.8.0
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Couldn't find Cuda build tools on your PC. Reverting to CPU.
Collecting torch
Downloading torch-2.0.1-cp310-cp310-manylinux1_x86_64.whl (619.9 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 619.9/619.9 MB 10.9 MB/s eta 0:00:00
Collecting torchvision
Downloading torchvision-0.15.2-cp310-cp310-manylinux1_x86_64.whl (6.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 11.1 MB/s eta 0:00:00
Collecting torchaudio
Downloading torchaudio-2.0.2-cp310-cp310-manylinux1_x86_64.whl (4.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 11.6 MB/s eta 0:00:00
Collecting filelock (from torch)
Downloading filelock-3.12.2-py3-none-any.whl (10 kB)
Requirement already satisfied: typing-extensions in ./env/lib/python3.10/site-packages (from torch) (4.7.0)
Collecting sympy (from torch)
Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 10.4 MB/s eta 0:00:00
Collecting networkx (from torch)
Downloading networkx-3.1-py3-none-any.whl (2.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 11.1 MB/s eta 0:00:00
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch) (3.1.2)
Collecting nvidia-cuda-nvrtc-cu11==11.7.99 (from torch)
Downloading nvidia_cuda_nvrtc_cu11-11.7.99-2-py3-none-manylinux1_x86_64.whl (21.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21.0/21.0 MB 11.2 MB/s eta 0:00:00
Collecting nvidia-cuda-runtime-cu11==11.7.99 (from torch)
Downloading nvidia_cuda_runtime_cu11-11.7.99-py3-none-manylinux1_x86_64.whl (849 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 849.3/849.3 kB 12.9 MB/s eta 0:00:00
Collecting nvidia-cuda-cupti-cu11==11.7.101 (from torch)
Downloading nvidia_cuda_cupti_cu11-11.7.101-py3-none-manylinux1_x86_64.whl (11.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 11.2 MB/s eta 0:00:00
Collecting nvidia-cudnn-cu11==8.5.0.96 (from torch)
Downloading nvidia_cudnn_cu11-8.5.0.96-2-py3-none-manylinux1_x86_64.whl (557.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 557.1/557.1 MB 10.0 MB/s eta 0:00:00
Collecting nvidia-cublas-cu11==11.10.3.66 (from torch)
Downloading nvidia_cublas_cu11-11.10.3.66-py3-none-manylinux1_x86_64.whl (317.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 317.1/317.1 MB 11.1 MB/s eta 0:00:00
Collecting nvidia-cufft-cu11==10.9.0.58 (from torch)
Downloading nvidia_cufft_cu11-10.9.0.58-py3-none-manylinux1_x86_64.whl (168.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 168.4/168.4 MB 11.4 MB/s eta 0:00:00
Collecting nvidia-curand-cu11==10.2.10.91 (from torch)
Downloading nvidia_curand_cu11-10.2.10.91-py3-none-manylinux1_x86_64.whl (54.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.6/54.6 MB 11.1 MB/s eta 0:00:00
Collecting nvidia-cusolver-cu11==11.4.0.1 (from torch)
Downloading nvidia_cusolver_cu11-11.4.0.1-2-py3-none-manylinux1_x86_64.whl (102.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 102.6/102.6 MB 11.6 MB/s eta 0:00:00
Collecting nvidia-cusparse-cu11==11.7.4.91 (from torch)
Downloading nvidia_cusparse_cu11-11.7.4.91-py3-none-manylinux1_x86_64.whl (173.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.2/173.2 MB 10.7 MB/s eta 0:00:00
Collecting nvidia-nccl-cu11==2.14.3 (from torch)
Downloading nvidia_nccl_cu11-2.14.3-py3-none-manylinux1_x86_64.whl (177.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 177.1/177.1 MB 10.4 MB/s eta 0:00:00
Collecting nvidia-nvtx-cu11==11.7.91 (from torch)
Downloading nvidia_nvtx_cu11-11.7.91-py3-none-manylinux1_x86_64.whl (98 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.6/98.6 kB 13.8 MB/s eta 0:00:00
Collecting triton==2.0.0 (from torch)
Downloading triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.3/63.3 MB 11.4 MB/s eta 0:00:00
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch) (59.6.0)
Collecting wheel (from nvidia-cublas-cu11==11.10.3.66->torch)
Downloading wheel-0.40.0-py3-none-any.whl (64 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.5/64.5 kB 10.4 MB/s eta 0:00:00
Collecting cmake (from triton==2.0.0->torch)
Downloading cmake-3.26.4-py2.py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (24.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.0/24.0 MB 10.2 MB/s eta 0:00:00
Collecting lit (from triton==2.0.0->torch)
Downloading lit-16.0.6.tar.gz (153 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.7/153.7 kB 16.2 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy in ./env/lib/python3.10/site-packages (from torchvision) (1.25.0)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from torchvision) (2.31.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./env/lib/python3.10/site-packages (from torchvision) (9.5.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from jinja2->torch) (2.1.3)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->torchvision) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->torchvision) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->torchvision) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->torchvision) (2023.5.7)
Collecting mpmath>=0.19 (from sympy->torch)
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 12.5 MB/s eta 0:00:00
Building wheels for collected packages: lit
Building wheel for lit (pyproject.toml) ... done
Created wheel for lit: filename=lit-16.0.6-py3-none-any.whl size=93582 sha256=c1768dff6ef06bf0601d1de860882d304f0319aae0a8a375f88c234eb104483e
Stored in directory: /tmp/pip-ephem-wheel-cache-lact0le1/wheels/14/f9/07/bb2308587bc2f57158f905a2325f6a89a2befa7437b2d7e137
Successfully built lit
Installing collected packages: mpmath, lit, cmake, wheel, sympy, nvidia-nccl-cu11, nvidia-cufft-cu11, nvidia-cuda-nvrtc-cu11, networkx, filelock, nvidia-nvtx-cu11, nvidia-cusparse-cu11, nvidia-curand-cu11, nvidia-cuda-runtime-cu11, nvidia-cuda-cupti-cu11, nvidia-cublas-cu11, nvidia-cusolver-cu11, nvidia-cudnn-cu11, triton, torch, torchvision, torchaudio
Successfully installed cmake-3.26.4 filelock-3.12.2 lit-16.0.6 mpmath-1.3.0 networkx-3.1 nvidia-cublas-cu11-11.10.3.66 nvidia-cuda-cupti-cu11-11.7.101 nvidia-cuda-nvrtc-cu11-11.7.99 nvidia-cuda-runtime-cu11-11.7.99 nvidia-cudnn-cu11-8.5.0.96 nvidia-cufft-cu11-10.9.0.58 nvidia-curand-cu11-10.2.10.91 nvidia-cusolver-cu11-11.4.0.1 nvidia-cusparse-cu11-11.7.4.91 nvidia-nccl-cu11-2.14.3 nvidia-nvtx-cu11-11.7.91 sympy-1.12 torch-2.0.1 torchaudio-2.0.2 torchvision-0.15.2 triton-2.0.0 wheel-0.40.0
Pytorch installed successfully!!
Trying to install a cuda enabled version of ctransformers
Collecting ctransformers
Downloading ctransformers-0.2.10.tar.gz (213 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 213.7/213.7 kB 3.0 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting huggingface-hub (from ctransformers)
Downloading huggingface_hub-0.15.1-py3-none-any.whl (236 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 236.8/236.8 kB 12.7 MB/s eta 0:00:00
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (3.12.2)
Collecting fsspec (from huggingface-hub->ctransformers)
Downloading fsspec-2023.6.0-py3-none-any.whl (163 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 13.5 MB/s eta 0:00:00
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (2.31.0)
Requirement already satisfied: tqdm>=4.42.1 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.65.0)
Requirement already satisfied: pyyaml>=5.1 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (6.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (4.7.0)
Requirement already satisfied: packaging>=20.9 in ./env/lib/python3.10/site-packages (from huggingface-hub->ctransformers) (23.1)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->huggingface-hub->ctransformers) (2023.5.7)
Building wheels for collected packages: ctransformers
Building wheel for ctransformers (pyproject.toml) ... done
Created wheel for ctransformers: filename=ctransformers-0.2.10-cp310-cp310-linux_x86_64.whl size=394541 sha256=3a43651c247d10da748467005cfefa0e742338938f858f140659902ef9011030
Stored in directory: /tmp/pip-ephem-wheel-cache-rc9okwme/wheels/e2/96/f0/eddd9a9febd7f45c948d3bbda84f847186bf46c82a8e7d967b
Successfully built ctransformers
Installing collected packages: fsspec, huggingface-hub, ctransformers
Successfully installed ctransformers-0.2.10 fsspec-2023.6.0 huggingface-hub-0.15.1
Collecting transformers (from -r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading transformers-4.30.2-py3-none-any.whl (7.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.2/7.2 MB 10.0 MB/s eta 0:00:00
Collecting accelerate (from -r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2))
Downloading accelerate-0.20.3-py3-none-any.whl (227 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.6/227.6 kB 13.8 MB/s eta 0:00:00
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.12.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (0.15.1)
Requirement already satisfied: numpy>=1.17 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (1.25.0)
Requirement already satisfied: packaging>=20.0 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (23.1)
Requirement already satisfied: pyyaml>=5.1 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (6.0)
Collecting regex!=2019.12.17 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading regex-2023.6.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (770 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 770.4/770.4 kB 9.5 MB/s eta 0:00:00
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2.31.0)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 10.7 MB/s eta 0:00:00
Collecting safetensors>=0.3.1 (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1))
Downloading safetensors-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 8.1 MB/s eta 0:00:00
Requirement already satisfied: tqdm>=4.27 in ./env/lib/python3.10/site-packages (from transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: torch>=1.6.0 in ./env/lib/python3.10/site-packages (from accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.0.1)
Requirement already satisfied: fsspec in ./env/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2023.6.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./env/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (4.7.0)
Requirement already satisfied: sympy in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (1.12)
Requirement already satisfied: networkx in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.1)
Requirement already satisfied: jinja2 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in ./env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.0.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (59.6.0)
Requirement already satisfied: wheel in ./env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (0.40.0)
Requirement already satisfied: cmake in ./env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (3.26.4)
Requirement already satisfied: lit in ./env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (16.0.6)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->transformers->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 1)) (2023.5.7)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from jinja2->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in ./env/lib/python3.10/site-packages (from sympy->torch>=1.6.0->accelerate->-r /home/corey/Documents/lollms/bindings_zoo/c_transformers/requirements.txt (line 2)) (1.3.0)
Installing collected packages: tokenizers, safetensors, regex, transformers, accelerate
Successfully installed accelerate-0.20.3 regex-2023.6.3 safetensors-0.3.1 tokenizers-0.13.3 transformers-4.30.2
Installed successfully
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.

Current binding: c_transformers
Current model: None
Menu:
1 - orca-mini-3b.ggmlv3.q4_0.bin
2 - wizard-falcon-7b.ggmlv3.q5_0.bin
3 - wizard-falcon40b.ggmlv3.q6_K.bin
4 - Install model
5 - Change binding
6 - Back
Enter your choice: 1
You selected model: orca-mini-3b.ggmlv3.q4_0.bin
./webui.sh: line 144: 2989 Illegal instruction (core dumped) python app.py
corey@llm:~/webui$ sed 's/orca-mini-3b.ggmlv3.q4_0.bin/wizard-falcon-7b.ggmlv3.q5_0.bin/' ~/Documents/lollms/configs/local_config.yaml
active_personality_id: 0
binding_name: c_transformers
config: local_config
ctx_size: 2048
db_path: database.db
debug: false
host: localhost
model_name: wizard-falcon-7b.ggmlv3.q5_0.bin
n_predict: 1024
n_threads: 8
override_personality_model_parameters: false
personalities:

english/generic/lollms
port: 9600
repeat_last_n: 40
repeat_penalty: 1.2
seed: -1
temperature: 0.9
top_k: 50
top_p: 0.95
user_name: user
version: 7
corey@llm:/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH. ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.## HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.28)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.218)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (0.33.3)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (4.0.0)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (1.16.0)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.7.0)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
./webui.sh: line 144: 3329 Illegal instruction (core dumped) python app.py
corey@llm:/webui$ sed 's/orca-mini-3b.ggmlv3.q4_0.bin/wizard-falcon40b.ggmlv3.q6_K.bin/' ~/Documents/lollms/configs/local_config.yaml
active_personality_id: 0
binding_name: c_transformers
config: local_config
ctx_size: 2048
db_path: database.db
debug: false
host: localhost
model_name: wizard-falcon40b.ggmlv3.q6_K.bin
n_predict: 1024
n_threads: 8
override_personality_model_parameters: false
personalities:
english/generic/lollms
port: 9600
repeat_last_n: 40
repeat_penalty: 1.2
seed: -1
temperature: 0.9
top_k: 50
top_p: 0.95
user_name: user
version: 7
corey@llm:/webui$ ./webui.sh
\u001b[34m
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH .HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHH. ,HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHH.## HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH#.HHHHH_,,,,,,,,,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHH.,,,,,,,,HHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH.,,,,,,,,,,,,HHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH*,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHH#,,,,,,,,,,,,**HHHHHHHHHHHHHHHHH
HHHHHHHHHH..HHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,#HHHHHHHHHHHHHHHH
HHHHHHH,,,,_H*,,,,,,,,,,,,,,,,H,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,#HHHHH.,,,,,,_HHHHH.,,,,,,,,*****HHHHHHHH
HHHHHH.,,,,,*,.HHHHHHH,,HHHHHHH.,,,HHHHHHHH
HHHHHH.,,,,,,,,,,,,,,,,,,,.HHHHH.,,,,,,,,,,,,.HHHHHH,,,,,,,,,,,,,,,,,HHHHHHHH
HHHHHH.,,,,,,_H,,,,,,,,,,,,,,,,,,,H,HHHHHHHH
HHHHHHH.,,,,.H,,,,,,,,,,,,,,,,,,,,,,,,,H,,,,_HHHHHHHHH
HHHHHHHHHHHHHHH,,,,,,,,,,,,,.HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH,,,,,,,,,,#H#,,,,,,,,,,,,,,,,#H*,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,,,.HHHHHHHHHHHHH#,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,,,,,,,,,.HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,HHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHH*,,,*******..HHHHHHHHH.#,,,,,HHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHH,,,***#HHHHHHHHHHHHHHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHH
HHHHHHHHHHHHHHHH.,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH.#HHHHHHHHHHHH
HHHHHHHHHHHHHHH_,,,.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHH,,#HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHH.HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
\u001b[0m
Internet Connection working fine
Checking for Git...is installed
Pulling latest version...
Already up to date.
Checking for python3...is installed
Checking for venv module...is installed
Creating virtual environment...is created
Activating virtual environment...is active
Installing requirements...
Requirement already satisfied: pip in ./env/lib/python3.10/site-packages (23.1.2)
Requirement already satisfied: tqdm in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (5.9.5)
Requirement already satisfied: flask in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.3.2)
Requirement already satisfied: flask_socketio in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (5.3.4)
Requirement already satisfied: pytest in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (7.4.0)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (6.0)
Requirement already satisfied: markdown in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.4.3)
Requirement already satisfied: gevent in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (22.10.2)
Requirement already satisfied: gevent-websocket in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (0.10.1)
Requirement already satisfied: lollms in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (2.0.28)
Requirement already satisfied: langchain in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (0.0.218)
Requirement already satisfied: requests in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (2.31.0)
Requirement already satisfied: eventlet in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (0.33.3)
Requirement already satisfied: websocket-client in ./env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (1.6.1)
Requirement already satisfied: Werkzeug>=2.3.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.3.6)
Requirement already satisfied: Jinja2>=3.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (3.1.2)
Requirement already satisfied: itsdangerous>=2.1.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (2.1.2)
Requirement already satisfied: click>=8.1.3 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (8.1.3)
Requirement already satisfied: blinker>=1.6.2 in ./env/lib/python3.10/site-packages (from flask->-r requirements.txt (line 3)) (1.6.2)
Requirement already satisfied: python-socketio>=5.0.2 in ./env/lib/python3.10/site-packages (from flask_socketio->-r requirements.txt (line 4)) (5.8.0)
Requirement already satisfied: iniconfig in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.0)
Requirement already satisfied: packaging in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (23.1)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (1.1.1)
Requirement already satisfied: tomli>=1.0.0 in ./env/lib/python3.10/site-packages (from pytest->-r requirements.txt (line 5)) (2.0.1)
Requirement already satisfied: zope.event in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (5.0)
Requirement already satisfied: zope.interface in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (6.0)
Requirement already satisfied: setuptools in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (59.6.0)
Requirement already satisfied: greenlet>=2.0.0 in ./env/lib/python3.10/site-packages (from gevent->-r requirements.txt (line 8)) (2.0.2)
Requirement already satisfied: Pillow in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: flask-cors in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (4.0.0)
Requirement already satisfied: simple-websocket in ./env/lib/python3.10/site-packages (from lollms->-r requirements.txt (line 10)) (0.10.1)
Requirement already satisfied: SQLAlchemy<3,>=1.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.0.17)
Requirement already satisfied: aiohttp<4.0.0,>=3.8.3 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (3.8.4)
Requirement already satisfied: async-timeout<5.0.0,>=4.0.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (4.0.2)
Requirement already satisfied: dataclasses-json<0.6.0,>=0.5.7 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.5.8)
Requirement already satisfied: langchainplus-sdk>=0.0.17 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (0.0.17)
Requirement already satisfied: numexpr<3.0.0,>=2.8.4 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (2.8.4)
Requirement already satisfied: numpy<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.25.0)
Requirement already satisfied: openapi-schema-pydantic<2.0,>=1.2 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.2.4)
Requirement already satisfied: pydantic<2,>=1 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (1.10.9)
Requirement already satisfied: tenacity<9.0.0,>=8.1.0 in ./env/lib/python3.10/site-packages (from langchain->-r requirements.txt (line 11)) (8.2.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2.0.3)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests->-r requirements.txt (line 12)) (2023.5.7)
Requirement already satisfied: dnspython>=1.15.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: six>=1.10.0 in ./env/lib/python3.10/site-packages (from eventlet->-r requirements.txt (line 13)) (1.16.0)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (23.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (6.0.4)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp<4.0.0,>=3.8.3->langchain->-r requirements.txt (line 11)) (1.3.1)
Requirement already satisfied: marshmallow<4.0.0,>=3.3.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (3.19.0)
Requirement already satisfied: marshmallow-enum<2.0.0,>=1.5.1 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.5.1)
Requirement already satisfied: typing-inspect>=0.4.0 in ./env/lib/python3.10/site-packages (from dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./env/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 3)) (2.1.3)
Requirement already satisfied: typing-extensions>=4.2.0 in ./env/lib/python3.10/site-packages (from pydantic<2,>=1->langchain->-r requirements.txt (line 11)) (4.7.0)
Requirement already satisfied: bidict>=0.21.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (0.22.1)
Requirement already satisfied: python-engineio>=4.3.0 in ./env/lib/python3.10/site-packages (from python-socketio>=5.0.2->flask_socketio->-r requirements.txt (line 4)) (4.4.1)
Requirement already satisfied: wsproto in ./env/lib/python3.10/site-packages (from simple-websocket->lollms->-r requirements.txt (line 10)) (1.2.0)
Requirement already satisfied: mypy-extensions>=0.3.0 in ./env/lib/python3.10/site-packages (from typing-inspect>=0.4.0->dataclasses-json<0.6.0,>=0.5.7->langchain->-r requirements.txt (line 11)) (1.0.0)
Requirement already satisfied: h11<1,>=0.9.0 in ./env/lib/python3.10/site-packages (from wsproto->simple-websocket->lollms->-r requirements.txt (line 10)) (0.14.0)
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
Personalities zoo found in your personal space.
Pulling last personalities zoo
Already up to date.
./webui.sh: line 144: 3398 Illegal instruction (core dumped) python app.py
corey@llm:/webui$

`

Answer 3 · 2023-06-29T12:46:26.000Z

Hi I need to ask the developers of ctransformers about this.