skyisveryblue1/LLM

References for LLM

Live Caption

https://github.com/tmoroney/auto-subs.git

• https://github.com/openai/whisper.git
• https://github.com/SYSTRAN/faster-whisper.git

https://github.com/abb128/LiveCaptions.git

• https://github.com/abb128/april-asr.git
• https://github.com/microsoft/onnxruntime.git

https://github.com/m1guelpf/auto-subtitle

https://sourceforge.net/projects/vatsg/files/latest/download

Acrobat SDK

• https://github.com/adobe/dc-acrobat-sdk-docs.git

• https://opensource.adobe.com/dc-acrobat-sdk-docs/library/jsapiref/JS_API_AcroJS.html

• https://github.com/adobe/pdfservices-python-sdk.git

• https://github.com/adobe/pdfservices-python-sdk-samples.git

• https://github.com/adobe/PDFServices.NET.SDK.Samples.git

• https://github.com/adobe/pdfservices-java-sdk-samples.git

• https://github.com/adobe/pdfservices-java-sdk-samples/archive/refs/tags/v4.1.0.tar.gz

• https://github.com/adobe/pdfservices-java-sdk-samples/archive/refs/tags/v3.5.1.tar.gz

• https://github.com/adobe/pdfservices-node-sdk-samples.git

Java based HTML to PDF

• https://github.com/danfickle/openhtmltopdf.git
• https://github.com/flyingsaucerproject/flyingsaucer.git
• https://github.com/itext/itext-pdfhtml-java.git

HTML Equation Editor

• https://github.com/arnog/mathlive.git
• https://github.com/wiris/html-integrations.git
• https://github.com/camdenreslink/equation-editor.git

OCR

• https://github.com/tesseract-ocr/tesseract.git
• https://github.com/JaidedAI/EasyOCR.git
• https://github.com/mindee/doctr.git
• https://github.com/ocropus-archive/DUP-ocropy.git
• https://github.com/kba/awesome-ocr

WordNet

• https://wordnet.princeton.edu/
• https://github.com/globalwordnet/english-wordnet.git

Knowhows

Nginx configuration for load balance of Apache Tomcat servers

• https://docs.nginx.com/nginx/deployment-guides/load-balance-third-party/apache-tomcat/

Oracle 19c pricing

• https://www.oracle.com/a/ocom/docs/corporate/pricing/technology-price-list-070617.pdf
• https://redresscompliance.com/oracle-technology-price-list-how-to-calculate-pricing/

Neural Machine Translation

Document

• https://github.com/tensorflow/nmt.git
• https://github.com/ZahraBenslimane/Neural-Machine-Translation-by-Jointly-Learning-to-Align-and-Translate.git

Open source project

• https://github.com/UKPLab/EasyNMT.git
• https://github.com/OpenNMT/OpenNMT-py.git
• https://github.com/OpenNMT/OpenNMT-tf
• https://github.com/OpenNMT/CTranslate2.git

LLM

Source code

1. ollama: https://github.com/ollama/ollama.git
2. llama.cpp : https://github.com/ggerganov/llama.cpp.git
3. llm on pc: https://github.com/lyogavin/airllm.git
4. https://github.com/nomic-ai/gpt4all.git

Training LLM

1. https://www.datacamp.com/tutorial/how-to-train-a-llm-with-pytorch
   • source code: https://github.com/keitazoumana/Medium-Articles-Notebooks/blob/main/Train_your_LLM.ipynb
   • dataset: https://huggingface.co/datasets/tatsu-lab/alpaca
2. seq2seq
   • https://github.com/google/seq2seq.git
   • https://github.com/bentrevett/pytorch-seq2seq.git
   • https://github.com/farizrahman4u/seq2seq.git
3. ONNX https://github.com/microsoft/onnxruntime.git

Tools

1. Langchain
   • https://github.com/langchain-ai/langchain.git
   • https://github.com/langchain-ai/langchainjs.git
2. https://github.com/llmware-ai/llmware.git
3. https://github.com/langfuse/langfuse.git
4. https://github.com/kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference.git
5. https://github.com/h2oai/h2o-llmstudio.git
6. https://github.com/langgenius/dify.git
7. https://github.com/huggingface/transformers.git

Informations

• https://github.com/Hannibal046/Awesome-LLM.git
• https://github.com/Barnacle-ai/awesome-llm-list.git
• https://github.com/ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing.git

References

• https://github.com/scutan90/DeepLearning-500-questions.git

Toolkits & Drivers

1. Pytorch

   • https://download.pytorch.org/whl/cu111/torch-1.8.1%2Bcu111-cp37-cp37m-linux_x86_64.whl
   • https://download.pytorch.org/whl/cu111/torchvision-0.9.1%2Bcu111-cp37-cp37m-linux_x86_64.whl
   • torchaudio-0.8.1-cp37-cp37m-manylinux1_x86_64.whl

2. Tensorflow

   • https://pypi.tuna.tsinghua.edu.cn/packages/c3/4a/00a5f8ee5b3c07220d0f565926bf13494e2fdbb00da97e01c23256ee3deb/tensorflow_cpu-2.1.0-cp27-cp27mu-manylinux2010_x86_64.whl#sha256=7fa4781930c03b2105482db63994bd14eb17e6b1a0f62a17cbf85d76491c9f82
   • https://pypi.tuna.tsinghua.edu.cn/packages/03/d1/05e73ce37a628d5cd5a40b43115f2a6ef4ce0c016f80e0f22deed32ddbc0/tensorflow_cpu-2.1.3-cp36-cp36m-manylinux2010_x86_64.whl#sha256=385e5387f2fc0e06e1c4f811ac6a2f7cc2a81a044a3bd6497bbfeb813dd6db2b
   • https://pypi.tuna.tsinghua.edu.cn/packages/80/23/cfceead292f257a2b928d2163b1cfbce9b5ecf8fe92c53779d62ddd8483e/tensorflow_cpu-2.1.3-cp37-cp37m-win_amd64.whl#sha256=a9eabde5c2fd58ec8ad581cded3d462b4ca4e0603842ec9c9715527960821f62
   • https://pypi.tuna.tsinghua.edu.cn/packages/5a/3c/743393aa268e0c29a00b0dd6689762f8469ea634613836822842f9692dae/tensorflow_cpu-2.3.0-cp35-cp35m-manylinux2010_x86_64.whl#sha256=82dd2df04aa5e1c002f3c018b63ac803f56ee3f7ee5412a9c76202f7a2575fea
   • https://pypi.tuna.tsinghua.edu.cn/packages/34/34/7fab6d4dc27ce3f14343d61795b259803d87c4b7d82b05ba15f2779dac33/tensorflow_cpu-2.3.0-cp38-cp38-win_amd64.whl#sha256=877d2f5b7aeff4c0ae4e92b2aa1a1909962d08acad9d2d0761a161d1f179ddf0
   • https://pypi.tuna.tsinghua.edu.cn/packages/74/32/1544170f8ec616aed04790c4df2e45470a87ea7001eddb86c036ce6b112a/tensorflow_cpu-2.8.0-cp310-cp310-manylinux2010_x86_64.whl#sha256=60f7f3258906c6e0753b4a57b461acc2d4360f367714b0bc684b9456658a31ea
   • https://pypi.tuna.tsinghua.edu.cn/packages/6e/40/45150d18bf83609335c4bea9a9918eb2dfd94eb61c4aa4a760b566a27b24/tensorflow_cpu-2.8.0-cp310-cp310-win_amd64.whl#sha256=0399da0d90d13a4601f9c1fca89c8c6c4524698bbb8cd2befff2413e25c64415
   • https://pypi.tuna.tsinghua.edu.cn/packages/6f/e4/69eab4bce33479915fff732c681978ba0bca27bde8bd99687662ac35de29/tensorflow_cpu-2.9.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=6666ddeae45e1f41da788cb4bdea3435aba16edb0bc17b7ac00631c7c9eb052e
   • https://pypi.tuna.tsinghua.edu.cn/packages/c3/ea/ddd57c1cce2dde5320b27968d2aa6f08ab1c889d768406811eec4ead8e76/tensorflow_cpu-2.9.1-cp310-cp310-win_amd64.whl#sha256=7442cd76a1d72473c466732a2aff8eba08c78afbf47fc6f2f019ef861878900d

3. NVIDIA Drivers & SDK

   • A100: https://www.nvidia.com/content/DriverDownloads/confirmation.php?url=/tesla/550.54.15/NVIDIA-Linux-x86_64-550.54.15.run&lang=us&type=Data%20Center%20/%20Tesla

   • V100: https://us.download.nvidia.com/tesla/450.248.02/NVIDIA-Linux-x86_64-450.248.02.run?_gl=1*43tr9u*_gcl_au*MTEyNzU2MDMyMC4xNzE2Nzc5NTUz

   • P100: https://www.nvidia.com/content/DriverDownloads/confirmation.php?url=/tesla/440.95.01/NVIDIA-Linux-x86_64-440.95.01.run&lang=us&type=Data%20Center%20/%20Tesla

   • K80: https://www.nvidia.com/content/DriverDownloads/confirmation.php?url=/tesla/440.95.01/NVIDIA-Linux-x86_64-440.95.01.run&lang=us&type=Data%20Center%20/%20Tesla

   • CUDA 10.0: https://developer.nvidia.com/compute/cuda/10.0/Prod/local_installers/cuda_10.0.130_410.48_linux

   • CUDA 10.1 RHEL6: https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_418.87.00_rhel6.run

   • CUDA 10.1 Linux: https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_418.87.00_linux.run

   • CUDA 10.1 Windows: https://developer.download.nvidia.com/compute/cuda/10.1/Prod/local_installers/cuda_10.1.243_426.00_windows.exe?_gl=1*1dj8n28*_gcl_au*MTEyNzU2MDMyMC4xNzE2Nzc5NTUz

   • CUDA 11.0.1 Linux: https://developer.download.nvidia.com/compute/cuda/11.0.1/local_installers/cuda_11.0.1_450.36.06_linux.run

   • CUDA 11.0.1 Windows: https://developer.download.nvidia.com/compute/cuda/11.0.1/local_installers/cuda_11.0.1_451.22_win10.exe?_gl=1*1dj8n28*_gcl_au*MTEyNzU2MDMyMC4xNzE2Nzc5NTUz

   • CUDA 11.5 Linux: https://developer.download.nvidia.com/compute/cuda/11.5.0/local_installers/cuda_11.5.0_495.29.05_linux.run

   • CUDA 12.0 Linux: https://developer.download.nvidia.com/compute/cuda/12.0.0/local_installers/cuda_12.0.0_525.60.13_linux.run

   • CUDA 12.0 Windows: https://developer.download.nvidia.com/compute/cuda/12.0.0/local_installers/cuda_12.0.0_527.41_windows.exe?_gl=1*17wduhk*_gcl_au*MTEyNzU2MDMyMC4xNzE2Nzc5NTUz

4. JDK

   • https://www.oracle.com/webapps/redirect/signon?nexturl=https://download.oracle.com/otn/java/jdk/11.0.24%2B7/21cffd70ff1e41a3a5ef9898f46e442d/jdk-11.0.24_linux-aarch64_bin.rpm
   • https://www.oracle.com/webapps/redirect/signon?nexturl=https://download.oracle.com/otn/java/jdk/11.0.24%2B7/21cffd70ff1e41a3a5ef9898f46e442d/jdk-11.0.24_linux-aarch64_bin.tar.gz
   • https://www.oracle.com/webapps/redirect/signon?nexturl=https://download.oracle.com/otn/java/jdk/11.0.24%2B7/21cffd70ff1e41a3a5ef9898f46e442d/jdk-11.0.24_linux-x64_bin.deb
   • https://www.oracle.com/webapps/redirect/signon?nexturl=https://download.oracle.com/otn/java/jdk/11.0.24%2B7/21cffd70ff1e41a3a5ef9898f46e442d/jdk-11.0.24_linux-x64_bin.rpm
   • https://www.oracle.com/webapps/redirect/signon?nexturl=https://download.oracle.com/otn/java/jdk/11.0.24%2B7/21cffd70ff1e41a3a5ef9898f46e442d/jdk-11.0.24_linux-x64_bin.tar.gz
   • https://download.oracle.com/java/17/latest/jdk-17_linux-aarch64_bin.tar.gz
   • https://download.oracle.com/java/17/latest/jdk-17_linux-aarch64_bin.rpm
   • https://download.oracle.com/java/17/latest/jdk-17_linux-x64_bin.tar.gz
   • https://download.oracle.com/java/17/latest/jdk-17_linux-x64_bin.deb
   • https://download.oracle.com/java/17/latest/jdk-17_linux-x64_bin.rpm

Others

1. DSpace

• Source code: https://github.com/DSpace/DSpace.git
• Backend (REST API): https://github.com/DSpace/DSpace/releases
• Frontend (User Interface): https://github.com/DSpace/dspace-angular/releases

2. Online document editor

• https://github.com/ONLYOFFICE/DocumentServer.git
• https://github.com/ether/etherpad-lite.git
• https://github.com/CollaboraOnline/online.git

3. Online diagram editor

• https://github.com/jgraph/drawio.git

---

Open source LLM

• https://github.com/meta-llama/llama.git
• https://github.com/meta-llama/llama3.git
• https://github.com/QwenLM/Qwen.git
• https://github.com/QwenLM/Qwen-VL.git
• https://github.com/lm-sys/FastChat.git
• https://github.com/yxuansu/OpenAlpaca.git
• https://github.com/ludwig-ai/ludwig.git

LLM Model

• https://huggingface.co/meta-llama
• https://huggingface.co/mistralai
• https://huggingface.co/tiiuae/falcon-7b