Pinned Repositories
auto-function-serving
A python package to offload a function call to an http server running on localhost automatically using a decorator. Compatible with multiprocessing, pickle, flask, fastapi, async etc..
Basic-UI-for-GPT-J-6B-with-low-vram
A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.
Basic-UI-for-GPT-Neo-with-low-vram
A basic ui for running gpt neo 2.7B on low vram (3 gb Vram minimum)
Gpt-Neo-Limited-Vram-Cuda
A notebook that runs GPT-Neo with low vram (6 gb) and cuda acceleration by loading it into gpu memory in smaller parts.
Gpu-bandwidth-benchmark
A test to see the speed of transfer of tensors from cpu to gpu in pytorch with 2 cuda streams
Model-compression-by-partially-connected-layers
Decrease the model size by replacing fully connected layers with partially connected layers
saving-and-loading-large-models-pytorch
I am using this to load gpt-j-6b to prevent excessive ram usage
Sofa-Problem-using-simulated-annealing
Basic Proof of concept for using simulated annealing on the sofa problem to get a rough shape.
strongmock
StrongMock is a powerful mocking library for Python that leverages low-level ctypes functionality to provide extensive mocking capabilities. Some care may be needed while using this.
Temporal-Neuron-Variance-Pruning-Demo
An implementation of Variance Pruning: Pruning Language Models via Temporal Neuron Variance by Berry Weinstein, Yonatan Belinkov
arrmansa's Repositories
arrmansa/Sofa-Problem-using-simulated-annealing
Basic Proof of concept for using simulated annealing on the sofa problem to get a rough shape.
arrmansa/strongmock
StrongMock is a powerful mocking library for Python that leverages low-level ctypes functionality to provide extensive mocking capabilities. Some care may be needed while using this.
arrmansa/auto-function-serving
A python package to offload a function call to an http server running on localhost automatically using a decorator. Compatible with multiprocessing, pickle, flask, fastapi, async etc..
arrmansa/Temporal-Neuron-Variance-Pruning-Demo
An implementation of Variance Pruning: Pruning Language Models via Temporal Neuron Variance by Berry Weinstein, Yonatan Belinkov
arrmansa/chain-reaction-python
Some tests on the game of chain reaction
arrmansa/cpython
The Python programming language
arrmansa/exponential-distribution-interval
using dice rolls, chunked dice rolls and the normal method
arrmansa/Fast-Gematria-calculator
tests on https://codegolf.stackexchange.com/questions/252679/fastest-gematria-calculator
arrmansa/fast-sentence-transformers
This repository, called fast sentence transformers, contains code to run 5X faster sentence transformers using tools like quantization and ONNX.
arrmansa/fast-word-equation-solver
https://codegolf.stackexchange.com/questions/34926/write-a-fast-word-equation-solver
arrmansa/fastapi-logging-tests
log unique request id, while replacing newlines for a good log format
arrmansa/leetcode-nice-solutions
Some solutions for leetcode problems that I found fun - either the algorithm or using numpy bruteforce where it shouldn't be
arrmansa/metaballs
Just some tests after watching https://www.youtube.com/watch?v=6oMZb3yP_H8 Cool stuff.
arrmansa/modify-tuples-strings-inplace-python
Methods to modify python immutable python objects inplace using ctypes. Experimental. Warning - Do not use these in your code unless you are very, very sure what you are doing and have very good reasons.
arrmansa/my-originalish-recipies
A non-conventional rapid meringue recipe that results in a limited lifespan treat. (Warning - Uses magnesium)
arrmansa/My-Windows-Laptop-Setup-Guide
My guide to setup windows in a way that is private, fast and updateless.
arrmansa/My-Zephyrus-Duo-Debugging
The list of fixes that were needed on my laptop.
arrmansa/ping-capture-and-save
Interesting code for a stackoverflow question
arrmansa/python-multiprocessing-shared-ctype-value-benchmark
a benchmark to check the ipc speed compared to native speed when incrementing a counter
arrmansa/Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
arrmansa/rock_paper_scissors
arrmansa/rust_test_1
just to check if it runs
arrmansa/sampleproject-PyPI
first test
arrmansa/Serve-Function-with-Python-HTTPServer
Uses HTTP Post requests and pickle object serialization to serve a function. Single thread Python HTTPServer with low overhead and simple code.
arrmansa/smallest-area-of-a-convex-grid-polygon
https://codegolf.stackexchange.com/questions/253633/the-smallest-area-of-a-convex-grid-polygon
arrmansa/starlette
The little ASGI framework that shines. 🌟
arrmansa/TavernAI
Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
arrmansa/test_website
just a test
arrmansa/unittest-module-mocking
Experiments with coverage and mocking modules
arrmansa/vowel-counting-speed-python