PicoCreator
Helping build AI LLM for opensource and specialized use cases - and is part of the RWKV team ( https://wiki.rwkv.com )
recursal.aiSingapore
Pinned Repositories
gpu.js
GPU Accelerated JavaScript
awesome-list-factory-building-games
List of factory building games - like factorio and satisfactory
Babel-Pile
Ongoing organised collection of various AI datasets, to eventually encompass the knowledge of all humankind.
list-of-meetup-alternatives
Compiling a list of meetup alternatives, and possible replacement technologies. PR is welcomed.
QKV-Transformers-are-RNNs
QKV Transformers are RNN's with extra steps and larger memory capacity
RWKV-LM-LoRA
RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
smol-dev-js
Smol personal AI, for smol incremental tasks in a JS project
RWKV-cpp-node
Node.js implementation binding for the RWKV.cpp module
RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
inboxkitten
Disposable email inbox powered by serverless mailgun kittens
PicoCreator's Repositories
PicoCreator/smol-dev-js
Smol personal AI, for smol incremental tasks in a JS project
PicoCreator/list-of-meetup-alternatives
Compiling a list of meetup alternatives, and possible replacement technologies. PR is welcomed.
PicoCreator/RWKV-LM-LoRA
RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
PicoCreator/awesome-list-factory-building-games
List of factory building games - like factorio and satisfactory
PicoCreator/QKV-Transformers-are-RNNs
QKV Transformers are RNN's with extra steps and larger memory capacity
PicoCreator/2nd-brain
2nd-brain project, inspired heavily by swyx
PicoCreator/Babel-Pile
Ongoing organised collection of various AI datasets, to eventually encompass the knowledge of all humankind.
PicoCreator/constitution-multi-lang
A collection of multiple nation, constitutional legal documents, with their official language translation.
PicoCreator/open-meetup-registry
PicoCreator/super-silly-depifier
PicoCreator/honkit-plugin-cloudinary-url-fix
Gitbook.com tends to format image upload to cloudinary with a "\" before "_" in their markdown code. This causes wierd compatibility issues which this plugin fixes
PicoCreator/testing-zero-to-hero
PicoCreator/2019.jsconf.asia
PicoCreator/configami-k8-template
Various configami scripts that can be used as useful templates for larger config scripts
PicoCreator/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
PicoCreator/dockerfile-plus
New commands for Dockerfile
PicoCreator/honkit-plugin-tabs
Port of gitbook-plugin-tabs , configured for honkit
PicoCreator/image-archive
Repository for various images (or memes), for me to link to in publications, studies, or keep track of in general
PicoCreator/json2binidx_tool
PicoCreator/lm-evaluation-harness
A framework for few-shot evaluation of language models.
PicoCreator/Not-DnD-5thSRD
This is Not DnD 5thSRD! It is a creative expression, of a common set of rules, for another realm. That is losely compatible with the rules of Dungeon and Dragons.
PicoCreator/RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
PicoCreator/RWKV-World-HF-Tokenizer
PicoCreator/RWKV.com
PicoCreator/rwkv.cpp
INT4 and FP16 inference on CPU for RWKV language model
PicoCreator/test-gpl
PicoCreator/unee-t-ui-test
Uilicious test scripts for unee-t
PicoCreator/UTM
Virtual machines for iOS and macOS
PicoCreator/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
PicoCreator/webdriverio
Next-gen WebDriver test automation framework for Node.js