/Homunculus-Project

Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

No issues in this repository yet.