/growing-transformer

Dynamically Growing Transformer Using Firefly Neural Architecture Descent

Primary LanguagePython

Dynamically Growing Transformer Using Firefly Neural Architecture Descent

Getting Started

  • Clone repository
  • Install package: pip install -e .
  • Run example: python examples/mlp_train_firefly.py

For development purposes:

  • Install dev dependencies: pip install -r requirements-dev.txt
  • Run tests: pytest