/embeddings

Trying to shard big embedding tables in multiple devices paying attention to the communication aspects of parallel inference

Primary LanguagePython

Sharding Strategies for Exploiting Locality in Embedding Tables

Work done for my Master Thesis at University of Padua.