Official Code Repo for the paper "Learning to Play Atari in a World of Tokens" accepted at ICML, 2024