This is an early experimental version of transnormer-v2, which is slightly different from the paper Scaling TransNormer to 175 Billion Parameters.
This is an early experimental version of transnormer-v2, which is slightly different from the paper Scaling TransNormer to 175 Billion Parameters.