[FEATURE]: Request updates for pretraining roberta

[jiahuanluo]

Describe the feature

I encountered issues while trying to run the RoBERTa pretraining using the provided ColossalAI repository code. The code has not been maintained and is currently not functional.