1st place solution to RuCode 6.5
Private leaderboard (rucode6.5-team0325) |
---|
Solution Description:
- Pre-trained model: https://huggingface.co/ai-forever/ruRoberta-large
- Optimier: AdamW, Schduler: Cosine Schedule with Warmup, Loss: Cross Entropy
- Keypoints: training only on answers