Hi, I can't contact you via email.
beyondguo opened this issue · 0 comments
beyondguo commented
Hi Jason!
Sorry to interrupt you. I can't contact you via email. I have to try this place.
I am very interested in your EMNLP paper "Good-Enough Example Extrapolation", which provides me lots of inspirations.
When reading the paper, I have some questions :
- You mentioned that " implement GE3 at this final max-pooled hidden layer, which has size 768. That is, the hidden-space augmentation method only updates classifier weights after the BERT encoder", do you mean the weights of transformer are frozen during training? This is a very important detail when I reimplement your paper.
- GE3 needs to average the hidden vectors of all samples in the same class. So how to implement it in a mini-batch training? Or did you implement the GE3 in a two-stage way: First use BERT to get all vectors, and use GE3 for feature augmentation, then use a simple classifier to train on top of these features?
- Could you please provide the source code? I am new to this area and I really want to study this method by code.
I would appreciate it if you could answer my questions and provide the source code. In fact, I am also quite interested in data augmentation and have cited your EDA and other works in my paper and working papers. I look forward to communicate with you! Thanks a lot.