sikfeng/quantum-transfer-learning-with-bert

Quantum Transfer Learning with BERT

Quantum Transfer Learning with BERT

This is largely adapted from this tutorial.

Instead of using ResNet on the Hymenoptera dataset, I adapted it for BERT on GLUE.

The model uses a classical pretrained model (BERT) and finetunes a quantum circuit on the GLUE dataset using the BERT embeddings. The BERT model has its weights frozen for simplicity.

Libraries used

• PyTorch for the BERT model
• 🤗 Transformers for the BERT model
• 🤗 Datasets for the GLUE dataset
• Pennylane for the Quantum circuit