Please refer to the following codes for prompting LLaMA-2-70b and GPT models
- LLaMA-2-70b - llama-recipes
- OpenAI models - openai-python
The exact response of all the prompting methods for every question is available in raw_qa.zip
If you use MaScQA in your research, please cite MaScQA: investigating materials science knowledge of large language models
@article{zaki2024mascqa,
title={MaScQA: investigating materials science knowledge of large language models},
author={Zaki, Mohd and Krishnan, NM Anoop and others},
journal={Digital Discovery},
volume={3},
number={2},
pages={313--327},
year={2024},
url={https://pubs.rsc.org/en/content/articlehtml/2024/dd/d3dd00188a},
doi={10.1039/D3DD00188A},
publisher={Royal Society of Chemistry}
}