How much does it cost to train a first 7B LLaMA model in the cloud?

Question

PhilipMay opened this issue 2 years ago · 3 comments

This can be answered if #1 and #2 is answered.

Answer 1 · 2023-03-23T08:46:49.000Z

Here is a cost indication (8 V100 with 80GB). Not sure if this is the 40GB or 80GB variant.

Answer 2 · 2023-03-23T08:52:06.000Z

Azure "spot instances" the 80G variant cost 8 euros / h and the 40G variant 7 euros / h for 8 A100.

Answer 3 · 2023-03-23T08:56:20.000Z

Screenshot from Azure. 2nd Entry is a mistake (bug) and should read "40 GB".