Where can I download the weights of the 7B model?
BenBill2077 opened this issue · 33 comments
Still waiting for the email.
Bittorrent (magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA). Some people have allegedly been getting ghosted, and getting ghosted ain't cool, so just do it, the speeds via bittorrent ain't bad once it gets started.
try this hacked llama: https://github.com/juncongmoo/pyllama pretty good
Just search Twitter for torrents.
Just to be clear downloading and using these weights is all totally legal as weights are not copyrightable.
Whether uploading these weights in the first place was legal if the person signed the Meta form, is a grey area.
Well it would be like writing every even letter of a Wikipedia article to a text file and then creating a form which says if I give you this text file you have to promise not to give it to anyone else. Now would that hold up in court? 🤔
I have a feeling Meta doesn't mind the weights being on Torrent sights but doesn't want to "officially" release them to the public so they can deny all responsibility.
Besides which the license only refers to the "software" and not the data. Which means you could just rewrite the inference code to avoid copyright.
I would recommend this: https://github.com/howl-anderson/unlocking-the-power-of-llms for anyone live in China.
The shawwn/llama-dl README.md file has an archived copy here, if it's helpful: https://archive.is/7t3it
https://archive.is/7t3it
seems not available for now :(
https://archive.is/7t3it
seems not available for now :(
Yup... just get the torrent, or the IPFS mirror.
Some have been having trouble with the magnet. For preservation, I've reuploaded the original torrent content to an ipfs node.
http gateways (the links below) will be slow to retrieve until more people have the files. Use a local node like Kubo or Brave Browser if possible - it's faster and helps reseed the content for others temporarily (after downloading), or permanently (if pinned).
Full backup: ipfs://Qmb9y5GCkTG7ZzbBWMu2BXwMkzyCKcUjtEKPpgdZ7GEFKm
7B: ipfs://QmbvdJ7KgvZiyaqHw5QtQxRtUd7pCAdkWWbzuvyKusLGTw 13B: ipfs://QmPCfCEERStStjg4kfj3cmCUu1TP7pVQbxdFMwnhpuJtxk 30B: ipfs://QmSD8cxm4zvvnD35KKFu8D9VjXAavNoGWemPW1pQ3AF9ZZ 65B: ipfs://QmdWH379NQu8XoesA8AFw9nKV2MpGR4KohK7WyugadAKTh
You can download normally, or use these commands from the Kubo CLI:
# Optional: Preload the 7B model. Retrieves the content you don't have yet. Replace with another CID, as needed. ipfs refs -r QmbvdJ7KgvZiyaqHw5QtQxRtUd7pCAdkWWbzuvyKusLGTw # Optional: Pin the 7B model. The GC removes old content you don't use, this prevents the model from being GC'd if enabled. ipfs pin add QmbvdJ7KgvZiyaqHw5QtQxRtUd7pCAdkWWbzuvyKusLGTw # Download from IPFS and save to disk via CLI: ipfs get QmbvdJ7KgvZiyaqHw5QtQxRtUd7pCAdkWWbzuvyKusLGTw --output ./7B
Where can I get the original LLaMA model weights?
Easy, just fill out this official form, give them very clear reasoning why you should be granted a temporary (Identifiable) download link, and hope that you don't get ghosted. Or you could just use the torrent, like the rest of us.
Thanks.How can I use the torrent?
While you can use any bittorrent client, just use a client like Aria2c (It's basically just a CLI downloader that just so happens to support bittorrent), which on Ubuntu can be gotten through
sudo apt install aria2, and on Windows and Mac OS (Which I'm not very familiar with) can be gotten from this page. Witharia2cin your path (On Ubuntu, it just is. For Windows/Mac, in a termal or CMD, just navigate into the path ofaria2c), run one of the following...For the 7B model...
aria2c --select-file 21-23,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'For the 13B model...
aria2c --select-file 1-4,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'For the 30B model...
aria2c --select-file 5-10,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'For the 65B model...
aria2c --select-file 11-20,25,26 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'And for everything...
aria2c 'magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA'Once the download status goes to "SEED", you can press CTRL+C to end the process, or alternatively, let it seed to a ratio of 1.0, at which point it'll close on it's own. On Windows/Mac, the usage is nearly identical, just use ./ in front of the executable name (Again, while in the directory of it), and for Windows specifically, call the executable as
./aria2c.exe. The last version for Mac was aria2 1.35.0. Once you have the models, it's up to you how you use them. Also note, aria2c doesn't trim ajacent files from what's selected (Torrents always require things be in chunks, and chunks almost always contain either the middle of a file, or two ends of two files, so this is normal), so if you see model dirs that you didn't want, just remove them once the download is complete. There's also the other magnet link that was specifically a part of this pull request (magnet:?xt=urn:btih:ZXXDAUWYLRUXXBHUYEMS6Q5CE5WA3LVA&dn=LLaMA), but I could not get this one to work for me. Also note, I personally could not get either of these magnet links to work within Colab (Even using reconstructed seed files, made fromaria2c --bt-metadata-only=true --bt-save-metadata=true MAGNETURLwouldn't start on there), but I could get the former link working on my local system.
What does getting 'Ghosted' mean?
What does getting 'Ghosted' mean?
Sorry for my ignorance, I thought it had some technical meaning beyond that. Such as those that obtain the weights through non standard channels end up suffering from some sort of negative effect of 'Ghosting'
Thanks!
Bittorrent (magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA). Some people have allegedly been getting ghosted, and getting ghosted ain't cool, so just do it, the speeds via bittorrent ain't bad once it gets started.
it has no config.json for 13B. Where I can obtain it ?
(solved)
How long is the waitlist?
You likely will not even get a response from the team at Facebook. 'Ghosted' is a term used commonly around here. None the less it never hurts to try.
Ok.
How do I use these weights?
I think you can use them with hugging face transformers
Bittorrent (magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA). Some people have allegedly been getting ghosted, and getting ghosted ain't cool, so just do it, the speeds via bittorrent ain't bad once it gets started.
it has no config.json for 13B. Where I can obtain it ?
(solved)
I would appreciate it if you could provide information on the location of the config.json file. I am currently encountering an error while attempting to run the command "python -m 'fastchat.model.apply_delta'," and it appears to be related to the config file.
These methods seems very helpful! Thanks all of you!
selissarichi.com
Hey @Daviljoe193 thank you! I'm wondering is it possible to only download the 7B and 13B weights?
I find a useful way to download model weights, just use this in terminal
curl -o- https://raw.githubusercontent.com/shawwn/llama-dl/56f50b96072f42fb2520b1ad5a1d6ef30351f23c/llama.sh | $(brew --prefix)/bin/bash
you can copy the script in your computer and choose to download the sepcific weighets (i.e. 7B) in llama.sh
@kenhuangsy you can try this
curl -o- https://raw.githubusercontent.com/shawwn/llama-dl/56f50b96072f42fb2520b1ad5a1d6ef30351f23c/llama.sh | $(brew --prefix)/bin/bash
It help to me
@Cliffia123 thanks!
I would recommend this: https://github.com/howl-anderson/unlocking-the-power-of-llms for anyone live in China.
The ability to download is no longer available.
这是完整版的llama-7b权重文件吗？
这是完整版的llama-7b权重文件吗？
这是完整版的llama-7b权重文件吗？
I saw your answer, thank you very much for answering my question!
Thank you!
这是完整版的llama-7b权重文件吗？
这个应该是 https://huggingface.co/huggyllama/llama-7b
为什么这个里面有两组大文件呀，一组的后缀是.safetensors；另一组的后缀是.bin；并且它们的大小是相同的。
