instructions for generating vocab.pkl?

Question

instructions for generating vocab.pkl?

Opened this issue 3 years ago · 15 comments

Hi. Would it be possible for the authors to either upload vocab.pkl (for the pretrained model), or give instructions and code about how to generate the vocab.pkl file from the CHEMBL24 dataset (or any other dataset used)? Thanks

Answer 1 · 2021-06-28T14:36:39.000Z

Hi. I'm sorry but I lost access to the resources.
Does this issue help?
#11

Answer 2 · 2021-06-28T14:50:24.000Z

Hi Shion Thanks for getting back to me! I checked that issue and it points to the ChEMBL24 dataset. I am interested in how to generate vocab.pkl from this dataset. Actually, I just wish to run the pretrained model on a set of molecules I have, to generate their vector representations. If this is possible without the vocab.pkl file, please let me know! Thanks Regards, Manav

…

________________________________ From: Shion Honda ***@***.***> Sent: Monday, June 28, 2021 3:36 PM To: DSPsleeporg/smiles-transformer ***@***.***> Cc: manavsingh415 ***@***.***>; Author ***@***.***> Subject: Re: [DSPsleeporg/smiles-transformer] instructions for generating vocab.pkl? (#17) Hi. I'm sorry but I lost access to the resources. Does this issue help? #11<#11> — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#17 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AMRX2BDUJKUPHPRPEPZEY43TVCCIDANCNFSM47N53UPA>.

Answer 3 · 2021-06-28T23:45:08.000Z

Well, I meant to mention this comment. I'm glad if it helps.
#11 (comment)

Answer 4 · 2021-09-28T08:31:33.000Z

Hi Shion,

I have tried to generate the vocab.pkl from ChEMBL 24. Using default parameters in the build_vocab.py file, I get a vocabulary size of 75.

If I am not mistaken, this is not compatible with the pretrained model provided:

size mismatch for embed.weight: copying a param with shape torch.Size([45, 256]) from checkpoint, the shape in current model is torch.Size([75, 256]).
size mismatch for out.weight: copying a param with shape torch.Size([45, 256]) from checkpoint, the shape in current model is torch.Size([75, 256]).
size mismatch for out.bias: copying a param with shape torch.Size([45]) from checkpoint, the shape in current model is torch.Size([75]).

Thanks!
M

Answer 5 · 2021-10-02T03:47:11.000Z

Thanks for reporting.
That's strange. Then I might have used different parameters... I'm sorry that it's not set properly.

Answer 6 · 2021-10-02T03:48:10.000Z

Does it help?
#19

Answer 7 · 2021-10-02T05:52:57.000Z

Hi..! Unfortunately the vocab.pkl file from #19 does not help either...

size mismatch for embed.weight: copying a param with shape torch.Size([45, 256]) from checkpoint, the shape in current model is torch.Size([50, 256]).
size mismatch for out.weight: copying a param with shape torch.Size([45, 256]) from checkpoint, the shape in current model is torch.Size([50, 256]).
size mismatch for out.bias: copying a param with shape torch.Size([45]) from checkpoint, the shape in current model is torch.Size([50]).

Answer 8 · 2021-10-20T07:52:57.000Z

I was able to reproduce the vocab.pkl with following steps

Download chemble_24 data form chemble_24_1 with name chembl_24_1_chemreps.txt.gz , this is the same data as mentioned by the author in this issue.
Then open the 01_data_prepare.ipynb file and start running from the following cell
Run till the following line (to obtain chembl_24.csv)
After obtaining the csv file run the build_corpus.py, I have only changed the file reading location and the pandas dataframe column to obtain SMILES. Running this file will take some time.
After obtaining the data/chembl24_corpus.txt by running above, run the build_vocab.py file
Now this vocab will have len(vocab)==45, I am attaching the obtained result below

PS: don't forget to change the the n_layers from 3 to 4 - trfm = TrfmSeq2seq(len(vocab), 256, len(vocab), 4)

Thanks

Regards,
Dinabandhu

Answer 9 · 2021-10-22T00:08:54.000Z

@dinabandhu50
Thank you so much!!

Answer 10 · 2021-11-26T10:41:57.000Z

copying a param with shape torch.Size([45, 256]) from checkpoint, the shape in current model is torch.Size([75, 256]).
size mismatch for out.weight: copying a param with shape torch.Size([45, 256]) from checkpoint, the

have you solved this mismatch problem ?

Answer 11 · 2022-07-03T16:47:02.000Z

It indeed solves the mismatch problem

Answer 12 · 2022-11-11T15:37:11.000Z

where could I fin 01_data_prepare.ipynb ? Thanks.

Answer 13 · 2022-11-11T17:23:38.000Z

I find the data_prepare.ipynb, however, I still have a problem in step of runing the build_corpus.py. At the beginning It shows i don't have the utils module, then I install it with pip install utils. However, when I run it again, it shows the error "cannot import name 'split' from 'utils'". I use Python3 to run this command, do you have any suggestion on it? Thanks.

Answer 14 · 2023-03-22T16:33:46.000Z

Where did you get the "01_data_prepare.ipnyb'?

Answer 15 · 2023-09-09T02:35:01.000Z

Where did you get the "01_data_prepare.ipnyb'?

I think that is 'prepare_data.ipynb' in 'experiments' folder
I could make file from that file