danhper/bigcode-tools

Generating embeddings problem

buaanlsdewm opened this issue · 1 comments

@tuvistavie hello,i use your bigcode-tools to generate token embeddings.i get problems when running the code ‘docker-bigcode bigcode-ast-tools generate-vocabulary --strip-identifiers -o workspace/java-vocabulary-no-ids.tsv workspace/apache-commons-asts.json’ in step 4 in the tutorial,you can see the bug in the following image.Can you solve the problem?thank you
1

This should be fixed by ce54697, please let me know if you still run into any issue.