about data prepare
bbrookie opened this issue · 2 comments
Thank you for your open source code
When I run run_prepare_shared.sh, I ran into some problems. If I set the nj parameter on line 90 to 100 , the following problems will occur：
~/projects/EEND-master/egs/mini_librispeech/v1/utils/validate_data_dir.sh: no such directory data/simu/data/train_clean_5_ns2_beta2_500 run.pl: job failed, log is in data/simu/.work/random_mixture_train_clean_5_ns2_beta2_500.log utils/split_scp.pl: You are splitting into too many pieces! [reduce $nj (100) to be smaller than the number of lines (5) in data/simu/.work/mixture_train_clean_5_ns2_beta2_500.scp]
But if I set nj to 3, I will only get very little mixed audio.
Another problem is that no matter if I set nj to 3 or 100，There will always be an error record in this file（data/simu/.work/random_mixture_train_clean_5_ns2_beta2_500.log），which is:
Traceback (most recent call last): File "../../../eend/bin/random_mixture.py", line 123, in <module> rir = rirs[random.choice(all_rirs)] File "/home/tp/anaconda3/envs/EEND/lib/python3.7/random.py", line 261, in choice raise IndexError('Cannot choose from an empty sequence') from None IndexError: Cannot choose from an empty sequence
Can you help me answer how I should set the nj value, and how can I avoid problems in the log?Looking forward to your answer. Thanks!
I have the same problem, do u know how to solve it? Thanks!
I faced the same and inside the log file here the error was present. In my case the eend->bin 's python files didn't have execution permission.
data/simu/data/train_clean_5_ns2_beta2_500 run.pl: job failed, log is in data/simu/.work/random_mixture_train_clean_5_ns2_beta2_500.log