ArffDataModel.buildModel() stops indefinitely after building Converter
Vivraan opened this issue · 2 comments
Vivraan commented
When I call ArffModel.buildModel()
, I find that after ArffModel.buildConvert()
is called, ArffModel.buildSplitter()
takes indefinitely long to execute.
Configuration conf = new Configuration();
conf.set("dfs.data.dir", directory.toString());
conf.set("data.input.path", Paths.get("ml-1m", "ratings.arff").toString());
ArffDataModel dataModel = new ArffDataModel(conf);
dataModel.buildDataModel();
Output:
Dec 23, 2018 11:04:46 AM net.librec.data.model.ArffDataModel buildDataModel
INFO: Transform data to Convertor successfully!
SunYatong commented
Yes, it cost a lot of time when converting a tensor to a matrix for splitting.
Vivraan commented
How long should it typically take to do that? My run lasted for more than 40 minutes when I tried it on my PC (Core i5 6th gen at 2.7GHz, 16GB RAM, Windows 10).