guoguibing/librec

ArffDataModel.buildModel() stops indefinitely after building Converter

Vivraan opened this issue · 2 comments

When I call ArffModel.buildModel(), I find that after ArffModel.buildConvert() is called, ArffModel.buildSplitter() takes indefinitely long to execute.

        Configuration conf = new Configuration();
        conf.set("dfs.data.dir", directory.toString());
        conf.set("data.input.path", Paths.get("ml-1m", "ratings.arff").toString());
        ArffDataModel dataModel = new ArffDataModel(conf);
        dataModel.buildDataModel();

Output:

Dec 23, 2018 11:04:46 AM net.librec.data.model.ArffDataModel buildDataModel
INFO: Transform data to Convertor successfully!

Yes, it cost a lot of time when converting a tensor to a matrix for splitting.

How long should it typically take to do that? My run lasted for more than 40 minutes when I tried it on my PC (Core i5 6th gen at 2.7GHz, 16GB RAM, Windows 10).