shilad/wikibrain

Performance of WikidataDao

Closed this issue · 1 comments

tobyli commented

@shilad Hi Shilad

I use the SR module and the Wikidata module for my degree-of-separation program these days. They are super cool and pretty reliable so far. I fixed one or two minor bugs.

The performance of WikidataDao is kind of on the slow side. It takes me around 10sec to 30sec to do a BFS with 2k-3k edges (I can go through 100k+ links with LocalLinkDao in similar time)

I'm wondering if this is the performance that we'll have to live with....Is it normal that there is such a difference in performance between WikidataDao and other DAOs?

Thanks

shilad commented

Where's your degree-of-separation program? Sounds cool!

WikidataDao is definitely not designed for performance. What information do you exactly need? One possible solution is to write your own cache using the ObjectDb.