mustafasaifee42/VR-Viz

How to handle large data more then 1000000

neerajchourasia opened this issue · 12 comments

Hi Team,

I am trying this library to plot different graphs for data that is in .CSV file and containing more than 1000000 records.
This library is not able to handle this much data, app getting crash. I am able to run the app by using 100000 records.
My requirement is to load more than 1000000 records over the graph and charts.

Can you please help me regards this?

Thank you so much in advance.

@neerajchourasia Can you let me know which graph are you trying to use and does your computer have a dedicated graphics card?

@mustafasaifee42 I am using MacBook Pro here is configuration

Processor : 2.6 GHz Intel Core i7
Memory : 16 GB 2400 MHz DDR4
Graphics : Radeon Pro 560X 4 GB Intel UHD Graphics 630 1536 MB

I am using following graphs :-
vr-viz-Scatter Plot
vr-viz-Scatter Plot Connected
vr-viz-Scatter Plot Droplines
vr-viz-Scatter Plot Projection

Running this as react project using NPM RUN START command.

Have you tried using box instead of sphere as its take more computational power to visualize data? If possible can you share your data sheet via email (saifee.mustafa@gmail.com)

@neerajchourasia did it work for you?

@mustafasaifee42 it is not working.

@neerajchourasia can you share the data sheet so I can check if its a issue that if its hard to do it with web.

@mustafasaifee42 Is there are any limits in number of rows imposed by the library?

@mustafasaifee42 How can I use box instead of sphere?

@mustafasaifee42 I have sent file over mail and shared github link as well.

@mustafasaifee42 Did you get a chance to look into this issue, please help to resolve this issue or suggest me to alternate way to implement.

I have added a feature to visualize millions of data point: https://github.com/mustafasaifee42/VR-Viz#optimizeview-bool

Closing this issue now