raydium-io/raydium-sdk

Mainnet JSON pool files of 378.89M causing crazy long loading time

wh173-c47 opened this issue · 2 comments

Hi, just wondering why isn't there any pagination (I mean the least here) when working with the SDK / API to fetch liquidity info ? (either no mapping / simple get per mint or so).
Especially this route: https://api.raydium.io/v2/sdk/liquidity/mainnet.json
Which loads in an average of several minutes, of course 378.89MB fetched at once is pretty brutal and far from being efficient in my opinion...

Any reasons behind this design ? Any improvments scheduled so far ? I have to say I quit your UI a while ago as it is constantly lagging, loading an incredible amount of data and consuming my RAM faster than most heavy websites I saw in my life.

Thing is it's a bit annoying to end up storing the file locally hoping for no changes, or fetching it all at each runs.

Would be glad to help if needed by the way.

Best regards

Yes what is happening here

Yes, any updates about fetching this data are appreciated. Would be cool to fetch file for the specified token.