wmkouw/libTLDA

Need too much memory?

Opened this issue · 1 comments

X: memory usage: 705.4+ MB, Z: memory usage: 350.5+ MB, I encountered this error ( MemoryError: Unable to allocate 1010. GiB for an array with shape (368104, 368104) and data type float64 ) when I use tca, How to solve this problem?Looking forward to your reply.

You have too many samples. TCA is a kernel-based method, meaning its memory cost is quadratic+.
The standard approach is to subsample your data; take every 10th, 100th or 1000th sample.