Reduce memory footprint
willeppy opened this issue · 0 comments
willeppy commented
The widget takes up lots of memory. Part of this is lux issue (see lux-org#369) but we are making it worse with the Altair vis since there is no optimization.
Fix
Add optimizations to only keep the data that is relevant for the particular altar vis, rather than all of the data. Lux is already doing it we just need to replicate.
See below for where lux only keeps the part of the data that is needed for a particular vis
https://github.com/willeppy/lux/blob/86a3547b1e01ad501a9b9e11f57658912f17a207/lux/executor/PandasExecutor.py#L98
Changes would need to be in this file (I think)
https://github.com/willeppy/lux/blob/86a3547b1e01ad501a9b9e11f57658912f17a207/lux/implicit/implicit_plotter.py