Support for configurations larger than the cache
seldridge opened this issue · 0 comments
seldridge commented
Add support for paging in of data into the cache in the event that an NN configuration is too large to fit in cache. While a straight "get from memory the data you need" approach would work, a better approach would be to page in the weights as needed since the weights are the asymptotically dominant component of the NN configuration.