Implement configurable external storage
Closed this issue · 2 comments
austin-hilberg commented
Implement configurable external storage
dimitri-yatsenko commented
Required development
- Separate blobs serialization from database query functionality datajoint/mym#10
- Implement store specification in a configuration file. Maybe use
dj.set
as with other options or implement ajson
configuration file similar to datajoint-python. - Implement table declaration support for
blob@store
, including reverse engineering in.describe
- Implement UUID checksum matching datajoint-python
- Implement external store tracking table matching datajoint-python
- Impelement the path subfolding scheme matching datajoint-python
- Update insert to write blobs to the external file
- Update fetch to read blobs from the external file
- Impelement the delete and file cleanup methods matching those of datajoint-python
shenshan commented
Decisions:
2. Configuration
- potential retirement of
dj.set
, - configure with
dj_local_conf.json
, - inherit from mapping object?
- global and local config: order of default, global, local, env?
- check the availability of uuid support from MATLAB
https://www.mathworks.com/matlabcentral/answers/240447-using-java-uuid-in-matlab#answer_191523
If too hard, we can skip the support of uuid.