Remove Tantivy to avoid EFS friction
Closed this issue · 0 comments
daryllimyt commented
Motivation
- We are facing problems with EFS, also it's expensive and iteration cycles are slow
- LanceDB can be offloaded to S3 instead of on disk, where it's triggering warnings:
- It's creating warnings when trying to use in a volume
- Remove Tantivy for now - use Tantivy through ParadeDB
Benefits
- Reduced CDK deployment time because we don't have to set up EFS