Netflix/metacat

s3 catalog example

tooptoop4 opened this issue · 2 comments

tooptoop4 commented

can you post s3 catalog example (not hive)? i couldn't see any with bucket path, access keys.etc I assume metacat can import object tags.

ajoymajumdar commented

No, s3 catalog is not a connector for s3 as a object store. In Metacat we created a simpler and faster version of the hive metastore data model to store metadata about the data stored. At Netflix, we store data in S3 and so we named it s3 connector.

rae89 commented

So how do you use metacat with data the lives in s3?

  • 👍1