astronomy-commons/hats-import

Gaia margin cache catalog on Epyc has a wrong index dtype and misses its name

hombit opened this issue · 1 comments

hombit commented

Bug report

Gaia margin catalog on epyc has a weird metadata for the index - it has name of __index_level_0__ (vs _hipscat_index for "normal" catalogs) and dtype of int64 (vs uint64)

with fsspec.open('https://epyc.astro.washington.edu/~lincc-frameworks/hipscat_surveys/gaia_dr3/gaia_10arcs/_common_metadata') as f:
    meta = pa.parquet.read_metadata(f)
meta.schema
...
  optional int64 field_id=-1 __index_level_0__;

Before submitting
Please check the following:

  • I have described the situation in which the bug arose, including what code was executed, information about my environment, and any applicable data others will need to reproduce the problem.
  • I have included available evidence of the unexpected behavior (including error messages, screenshots, and/or plots) as well as a descriprion of what I expected instead.
  • If I have a solution in mind, I have provided an explanation and/or pseudocode and/or task list.