nomic-ai/nomic

Not raising value error if id field is too long.

EdAyers opened this issue · 2 comments

I'm getting 'pyarrow.lib.ChunkedArray' object has no attribute 'utf8_length' at this line instead of it raising the error on the next line when I have an id field that is too long.

first_match = data.filter(data[project.id_field].utf8_length() > 36).to_pylist()[0]

mwe

# nomic 1.1.6
# python 3.10.10
# pyarrow 11.0.0
from nomic import atlas
import numpy as np

project = atlas.AtlasProject(
    name="asdf",
    modality="embedding",
    unique_id_field="id",
    reset_project_if_exists=True,
)

embeddings = np.random.rand(273, 384)
data = [{"id": "hello {i}" * 128} for i in range(273)]

project.add_embeddings(embeddings=embeddings, data=data)

Thanks noting this. Should be addressed by #148, leaving issue open until merged.

Merged. Closing.