brianpetro/obsidian-smart-connections

No embeddings/links created for new notes

Opened this issue · 5 comments

l-mb commented

I have Smart Connections 2.3.45 on Obsidian 1.7.7 on a Linux desktop.

I use OpenAI Text-3 Large as the embedding model (minimum embedding length set to 100).

It works fine after initial setup, but eventually, new/updated notes don't seem to be indexed/embedded, and going to the notes would show a No entity found for key: <pathname> notification.

Instead, the smart links tab would keep showing the results of the previous notes (I think at least the tab should be cleared if the file isn't embedded right?).

Re-load Sources, Import etc all don't fix it; "Clear All & Re-import" does, but is obviously kind of a big hammer :-)

My expectation would be that embeddings are asynchronously updated/created for updated/new notes?

Suggestion

Not sure if there's a grace/dampening period anywhere, obviously we also wouldn't want it to happen after every key press - maybe after xx minutes of inactivity, and/or with an explicit "Refresh embedding" trigger command, and in the mean time show that it's a wee bit outdated?

brianpetro commented

@l-mb this is something I've been thinking about and do plan on implementing.

In the meantime, the Refresh and make connections command will trigger the re-embedding of the current note.

Local models running in Obsidian are the current bottleneck, since embedding often slows down Obsidian significantly. However, this is a non-issue with API/cloud models.

Thanks for raising the issue 🌴

l-mb commented

Thanks for the response!

There is no "Refresh and make connections" command in my Obsidian command - I assume you mean the "Refresh" button in the sidebar? That seems to do exactly nothing for me (and never really has, as far as I could tell, not even a failure notification).

brianpetro commented

@l-mb Refresh & make connections like this

image

🌴

l-mb commented

Ohhh. I was typing a literal "Refresh and" into the command palette and it's an & ... My bad. Thanks. Yes, that works!

Though maybe that is a function that the refresh icon in the "Smart Connections" pane also could invoke?

brianpetro commented

Yes, I had a feeling that was it. Sorry for the confusion.

Though maybe that is a function that the refresh icon in the "Smart Connections" pane also could invoke?

Agreed. I made a note
image
🌴