How do i use custom models?

Question

How do i use custom models?

isntfunny opened this issue a year ago · 7 comments

isntfunny commented a year ago

Is it possible to use custom models, for example from here?

And if so, can they be hosted locally instead of being loaded from an url when using the node version?

DanielHauschildt commented a year ago

No.

Answer 1 · 2023-11-23T18:45:18.000Z

In this line there is a reference to a large model. Is it somehow possible to use that to get better results?

https://github.com/imgly/background-removal-js/blob/main/packages/node/src/schema.ts#L43

Answer 2 · 2023-12-24T07:21:11.000Z

The large model is using float32 compared to float16. The quality is almost the same.

Answer 3 · 2023-12-24T07:21:39.000Z

FYI: I added a new mode with 1.3.0 that outputs the original image resolution

Answer 4 · 2024-02-28T18:07:07.000Z

Is there any way (could be hacky) that we can use custom models?

I understand that you said there was no way to do it currently, but I likely need a stronger model to accurately remove backgrounds as neither of the current ones are good enough for my use case.

Answer 5 · 2024-03-27T18:19:06.000Z

Joining the original question. Whereas the library works great on complex images, it often fails on images with simple objects. Having the ability to switch models would be an amazing feature of this library.

@DanielHauschildt could you elaborate on why the answer is no? Is this because it is hard to integrate or there are no human resources to do it or something else?

Answer 6 · 2024-05-16T05:14:31.000Z

Its just a resource thing.

If you have a proposal for models that work better, please let me know.