[Feature Request]: Function to implement own chunking / RAG methods

[Naschkater]

Is there an existing issue for the same feature request?

• I have checked the existing issues.

Is your feature request related to a problem?

RAPTOR is great, but I think beeing able to implement custom chunking and retrieval functions would really push this project to be a one of a kind for RAG apps.

Describe the feature you'd like

A button on the KB config to load a custom chunking / embedding function.

Describe implementation you've considered

Documentation, adoption, use case

Users could implement and share other custom retrieval methods. Custom retrieval methods would allow users to fully customize their KB and enable their data to be used to the fullest.

Additional information

No response

[farbodbj]

I'm trying to use RagFlow to use a RAG-based solution on a large codebase, the naive chunking method available by default on RagFlow often causes the code to be chunked at wrong positions which may result in losing meaning. This can be improved by a customized or pluggable chunking method