Please add option for a local reranking model!

[exito100]

I would think many people would want to use a fully private non-naive RAG setup. So why not add teh option to use Ollama for the reranking model too?

There is at least on GGUF reranker that Ollama supports: epoch/rank-zephyr. I have tried many platforms to get a quality RAG system working and Kotaemonm comes closest so far but is lacking the local reranker. Perhaps another model that is smaller would also be a good option for people with resource issues.