When will buffer queues be enabled?

[bodybreaker]

I noticed that it states that requests can queue when all llama.cpp instances are busy.
I was wondering if the queuing is done per llama.cpp server or per slot?
I am currently trying to scale up from 1 to multiple llama.cpp servers and the paddler_requests_buffered metric is always 0.

[mcharytoniuk]

@bodybreaker I will check if those metrics work correctly and get back to you.