Add a conduit streaming interface to querying

[YoEight]

Greetings,

I use the stream function a lot, and while it does the job well for most use-cases, I find it too limiting from time to time. The best example I have is when I'm dealing with batching and have to handle the case when I have a batch smaller than the size I fixed earlier.

One significant quality of life improvement would be to know when we've reached the end of the iterator. It seems doable by looking at that line where we can know how many rows we got in the resultset prior.

What would be excellent is exposing a stream-processing-like interface using conduit library. I'm leaning towards the latter. That's a task I'm willing to tackle on, once I got more bandwidth at work.

What do you think about such improvements?

Thanks for your time.

[chrisdone]

I'm open to adding a conduit for streaming a query. I considered adding one initially.

Provided you handle resources correctly and don't leak anything, including due exceptions, an additional streaming interface via conduit should be fine. 👍

[YoEight]

I'll be happy to be at your scrutiny once I got some time for implementing this feature 😄