How to stream autogen responses using FASTAPI ?

[AkashKulkarni4444]

Does autogen have a streaming option/feature ?
Rather than just providing output all at once streaming should be present.
If it is present can it be integrated with fastAPI ?

[sonichi]

AutoGen Studio uses FastAPI.
cc @victordibia

[ekzhu]

We are working on a IOStream that supports streaming to any destination. #1551 @davorrunje

[davorrunje]

@AkashKulkarni4444 PR #1551 will be finished this week and it will have an example of streaming outputs using websockets integrated in FastAPI.

[victordibia]

Yes. Autogen studio uses Fastapi.
And yes, the final implementation will explore the FastApi websocket native implementation.

[davorrunje]

@victordibia I'll ping you once I add FastAPI/websocket example to discuss if you need any extra support for Autogen Studio. I am working on it right now, should be soon.

[victordibia]

Thanks this will be great!

[sundar-sarvam]

Any updates on this? Can you share the reference please?

[sundar-sarvam]

I see it being non-streaming. Is there any way this will be streaming?