Very insightful article. I would like to know your thoughts on the following: If the goal is to reduce resource utilisation on the server and bandwidth, would server-side events work for an agent based API? The client is limited to one call to initiate the agents workflow then the agent pushes intermediate steps and final output to the client.
Very insightful article. I would like to know your thoughts on the following: If the goal is to reduce resource utilisation on the server and bandwidth, would server-side events work for an agent based API? The client is limited to one call to initiate the agents workflow then the agent pushes intermediate steps and final output to the client.
Yes. That is the right pattern to approach this.
If you have used AutoGen studio, this is exactly how it works.
https://newsletter.victordibia.com/p/autogen-studio-a-no-code-user-interface
What about using Microsoft Power Automate for workflows. Including websockets and FASTAI API?
Thats a great idea @george!
I think it would be a great experiment, but I have not tried this out yet.
Could you explain where you are defining 'receiver' and 'message' used in 'agent_history.append'?