We are so back

I purchased a year crunchyroll subscription but i pirate anyway because the subs are better.

Got very confused by the reading order for a second.

I’m trying to understand how this is used, my current selfhosted setup is quite simple:

frontend - backend - vllm

Using the openai compatible api vllm returns with tool calls that need to be handeled by the backend, an results are then send to the frontend by the backend, the frontend never communicates with vllm directly.

Form what i can gather AG-UI is a way for the frontend to directly communicate with in my case vllm in a secure way? letting the frontend handle the tool calls?

The manga is peak so i’m really wondering as to how they are going to adapt this.

WE ARE SO BACK