Streaming LLM tokens to browsers with ASP.NET Core 10 SSE results
Stream LLM tokens to the browser from ASP.NET Core 10 with TypedResults.ServerSentEvents and IChatClient, and cancel the model call when the tab closes.
Notes
Engineering notes on the products Launchbase ships.
Stream LLM tokens to the browser from ASP.NET Core 10 with TypedResults.ServerSentEvents and IChatClient, and cancel the model call when the tab closes.