Breaking change
- WebSocket communication
Patch Changes
- Added Condition handling for unknown addons on LLMs (#188)
- New configurations for additional addons in LLMs (#188)
What are WebSockets and why are they great for you?
One of the key changes in this release is improved WebSocket handling. You may have noticed that we mention "better WebSocket handling" in the release notes. But what does that mean for you as a user?
WebSockets are a technology that enables two-way real-time communication between your browser (client) and the server. Unlike older methods, where you have to wait for the server to process your entire request and send a complete response at once (which can take tens of seconds with LLM), WebSockets change that:
- Instant response: The server can send you the response in small chunks (called "streaming") as soon as they are generated. You see the text appear gradually, instead of staring at a "spinning wheel."
- You can interrupt the response: Because communication works both ways at any time, you can interrupt the server in the middle of generating a response. If you send a new query, the server can immediately stop working on the old response and start processing the new one.
The result is a much smoother and more interactive chat experience that feels immediate and "live." Our improvements in this area mean a more stable and reliable connection for this type of communication.
Read more
- Previous Release: 0.7.1 on Spreadsheet Day