Added vLLM support (#524)

Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>
This commit is contained in:
Peer SchüttandThorsten Sommer authored and GitHub committed 2025-08-10 16:26:25 +02:00
1 parent fe2baa8c00
commit b75d90b13f
12 files changed
+24 -21

No files matched your search

@@ -2,5 +2,6 @@
- Added an option for chat templates to predefine a user input.
- Added the ability to create chat templates from existing chats.
- Added an enterprise IT configuration option to prevent manual addition of LLM providers in managed environments.
- Added support for self-hosted LLMs using [vLLM](https://blog.vllm.ai/2023/06/20/vllm.html).
- Improved the display of enterprise configurations on the about page; configuration details are only shown when needed.
- Improved hot reloading on Unix-like systems when entire plugins were added or removed.