Commit Graph

2 Commits

Author SHA1 Message Date
Peer Schütt
ca267cf174 Removed the MaxTokens parameter, because vLLM doesnt support setting the value to -1. 2025-07-24 17:23:30 +02:00
Thorsten Sommer
29263660fc
Implement support for self-hosted and local LLMs (#20) 2024-07-03 20:31:04 +02:00