28 Commits

Include renames

Author	SHA1	Message	Date
Thorsten Sommer	8950acb654	Keep provider management working when tokenizer storage fails	2026-09-06 11:20:54 +02:00
Thorsten Sommer	fe35630eff	Merge branch 'main' into chunk-data ... Resolved 29 conflicting files. The notable decisions: Confidence: main's tool-calling gate (RequiredProviderConfidence) and this branch's local-RAG gate (DataConfidenceLevel) turned out to be the same rule on the same axis, so they are now one field. Both tool results and data sources raise it through RequireProviderConfidence(). The gate checks the level strictly and no longer exempts providers trusted by configuration: TrustedProviderIds is documented as applying to data-source security checks only, and organizations set confidence through DataConfidence .CustomConfidenceScheme instead. The security axis (DataSecurity, ERI, IsTrustedForDataSourceSecurityChecks) is unchanged. Provider creation: main's CreateProvider signature won (hfEndpointKind, capabilityOverrides, no model parameter); tokenizerPath was added to it and is set for every provider, including the new Hetzner, IONOS and LiteLLM. Provider and EmbeddingProvider combine the record parameters, Lua parsing and Lua serialization of both sides. File types: main's hierarchy (ODT leaf, WORD parent, PowerPoint without the legacy .ppt, TABULAR instead of DELIMITED_TABLE) plus this branch's SPREADSHEET parent with ODS and the xlsm/xlsb/xla/xlam extensions, which the runtime already reads. Both sides had added a conflicting HTML filter; the reading family keeps the name, and the export path uses a narrow HTML_DOCUMENT, following the existing LATEX/TEX split. Runtime: main's file_data.rs is the base, including the prompt-injection sanitizer and the extraction routes. Token counting and chunk segmentation moved into take_released, so they act on the text the filter has released rather than on text it is still holding. A failed count is logged and left out instead of ending the extraction, because the app counts such a segment itself. Data sources: the participating-provider checks of this branch are kept, and main's GetAllowedDataSources overload now builds on them. DirectChatService resolves the launched chat's data source options before the check, so filter and chat see the same options. .NET and Rust both build clean; I18N regenerated to 4060 keys.	2026-09-05 21:20:33 +02:00
3 people	4d8d30e15e	Added tool calling support (#731) ... Co-authored-by: krut_ni <nils.kruthoff@dlr.de> Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-09-04 15:48:07 +02:00
PaulKoudelka	c59e33e1b1	added sql integration instead of json files	2026-07-28 15:25:10 +02:00
Paul Koudelka	2e06af13e0	Merge branch 'main' into chunk-data	2026-07-01 09:54:12 +02:00
Thorsten Sommer	dddb40096d	Added support for organization-trusted providers (#816)	2026-06-21 15:16:37 +02:00
PaulKoudelka	00b6c98f3b	Merge branch 'main' into chunk-data	2026-05-26 17:19:32 +02:00
Thorsten Sommer	8853ea0cfe	Improved transcription error handling (#773)	2026-05-23 11:25:18 +02:00
PaulKoudelka	e3cb7e9734	Merge branch 'main' into custom-tokenizer	2026-04-24 12:07:22 +02:00
Thorsten Sommer	247c1b66b9	Added HasModelLoadingCapability to all providers (#737) (#737)	2026-04-16 11:24:22 +02:00
Thorsten Sommer	da62814b2f	Improved error handling for model loading (#732)	2026-04-14 13:39:11 +02:00
PaulKoudelka	e07ca378d4	added functionality to add tokenizer to LLM and embedding models	2026-04-10 18:34:10 +02:00
Paul KoudelkaandThorsten Sommer	a8951fe58a	Added embedding API (#654) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-02-20 15:32:54 +01:00
Thorsten Sommer	529986837e	Implemented the transcription API (#623)	2026-01-11 16:02:28 +01:00
Thorsten Sommer	30197cf507	Added transcription providers (#619)	2026-01-09 12:45:21 +01:00
Thorsten Sommer	e9485ca8ea	Added support for images (#609)	2025-12-30 18:30:32 +01:00
Peer SchüttandThorsten Sommer	9ef1a047f0	Added expert mode to providers (#562) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2025-11-13 18:13:16 +01:00
Peer Schüttandtsommer	2a01d3bb6e	Added support for Perplexity (#545) ... Co-authored-by: Thorsten Sommer <mail@tsommer.org>	2025-08-31 14:27:35 +02:00
Thorsten Sommer	d6af5a3afd	Add model capabilities (#450)	2025-05-11 12:51:35 +02:00
Thorsten Sommer	38a45955fb	Improved profile and system prompt handling (#241)	2025-01-02 14:50:54 +01:00
Thorsten Sommer	799112eb9d	Added embedding configurations (#224)	2024-12-03 15:24:40 +01:00
Thorsten Sommer	fc64c0b505	Improve ipc (#102)	2024-09-01 20:10:03 +02:00
tsommer	9d70103b72	Allow using a provisional API key	2024-06-03 19:42:53 +02:00
tsommer	9c1a49bc01	Improved imports	2024-05-19 20:54:43 +02:00
tsommer	722c7e943d	Mode model loading returning enumerable list of data	2024-05-19 16:14:05 +02:00
tsommer	bbb9d883a1	Refined provider interface	2024-05-04 10:58:18 +02:00
tsommer	418f458118	Added documentation	2024-05-04 10:55:00 +02:00
tsommer	c3fd6b81a8	Finished provider settings	2024-04-20 17:07:12 +02:00