28 Commits

Author	SHA1	Message	Date
Thorsten Sommer	fe35630eff	Merge branch 'main' into chunk-data ... Resolved 29 conflicting files. The notable decisions: Confidence: main's tool-calling gate (RequiredProviderConfidence) and this branch's local-RAG gate (DataConfidenceLevel) turned out to be the same rule on the same axis, so they are now one field. Both tool results and data sources raise it through RequireProviderConfidence(). The gate checks the level strictly and no longer exempts providers trusted by configuration: TrustedProviderIds is documented as applying to data-source security checks only, and organizations set confidence through DataConfidence .CustomConfidenceScheme instead. The security axis (DataSecurity, ERI, IsTrustedForDataSourceSecurityChecks) is unchanged. Provider creation: main's CreateProvider signature won (hfEndpointKind, capabilityOverrides, no model parameter); tokenizerPath was added to it and is set for every provider, including the new Hetzner, IONOS and LiteLLM. Provider and EmbeddingProvider combine the record parameters, Lua parsing and Lua serialization of both sides. File types: main's hierarchy (ODT leaf, WORD parent, PowerPoint without the legacy .ppt, TABULAR instead of DELIMITED_TABLE) plus this branch's SPREADSHEET parent with ODS and the xlsm/xlsb/xla/xlam extensions, which the runtime already reads. Both sides had added a conflicting HTML filter; the reading family keeps the name, and the export path uses a narrow HTML_DOCUMENT, following the existing LATEX/TEX split. Runtime: main's file_data.rs is the base, including the prompt-injection sanitizer and the extraction routes. Token counting and chunk segmentation moved into take_released, so they act on the text the filter has released rather than on text it is still holding. A failed count is logged and left out instead of ending the extraction, because the app counts such a segment itself. Data sources: the participating-provider checks of this branch are kept, and main's GetAllowedDataSources overload now builds on them. DirectChatService resolves the launched chat's data source options before the check, so filter and chat see the same options. .NET and Rust both build clean; I18N regenerated to 4060 keys.	2026-09-05 21:20:33 +02:00
Thorsten Sommer	f14c69b938	Reworked the Hugging Face provider (#944)	2026-08-30 16:45:14 +02:00
Peer Hogeterp	e78a0e61b9	Added provider icons (#934) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-25 12:46:10 +02:00
Dominic Neuburg	592c9c76e2	Added user-managed API keys for enterprise-configured providers (#919) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-15 11:20:36 +02:00
PaulKoudelka	9932b5870b	Merge branch 'main' into chunk-data	2026-08-04 18:01:25 +02:00
PaulKoudelka	89f7156fdf	improved chunking pipeline and handling of expert settings	2026-07-29 18:47:59 +02:00
PaulKoudelka	1bf9328fb9	made the chunking process more robust	2026-07-28 16:37:07 +02:00
PaulKoudelka	c59e33e1b1	added sql integration instead of json files	2026-07-28 15:25:10 +02:00
Paul Koudelka	2e06af13e0	Merge branch 'main' into chunk-data	2026-07-01 09:54:12 +02:00
Thorsten Sommer	c3bf2563cd	Fixed self-hosted provider API key handling (#811)	2026-06-20 15:55:09 +02:00
Paul Koudelka	ea87d79ca9	current main is now successfully merged into branch	2026-05-27 20:02:43 +02:00
Paul Koudelka	637bf9701b	added manual refresh and cleaned up code	2026-05-13 18:13:34 +02:00
PaulKoudelka	e3cb7e9734	Merge branch 'main' into custom-tokenizer	2026-04-24 12:07:22 +02:00
Paul Koudelka	aa554d4a53	added possibility to add tokenizer via plugin and refactored earlier changes	2026-04-23 16:29:30 +02:00
PaulKoudelka	41573406d5	token count now adapts to chosen provider tokenizer	2026-04-14 16:27:10 +02:00
Thorsten Sommer	da62814b2f	Improved error handling for model loading (#732)	2026-04-14 13:39:11 +02:00
PaulKoudelka	e07ca378d4	added functionality to add tokenizer to LLM and embedding models	2026-04-10 18:34:10 +02:00
PaulKoudelka	0854debc00	added functionality to save/move tokenizer file	2026-04-10 18:31:20 +02:00
Thorsten Sommer	3abc2bf0f1	Fixed several provider dialog issues (#629)	2026-01-18 17:15:18 +01:00
Thorsten Sommer	529986837e	Implemented the transcription API (#623)	2026-01-11 16:02:28 +01:00
Thorsten Sommer	7110fb866f	Added embedding provider config (#622)	2026-01-09 15:41:54 +01:00
Thorsten Sommer	6a37ce6d25	Improved provider logging (#551)	2025-09-03 21:25:17 +02:00
Thorsten Sommer	9fa0f95611	Localized the embedding configuration (#455)	2025-05-11 16:57:52 +02:00
Thorsten Sommer	ce8d84a12a	Migrate to .NET 9 & MudBlazor 8 (#333)	2025-03-12 19:12:56 +01:00
Thorsten Sommer	f4780939fc	Integrated data sources into any chat (#282)	2025-02-15 15:41:12 +01:00
Thorsten Sommer	ae72c50236	Fixed the embedding dialog to store the selected embedding model (#261)	2025-01-13 20:10:58 +01:00
Thorsten Sommer	63be312bb4	Configure data sources (#259)	2025-01-13 19:51:26 +01:00
Thorsten Sommer	8cbef49d89	Add ERI server assistant (#231)	2025-01-01 15:49:27 +01:00