334 Commits

Author	SHA1	Message	Date
Thorsten Sommer	b0b30b0f9b	Always show the embedding status in the navigation	2026-09-09 16:23:04 +02:00
Thorsten Sommer	2a79f5f3b7	Classify broken document and presentation packages	2026-09-09 15:57:22 +02:00
Thorsten Sommer	7678508276	Pair buffered document content with its own token count	2026-09-09 15:05:39 +02:00
Thorsten Sommer	f094cb6ac5	Localize the messages of failed indexing attempts	2026-09-09 13:23:12 +02:00
Thorsten Sommer	2b18d32bf2	Group the indexing failures by cause	2026-09-09 13:07:59 +02:00
Thorsten Sommer	59e278086c	Show permanently skipped files as their own category	2026-09-09 11:30:45 +02:00
Thorsten Sommer	2eb619fb04	Skip files whose indexing failed permanently	2026-09-09 11:22:13 +02:00
Thorsten Sommer	0e22d58796	Persist permanent indexing failures in the RAG index	2026-09-09 11:12:30 +02:00
Thorsten Sommer	6dd2389a99	Carry the extraction failure code into the indexer	2026-09-09 10:42:02 +02:00
Thorsten Sommer	6c1360725f	Use the storage icon for data sources	2026-09-06 19:52:34 +02:00
Thorsten Sommer	871bbfe79a	Show why an embedding or a retrieval failed	2026-09-06 16:13:28 +02:00
Thorsten Sommer	21a01499da	Report embedding failures with a clear cause	2026-09-06 15:54:53 +02:00
Thorsten Sommer	9875fbc646	Report prompt injection findings from the embedding pipeline	2026-09-06 15:26:16 +02:00
Thorsten Sommer	2c212f75f6	Resolve the remaining unused-symbol warnings	2026-09-06 14:20:53 +02:00
Thorsten Sommer	fb8e37aaf3	Clean up compiler and inspection warnings	2026-09-06 13:26:56 +02:00
Thorsten Sommer	d3a40e999c	Gate the RAG background work behind the preview feature flag	2026-09-06 12:41:45 +02:00
Thorsten Sommer	fe35630eff	Merge branch 'main' into chunk-data ... Resolved 29 conflicting files. The notable decisions: Confidence: main's tool-calling gate (RequiredProviderConfidence) and this branch's local-RAG gate (DataConfidenceLevel) turned out to be the same rule on the same axis, so they are now one field. Both tool results and data sources raise it through RequireProviderConfidence(). The gate checks the level strictly and no longer exempts providers trusted by configuration: TrustedProviderIds is documented as applying to data-source security checks only, and organizations set confidence through DataConfidence .CustomConfidenceScheme instead. The security axis (DataSecurity, ERI, IsTrustedForDataSourceSecurityChecks) is unchanged. Provider creation: main's CreateProvider signature won (hfEndpointKind, capabilityOverrides, no model parameter); tokenizerPath was added to it and is set for every provider, including the new Hetzner, IONOS and LiteLLM. Provider and EmbeddingProvider combine the record parameters, Lua parsing and Lua serialization of both sides. File types: main's hierarchy (ODT leaf, WORD parent, PowerPoint without the legacy .ppt, TABULAR instead of DELIMITED_TABLE) plus this branch's SPREADSHEET parent with ODS and the xlsm/xlsb/xla/xlam extensions, which the runtime already reads. Both sides had added a conflicting HTML filter; the reading family keeps the name, and the export path uses a narrow HTML_DOCUMENT, following the existing LATEX/TEX split. Runtime: main's file_data.rs is the base, including the prompt-injection sanitizer and the extraction routes. Token counting and chunk segmentation moved into take_released, so they act on the text the filter has released rather than on text it is still holding. A failed count is logged and left out instead of ending the extraction, because the app counts such a segment itself. Data sources: the participating-provider checks of this branch are kept, and main's GetAllowedDataSources overload now builds on them. DirectChatService resolves the launched chat's data source options before the check, so filter and chat see the same options. .NET and Rust both build clean; I18N regenerated to 4060 keys.	2026-09-05 21:20:33 +02:00
Thorsten Sommer	aca4404351	Quiet secret store logs and fix untranslated tool messages (#950)	2026-09-05 19:38:54 +02:00
Thorsten Sommer	88bf475847	Added admin dialog for tool configuration exports (#949)	2026-09-05 19:16:54 +02:00
Thorsten Sommer	4141e7c504	Support multiple web search backends: SearXNG, Staan, and Tavily (#948)	2026-09-04 22:14:29 +02:00
Peer Hogeterp	4d8d30e15e	Added tool calling support (#731) ... Co-authored-by: krut_ni <nils.kruthoff@dlr.de> Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-09-04 15:48:07 +02:00
nilskruthoff	c66a61713d	Rework of the file export (#894) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-31 08:40:50 +02:00
Thorsten Sommer	f14c69b938	Reworked the Hugging Face provider (#944)	2026-08-30 16:45:14 +02:00
Prodman Devokadev	5966f0f6a5	Added LiteLLM as a new LLM provider (#909) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-30 12:55:18 +02:00
Thorsten Sommer	2965102c53	Added transcription for Helmholtz and Groq, embeddings for GWDG, and fixed Mistral model capabilities (#942)	2026-08-29 22:25:12 +02:00
Thorsten Sommer	c9b7f224cc	Added enterprise-managed activation for assistant plugins (#939)	2026-08-29 14:12:14 +02:00
Thorsten Sommer	3940ad7f29	Improved enterprise plugin rollouts and protected deployed plugins against changes (#938)	2026-08-28 14:06:24 +02:00
Peer Hogeterp	a4c35fc2f2	Added direct-chat launchers for assistant plugins and a dialog to reconfigure them (#935) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-27 16:19:35 +02:00
Thorsten Sommer	f03c2d1c88	Hardened background work against disconnected circuits (#937)	2026-08-25 18:53:09 +02:00
Thorsten Sommer	99089f853e	Fixed and guarded the I18N key collection against missing keys (#936)	2026-08-25 16:53:19 +02:00
nilskruthoff	415ed35422	Added a component for dynamic assistants (#911)	2026-08-25 14:53:38 +02:00
Peer Hogeterp	e78a0e61b9	Added provider icons (#934) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-25 12:46:10 +02:00
Peer Hogeterp	afdcc0455d	Fixed issues when multiple configurations intro texts or mandatory infos share the same ID (#932) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-25 08:39:29 +02:00
Thorsten Sommer	7d9a4f5ab1	Reduced memory usage and fixed several memory leaks (#933)	2026-08-23 21:15:37 +02:00
Sabrina-devops	902a01a4d0	Added a prompt injection detection (#857) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-23 11:09:11 +02:00
Thorsten Sommer	e9ce64cf0c	Fixed estimated document pages (#929)	2026-08-18 18:28:40 +02:00
Thorsten Sommer	da68051c61	Clarify update guidance and strongly type Linux package detection (#925)	2026-08-16 12:18:53 +02:00
Thorsten Sommer	8148b66876	Fixed plugin installation and endless plugin reloading on Linux (#924)	2026-08-15 19:55:42 +02:00
Thorsten Sommer	57c0b59fa5	Fixed AI Studio installing a second copy of itself next to an existing installation (#922)	2026-08-15 14:04:45 +02:00
Dominic Neuburg	592c9c76e2	Added user-managed API keys for enterprise-configured providers (#919) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-15 11:20:36 +02:00
PaulKoudelka	aafc58b31a	showed user default values in expert settings for datasources	2026-08-14 16:02:40 +02:00
PaulKoudelka	15afe1c80c	refactored the classes and functions	2026-08-14 14:25:53 +02:00
PaulKoudelka	1a263127f5	replaced embedding_state with index_store as a sqlite name	2026-08-14 12:37:50 +02:00
PaulKoudelka	50aa5c485d	fixed issue where augumentation failed	2026-08-14 12:03:52 +02:00
PaulKoudelka	88999d985c	refactored confidence levels and ensured checks work	2026-08-14 12:03:16 +02:00
Thorsten Sommer	ede45103b9	Removed provider access rule suppressions outside the settings manager (#915)	2026-08-12 20:44:48 +02:00
Paul Koudelka	647c428ebf	improved code and made sure components are reused if possible	2026-08-12 14:19:32 +02:00
Paul Koudelka	d95487aa6e	disabled images for RAG for now	2026-08-12 11:43:47 +02:00
j-erler	bb8f6f13f0	Added the Batch Processing Assistant (#901) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-11 20:14:21 +02:00
Paul Koudelka	987f493848	made check for vectordb more robust	2026-08-11 15:55:12 +02:00