178 Commits

Author	SHA1	Message	Date
Thorsten Sommer	4c69434c47	Add a data sources panel to the app settings	2026-09-06 20:34:18 +02:00
Thorsten Sommer	d386ebc04b	Raise local RAG from prototype to beta	2026-09-06 19:57:56 +02:00
Thorsten Sommer	6c1360725f	Use the storage icon for data sources	2026-09-06 19:52:34 +02:00
Thorsten Sommer	fb8e37aaf3	Clean up compiler and inspection warnings	2026-09-06 13:26:56 +02:00
Thorsten Sommer	8950acb654	Keep provider management working when tokenizer storage fails	2026-09-06 11:20:54 +02:00
Thorsten Sommer	fe35630eff	Merge branch 'main' into chunk-data ... Resolved 29 conflicting files. The notable decisions: Confidence: main's tool-calling gate (RequiredProviderConfidence) and this branch's local-RAG gate (DataConfidenceLevel) turned out to be the same rule on the same axis, so they are now one field. Both tool results and data sources raise it through RequireProviderConfidence(). The gate checks the level strictly and no longer exempts providers trusted by configuration: TrustedProviderIds is documented as applying to data-source security checks only, and organizations set confidence through DataConfidence .CustomConfidenceScheme instead. The security axis (DataSecurity, ERI, IsTrustedForDataSourceSecurityChecks) is unchanged. Provider creation: main's CreateProvider signature won (hfEndpointKind, capabilityOverrides, no model parameter); tokenizerPath was added to it and is set for every provider, including the new Hetzner, IONOS and LiteLLM. Provider and EmbeddingProvider combine the record parameters, Lua parsing and Lua serialization of both sides. File types: main's hierarchy (ODT leaf, WORD parent, PowerPoint without the legacy .ppt, TABULAR instead of DELIMITED_TABLE) plus this branch's SPREADSHEET parent with ODS and the xlsm/xlsb/xla/xlam extensions, which the runtime already reads. Both sides had added a conflicting HTML filter; the reading family keeps the name, and the export path uses a narrow HTML_DOCUMENT, following the existing LATEX/TEX split. Runtime: main's file_data.rs is the base, including the prompt-injection sanitizer and the extraction routes. Token counting and chunk segmentation moved into take_released, so they act on the text the filter has released rather than on text it is still holding. A failed count is logged and left out instead of ending the extraction, because the app counts such a segment itself. Data sources: the participating-provider checks of this branch are kept, and main's GetAllowedDataSources overload now builds on them. DirectChatService resolves the launched chat's data source options before the check, so filter and chat see the same options. .NET and Rust both build clean; I18N regenerated to 4060 keys.	2026-09-05 21:20:33 +02:00
Thorsten Sommer	88bf475847	Added admin dialog for tool configuration exports (#949)	2026-09-05 19:16:54 +02:00
Thorsten Sommer	4141e7c504	Support multiple web search backends: SearXNG, Staan, and Tavily (#948)	2026-09-04 22:14:29 +02:00
Peer Hogeterp	4d8d30e15e	Added tool calling support (#731) ... Co-authored-by: krut_ni <nils.kruthoff@dlr.de> Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-09-04 15:48:07 +02:00
nilskruthoff	c66a61713d	Rework of the file export (#894) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-31 08:40:50 +02:00
Thorsten Sommer	f14c69b938	Reworked the Hugging Face provider (#944)	2026-08-30 16:45:14 +02:00
Thorsten Sommer	3940ad7f29	Improved enterprise plugin rollouts and protected deployed plugins against changes (#938)	2026-08-28 14:06:24 +02:00
Peer Hogeterp	a4c35fc2f2	Added direct-chat launchers for assistant plugins and a dialog to reconfigure them (#935) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-27 16:19:35 +02:00
Thorsten Sommer	f03c2d1c88	Hardened background work against disconnected circuits (#937)	2026-08-25 18:53:09 +02:00
Thorsten Sommer	99089f853e	Fixed and guarded the I18N key collection against missing keys (#936)	2026-08-25 16:53:19 +02:00
Peer Hogeterp	e78a0e61b9	Added provider icons (#934) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-25 12:46:10 +02:00
Thorsten Sommer	7d9a4f5ab1	Reduced memory usage and fixed several memory leaks (#933)	2026-08-23 21:15:37 +02:00
Sabrina-devops	902a01a4d0	Added a prompt injection detection (#857) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-23 11:09:11 +02:00
Dominic Neuburg	592c9c76e2	Added user-managed API keys for enterprise-configured providers (#919) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-15 11:20:36 +02:00
PaulKoudelka	aafc58b31a	showed user default values in expert settings for datasources	2026-08-14 16:02:40 +02:00
PaulKoudelka	88999d985c	refactored confidence levels and ensured checks work	2026-08-14 12:03:16 +02:00
PaulKoudelka	786b106096	made datasource selection more user friendly	2026-08-13 15:51:28 +02:00
Thorsten Sommer	98c86b94f5	Sort and group model lists by provider (#916)	2026-08-12 21:57:58 +02:00
Thorsten Sommer	ede45103b9	Removed provider access rule suppressions outside the settings manager (#915)	2026-08-12 20:44:48 +02:00
Paul Koudelka	647c428ebf	improved code and made sure components are reused if possible	2026-08-12 14:19:32 +02:00
j-erler	bb8f6f13f0	Added the Batch Processing Assistant (#901) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-11 20:14:21 +02:00
Paul Koudelka	202e37410b	moved datasource indexing to lower level	2026-08-10 23:12:55 +02:00
Paul Koudelka	2547701320	ensured consistent maximum token limit	2026-08-10 22:13:13 +02:00
Paul Koudelka	f9263b02dd	fixed the expert settings for datasource_file	2026-08-10 22:06:26 +02:00
Thorsten Sommer	ed52abfd37	Fixed the file preview showing an empty document while the file was still being read (#907)	2026-08-10 17:10:55 +02:00
Thorsten Sommer	8f8f788896	Fixed attached files silently reaching the AI as empty documents (#904)	2026-08-10 16:37:44 +02:00
Thorsten Sommer	6e143aafaa	Improved local plugin handling (share, import, delete) (#900)	2026-08-09 19:01:58 +02:00
nilskruthoff	34a9fd6283	Fixed plugin code issues scrolling out of view (#889)	2026-08-06 12:30:23 +02:00
nilskruthoff	8a9e6aeb87	Added export and import of plugin archives (#885) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-08-06 10:42:20 +02:00
Paul Koudelka	185a99c9ed	Added security checks for confidence levels	2026-08-05 15:05:17 +02:00
PaulKoudelka	9932b5870b	Merge branch 'main' into chunk-data	2026-08-04 18:01:25 +02:00
PaulKoudelka	2a3a82820c	forced overlap on chunks	2026-08-04 15:08:47 +02:00
PaulKoudelka	c78a8f05ef	added metadata for bm25 and also confidence levels	2026-08-03 19:45:47 +02:00
PaulKoudelka	b3ba945b98	made the embedding procedure more robust	2026-08-03 17:53:31 +02:00
Thorsten Sommer	58cc811a58	Added the visual briefing assistant (#893)	2026-08-02 21:41:12 +02:00
PaulKoudelka	89f7156fdf	improved chunking pipeline and handling of expert settings	2026-07-29 18:47:59 +02:00
PaulKoudelka	fd2d99872a	added warning and improved error handling	2026-07-28 20:22:37 +02:00
PaulKoudelka	1bf9328fb9	made the chunking process more robust	2026-07-28 16:37:07 +02:00
PaulKoudelka	c59e33e1b1	added sql integration instead of json files	2026-07-28 15:25:10 +02:00
Thorsten Sommer	8fa0c4db01	Improve Linux clipboard support and file handling (#872)	2026-07-19 19:56:30 +02:00
nilskruthoff	88aab302a2	Assistant Builder improvements (#851) ... Co-authored-by: Thorsten Sommer <SommerEngineering@users.noreply.github.com>	2026-07-15 21:00:25 +02:00
Thorsten Sommer	aaf77b6882	Added audio and video transcription for chats and assistants (#856)	2026-07-15 12:53:30 +02:00
Thorsten Sommer	2f81546cfe	Improved enterprise update policies & Flatpak support (#853)	2026-07-13 13:35:24 +02:00
Thorsten Sommer	4a15ff2665	Improved file attachment handling in assistants & dialogs (#840)	2026-07-06 20:27:25 +02:00
Thorsten Sommer	0476595f2d	Fixed the dialog for adding providers (#837)	2026-07-06 15:19:10 +02:00