AI-Studio/app/MindWork AI Studio/Settings/DataModel
Thorsten Sommer fe35630eff
Merge branch 'main' into chunk-data
Resolved 29 conflicting files. The notable decisions:

Confidence: main's tool-calling gate (RequiredProviderConfidence) and this
branch's local-RAG gate (DataConfidenceLevel) turned out to be the same rule
on the same axis, so they are now one field. Both tool results and data
sources raise it through RequireProviderConfidence(). The gate checks the
level strictly and no longer exempts providers trusted by configuration:
TrustedProviderIds is documented as applying to data-source security checks
only, and organizations set confidence through DataConfidence
.CustomConfidenceScheme instead. The security axis (DataSecurity, ERI,
IsTrustedForDataSourceSecurityChecks) is unchanged.

Provider creation: main's CreateProvider signature won (hfEndpointKind,
capabilityOverrides, no model parameter); tokenizerPath was added to it and
is set for every provider, including the new Hetzner, IONOS and LiteLLM.
Provider and EmbeddingProvider combine the record parameters, Lua parsing and
Lua serialization of both sides.

File types: main's hierarchy (ODT leaf, WORD parent, PowerPoint without the
legacy .ppt, TABULAR instead of DELIMITED_TABLE) plus this branch's
SPREADSHEET parent with ODS and the xlsm/xlsb/xla/xlam extensions, which the
runtime already reads. Both sides had added a conflicting HTML filter; the
reading family keeps the name, and the export path uses a narrow
HTML_DOCUMENT, following the existing LATEX/TEX split.

Runtime: main's file_data.rs is the base, including the prompt-injection
sanitizer and the extraction routes. Token counting and chunk segmentation
moved into take_released, so they act on the text the filter has released
rather than on text it is still holding. A failed count is logged and left
out instead of ending the extraction, because the app counts such a segment
itself.

Data sources: the participating-provider checks of this branch are kept, and
main's GetAllowedDataSources overload now builds on them. DirectChatService
resolves the launched chat's data source options before the check, so filter
and chat see the same options.

.NET and Rust both build clean; I18N regenerated to 4060 keys.
2026-09-05 21:20:33 +02:00
..
PreviousModels Added support for organization-managed provider confidence settings (#815) 2026-06-21 11:52:02 +02:00
AddChatProviderBehavior.cs Remember chat provider (#217) 2024-11-23 13:04:02 +01:00
Bias.cs Added bias names (#172) 2024-10-21 18:21:08 +02:00
BiasCatalog.cs Migrated to use the shared random instance (#214) 2024-11-16 12:20:04 +01:00
BiasCategory.cs Defined bias catalog (#166) 2024-10-20 12:35:03 +02:00
BiasCategoryExtensions.cs Defined bias catalog (#166) 2024-10-20 12:35:03 +02:00
Data.cs Added tool calling support (#731) 2026-09-04 15:48:07 +02:00
DataAgenda.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataAgentDataSourceSelection.cs Added configuration plugin options for default chat data sources (#833) 2026-07-05 14:46:31 +02:00
DataAgentRetrievalContextValidation.cs Added configuration plugin options for default chat data sources (#833) 2026-07-05 14:46:31 +02:00
DataApp.cs Merge branch 'main' into chunk-data 2026-09-05 21:20:33 +02:00
DataAssistantPluginAudit.cs Added support for organization-approved assistant plugins (#821) 2026-07-05 15:20:29 +02:00
DataAssistantPluginEnterpriseApproval.cs Added enterprise-managed activation for assistant plugins (#939) 2026-08-29 14:12:14 +02:00
DataBatchProcessing.cs Rework of the file export (#894) 2026-08-31 08:40:50 +02:00
DataBiasOfTheDay.cs Bias of the day (#173) 2024-10-28 15:41:00 +01:00
DataChat.cs Added configuration plugin options for default chat data sources (#833) 2026-07-05 14:46:31 +02:00
DataCoding.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataConfidence.cs Added support for organization-managed provider confidence settings (#815) 2026-06-21 11:52:02 +02:00
DataDataSourceIndexing.cs added manual refresh and cleaned up code 2026-05-13 18:13:34 +02:00
DataDocumentAnalysis.cs Added a preview of the document analysis assistant (#561) 2025-11-24 12:37:18 +01:00
DataDocumentAnalysisPolicy.cs Added tool calling support (#731) 2026-09-04 15:48:07 +02:00
DataEMail.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataERI.cs Add ERI server assistant (#231) 2025-01-01 15:49:27 +01:00
DataERIServer.cs Add ERI server assistant (#231) 2025-01-01 15:49:27 +01:00
DataGrammarSpelling.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataI18N.cs Added I18N assistant for localization of AI Studio content (#422) 2025-04-26 18:55:23 +02:00
DataIconFinder.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataIntroduction.cs Added support for organization-managed introduction texts (#814) 2026-06-20 20:28:22 +02:00
DataJobPostings.cs Add job posting assistant (#150) 2024-09-15 21:14:56 +02:00
DataLegalCheck.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataMandatoryInfo.cs Added support for organization-managed introduction texts (#814) 2026-06-20 20:28:22 +02:00
DataMandatoryInfoAcceptance.cs Added an option for mandatory terms of use dialogs (#725) 2026-04-10 17:11:05 +02:00
DataMandatoryInformation.cs Added an option for mandatory terms of use dialogs (#725) 2026-04-10 17:11:05 +02:00
DataMyTasks.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataPromptOptimizer.cs Added a prompt optimization assistant (#709) 2026-04-15 19:40:53 +02:00
DataRewriteImprove.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataSlideBuilder.cs Added a slide assistant (#647) 2026-03-16 10:44:21 +01:00
DataSourceERI_V1.cs refactored confidence levels and ensured checks work 2026-08-14 12:03:16 +02:00
DataSourceERIUsernamePasswordMode.cs Configure ERI servers in config plugins (#767) 2026-05-18 16:26:51 +02:00
DataSourceLocalDirectory.cs showed user default values in expert settings for datasources 2026-08-14 16:02:40 +02:00
DataSourceLocalFile.cs showed user default values in expert settings for datasources 2026-08-14 16:02:40 +02:00
DataSourceOptions.cs Integrated data sources into any chat (#282) 2025-02-15 15:41:12 +01:00
DataSourceSecurity.cs Integrated data sources into any chat (#282) 2025-02-15 15:41:12 +01:00
DataSourceSecurityExtensions.cs Added more text content to the I18N system (#446) 2025-05-04 14:59:30 +02:00
DataSourceType.cs Configure data sources (#259) 2025-01-13 19:51:26 +01:00
DataSourceTypeExtension.cs Added more text content to the I18N system (#446) 2025-05-04 14:59:30 +02:00
DataSynonyms.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataTextContentCleaner.cs Add agenda assistant (#69) 2024-08-05 21:12:52 +02:00
DataTextSummarizer.cs Improving the text summarizer assistant (#544) 2025-08-30 10:35:40 +02:00
DataTools.cs Support multiple web search backends: SearXNG, Staan, and Tavily (#948) 2026-09-04 22:14:29 +02:00
DataTranslation.cs Added options to enforce minimum confidence levels for each assistant (#147) 2024-09-14 19:20:33 +02:00
DataVisualBriefing.cs Added the visual briefing assistant (#893) 2026-08-02 21:41:12 +02:00
DataWorkspace.cs Improved chat UI (#240) 2025-01-02 13:16:47 +01:00
LangBehavior.cs Configure language & start language plugins (#400) 2025-04-12 21:13:33 +02:00
LangBehaviorExtensions.cs Improved I18N system (#445) 2025-05-03 21:47:43 +02:00
LoadingChatProviderBehavior.cs Remember chat provider (#217) 2024-11-23 13:04:02 +01:00
NavBehavior.cs Add default configuration for assistants (#52) 2024-07-28 11:20:00 +02:00
PreviewFeatures.cs Added the visual briefing assistant (#893) 2026-08-02 21:41:12 +02:00
PreviewFeaturesExtensions.cs Added the visual briefing assistant (#893) 2026-08-02 21:41:12 +02:00
PreviewVisibility.cs Added embedding configurations (#224) 2024-12-03 15:24:40 +01:00
PreviewVisibilityExtensions.cs Added the visual briefing assistant (#893) 2026-08-02 21:41:12 +02:00
SendBehavior.cs Add default configuration for assistants (#52) 2024-07-28 11:20:00 +02:00
SendToChatDataSourceBehavior.cs Integrated data sources into any chat (#282) 2025-02-15 15:41:12 +01:00
SendToChatDataSourceBehaviorExtensions.cs Added more text content to the I18N system (#446) 2025-05-04 14:59:30 +02:00
StartPage.cs Added config option for start page (#704) 2026-03-21 18:05:06 +01:00
StartPageExtensions.cs Added config option for start page (#704) 2026-03-21 18:05:06 +01:00
Themes.cs Added color themes (dark & light) (#148) 2024-09-15 12:30:07 +02:00
ThemesExtensions.cs Added more text content to the I18N system (#446) 2025-05-04 14:59:30 +02:00
UpdateInstallation.cs Added option for update installation behavior (#539) 2025-08-26 20:06:13 +02:00
UpdateInterval.cs Improved enterprise update policies & Flatpak support (#853) 2026-07-13 13:35:24 +02:00
WorkspaceDisplayBehavior.cs Added workspace display options (#184) 2024-11-02 22:53:02 +01:00
WorkspaceStorageBehavior.cs Add default configuration for assistants (#52) 2024-07-28 11:20:00 +02:00
WorkspaceStorageTemporaryMaintenancePolicy.cs Add default configuration for assistants (#52) 2024-07-28 11:20:00 +02:00