Updated internal embedding task

This commit is contained in:
Thorsten Sommer 2024-11-24 11:46:10 +01:00
parent f806ee28c5
commit 9f59243cd4
Signed by: tsommer
GPG Key ID: 371BBA77A02C0108

View File

@ -12,7 +12,7 @@ Things we are currently working on:
- [ ] App: Configure embedding providers
- [ ] App: Management of data sources (local & external data via [EDI](https://github.com/MindWorkAI/EDI))
- [ ] Runtime: Extract data from txt / md / pdf / docx / xlsx files
- [ ] Runtime: Implement internal embedding provider through [fastembed-rs](https://github.com/Anush008/fastembed-rs)
- [ ] (*Optional*) Runtime: Implement internal embedding provider through [fastembed-rs](https://github.com/Anush008/fastembed-rs)
- [ ] App: Implement external embedding providers
- [ ] App: Implement the process to vectorize one local file using embeddings
- [ ] Runtime: Integration of the vector database [LanceDB](https://github.com/lancedb/lancedb)