Commit Graph

4 Commits

Author SHA1 Message Date
Paul Koudelka
95fb213069 removed print statements 2026-04-15 10:19:50 +02:00
PaulKoudelka
41573406d5 token count now adapts to chosen provider tokenizer 2026-04-14 16:27:10 +02:00
PaulKoudelka
e07ca378d4 added functionality to add tokenizer to LLM and embedding models 2026-04-10 18:34:10 +02:00
PaulKoudelka
0854debc00 added functionality to save/move tokenizer file 2026-04-10 18:31:20 +02:00