I keep a lot of notes in markdown files, and I’d like an LLM to assist.

I regularly use Open WebUI with with inference routed through huggingface. Open WebUI kind of has this functionality like you can upload a markdown file and prompt it to improve it in whatever way, but of course that’s a fairly clunky workflow.

I really want something built into the editor, that can use RAG to consider other files in context.

I also don’t want to be locked in to a specific LLM or provider, I’d like to be able to link it to OpenRouter or similar.

  • Bluefruit@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 hours ago

    Koboldcpp has a pretty easy way to add a text db built right into it. You can use any model you want, and its pretty customizable.