I keep a lot of notes in markdown files, and I’d like an LLM to assist.

I regularly use Open WebUI with with inference routed through huggingface. Open WebUI kind of has this functionality like you can upload a markdown file and prompt it to improve it in whatever way, but of course that’s a fairly clunky workflow.

I really want something built into the editor, that can use RAG to consider other files in context.

I also don’t want to be locked in to a specific LLM or provider, I’d like to be able to link it to OpenRouter or similar.

  • fizzle@quokk.auOPEnglish
    1·
    13 hours ago

    you are looking fir a markdown editor which has a chat window on the side which can look at other files to assist in writing.

    Yes, although I’m interested in what other solutions might be around.

    I use a variety of editors. Whichever suits my mood in a given moment. Sometimes helix which is a TUI, sometimes gnome’s text editor, sometimes zettlr which is a more “zettelkasten” type knowledge base manager. I’m flexible. If there was a text editor that had this type of functionality built in then that’s what I’d use for tasks where I wanted this type of assistance. I don’t care about vim short cuts.

    I appreciate your proposing a solution. It still feels like there’s a yawning chasm in my knowledge. As in, what platform or software can I use to implement tools like you propose? I haven’t been able to figure out how to get open webui to provide that sort of functionality, although I suspect that it can.

    I think I’m asking, what is the software that connects my selection of markdown files to the LLM. I know you can upload a bunch of text files to open webui but you can’t edit in place. it would be like upload edit download upload edit download upload ad nauseum.