Anybody know of a good service / docker that will do BM25 + vector lookup without spinning up half a dozen microservices?

I agree. Someone here posted a drop-in for grep that added the ability to do hybrid text/vector search but the constant need to re-index files was annoying and a drag. Moreover, vector search can add a ton of noise if the model isn't meant for code search and if you're not using a re-ranker.

For all intents and purposes, running gpt-oss 20B in a while loop with access to ripgrep works pretty dang well. gpt-oss is a tool calling god compared to everything else i've tried, and fast.

I've gotten great results applying it to file paths + signatures. Even better if you also fuse those results with BM25.

With AI needing more access to documentation, WDYT about using RAG for documentation retrieval?

static embedding models im finding quite fast lee101/gobed https://github.com/lee101/gobed is 1ms on gpu :) would need to be trained for code though the bigger code llm embeddings can be high quality too so its just yea about where is ideal on the pareto fronteir really , often yea though your right it tends to be bm25 or rg even for code but yea more complex solutions are kind of possible too if its really important the search is high quality

That looks great! Is there a way to store / cache the embeddings?

For the uneducated, how large is too large? Curious.