NHacker Next
login
▲LLM Inference Handbookbentoml.com
95 points by djhu9 8 hours ago | 3 comments
Loading comments...
sherlockxu 3 hours ago [-]
Hi everyone. I'm one of the maintainers of this project. We're both excited and humbled to see it on Hacker News!

We created this handbook to make LLM inference concepts more accessible, especially for developers building real-world LLM applications. The goal is to pull together scattered knowledge into something clear, practical, and easy to build on.

We’re continuing to improve it, so feedback is very welcome!

GitHub repo: https://github.com/bentoml/llm-inference-in-production

armcat 1 hours ago [-]
Amazing work on this, beautifully put together and very useful!
aligundogdu 2 hours ago [-]
It's a really beautiful project, and I’d like to ask something purely out of curiosity and with the best intentions. What’s the name of the design trend you used for your website? I really loved the website too.