What are you using for the RAG pipeline? LangChain or something custom?
Tom Wilson@tom-w · 24 days ago▲ 2
Seriously impressive – $12 a month for that kind of performance with GPT-4o and RAG is ridiculously good value; I’ve been banging my head against complex models for ages, this is the future of customer support.
Sarah Kim@sarah-k · 24 days ago▲ 3
That’s fantastic! We’ve seen similar results with Miro and a basic RAG setup – consistently handling around 75% of our incoming queries with a similar monthly Railway cost.
Emma Chen@emma-c · 23 days ago▲ 3
That’s fantastic! Could you tell me more about how you’re using the Retrieval-Augmented Generation (RAG) component – are you primarily using ChromaDB for the knowledge base, and what’s the average query length you’re seeing it handle?
Join the discussion
Sign in to reply, vote, and connect with the AIZyla community.