01 / AI Q&A · Swingvy · 2024
Finding the balance: RAG quality and cost
- RAG
- User Feedback
- Model Evaluation
I built a Q&A system based on Singapore’s labour laws when LLM capabilities and available resources were limited. Answer quality, latency, and cost all mattered.
THE APPROACH
I refined retrieval and built a foundation for collecting user feedback on answer quality. I also created an evaluation process to compare models on response speed, quality, and cost.

