-
Structured output engineering for production LLMs
Transitioning from 85% parse rates to production-grade reliability. Constrained decoding guarantees format, Pydantic ensures correctness, token optimization cuts costs by 50%.
-
The chunk size dilemma: identifying the optimal value in RAG systems
Finding the optimal chunk size is non-trivial: too small loses context, too large dilutes semantics through mean pooling. A systematic methodology for identifying the sweet spot.
-
Mitigating positional bias in LLM-as-a-judge evaluation: the swapping technique
LLM judges often exhibit a strong preference for the first presented option (position bias). A position-swapping methodology significantly improves agreement with human ratings.
-
Hybrid retrieval with RRF: solving the score normalization problem
Pure vector search isn't always enough. Weighted averaging of BM25 and vector scores breaks due to incompatible scales. RRF solves this by using ranks instead of scores.
-
LLM orchestration: a pragmatic guide to complexity
Most production apps are simple chains, yet everyone is building agents. Here's a clear framework on when you really need loops, graphs, and agents in your LLM app.