-
The metric gap: bridging business outcomes and AI component optimization
Why high component scores often mask system failures. A methodology for using E2E evaluation to prioritize engineering work.
-
Reflection vs evaluation: why the Agent-Critic pattern fails without separation of concerns
Architectural separation of reflection (context generation) and evaluation (quality gating) prevents confirmation bias, premature stopping, and infinite loops in multi-agent research systems.
-
Vector search + hard filters in Elasticsearch: the hidden RAG bottleneck
HNSW graph topology breaks under metadata filtering. A hybrid retrieval strategy for production RAG systems.
-
Architecture design: a constraint-satisfaction approach
Methodology for reducing the architectural search space through hierarchical constraint definition: problem, boundaries, and trade-offs.
-
Classification with LLMs: getting accurate probabilities from structured output
Verbalized confidence in JSON schema provides fast probability estimates for classification tasks. Optimization patterns improve calibration.