Blog
AI
6 posts
AI
Treating the token budget as structure, not a feature
Growing the context window defers the problem. Decide what not to include first.
· #cost #llm #token-optimization
AI
Three questions to answer before adding RAG
Most RAG failures start in the documents, not in the retrieval.
· #architecture #rag
AI
Schemas make LLM output trustworthy. Prompts do not.
Instead of asking for JSON, make anything that is not JSON fail to pass.
· #llm #prompt-engineering
AI
Prompt tuning without evaluation is taste
The feeling that it got better usually comes from the last example you looked at.
· #evaluation #llm
AI
Give an agent logs before you give it tools
If you cannot see what it called and why, you cannot fix it.
· #agent #llm
AI
A larger context window does not remove retrieval
Being able to include everything is not the same as needing to.
· #llm #rag