Haystack
An open-source Python framework from deepset for production retrieval and search pipelines, with more explicit pipeline control than most alternatives.
Tested on GPT-5 ·
LIBRARY · Free, open source; deepset also offers a paid hosted platform
Haystack declares pipelines as explicit graphs of components, retriever, ranker, generator. You can see exactly what happens to a query, which a framework that hides the steps behind one call does not allow. The cost is more configuration up front. In return there is less to reverse-engineer when something has to change.
It is aimed at retrieval and search, not at general agent chaining. It is a narrower, more production-minded tool than a framework that tries to cover every LLM use case.
Notes from the author
For the first weeks after launch, log the retrieved documents for every query along with the final answer. Bad retrieval hides behind a good-looking reply, and you only see it when you check what fed it.
For information only, not professional advice. You use it at your own risk and we are not liable for any loss or damage. See the disclaimer.
Tagged