ragas Profile Banner
ragas Profile
ragas

@ragas_io

761
Followers
0
Following
5
Media
36
Statuses

Supercharge Your LLM Application Evaluations 🚀 Github: Discord:

Joined March 2024
Don't wanna be here? Send us removal request.
Pinned Tweet
@ragas_io
ragas
3 days
Today, we are proud to announce the release of ragas version 0.2. This release brings several improvements and marks a significant step toward supporting the evaluation of all types of LLM applications. Key highlights include: ▸ A new interface for evaluation datasets ▸ An
Tweet media one
2
13
97
@ragas_io
ragas
5 months
Guess what! @AndrewYNg just followed us! ❤️
Tweet media one
4
3
22
@ragas_io
ragas
5 months
We are preparing the roadmap for ragas v0.2 and would love to get all your feedback. We invite the community to discuss these plans, share your thoughts, and help shape the future of ragas. ▸ Poll here to let us know your preferred timings for the
Tweet media one
0
2
19
@ragas_io
ragas
2 months
Weekly release update : ragas v0.1.14 is out 🚀 Major new features 👉🏽 ▸ New Metric based on  @vectara 's new HHEM model which is a better Hallucination Detection Model. ▸ Integration with  @helicone_ai (YC W23) which is an open-source platform for logging, monitoring, and
2
4
16
@ragas_io
ragas
2 months
This would not have been possible without the love of our oss community ❤️
@NirantK
Nirant
2 months
Ragas is now a first class eval suite — mentioned directly in the Intel's latest RAG Foundry project and earlier OpenAI dev day mention Built from BLR & Kochi via YC 🇮🇳 x AI 🙌
Tweet media one
3
3
80
0
1
8
@ragas_io
ragas
3 months
Reach out to us on founders @explodinggradients .com if you're interested in being part of this 🔥
@Shahules786
ikka
3 months
Been cooking something 🍳 for synthetic test data generation from documents to evaluate RAG systems. ▸ 10x improvement over the last version in terms of quality and scalability. DM me if you're interested in participating in private beta testing of this feature.
Tweet media one
4
4
25
0
0
4
@ragas_io
ragas
5 months
This is exactly what we are solving for & we do it as open-source.
@AndrewYNg
Andrew Ng
5 months
A barrier to faster progress in generative AI is evaluations (evals), particularly of custom AI applications that generate free-form text. Let’s say you have a multi-agent research system that includes a researcher agent and a writer agent. Would adding a fact-checking agent
59
171
899
0
0
3
@ragas_io
ragas
5 months
Join us on May 30th to learn about some of new things we are working on from @Shahules786
@qdrant_engine
Qdrant
5 months
Join us for ​ @Haystack_AI 's May 30th Webinar: Evaluating RAG Pipelines. 🚀 Featuring talks by our @atitaarora and @Shahules786 from @ragas_io . We'll explore a critical step in bringing your RAG application to production: effective RAG evaluation.
0
2
10
0
1
3
@ragas_io
ragas
7 months
A fine article on how @vectara users can make use of ragas to evaluate RAG pipelines.
@ofermend
Ofer Mendelevitch
7 months
When building your #GenAI application with @vectara , you can now evaluate your pipeline using @ragas . Thanks @Shahules786 and Jithin James. Learn how in this new blog post:
0
2
7
0
3
3
@ragas_io
ragas
3 months
We are welcoming feature requests to add new metrics to Ragas. 🚀 ⭐️Fill out this simple 3-question form to have your desired metrics added to ragas You're free to propose any metrics or tasks that can help with evaluating LLM applications. We will also
0
1
2
@ragas_io
ragas
7 months
Releasing our first custom model as part of the ragas framework. Many more to come as we tackle the hard problem of LLM application evaluation and testing. Do check it out.
@Shahules786
ikka
7 months
As our journey with YC W24 wraps up, we're thrilled to share a special gift with you all! 🎁 We are releasing one of first model as part of @Ragas_io for synthetic test data generation - ragas critic LLM to replace GPT-4 as critic. ⭐️ ▸ Finetuned + GPTQ quantised Qwen 1.8B
8
17
135
0
0
2
@ragas_io
ragas
5 months
Checkout our new killer landing page All credits to @joelmakescodes
@1littlecoder
1LittleCoder💻
5 months
Ragas probably has the best landing page in the LLM!! Great work @Shahules786 and team 👏🏽👏🏽👏🏽
1
1
23
0
0
1
@ragas_io
ragas
2 months
@cmgriffing thanks for the feedback. We will take a look at this.
0
0
1
@ragas_io
ragas
7 months
Loved it ❤️
@jamescalam
James Briggs
7 months
A critical skill for AI engineers → evaluation ← RAGAS is a library built for evaluating RAG pipelines, here we dive into metrics-driven development for AI agents (built with @LangChainAI @pinecone @cohere and @AnthropicAI ) #GenAI #AIEng
4
31
227
0
0
1