Search results

Does anyone take care of maintaining this project now?

questionFurther information is requestedFurther information is requested

Status: Open.

#2833 In vibrantlabsai/ragas;

· AllesOderNicht opened on Jul 10, 2026

Proposal: white-box uncertainty (self-FV) confidence for open-weight LLM judges — interested as an example?

Status: Open.

#2819 In vibrantlabsai/ragas;

· ysys143 opened on Jul 7, 2026

Local backends allow dataset names to resolve outside storage roots

Status: Open.

#2814 In vibrantlabsai/ragas;

· VectorPeak opened on Jul 5, 2026

Swarm converter raises KeyError for assistant messages without tool_calls

Status: Open.

#2813 In vibrantlabsai/ragas;

· VectorPeak opened on Jul 5, 2026

FactualCorrectness scores 0.0 when no claims can be decomposed (correct abstentions), inconsistent with Faithfulness returning NaN

Status: Open.

#2806 In vibrantlabsai/ragas;

· svelpuri opened on Jul 3, 2026

Feature: Persistent evaluation history via Dakera — longitudinal RAG pipeline tracking

Status: Open.

#2802 In vibrantlabsai/ragas;

· ferhimedamine opened on Jul 1, 2026

Docs/cookbook: paired baseline vs RAG eval with shared reference context

Status: Open.

#2791 In vibrantlabsai/ragas;

· DanPenso opened on Jun 26, 2026

EmbeddingUsageEvent telemetry NaNs a metric when embeddings expose a non-string .model (e.g. fastembed)

Status: Open.

#2783 In vibrantlabsai/ragas;

· aneeshv12 opened on Jun 23, 2026

get_token_usage_for_bedrock always returns 0 (reads wrong response_metadata keys for langchain-aws ChatBedrock/ChatBedrockConverse)

Status: Open.

#2779 In vibrantlabsai/ragas;

· kimnamu opened on Jun 19, 2026

NonLLMContextRecall and NonLLMContextPrecisionWithReference threshold relevance inconsistently (> vs >=)

bugSomething isn't workingSomething isn't working

Status: Open.

#2777 In vibrantlabsai/ragas;

· 3939justinyi opened on Jun 18, 2026

llm_factory raises ValueError when using mistralai client

bugSomething isn't workingSomething isn't working

Status: Open.

#2774 In vibrantlabsai/ragas;

· rcontrai opened on Jun 17, 2026

Evaluate VORTEXRAG with RAGAS — new 7-layer RAG framework

Status: Open.

#2763 In vibrantlabsai/ragas;

· vignesh2027 opened on Jun 7, 2026