Context Relevance

Understand Galileo's Context Relevance Metric

Definition: Measures how relevant (or similar) the context provided was to the user query. Higher context relevance means your retrieived context is relevant to your query.

Calculation: We measure the cosine similarity from a user's respective vector database between the given query embedding and the context embedding.

Usefulness: Examine certain query's where your vector database lacks relevant documents and take preventative measures like augmenting your knowledge base or vector DB with additional documents, modifying your retrieval strategy or using better embeddings.

This metric requires {context} and {query} slots in your data, as well as embeddings for them (i.e. {context_embedding}, {query_embedding}).