Galileo Evaluate enables you to evaluate and optimize your prompts with out-of-the-box Guardrail metrics.

  1. Pip Install promptquality and create runs in your Python notebook.

  2. Next, you execute promptquality.run() like shown below.


    import promptquality as pq

    pq.login({YOUR_GALILEO_URL})

    template = "Explain {topic} to me like I'm a 5 year old"

    data = {"topic": ["Quantum Physics", "Politics", "Large Language Models"]}

    pq.run(project_name='my_first_project',
           template=template,
           dataset=data,
           settings=pq.Settings(model_alias='ChatGPT (16K context)',
                                temperature=0.8,
                                max_tokens=400))

The code snippet above uses ChatGPT API endpoint from OpenAI. Want to use other models (Azure OpenAI, Cohere, Anthropic, Mistral, etc)? Check out the integration page here.

Was this page helpful?

Create an Evaluation SetEvaluate and Optimize RAG Applications