insights
Get Seq2Seq Metrics For Run
auth
projects
- POSTValidate Dataset
- POSTStart Training Job
- GETTraining Status
- POSTGet Token For Training Job
- GETGet Collaborator Roles
- GETGet Projects
- POSTCreate Project
- POSTGet Projects Paginated
- GETGet All Projects
- GETGet Project
- PUTUpdate Project
- DELDelete Project
- POSTUpload File
- GETList User Project Collaborators
- POSTCreate User Project Collaborators
- GETList Group Project Collaborators
- POSTCreate Group Project Collaborators
- DELDelete User Project Collaborator
- PATCHUpdate User Project Collaborator
- DELDelete Group Project Collaborator
- PATCHUpdate Group Project Collaborator
- PUTBookmark Project
- DELUnbookmark Project
users
- GETGet User Roles
- POSTRequest Access
- POSTGenerate Signup Link
- POSTInvite Users
- GETList Users
- POSTCreate Or Verify User
- DELDelete User Self
- POSTCreate Or Verify User Social
- GETList All Users
- GETGet User
- PUTUpdate User
- DELDelete User
- GETGet Latest User Run
- GETGet Project Runs For User
- GETGenerate Password Reset Link
- GETGenerate Password Reset Email
- POSTPassword Reset
- POSTTransfer User Data
- GETList Current User Groups
edits
evaluate-alerts
data
- POSTGet Metric Insights With Filters
- GETList Prompt Datasets
- POSTUpload Prompt Evaluation Dataset
- GETDownload Prompt Dataset
- PUTUpdate Prompt Dataset
- DELDelete Prompt Dataset
- GETGet Rows
- POSTCalculate Cost
- GETDownload Prompt Run Dataset
- GETExport Prompt Dataset
- GETGet Prompt Chain Rows
- GETGet Rows As Columns
- POSTGet Rows As Columns With Filters
- GETGet Row As Column
- GETGet Multi Run Sample Ids
- POSTGet Multi Run Samples For Row Ids
- GETGet Chain As Columns
- GETGet Groups
features
feedback
groups
insights
- POSTGet Summary Statistics
- POSTGet Groupby Statistics
- POSTGet Insight Ids
- POSTGet Percentage
- POSTGet Thresholds
- POSTCompare Runs
- POSTGet Column Distribution
- POSTGet Model Metrics
- POSTGet Task Metrics
- POSTGet Label Co Occurrence
- POSTGet Similar From Split
- POSTGet Cbo Clusters For Split
- POSTGet Cartograph Clusters For Split
- POSTGet Communities For Split
- POSTGet Top Insights
- POSTGet Correlation Matrix Chart
- GETGet Alerts For Run
- DELDismiss Alert
- GETGet Errors
- POSTGet Error Counts
- POSTGet Map For Run
- POSTGet Segmentation Metrics For Run
- POSTGet Seq2Seq Metrics For Run
- POSTGet Data Rows
- POSTGet Error Distribution For Column
integrations
- GETList Integrations
- GETList Available Integrations
- GETGet Integration
- DELDelete Integration
- GETGet Integration Config
- GETGet Integration Status
- PUTCreate Or Update Integration
- PUTCreate Or Update Integration
- PUTCreate Or Update Integration
- PUTCreate Or Update Integration
- PUTCreate Or Update Unity Catalog Integration
- GETGet Databricks Clusters
- GETGet Databases For Cluster
- POSTExport To Databricks
- POSTExport Edits Databricks
- GETList Databricks Sql Warehouses
- POSTExport To Databricks Unity Catalog
- POSTExport Edits Databricks Unity Catalog
- PUTCreate Or Update Integration
- GETGet Labelstudio Projects
- POSTExport To Labelstudio
- PUTCreate Or Update Integration
- PUTCreate Or Update Integration
- PUTCreate Or Update Integration
llm_integrations
observe
prompts
- POSTIngest Prompt Chain Run
- POSTIngest Batch
- GETGet All Models
- PUTPut Score
- GETGet Project Templates
- POSTCreate Prompt Template With Version
- GETGet Template Version By Name
- GETGet Template From Project
- DELDelete Template
- POSTCreate Prompt Template Version
- GETGet Template Version
- PUTSet Selected Template Version
runs
- GETGet Project Runs
- POSTCreate Run
- DELDelete Runs
- GETGet Project Prompt Runs
- GETGet Project Prompt Runs As Columns
- POSTGet Project Prompt Runs As Columns With Filters
- GETGet Run
- PUTUpdate Run
- DELDelete Run
- GETGet Prompt Run
- GETGet Run Link
- GETGet Run Tasks
- GETGet Run Labels
- GETGet Run Inference Names
- GETGet Num Epochs For Run
- GETGet Splits
- GETGet Metrics For Run
- PUTSet Metric For Run
- GETGet Prompt Aggregate Metrics As Singleton Columns
- GETGet Run Tags
- POSTSet Tag For Run
- GETGet Run Tag
- PUTUpdate Tag For Run
- DELDelete Run Tag
slices
insights
Get Seq2Seq Metrics For Run
[Seq2Seq ONLY] Calculates bleu, rouge, and DEP for the (filtered) df.
POST
/
projects
/
{project_id}
/
runs
/
{run_id}
/
split
/
{split}
/
insights
/
seq2seq
/
metrics
Galileo-API-Key
string
*
Galileo-API-Key
Required
string
project_id
string
*
project_id
Required
string
run_id
string
*
run_id
Required
string
split
enum<string>
*
split
Required
enum<string>
inference_name
string
inference_name
string
scope
string
scope
string
object
*
task
string
task
string
filter_params
object
filter_params
object
ids
array
ids
array
similar_to
array
similar_to
array
num_similar_to
integer
num_similar_to
integer
text_pat
string
text_pat
string
regex
boolean
regex
boolean
data_error_potential_high
number
data_error_potential_high
number
data_error_potential_low
number
data_error_potential_low
number
misclassified_only
boolean
misclassified_only
boolean
gold_filter
array
gold_filter
array
pred_filter
array
pred_filter
array
meta_filter
array
meta_filter
array
drift_score_threshold
number
drift_score_threshold
number
is_drifted
boolean
is_drifted
boolean
span_sample_ids
array
span_sample_ids
array
span_text
string
span_text
string
span_regex
boolean
span_regex
boolean
exclude_ids
array
exclude_ids
array
lasso
object
lasso
object
Representation of a lasso selection (used by embeddings)
x and y correspond to the cursor movement while tracing the lasso. This is natively provided by plotly when creating a lasso selection, for example
x
array
*
x
Required
array
y
array
*
y
Required
array
class_filter
array
class_filter
array
likely_mislabeled
boolean
likely_mislabeled
boolean
likely_mislabeled_dep_percentile
integer
likely_mislabeled_dep_percentile
integer
cbo_clusters
array
cbo_clusters
array
data_embs
boolean
data_embs
boolean
confidence_high
number
confidence_high
number
confidence_low
number
confidence_low
number
is_otb
boolean
is_otb
boolean
image_ids
array
image_ids
array
cluster_ids
array
cluster_ids
array
correctly_classified
boolean
correctly_classified
boolean
is_edited
boolean
is_edited
boolean
compare_to
enum<string>
compare_to
enum<string>
map_threshold
number
map_threshold
number
meta_cols
array
meta_cols
array
Authorizations
Galileo-API-Key
string
headerrequiredPath Parameters
project_id
string
requiredrun_id
string
requiredsplit
enum<string>
requiredAvailable options:
training, validation, test, inference Query Parameters
inference_name
string
default: scope
string | null
default: Body
application/json
task
string | null
filter_params
object
compare_to
enum<string> | null
Available options:
training, validation, test, inference map_threshold
number
default: 0.5meta_cols
string[] | null
Response
200 - application/json
average_data_error_potential
number | null
average_bleu
number | null
average_rouge
number | null
Was this page helpful?