Private Identifiable Information

Understand Galileo's PII Metric

Definition: Identify's instances of PII within a model's responses specifically flagging:

• Address

• Credit Card Information

• Date

• Email

• Name

• Network Information

• Personal Identification (ID)

• Password

• Phone Number

• Social Security Number (SSN)

• Username

Calculation: We use DeBERTa-based model fined tuned on open-source datasets such as Isotonic/pii-masking-200k and ai4privacy/pii-masking-43k. We are working on improving this model with more open and proprietary datasets.

Usefulness: Automatically identify and flag responses with PII, and respond accordingly by implementing guardrails or other preventative measures.