Private Identifiable Information

Understand Galileo's PII Metric

Definition: Identify's instances of PII within a model's responses specifically flagging:

  • Address

  • Credit Card Information

  • Date

  • Email

  • Name

  • Network Information

  • Personal Identification (ID)

  • Password

  • Phone Number

  • Social Security Number (SSN)

  • Username

Calculation: We use DeBERTa-based model fined tuned on open-source datasets such as Isotonic/pii-masking-200k and ai4privacy/pii-masking-43k. We are working on improving this model with more open and proprietary datasets.

Usefulness: Automatically identify and flag responses with PII, and respond accordingly by implementing guardrails or other preventative measures.

Last updated