Pii Pipeline

[lukehinds]

Initial implementation of the PII pipelline

[jhrozek]

looking good, left a couple of comments.

We don't have to fix up everything now, I know we have a cleanup lined up.

[jhrozek]

I also see a bunch of these in the logs:

2025-02-06T11:42:45.266370Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: es, registry supported la
nguages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils.py
2025-02-06T11:42:45.268406Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: it, registry supported languages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils
.py                                                                                                                                                                                         2025-02-06T11:42:45.270470Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: pl, registry supported la
nguages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils.py

[lukehinds]

I also see a bunch of these in the logs:

2025-02-06T11:42:45.266370Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: es, registry supported la
nguages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils.py
2025-02-06T11:42:45.268406Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: it, registry supported languages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils
.py                                                                                                                                                                                         2025-02-06T11:42:45.270470Z [warning  ] Recognizer not added to registry because language is not supported by registry - CreditCardRecognizer supported languages: pl, registry supported la
nguages: en lineno=119 module=recognizers_loader_utils pathname=/Users/jakub/devel/codegate/venv/lib/python3.12/site-packages/presidio_analyzer/recognizer_registry/recognizers_loader_utils.py

We can ignore these.

[aponcedeleonch]

Couple of comments but nothing major. I think we can take care of them in future PRs