Failed notification on successful pipeline with retry

Hi everyone,

I have a pipeline with a retry setting in a test job. I’m receiving a pipeline failure email also if the whole pipeline it’s ending correctly. The failure is happening in the test job but the following retrying is ending in a success and the whole pipeline is ending with a success.

From the documentation using ‘allow_failure’ seem will always consider the pipeline a success also if all the retries will end in failure.

How can I configure the pipeline to signal the failure only if all the retry of the jobs are failing?