Auto-cancel redundant pipelines doesn't cancel running pipeline

Problem to solve

I am marking the auto-cancel option in the setting of the CI/CD section.
I open a MR, and while the pipeline starts running I push a small change. It trigger a new pipeline (as expected) but the older one is not canceled.

Steps to reproduce

I actually don’t know what other information to provide, its a private repo.

Configuration

There is nothing regards it in the gitlab-ci.yml file.

Versions

I am using GitLab Enterprise Edition 15.11.13-ee