Getting emails for every commit

We used to have GitLab CE 11.11.3 and for this one project in our instance I have set my notifications to Watch so I get emails for all activities in that project - this however did not send me emails for every push to the repository.

Yesterday I upgraded our GitLab instance to 12.1.1 and my notification settings remained but now I get emails for every push.

Is it possible for me to go back to the way my notifications worked? I don’t want to get emails for every push because the culture in our office is to push every single commit by themselves and I’ll probably get spammed throughout the day because of this change. Good thing majority of our developers are on vacation right now but next week it’ll be busy again.