Close an issue on merge

Describe your question:

  • At the moment when I push a commit with the ‘Closes #’ keyword, the issue gets closed immediately. I am hoping that this keyword only triggers the close after it is merged to the default branch.

Is it possible to set this up as I am currently using ?