JUnit test reports: Monitor time taken & alert user if time changes significantly

The summary of JUnit test reports show the time taken for the test job, as documented here: Unit test reports | GitLab.

Can this be monitored for significant change?

It would be useful to know whether the time taken to perform the tests has increased (potentially showing a reduce in efficiency of the code under test)

If such a change was detected, could the user be alerted to the fact?

@p487morgan - Thanks for the post!

The functionality to alert a user when a test slows down is not built into the report today but we do have an open issue that sounds similar. I would be interested in hearing more about what problem you’re looking to solve with this feature and/or how you’re working around it today.

Another work around might be to add the value to a metrics report entry and then you can monitor on the MRs how much the total test time is changing.

Hopefully this helps!

-James H, GitLab Product Manager, Verify:Testing

Thanks James,
The open issue looks very useful. For our purposes, we would like to see at a glance if code changes have significantly altered the test time, mainly to catch unintentional regressions, in cases where we aren’t explicitly testing performance.

Useful to know about the metrics too - I’m sure that will prove useful in the future.

Kind regards,

I’m glad that helped Paul. :+1: and comments are appreciated on the issues as we are prioritizing and scheduling.


-James H, GitLab Product Manager, Verify:Testing