Our current QA team uses a self hosted test harness which executes a series of XML tests that designate how to run specific use cases. I am now looking into bringing this over to GitLab CICD and execute all tests via a commit trigger.
I currently have the ability of running a single one of our test harness tests by building an auto-run url. In other words, when the url is built, I can paste it into a browser and it will bring up our test harness, populate the various options and run the testcase. Currently I have a single Jest test that runs, I build the 1000+ auto-run links into an array and then push that into puppeteer to run. The problem I am having difficulty with is getting a 1-to-1 response from each test since these are all under a single jest test.
What I would like to know is whether there is a way that I can preprocess / build the url array with our autorun links and then have each of those individual urls handled as separate e2e tests in gitlabs CICD pipeline. I was reading the documentation but I havent been able to figure out a way to perform the desired task. In the end what I am wanting to achieve here is taking advantage of Gitlabs CICD dashboard to display the status of each individual test case rather than pushing the individual statuses to a db and then creating my own dashboard to report on those statuses.
If anyone has any ideas or advice, please send them my way. Also if it is not possible to perform the above, does anyone know if there is a way I can create a custom dashboard that I can display in Gitlab’s CICD pipeline page? Thanks!