I recently decided, based on this article, that instead of creating unit tests and using Sonarqube's test coverage, I will, at least for now, worry only with E2E tests. That being said, I do not want to report coverage, but I do want to report the success or failure of my test suites, to that if a test fails, my quality gates fails. I have the following configured in my sonarqube-scanner.js:
'sonar.testExecutionReportPaths': 'test-results.xml'
And this is the output of my custom Playwright reporter:
<testExecutions version="1">
<file path="tests/pages/test.spec.ts">
<testCase name="Should load the page filtered by default with todays date" duration="32323">
<failure message="short">sample failure text</failure>
</testCase>
</file>
</testExecutions>
I expected my dashboard to be failed due to a test suite failure, but it's passed. I think I have something misconfigured. Is there a way to configure sonarqube in a way that the above report would fail the quality gate?