WineTest failure patterns
Francois Gouget
fgouget at codeweavers.com
Thu May 27 09:45:40 CDT 2021
The new "failure patterns" pages are now complete:
* All results
https://test.winehq.org/data/patterns.html
* TestBot's Windows VMs only
https://test.winehq.org/data/patterns-tb-win.html
* TestBot's Wine VMs only
https://test.winehq.org/data/patterns-tb-wine.html
The main additions are:
* The pages start with a bit of documentation.
* Before the tests there is now an 'overview' pattern showing the number
of failed test units for each machine. This is useful to detect when a
VM goes bad, for instance when Windows 10 decides to pop up a 'first
use' configuration dialog: that line will turn red. This can also
highlight machines that get worse results than their peers, and thus
warrant a check.
You will also notice a couple of machines that only have a handful of
failures!
* For each test the pages link to related commits. For each commit they
show if it modified the test itself, a shared test resource or the
Wine module. This simplifies reviewing potential culprits when a test
starts failing.
* For each test the pages link to the related bugs. This simplifies
checking if someone has already analysed the bug or tried fixing it.
If the bug has a regression commit id, that commit is also shown as
such.
* The page also shows bugs for tests that have no failure. This
simplifies verifying that the bugs have been closed when a test is
fixed.
--
Francois Gouget <fgouget at codeweavers.com>
More information about the wine-devel
mailing list