[winetest] Show missing tests in single/group results

Paul Vriens paul.vriens.wine at gmail.com
Sun Aug 5 07:42:25 CDT 2007


Hi,

Before sending this to wine-patches I would like people to have a look first.
I've added as many screenshots as I thought where needed to show the changes (so
sorry in advance for the flood of pictures).

This patch makes sure that missing tests are shown in the test results, both
when there is only one system in a group (f.e. Win98) or multiple systems in a
group.

'single_test_before' shows that currently we have a single '.' where a test is
missing (without a link obviously or explanation).
'main_summary_before' shows the same '.' but now we have 2 systems in the group.
This means there is a link to the group overview.
'group_overview_before' shows nothing for these particular tests (gdiplus).

Now with the new output:

'single_test_after' still show the '.' but now it's marked todo (and a skip
border as these tests are skipped). 'failing_test_single_onmouseover' shows at
least some explanation.
'main_summary_after' is still the same with this new version (there is a link to
the group overview).
'group_overview_after' shows that now the group overview correctly shows the
missing tests and 'failing_test_onmouseover' shows some explanation.

Remember that this is still without winetest producing output about missing dll's.

Next patches will:

- add a missing dll as one of the reasons for missing tests
- add some better clue's on the main summary for multiple systems in a group 
(not a single '.' but maybe the same 'failed and skipped').

One of the thoughts I had was to replace the '.' with a '?' in case of missing
tests for an unknown reason but I'm not sure about that yet.

Comments/remarks etc.. are welcome. I'd also like to hear about other idea's for
this page to make it useful for everybody. Apart from the fact that we probably
should have more exposure to the fact that we have such a page/tool.
We saw an immediate rise (slowed down again) in test results as soon as winetest
was mentioned on 'http://tweakers.net/meuktracker/15817/Wine-0.9.42.html' (in
Dutch). There it was also mentioned that some machines crashed because of the
tests etc.. (maybe a wine-winetest component on bugzilla could help with that
which we could reference on the main test.winehq.org/data/*/index.html page).

Cheers,

Paul.









-------------- next part --------------
A non-text attachment was scrubbed...
Name: single_test_before.png
Type: image/png
Size: 15686 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/single_test_before-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: main_summary_before.png
Type: image/png
Size: 15266 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/main_summary_before-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: group_overview_before.png
Type: image/png
Size: 3943 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/group_overview_before-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: single_test_after.png
Type: image/png
Size: 14895 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/single_test_after-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: failing_test_single_onmouseover.png
Type: image/png
Size: 7924 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/failing_test_single_onmouseover-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: main_summary_after.png
Type: image/png
Size: 15505 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/main_summary_after-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: group_overview_after.png
Type: image/png
Size: 12883 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/group_overview_after-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: failing_test_onmouseover.png
Type: image/png
Size: 11702 bytes
Desc: not available
Url : http://www.winehq.org/pipermail/wine-devel/attachments/20070805/6f38301e/failing_test_onmouseover-0001.png


More information about the wine-devel mailing list