Wine test results problem
Katerina Nizhnik
sol at 7ka.mipt.ru
Fri Sep 2 08:47:07 CDT 2005
Hi,
I execute Wine tests on clean Windows XP SP2 and Windows 2003 SP1 EE.
I tried to use both pre-compiled binary from
http://www.astro.gla.ac.uk/users/paulm/WRT/CrossBuilt/winetest-latest.exe
and Wine sources built by myself with Visual Studio .NET 2003 (20050830 version).
What I do is just launching the test several times on the same machine
and comparing log files received.
Please, see the sample diff of 2 such log files.
Why the number of tests executed and number of failures are so
different for the identical test groups?
It seems to be some synchronization problem.
How should I fix this to obtain stable results?
Thank you in advance.
------------------------------------------------------------
@@ -50,7 +50,7 @@
module: 34 tests executed, 0 marked as todo, 0 failures.
mailslot: 75 tests executed, 0 marked as todo, 0 failures.
path: 1741 tests executed, 0 marked as todo, 0 failures.
-pipe: 419 tests executed, 0 marked as todo, 0 failures.
+pipe: 418 tests executed, 0 marked as todo, 0 failures.
tests/process.c: 1 tests executed, 0 marked as todo, 0 failures.
tests/process.c: 1 tests executed, 0 marked as todo, 0 failures.
tests/process.c: 1 tests executed, 0 marked as todo, 0 failures.
@@ -78,7 +78,7 @@
util: 139 tests executed, 0 marked as todo, 136 failures.
mlang: 11211 tests executed, 0 marked as todo, 20 failures.
msacm: 385 tests executed, 0 marked as todo, 0 failures.
-profile: 127 tests executed, 0 marked as todo, 1 failure.
+profile: 127 tests executed, 0 marked as todo, 0 failures.
htmldoc: 688 tests executed, 0 marked as todo, 0 failures.
protocol: 255 tests executed, 0 marked as todo, 0 failures.
db: 73 tests executed, 0 marked as todo, 0 failures.
@@ -104,7 +104,7 @@
env: 611 tests executed, 0 marked as todo, 0 failures.
error: 813 tests executed, 0 marked as todo, 0 failures.
generated: 1981 tests executed, 0 marked as todo, 0 failures.
-info: 765 tests executed, 0 marked as todo, 0 failures.
+info: 725 tests executed, 0 marked as todo, 0 failures.
large_int: 700 tests executed, 0 marked as todo, 0 failures.
path: 230 tests executed, 0 marked as todo, 5 failures.
reg: 9 tests executed, 0 marked as todo, 0 failures.
@@ -133,7 +133,7 @@
main: 15 tests executed, 0 marked as todo, 1 failure.
generated: 1141 tests executed, 0 marked as todo, 0 failures.
shelllink: 116 tests executed, 0 marked as todo, 3 failures.
-tests/shellpath.c: 10 tests executed, 0 marked as todo, 0 failures.
+tests/shellpath.c: 10 tests executed, 0 marked as todo, 4 failures.
tests/shellpath.c: 4 tests executed, 0 marked as todo, 0 failures.
shellpath: 447 tests executed, 0 marked as todo, 3 failures.
shlexec: 20 tests executed, 0 marked as todo, 0 failures.
@@ -174,4 +174,4 @@
timer: 44 tests executed, 0 marked as todo, 0 failures.
wave: 289 tests executed, 0 marked as todo, 15 failures.
protocol: 26 tests executed, 0 marked as todo, 0 failures.
-sock: 8971 tests executed, 0 marked as todo, 5 failures.
+sock: 8951 tests executed, 0 marked as todo, 5 failures.
------------------------------------------------------------
--
Sincerely yours,
katy
More information about the wine-devel
mailing list