Conformance tests

[Ferenc Wagner]

Hello,

recent discussion on the list ignited my interest again.
Francois has a very nice page
<http://fgouget.free.fr/wine/tests-en.shtml>, let's try to
make better use of it!

1. The precompiled binaries offered here would mean a great
   help, were they updated regularly.

2. Maybe better, a framework could be developed which would
   run all the tests, pack the results up and send it back
   to Francois for easy integration into his page.

3. The table on the page is too big for convenient use.  I
   do not know about much structure to see; maybe a table is
   not even needed.  Just version, date of test, if it is up
   to date with the binaries on the page, and a list of
   failing tests as links to the error messages would be
   enough.  If it is not, we can still embed it into the
   giant API database at http://24.229.94.2 (why is it not
   linked from WineHQ?) and have a general SQL interface! :)
   Hmm, some diffing capabilities might be useful indeed...

4. We could recruit people with access to the different
   platforms and send them mails asking for a rerun whenever
   the new tests are compiled.  Or advertise it on the devel
   list only...

What do you think?  I am even willing to do some of the
above, except for the build, as I have no constant access to
Windows machines.
                                                Feri.