[ANN] Conformance testing campaign

[Dimitrie O. Paun]

On Sat, 27 Sep 2003, Ferenc Wagner wrote:

> For the console test, yes.  I just did not care, because I
> was promised a better run.

In other words, he is supposed to detect a hanged test,
and report an error?

> We could put up a little cgi which asks for a tag and makes
> sure it is unique.  

This is overkill, for sure.

> Or simply append a number if the
> submission is done by email.  I do not expect too many
> concurrent submissions anyway...

For sure we need to append a number, but my point is that
once we generate that name dinamically, it's ugly and it
shouldn't be displayed. As for who submitted it, we already
have that, so we're good.

> But I have a real problem here: which results to put in the
> main summary if there are many reports for a version?  The
> one submitted first?  The one with the most/least successes?
> Or maybe a mixture?  Now it is the one with no tag, which is
> practically the first submission.

What about the max number of errors in all tests?

> > How come? I thought Jakob includes a dump of the OS version
> > structure, like so:
> 
> Yes, he does.  But except for one result submitted by Jakob,
> all the results are from my .bat-driven zip file.

In other words, for stuff that includes that info, you
parse it out? Maybe you should stop distributing the
.bat file, we need to figure out how well do the two
things work together, no?

-- 
Dimi.