RFC: 'test' bugzilla keyword

[Tony Lambregts]

Francois Gouget wrote:

>On Tue, 27 Aug 2002, Paul Millar wrote:
>[...]
>  
>
>>>Maybe 'conformance' would work?
>>>      
>>>
>>Personally, I prefer "regression" to "conformance", although both are
>>applicable names.
>>    
>>
>
>The problem is we already have a 'regression' keyword with a reasonable
>meaning: 'bugs relating to programs that were working at one time but
>stoped working for some reason'. But this does not specifically cover
>the 'conformance test suite'.
>
>If a conformance test used to work and no longer does, then I think it
>would be reasonable to tag it as 'conformance, regression'.
>
>But I have also found that some tests do not pass on Windows. IIRC,
>there's a test having to do with TEMP that fails if it is set to
>'c:\Windows\Temp' rather than 'c:\'. I would like to be able to make a
>bug report and tag it with a keyword to indicate it is related to the
>'conformance test suite' (or whatever we want to call it). Similarly,
>there would be reports to be made about the conformance tests as run on
>FreeBSD and Solaris. And note that none of these are regressions.
>
>
>  
>
You have sold me on "conformance" . The real proplem is that we have 
been calling the conformance test suite by the wrong name if you ask me. 
  The thing is that this is exactly what the suite is for (to be able to 
track where wine and windows differ in thier behavior.)  To be able to 
have a bug report where the source is available is indispensible.

Mr Newman can we please, please, please have this.


Tony Lambregts