appdb rating inflation

[Chris Morgan]

On 03 Jan 2007 22:46:31 +0200, Kari Hurtta <hurtta+gmane at siilo.fmi.fi> wrote:
> "Chris Morgan" <chmorgan at gmail.com> writes in gmane.comp.emulators.wine.devel:
>
> > On 03 Jan 2007 16:34:21 +0200, Kari Hurtta <hurtta+gmane at siilo.fmi.fi> wrote:
> > > "Dan Kegel" <dank at kegel.com> writes in gmane.comp.emulators.wine.devel:
> > >
> > > > The appdb says
> > > > "Only applications which install and run flawlessly on an out-of-the-box
> > > > Wine installation make it to the Platinum list"
> > >
> > > Yes.  Also on front page http://appdb.winehq.org/ on first item:
> > >
> > > The Top-10 Platinum List
> > >
> > > Ragnarok Online All Versions
> > >
> > > http://appdb.winehq.org/appview.php?iVersionId=928
> > >
> > > Maintainer's Rating:    Platinum
> > >
> > >
> > > Description:            What was not tested
> > >
> > >                          * Installation. That was not necessary because I
> > >                            already installed it in Windows - I'm just running
> > >                            RO from the Windows partition.
> > >
> > >
> > >
> > > So that appdb classification is complete garbage.
> > >
> > > If Platinum requires that installation works out of box, and
> > > tester did even tested installation and still gives platinium.
> > >
> > >
> > > So first item on http://appdb.winehq.org/ says "don't trust me".
> > >
> > > / Kari Hurtta
> > >
> > >
> > > ( Some other maintenaivers have give rating 'Garbage' for this application :-) )
> >
> > I agree, the rating isn't correct. We aren't going to be able to avoid
> > issues with mis-rated applications though, so discussing language
> > changes is only going to clarify the issue not entirely prevent them.
> >
> > In this case the maintainer of the application should be made aware of
> > this issue and should take care of correcting the rating.
> >
> > Chris
>
> Yes. However there may be another test for this application, which may
> be correctly rated platinium:
>         http://appdb.winehq.org/appview.php?iVersionId=928&iTestingId=8032
>
> On that test, installation is tested:
>
> |         What works
> |         Installing the game, patching, launching the game from the directory.
> |         Sound worked flawlessly. Runs as fast as on win32 at 1024x768 (full detail).
>
> http://appdb.winehq.org/   platinium list's first item should point
> to that test instead.
>
>
> Perhaps    appdb should check that   "Installs?" and "Runs?"   column on
> particular test have "Yes", before it accept "Platinum" to "Rating"
> column ?
>
>
> / Kari Hurtta
>
>

Exactly, we need some logic to ensure ratings are correct. I think the
fundamental change is that we should remove maintainer ratings
entirely and be driven by the test results. This way the rating of the
application depends on how well users can get it to run on their
platform under wine instead of an experts opinion.

Chris