Francois Gouget : testbot: Take into account multiple WineTest reports.

[Alexandre Julliard]

Module: tools
Branch: master
Commit: da678a9ebfe3862378543e80b03cd7c5496334cc
URL:    https://source.winehq.org/git/tools.git/?a=commit;h=da678a9ebfe3862378543e80b03cd7c5496334cc

Author: Francois Gouget <fgouget at codeweavers.com>
Date:   Tue Feb 18 17:33:09 2020 +0100

testbot: Take into account multiple WineTest reports.

Instead of keeping only the latest WineTest results, keep all of them
and only consider an error new if it does not appears in one of the
WineTest results. This minimizes the risk of tagging a failure as new
when it happens intermitently.
However it also means the number of reference WineTest results can grow
without bounds so purge them after $JobPurgeDays.
Since all reference reports end up in the latest/ directory this also
makes it unnecessary to go fishing for them in the jobs/ directory when
running UpdateTaskLogs on a specific job. Also filtering reference
reports to only use those older than the task can be done based on the
reference report mtime instead of having to keep trust the jobid order.

Note: UpdateTaskLog can optionally be run to update the new/old status
in the errors cache files.

Wine-Bug: https://bugs.winehq.org/show_bug.cgi?id=47998
Signed-off-by: Francois Gouget <fgouget at codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard at winehq.org>

---

 testbot/bin/Janitor.pl              |   9 +--
 testbot/bin/UpdateTaskLogs          | 107 +++++++++++++---------------------
 testbot/bin/WineRunTask.pl          |   5 ++
 testbot/bin/WineRunWineTest.pl      |   5 ++
 testbot/lib/WineTestBot/LogUtils.pm | 113 ++++++++++++++++++++----------------
 testbot/lib/WineTestBot/Tasks.pm    |  25 +++++++-
 6 files changed, 140 insertions(+), 124 deletions(-)

Diff:   https://source.winehq.org/git/tools.git/?a=commitdiff;h=da678a9ebfe3862378543e80b03cd7c5496334cc