Francois Gouget : testbot: Detect and kill stuck task scripts.

[Alexandre Julliard]

Module: tools
Branch: master
Commit: 3ce81c0c6cf9e9829608441ab943da0503492d1d
URL:    https://source.winehq.org/git/tools.git/?a=commit;h=3ce81c0c6cf9e9829608441ab943da0503492d1d

Author: Francois Gouget <fgouget at codeweavers.com>
Date:   Wed May  9 02:45:31 2018 +0200

testbot: Detect and kill stuck task scripts.

The tasks themselves have a timeout which the corresponding scripts
enforce. However the scripts themselves may get stuck, typically due
to network problems. When that happens they can end up blocking the
whole TestBot. So make sure the TestBot engine itself can detect stuck
scripts and take corrective action.
Note that the detection is not very timely but will happen at the
latest in the SafetyNet() function. This means there will be at most a
10 minutes delay.

Signed-off-by: Francois Gouget <fgouget at codeweavers.com>
Signed-off-by: Alexandre Julliard <julliard at winehq.org>

---

 testbot/bin/LibvirtTool.pl                  |  7 ++++++-
 testbot/bin/WineRunBuild.pl                 |  1 +
 testbot/bin/WineRunReconfig.pl              |  1 +
 testbot/bin/WineRunTask.pl                  |  1 +
 testbot/ddl/update32.sql                    |  5 +++++
 testbot/ddl/winetestbot.sql                 | 25 +++++++++++++------------
 testbot/doc/winetestbot-schema.dia          | 23 +++++++++++++++++++++++
 testbot/lib/WineTestBot/Config.pm           | 17 ++++++++++-------
 testbot/lib/WineTestBot/Engine/Scheduler.pm | 16 +++++++++++++++-
 testbot/lib/WineTestBot/Tasks.pm            |  7 +++++--
 testbot/lib/WineTestBot/VMs.pm              | 11 ++++++++---
 testbot/web/admin/VMDetails.pl              |  3 ++-
 12 files changed, 90 insertions(+), 27 deletions(-)

Diff:   https://source.winehq.org/git/tools.git/?a=commitdiff;h=3ce81c0c6cf9e9829608441ab943da0503492d1d