Looking for TestBot help
Zhiyi Zhang
zzhang at codeweavers.com
Sun Dec 20 19:37:22 CST 2020
On 12/17/20 5:28 PM, Francois Gouget wrote:
> In these freezing times I'm looking for volunteers to help with three
> TestBot related tasks:
>
> * Modify WineTest to detect which tests can be run by running
> 'xxx_test --list' and automatically detecting and dismissing the
> "Missing dll" / "Missing entrypoint" dialogs.
>
> This would fix a lot of issues with tests not being run when they
> should:
> - Detect and report WineTest's "load errors"
> https://bugs.winehq.org/show_bug.cgi?id=48062
> - Detect missing entry point errors
> https://bugs.winehq.org/show_bug.cgi?id=48208
>
> * Alternatively the same type of change is needed for the TestBot's
> TestLauncher where it would replace AllImportedDllsPresent():
> https://source.winehq.org/git/tools.git/blob/HEAD:/testbot/src/TestLauncher/TestLauncher.c#l94
>
> There too it will help with a lot of issues:
> - TestLauncher says a required DLL is missing, but the test runs fine
> without TestLauncher
> https://bugs.winehq.org/show_bug.cgi?id=31609
>
> But I expect that once this is done on one side it will be easy to
> port to the other. So the choice of codebase is yours.
>
>
> * Write or find a Windows tool to automatically take a screenshot every
> few seconds and deduplicate identical screenshots. The requirements
> are:
I can help out with this one. I had been debugging some screenshot problems on
Wine and already have a few code snippets to do screenshots and save them.
For this tool, I'm thinking doing it generally the following way:
1. Capture the whole virtual screen and save it in a png in memory.
2. Compare the png in 1, if it's not equal to the previous screenshot, save it to disk in a folder.
And this tool can run on Windows and Wine with your requirements met.
I wonder if it would be better if we do video capture instead? If we don't plan on keeping
the video forever, I think a 2 mins video shouldn't be too large. A few megabytes I think,
depending on the video format.
Zhiyi
> - Open-source of course.
> - No dependency (so if using an off-the-shelf tool it should not
> require installing some language runtime, etc).
> - Must support multi-screen configurations, even with slightly
> different resolutions.
> - Will eventually need to be used by the TestBot through TestAgentd,
> either by running this external tool, or be integrated in TestAgentd
> itself.
>
> The same functionality will be needed on Unix. If that's not possible
> with a Windows tool this may turn into a separate project to do the
> same on the Unix side. There I expect some scriptable open-source
> tools to already exist but if one tool can do it all that would be
> simpler.
>
> - Take live/regular screenshots
> https://bugs.winehq.org/show_bug.cgi?id=44709
>
>
> In the meantime I'll continue refreshing the test VMs, and working on
> the website and Engine perl side of things (but if there are volunteers
> for that you're welcome too).
>
>
More information about the wine-devel
mailing list