Quantcast

Proposal to drop Windows XP tests from Xen Project CI

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Proposal to drop Windows XP tests from Xen Project CI

Ian Jackson-2
Recently, the tests of Windows XP SP3 that are run by osstest, as part
of the Xen Project's test suite, have started failing a lot more.

It is not clear what has caused this.  The failures are causing
blockages: several of our `staging' branches are not gettting pushed
to the corresponding `stable' or `master' branches.  Older Xen
releases, as well as current master (4.9-rc) are affected.  This is a
problem for Xen development.

In my capacity as osstest administrator, I have tried to find someone
to help debug these.  (I don't have the knowledge to do so myself.)

I haven't had a good response.  My colleagues at Citrix tell me that
their internal XenRT system, used for XenServer, will be dropping its
own tests of Windows XP.  It's been suggested to me to simply drop the
Xen Project tests of Windows XP.

If you thinks that XP should continue to work well, and therefore to
be tested, I'm afraid I need your help.  Please contact me at the
address above, and I can provide more details, help, etc.

I myself investigated one failure and found that the VM seemed to have
responded to an ACPI power button event by rebooting, rather than by
shutting down as expected.  Wei looked at another failure and found
that the VM had failed to shut down because the XenRT guest agent
(which is baked into the autoinstall images we are using) was blocking
the shutdown.  There are also obviously other failure modes.

For now, here are some example logs:
  http://logs.test-lab.xenproject.org/osstest/logs/108185/test-amd64-amd64-xl-qemut-winxpsp3/info.html
  http://logs.test-lab.xenproject.org/osstest/logs/108185/test-amd64-amd64-xl-qemuu-winxpsp3/info.html

Thanks,
Ian.

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xen.org/xen-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Proposal to drop Windows XP tests from Xen Project CI

Ian Jackson-2
Ian Jackson writes ("Proposal to drop Windows XP tests from Xen Project CI"):

> Recently, the tests of Windows XP SP3 that are run by osstest, as part
> of the Xen Project's test suite, have started failing a lot more.
>
> It is not clear what has caused this.  The failures are causing
> blockages: several of our `staging' branches are not gettting pushed
> to the corresponding `stable' or `master' branches.  Older Xen
> releases, as well as current master (4.9-rc) are affected.  This is a
> problem for Xen development.
>
> In my capacity as osstest administrator, I have tried to find someone
> to help debug these.  (I don't have the knowledge to do so myself.)
>
> I haven't had a good response.  My colleagues at Citrix tell me that
> their internal XenRT system, used for XenServer, will be dropping its
> own tests of Windows XP.  It's been suggested to me to simply drop the
> Xen Project tests of Windows XP.
>
> If you thinks that XP should continue to work well, and therefore to
> be tested, I'm afraid I need your help.  Please contact me at the
> address above, and I can provide more details, help, etc.

I have just pushed to osstest pretest the change to drop testing of
Windows XP.  We are replacing it with tests of Windows Server 2016 and
Windows 10 (but of course as those are new tests, they will not count
for blocking regressions until they have passed).

Jan Beulich writes ("Re: [OSSTEST PATCH 3/3] make-flight: Drop Windows XP tests"):
> On 04.05.17 at 14:20, <[hidden email]> wrote:
> > We drop the tests only on the branches:
...

> >   xen-4.7-testing
> >   xen-4.8-testing
> >   xen-unstable
> >
> > The other branches are mostly out-of-support Xen branches.  These are
> > either old ones we are still doing security support for (and would
> > like to know about regressions on, even for old guests), or very old
> > ones which we don't expect to change ever.
>
> 4.6, while having passed the 1.5 year general support limit, had
> its most recent stable release go out before that time span was
> over, so I think we owe the community another stable release
> there. Hence I'm wondering whether it should be grouped with
> 4.7 and 4.8 above.

Done.  (Ie, I am dropping the tests on Xen 4.6 too.)

Ian.

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xen.org/xen-users
Loading...