question about xen regression test tools

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

question about xen regression test tools

alex.shi
 


I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
and the memtest test suite is very old. it is just 0.0.4 version.
So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?

Any hints will be very appreciated!


Thanks and best regards
Alex shi

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: question about xen regression test tools

James Bulpin-2
Alex,

ttcpbw uses a variant of the ttcp+ tool (see
http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)

specjbb is SPEC JBB (www.spec.org)

postmark 1.5c is what we use

vm86 is an internal test

We use memtest 0.0.4 but I've disabled it for now as I don't trust it.

James

Shi, Alex wrote:

>  
>
>
> I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
> But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
> and the memtest test suite is very old. it is just 0.0.4 version.
> So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>
> Any hints will be very appreciated!
>
>
> Thanks and best regards
> Alex shi

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi
Many thanks for your quick response.  
I am wondering, Are there any others test suite which was disabled now?

Did you know the VM regress? (http://www.skynet.ie/~mel/projects/vmregress/)
tt seems interesting, :) I am going to try it on VMX domain.


Thanks and best regards
Alex shi



-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
Sent: 2006年3月22日 11:21
To: Shi, Alex
Cc: [hidden email]
Subject: [Xen-users] Re: question about xen regression test tools

Alex,

ttcpbw uses a variant of the ttcp+ tool (see
http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)

specjbb is SPEC JBB (www.spec.org)

postmark 1.5c is what we use

vm86 is an internal test

We use memtest 0.0.4 but I've disabled it for now as I don't trust it.

James

Shi, Alex wrote:

>  
>
>
> I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
> But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
> and the memtest test suite is very old. it is just 0.0.4 version.
> So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>
> Any hints will be very appreciated!
>
>
> Thanks and best regards
> Alex shi

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Re: question about xen regression test tools

James Bulpin-2
In reply to this post by alex.shi
Shi, Alex wrote:
> I found the "updpingpong" case was not run recently. Does it have some problem?

It's not been written yet.

Please keep list discussions on the list.

James

>
> Thanks and best regards
> Alex shi
>
>
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
> Sent: 2006年3月22日 11:21
> To: Shi, Alex
> Cc: [hidden email]
> Subject: [Xen-users] Re: question about xen regression test tools
>
> Alex,
>
> ttcpbw uses a variant of the ttcp+ tool (see
> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>
> specjbb is SPEC JBB (www.spec.org)
>
> postmark 1.5c is what we use
>
> vm86 is an internal test
>
> We use memtest 0.0.4 but I've disabled it for now as I don't trust it.
>
> James
>
> Shi, Alex wrote:
>
>>
>>
>>
>>I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
>>But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
>>and the memtest test suite is very old. it is just 0.0.4 version.
>>So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>>
>>Any hints will be very appreciated!
>>
>>
>>Thanks and best regards
>>Alex shi
>
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi
I have some questiong about the xenrt webpage.

1, I find some item seems strange on revsion line of http://xenbits.xensource.com/xenrt/table.psp?horizontalGroup=config&horizontalAxis=revision&verticalGroup=phase&verticalAxis=test 
It seems the revsion line show the test date. but why are there other streaming "5a7efe0c"?

c7689e1e  20050818  20050819  dummy   5a7efe0c  20050820  20050821  20050822  531ad4bd  20050823  648c366d  

2, I find the lastest revsion it 20060214. it means you did not test xen-unstable from that day? or you do the test but just not update result to webpage?



Thanks and best regards
Alex shi



-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
Sent: 2006年3月23日 23:37
To: Shi, Alex
Cc: Xen User List
Subject: Re: [Xen-users] Re: question about xen regression test tools

Shi, Alex wrote:
> I found the "updpingpong" case was not run recently. Does it have some problem?

It's not been written yet.

Please keep list discussions on the list.

James

>
> Thanks and best regards
> Alex shi
>
>
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
> Sent: 2006年3月22日 11:21
> To: Shi, Alex
> Cc: [hidden email]
> Subject: [Xen-users] Re: question about xen regression test tools
>
> Alex,
>
> ttcpbw uses a variant of the ttcp+ tool (see
> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>
> specjbb is SPEC JBB (www.spec.org)
>
> postmark 1.5c is what we use
>
> vm86 is an internal test
>
> We use memtest 0.0.4 but I've disabled it for now as I don't trust it.
>
> James
>
> Shi, Alex wrote:
>
>>
>>
>>
>>I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
>>But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
>>and the memtest test suite is very old. it is just 0.0.4 version.
>>So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>>
>>Any hints will be very appreciated!
>>
>>
>>Thanks and best regards
>>Alex shi
>
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi
Would you like to share your test cases that were used in xenrt?
like to:  vm86, srm, updpingpong, bootxen, starttools, startdom test suite.



Thanks and best regards
Alex shi



-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
Sent: 2006年3月23日 23:37
To: Shi, Alex
Cc: Xen User List
Subject: Re: [Xen-users] Re: question about xen regression test tools

Shi, Alex wrote:
> I found the "updpingpong" case was not run recently. Does it have some problem?

It's not been written yet.

Please keep list discussions on the list.

James

>
> Thanks and best regards
> Alex shi
>
>
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
> Sent: 2006年3月22日 11:21
> To: Shi, Alex
> Cc: [hidden email]
> Subject: [Xen-users] Re: question about xen regression test tools
>
> Alex,
>
> ttcpbw uses a variant of the ttcp+ tool (see
> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>
> specjbb is SPEC JBB (www.spec.org)
>
> postmark 1.5c is what we use
>
> vm86 is an internal test
>
> We use memtest 0.0.4 but I've disabled it for now as I don't trust it.
>
> James
>
> Shi, Alex wrote:
>
>>
>>
>>
>>I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
>>But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
>>and the memtest test suite is very old. it is just 0.0.4 version.
>>So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>>
>>Any hints will be very appreciated!
>>
>>
>>Thanks and best regards
>>Alex shi
>
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi
I have found you use many boxes to do xen regress test, but most of I can not find related comments. Would you like to share those info with me? - thanks in advance

host
0  albaron
1  atitlan
2  baker
3  bernina
4  blanca
5  bogga
6  boonda
7  dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
8  dummy
9  dummyhos
10  forbes Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
11  gallenst
12  gheeta 1xEM64T (HT) 4GB SATA D915 Yukon
13  ghosts Dell SC1425 2xEM64T (HT) 4GB SATA e1000
14  gorga 1xEM64T (HT) 4GB SATA D915 Yukon
15  grappa 1xEM64T (HT) 4GB SATA D915 Yukon
16  grondo 1xEM64T (HT) 4GB SATA D915 Yukon
17  hubbard
18  humbolt
19  humphrey
20  humpreys
21  hunter
22  k2
23  kamet
24  leone
25  nowshak 2xOpteron 4GB SCSI (MPT Fusion)
26  peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
27  planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
28  pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
29  romba
30  sabinyo
31  trivor  



Thanks and best regards
Alex shi



-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
Sent: 2006年3月23日 23:37
To: Shi, Alex
Cc: Xen User List
Subject: Re: [Xen-users] Re: question about xen regression test tools

Shi, Alex wrote:
> I found the "updpingpong" case was not run recently. Does it have some problem?

It's not been written yet.

Please keep list discussions on the list.

James

>
> Thanks and best regards
> Alex shi
>
>
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
> Sent: 2006年3月22日 11:21
> To: Shi, Alex
> Cc: [hidden email]
> Subject: [Xen-users] Re: question about xen regression test tools
>
> Alex,
>
> ttcpbw uses a variant of the ttcp+ tool (see
> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>
> specjbb is SPEC JBB (www.spec.org)
>
> postmark 1.5c is what we use
>
> vm86 is an internal test
>
> We use memtest 0.0.4 but I've disabled it for now as I don't trust it.
>
> James
>
> Shi, Alex wrote:
>
>>
>>
>>
>>I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
>>But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
>>and the memtest test suite is very old. it is just 0.0.4 version.
>>So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>>
>>Any hints will be very appreciated!
>>
>>
>>Thanks and best regards
>>Alex shi
>
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Re: question about xen regression test tools

James Bulpin-2
Why don't you share your interest in testing and your results and
infrastructure with the list?

Shi, Alex wrote:

> I have found you use many boxes to do xen regress test, but most of I can not find related comments. Would you like to share those info with me? - thanks in advance
>
> host
> 0  albaron
> 1  atitlan
> 2  baker
> 3  bernina
> 4  blanca
> 5  bogga
> 6  boonda
> 7  dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
> 8  dummy
> 9  dummyhos
> 10  forbes Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
> 11  gallenst
> 12  gheeta 1xEM64T (HT) 4GB SATA D915 Yukon
> 13  ghosts Dell SC1425 2xEM64T (HT) 4GB SATA e1000
> 14  gorga 1xEM64T (HT) 4GB SATA D915 Yukon
> 15  grappa 1xEM64T (HT) 4GB SATA D915 Yukon
> 16  grondo 1xEM64T (HT) 4GB SATA D915 Yukon
> 17  hubbard
> 18  humbolt
> 19  humphrey
> 20  humpreys
> 21  hunter
> 22  k2
> 23  kamet
> 24  leone
> 25  nowshak 2xOpteron 4GB SCSI (MPT Fusion)
> 26  peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
> 27  planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
> 28  pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
> 29  romba
> 30  sabinyo
> 31  trivor  
>
>
>
> Thanks and best regards
> Alex shi
>
>
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
> Sent: 2006年3月23日 23:37
> To: Shi, Alex
> Cc: Xen User List
> Subject: Re: [Xen-users] Re: question about xen regression test tools
>
> Shi, Alex wrote:
>
>>I found the "updpingpong" case was not run recently. Does it have some problem?
>
>
> It's not been written yet.
>
> Please keep list discussions on the list.
>
> James
>
>
>>Thanks and best regards
>>Alex shi
>>
>>
>>
>>-----Original Message-----
>>From: [hidden email] [mailto:[hidden email]] On Behalf Of James Bulpin
>>Sent: 2006年3月22日 11:21
>>To: Shi, Alex
>>Cc: [hidden email]
>>Subject: [Xen-users] Re: question about xen regression test tools
>>
>>Alex,
>>
>>ttcpbw uses a variant of the ttcp+ tool (see
>>http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>>
>>specjbb is SPEC JBB (www.spec.org)
>>
>>postmark 1.5c is what we use
>>
>>vm86 is an internal test
>>
>>We use memtest 0.0.4 but I've disabled it for now as I don't trust it.
>>
>>James
>>
>>Shi, Alex wrote:
>>
>>
>>>
>>>
>>>I am very interesting to the xen regression test tools. like memtest, dbench, osdb, etc. etc.
>>>But I can not find some tools via google. like vm86, ttcpbw, specjbb, and postmark  (just find a postmark-1_5.c file from http://linuxcompressed.sourceforge.net/statistics/)
>>>and the memtest test suite is very old. it is just 0.0.4 version.
>>>So, Anyone like to tell me where I can find them? and share more detailed info of the test result on xenU or VMX domain of these test suites?
>>>
>>>Any hints will be very appreciated!
>>>
>>>
>>>Thanks and best regards
>>>Alex shi
>>
>>
>>_______________________________________________
>>Xen-users mailing list
>>[hidden email]
>>http://lists.xensource.com/xen-users
>
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi

We use 3 boxes to test IA32/IA32pae/IA32e and send our test results to xen-devel, pls see attached file.

Up to now these tests mainly focus on booting different guest OS. Because xen becomes more and more stable, we need to have more tests on guest OS(Now we use LTP). xenRT is excellent for this.

Thanks and best regards
Alex shi



James Bulpin wrote:

> Why don't you share your interest in testing and your results and
> infrastructure with the list?
>
> Shi, Alex wrote:
>> I have found you use many boxes to do xen regress test, but most of
>> I can not find related comments. Would you like to share those info
>> with me? - thanks in advance  
>>
>> host
>> 0  albaron
>> 1  atitlan
>> 2  baker
>> 3  bernina
>> 4  blanca
>> 5  bogga
>> 6  boonda
>> 7  dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion)
>> e1000 8  dummy 9  dummyhos
>> 10  forbes Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 11  gallenst 12  gheeta 1xEM64T (HT) 4GB SATA D915 Yukon
>> 13  ghosts Dell SC1425 2xEM64T (HT) 4GB SATA e1000
>> 14  gorga 1xEM64T (HT) 4GB SATA D915 Yukon
>> 15  grappa 1xEM64T (HT) 4GB SATA D915 Yukon
>> 16  grondo 1xEM64T (HT) 4GB SATA D915 Yukon
>> 17  hubbard
>> 18  humbolt
>> 19  humphrey
>> 20  humpreys
>> 21  hunter
>> 22  k2
>> 23  kamet
>> 24  leone
>> 25  nowshak 2xOpteron 4GB SCSI (MPT Fusion)
>> 26  peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>> 27  planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 28  pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
>> 29  romba
>> 30  sabinyo
>> 31  trivor
>>
>>
>>
>> Thanks and best regards
>> Alex shi
>>
>>
>>
>> -----Original Message-----
>> From: [hidden email]
>> [mailto:[hidden email]] On Behalf Of James
>> Bulpin  
>> Sent: 2006年3月23日 23:37
>> To: Shi, Alex
>> Cc: Xen User List
>> Subject: Re: [Xen-users] Re: question about xen regression test tools
>>
>> Shi, Alex wrote:
>>
>>> I found the "updpingpong" case was not run recently. Does it have
>>> some problem?
>>
>>
>> It's not been written yet.
>>
>> Please keep list discussions on the list.
>>
>> James
>>
>>
>>> Thanks and best regards
>>> Alex shi
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: [hidden email]
>>> [mailto:[hidden email]] On Behalf Of James
>>> Bulpin Sent: 2006年3月22日 11:21 To: Shi, Alex
>>> Cc: [hidden email]
>>> Subject: [Xen-users] Re: question about xen regression test tools
>>>
>>> Alex,
>>>
>>> ttcpbw uses a variant of the ttcp+ tool (see
>>> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>>>
>>> specjbb is SPEC JBB (www.spec.org)
>>>
>>> postmark 1.5c is what we use
>>>
>>> vm86 is an internal test
>>>
>>> We use memtest 0.0.4 but I've disabled it for now as I don't trust
>>> it.
>>>
>>> James
>>>
>>> Shi, Alex wrote:
>>>
>>>
>>>>
>>>>
>>>> I am very interesting to the xen regression test tools. like
>>>> memtest, dbench, osdb, etc. etc.
>>>> But I can not find some tools via google. like vm86, ttcpbw,
>>>> specjbb, and postmark  (just find a postmark-1_5.c file from
>>>> http://linuxcompressed.sourceforge.net/statistics/) and the
>>>> memtest test suite is very old. it is just 0.0.4 version.  
>>>> So, Anyone like to tell me where I can find them? and share more
>>>> detailed info of the test result on xenU or VMX domain of these
>>>> test suites?  
>>>>
>>>> Any hints will be very appreciated!
>>>>
>>>>
>>>> Thanks and best regards
>>>> Alex shi
>>>
>>>
>>> _______________________________________________
>>> Xen-users mailing list
>>> [hidden email]
>>> http://lists.xensource.com/xen-users
>>
>>
>> _______________________________________________
>> Xen-users mailing list
>> [hidden email]
>> http://lists.xensource.com/xen-users



We have tested latest xen on VT platform with Intel 915/E8500 chipset.Here is the test summary.
 

issues:

        - No blocking issue.

IA-32:
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32 2.4/2.6 linux in VMX domain
    Can bootup unmodified IA-32 WindowsXP SP1/SP2 in VMX domain
    Can bootup VMX & XenU with different memory size(VMX:128MB,256MB,512MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well

 
IA-32_PAE:
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32 2.6 linux in VMX domain
    Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
    Can bootup VMX & XenU with different memory size(VMX:256MB,512MB,1500MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well
   

IA-32e:
    Build&Boot SMP xen0 without problem
    Can bootup unmodified IA-32(2.4,2.6)/IA-32e(2.6) linux in VMX domain
    Can bootup unmodified IA-32 WindowXP SP1 in VMX domain
    Can bootup IA-32PAE 2.6 linux in VMX domain
    Can bootup VMX & xenU with different memory size.(VMX:128MB,256MB,512MB,4096MB.XenU:256MB)
    A selected subset of LTP runs well in VMX domain(2.6)
    A selected subset of xm-test runs well

   
   


for details
------------------------------------------------------------

Platform: IA-32
Service OS: FC3, IA-32, SMP
Hardware: Grandstale
Default guest OS: IA-32, 2.6 kernel

1, one vmx with memory 128M                     PASS
2, one vmx with memory 256M                     PASS
3, one vmx with memory 512M                     PASS
4, one xenU create                              PASS
5, 2 vmx and 2 xenU coexist                     PASS
6, four vmx coexist                             PASS
7, network in VMX domain                        PASS
8, network in XenU domain                       PASS
9, one window domain                            PASS
10,1 xp1 and 1 xp2 windows domains coexist      PASS
11,XenU migration                               PASS
12,subset LTP test in VMX domain                PASS


=========================================================================
Xm-test execution summary:
  PASS:  46
  FAIL:  3
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos
         /proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)


==============================================================================



LTP test result on IA-32

                     Summary Test Report of Last Session
==============================================================================
                Total     Pass      Fail     NoResult     Crash
==============================================================================
ltp             194       194        0          0          0
==============================================================================
ltp             194       194        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         120       120        0          0          0
sched             3         3         0          0          0
==============================================================================
Total           194       194        0          0          0



Platform: IA-32_PAE
Service OS: RHEL4U1, IA-32_PAE, SMP
Hardware: Grandstal
Default guest OS: IA-32, 2.6 kernel, no pae support

1, one vmx with memory 256M                     PASS
2, one vmx with memory 512M                     PASS
3, one vmx with memory 1.5GB                    PASS
4, one xenU with memory 256M                    PASS
5, network in VMX domain                        PASS
6, network in XenU domain                       PASS
7, one xp1 window domain                        PASS
8, xm-test                                      PASS
9, XenU migration                               PASS
10,LTP in VMX                                   PASS

=============================================================================
Xm-test execution summary:
  PASS:  46
  FAIL:  3
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos
         /proc/cpuinfo says xend didn't enforce dom0_cpus (2 != 1)

==============================================================================



LTP test result on PAE host

                     Summary Test Report of Last Session
==============================================================================
                Total     Pass      Fail     NoResult     Crash
==============================================================================
ltp             194       194        0          0          0
==============================================================================
ltp             194       194        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         120       120        0          0          0
sched             3         3         0          0          0
==============================================================================
Total           194       194        0          0          0




Platform: IA-32e
Service OS: RHEL4U2, IA-32e, SMP
Hardware: Paxville
Default guest OS: IA-32e, 2.6 kernel


1, one vmx with memory 128M                     PASS
2, one vmx with memory 256M                     PASS
3, one vmx with memory 512M                     PASS
4, one vmx with memory 4096M                    PASS
5, one xenU with memory 256M                    PASS
6, 2 vmx and 2 xenU coexist                     PASS
7, four vmx coexist                             PASS
8, network in VMX domain                        PASS
9, network in XenU domain                       PASS
10, one 2.4 IA32 VMX domain                     PASS
11, one 2.6 IA32 VMX domain                     PASS
12, IA-32 2.4 and 2.6 VMX coexist               PASS
13, IA-32 and IA-32e VMX coexist                PASS
14, LTP in VMX                                  PASS
15, one xp1 window domain                       PASS
16, IA-32PAE 2.6 linux domain                   PASS
17, xm-test                                     PASS


================================================================
Xm-test execution summary:
  PASS:  45
  FAIL:  4
  XPASS: 1
  XFAIL: 2


Details:

XFAIL: 02_network_local_ping_pos
         ping loopback failed for size 65507. ping eth0 failed for size 65507.

 FAIL: 01_enforce_dom0_cpus_basic_pos
         /proc/cpuinfo says xend didn't enforce dom0_cpus (16 != 1)
=================================================================


LTP test on IA-32e
               Summary Test Report of Last Session
==============================================================================
=                Total     Pass      Fail     NoResult     Crash
==============================================================================
=ltp             195       195        0          0          0
==============================================================================
=ltp             195       195        0          0          0
mm                21        21        0          0          0
dio               28        28        0          0          0
nptl              1         1         0          0          0
math              10        10        0          0          0
ipc               8         8         0          0          0
pty               3         3         0          0          0
quickhit         121       121        0          0          0
sched             3         3         0          0          0
==============================================================================
=Total           195       195        0          0          0


Thanks and best regards
Alex shi

_______________________________________________
Xen-devel mailing list
[hidden email]
http://lists.xensource.com/xen-devel

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

RE: Re: question about xen regression test tools

alex.shi
In reply to this post by alex.shi
Would you like to share your xen regress test infrastructure and test suites for us, if so, we can do similar test in our testing boxes.

Thanks and best regards
Alex shi



Shi, Alex wrote:

> We use 3 boxes to test IA32/IA32pae/IA32e and send our test results
> to xen-devel, pls see attached file.
>
> Up to now these tests mainly focus on booting different guest OS.
> Because xen becomes more and more stable, we need to have more tests
> on guest OS(Now we use LTP). xenRT is excellent for this.  
>
> Thanks and best regards
> Alex shi
>
>
>
> James Bulpin wrote:
>> Why don't you share your interest in testing and your results and
>> infrastructure with the list?
>>
>> Shi, Alex wrote:
>>> I have found you use many boxes to do xen regress test, but most of
>>> I can not find related comments. Would you like to share those info
>>> with me? - thanks in advance
>>>
>>> host
>>> 0  albaron
>>> 1  atitlan
>>> 2  baker
>>> 3  bernina
>>> 4  blanca
>>> 5  bogga
>>> 6  boonda
>>> 7  dammasto Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion)
>>> e1000 8  dummy 9  dummyhos 10  forbes Dell PE1850 2xXeon (EM64T,HT)
>>> 4GB SCSI (MPT Fusion) e1000 11  gallenst 12  gheeta 1xEM64T (HT)
>>> 4GB SATA D915 Yukon 13  ghosts Dell SC1425 2xEM64T (HT) 4GB SATA
>>> e1000 14  gorga 1xEM64T (HT) 4GB SATA D915 Yukon
>>> 15  grappa 1xEM64T (HT) 4GB SATA D915 Yukon
>>> 16  grondo 1xEM64T (HT) 4GB SATA D915 Yukon
>>> 17  hubbard
>>> 18  humbolt
>>> 19  humphrey
>>> 20  humpreys
>>> 21  hunter
>>> 22  k2
>>> 23  kamet
>>> 24  leone
>>> 25  nowshak 2xOpteron 4GB SCSI (MPT Fusion)
>>> 26  peclet Dell PE1850 2xXeon (EM64T,HT) 4GB SCSI (MPT Fusion) e1000
>>> 27  planb 2xOpteron 8GB SCSI (MPT Fusion) TG3
>>> 28  pong 2xOpteron 8GB SCSI (MPT Fusion) TG3
>>> 29  romba
>>> 30  sabinyo
>>> 31  trivor
>>>
>>>
>>>
>>> Thanks and best regards
>>> Alex shi
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: [hidden email]
>>> [mailto:[hidden email]] On Behalf Of James
>>> Bulpin Sent: 2006年3月23日 23:37
>>> To: Shi, Alex
>>> Cc: Xen User List
>>> Subject: Re: [Xen-users] Re: question about xen regression test
>>> tools
>>>
>>> Shi, Alex wrote:
>>>
>>>> I found the "updpingpong" case was not run recently. Does it have
>>>> some problem?
>>>
>>>
>>> It's not been written yet.
>>>
>>> Please keep list discussions on the list.
>>>
>>> James
>>>
>>>
>>>> Thanks and best regards
>>>> Alex shi
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: [hidden email]
>>>> [mailto:[hidden email]] On Behalf Of James
>>>> Bulpin Sent: 2006年3月22日 11:21 To: Shi, Alex
>>>> Cc: [hidden email]
>>>> Subject: [Xen-users] Re: question about xen regression test tools
>>>>
>>>> Alex,
>>>>
>>>> ttcpbw uses a variant of the ttcp+ tool (see
>>>> http://www.cl.cam.ac.uk/Research/SRG/netos/netx/code/ttcp.c)
>>>>
>>>> specjbb is SPEC JBB (www.spec.org)
>>>>
>>>> postmark 1.5c is what we use
>>>>
>>>> vm86 is an internal test
>>>>
>>>> We use memtest 0.0.4 but I've disabled it for now as I don't trust
>>>> it.
>>>>
>>>> James
>>>>
>>>> Shi, Alex wrote:
>>>>
>>>>
>>>>>
>>>>>
>>>>> I am very interesting to the xen regression test tools. like
>>>>> memtest, dbench, osdb, etc. etc.
>>>>> But I can not find some tools via google. like vm86, ttcpbw,
>>>>> specjbb, and postmark  (just find a postmark-1_5.c file from
>>>>> http://linuxcompressed.sourceforge.net/statistics/) and the
>>>>> memtest test suite is very old. it is just 0.0.4 version.
>>>>> So, Anyone like to tell me where I can find them? and share more
>>>>> detailed info of the test result on xenU or VMX domain of these
>>>>> test suites?
>>>>>
>>>>> Any hints will be very appreciated!
>>>>>
>>>>>
>>>>> Thanks and best regards
>>>>> Alex shi
>>>>
>>>>
>>>> _______________________________________________
>>>> Xen-users mailing list
>>>> [hidden email]
>>>> http://lists.xensource.com/xen-users
>>>
>>>
>>> _______________________________________________
>>> Xen-users mailing list
>>> [hidden email]
>>> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users