Xen 3.3.1 Need help

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Xen 3.3.1 Need help

alex-493
Hi. I need help.
I have
Xen 3.3.1(from sources) debian lenny 2.6.26-1 kernel. Now LA on server is about 20.
My server have 20 domUs - FreeBSD by HVM mode
2 days ago my dom0 start using 400% CPU  by xentop
iotop - all ok
server have 48Gb memory
Server was in working 200 days, this lags was started 1 day ago - and me do nothing on server.


[ 5331.891488] BUG: soft lockup - CPU#12 stuck for 101s! [getty:4279]                                                       
[ 5331.891488] Modules linked in: xt_tcpudp xt_physdev iptable_filter ip_tables x_tables tun bridge ipv6 nfsd auth_rpcgss exportfs nfs lockd nfs_acl sunrpc loop psmouse serio_raw joydev pcspkr igb i2c_i801 i2c_core button dca evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod sg sr_mod cdrom ata_generic sd_mod usbhid hid ff_memless ata_piix libata dock 3w_9xxx scsi_mod ide_pci_generic ide_core ehci_hcd uhci_hcd thermal processor fan thermal_sys [last unloaded: scsi_wait_scan]           
[ 5331.891488] CPU 12:                                                                                                      
[ 5331.891488] Modules linked in: xt_tcpudp xt_physdev iptable_filter ip_tables x_tables tun bridge ipv6 nfsd auth_rpcgss exportfs nfs lockd nfs_acl sunrpc loop psmouse serio_raw joydev pcspkr igb i2c_i801 i2c_core button dca evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod sg sr_mod cdrom ata_generic sd_mod usbhid hid ff_memless ata_piix libata dock 3w_9xxx scsi_mod ide_pci_generic ide_core ehci_hcd uhci_hcd thermal processor fan thermal_sys [last unloaded: scsi_wait_scan]
[ 5331.891488] Pid: 4279, comm: getty Not tainted 2.6.26-1-xen-amd64 #1
[ 5331.891488] RIP: e030:[<ffffffff8020822a>]  [<ffffffff8020822a>]
[ 5331.891488] RSP: e02b:ffff880bccd7fdf8  EFLAGS: 00000246
[ 5331.891488] RAX: 0000000000030003 RBX: 00000000000131f9 RCX: ffffffff8020822a
[ 5331.891488] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: 0000000000000000
[ 5331.891488] RBP: 00000000000131bf R08: 000000000000003a R09: ffff880001c4b100
[ 5331.891488] R10: 00007fac7dbeb9a0 R11: 0000000000000246 R12: 00000000000131f9
[ 5331.891488] R13: 0000000000000000 R14: 00000000ffffffd5 R15: ffff880bccf2b000
[ 5331.891488] FS:  00007fac7de016e0(0000) GS:ffffffff80539600(0000) knlGS:0000000000000000
[ 5331.891488] CS:  e033 DS: 0000 ES: 0000
[ 5331.891488] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 5331.891488] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 5331.891488]
[ 5331.891488] Call Trace:
[ 5331.891488]  [<ffffffff8022cc2b>] ? __call_console_drivers+0x5b/0x69
[ 5331.891488]  [<ffffffff8037c972>] ? force_evtchn_callback+0xa/0xb
[ 5331.891488]  [<ffffffff8022d104>] ? release_console_sem+0x1bd/0x202
[ 5331.891488]  [<ffffffff8035ea15>] ? write_chan+0x267/0x307
[ 5331.891488]  [<ffffffff80224d34>] ? default_wake_function+0x0/0xe
[ 5331.891488]  [<ffffffff8035c2cc>] ? tty_write+0x192/0x222
[ 5331.891488]  [<ffffffff8035e7ae>] ? write_chan+0x0/0x307
[ 5331.891488]  [<ffffffff8028a8d9>] ? vfs_write+0xad/0x156
[ 5331.891488]  [<ffffffff8028ae7b>] ? sys_write+0x45/0x6e
[ 5331.891488]  [<ffffffff8020b528>] ? system_call+0x68/0x6d
[ 5331.891488]  [<ffffffff8020b4c0>] ? system_call+0x0/0x6d
[ 5331.891488]
[ 5344.249476] clocksource/0: Time went backwards: ret=417a11d6ae4 delta=-24628914 shadow=417836e3b33 offset=1f2703df
[ 5376.819272] clocksource/0: Time went backwards: ret=41c4bc6219f delta=-19754683 shadow=41c2b87a67b offset=216bfc5e
[ 5412.111985] clocksource/0: Time went backwards: ret=42287acc99c delta=-75600329 shadow=42274ddcacf offset=1750e9ef



--
Best Regards,
[hidden email]



_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Xen 3.3.1 Need help

Pasi Kärkkäinen
On Thu, Jan 28, 2010 at 04:37:00PM +0300, alex wrote:
>    Hi. I need help.
>    I have
>    Xen 3.3.1(from sources) debian lenny 2.6.26-1 kernel. Now LA on server is
>    about 20.
>

You might want to update to later Xen version,
and especially to some other dom0 kernel version,
Debian lenny already has 2.6.26-2-xen available,
but that is known to be pretty buggy aswell.

So it would be better to run linux-2.6.18-xen in dom0,
or some of the other options:

http://wiki.xensource.com/xenwiki/XenDom0Kernels

For example the opensuse xen patches.

-- Pasi


>    My server have 20 domUs - FreeBSD by HVM mode
>    2 days ago my dom0 start using 400% CPU  by xentop
>    iotop - all ok
>    server have 48Gb memory
>    Server was in working 200 days, this lags was started 1 day ago - and me
>    do nothing on server.
>
>    [ 5331.891488] BUG: soft lockup - CPU#12 stuck for 101s!
>    [getty:4279]
>    [ 5331.891488] Modules linked in: xt_tcpudp xt_physdev iptable_filter
>    ip_tables x_tables tun bridge ipv6 nfsd auth_rpcgss exportfs nfs lockd
>    nfs_acl sunrpc loop psmouse serio_raw joydev pcspkr igb i2c_i801 i2c_core
>    button dca evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod sg
>    sr_mod cdrom ata_generic sd_mod usbhid hid ff_memless ata_piix libata dock
>    3w_9xxx scsi_mod ide_pci_generic ide_core ehci_hcd uhci_hcd thermal
>    processor fan thermal_sys [last unloaded: scsi_wait_scan]
>    [ 5331.891488] CPU
>    12:
>    [ 5331.891488] Modules linked in: xt_tcpudp xt_physdev iptable_filter
>    ip_tables x_tables tun bridge ipv6 nfsd auth_rpcgss exportfs nfs lockd
>    nfs_acl sunrpc loop psmouse serio_raw joydev pcspkr igb i2c_i801 i2c_core
>    button dca evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod sg
>    sr_mod cdrom ata_generic sd_mod usbhid hid ff_memless ata_piix libata dock
>    3w_9xxx scsi_mod ide_pci_generic ide_core ehci_hcd uhci_hcd thermal
>    processor fan thermal_sys [last unloaded: scsi_wait_scan]
>    [ 5331.891488] Pid: 4279, comm: getty Not tainted 2.6.26-1-xen-amd64 #1
>    [ 5331.891488] RIP: e030:[<ffffffff8020822a>]  [<ffffffff8020822a>]
>    [ 5331.891488] RSP: e02b:ffff880bccd7fdf8  EFLAGS: 00000246
>    [ 5331.891488] RAX: 0000000000030003 RBX: 00000000000131f9 RCX:
>    ffffffff8020822a
>    [ 5331.891488] RDX: 00000000ffffffff RSI: 0000000000000000 RDI:
>    0000000000000000
>    [ 5331.891488] RBP: 00000000000131bf R08: 000000000000003a R09:
>    ffff880001c4b100
>    [ 5331.891488] R10: 00007fac7dbeb9a0 R11: 0000000000000246 R12:
>    00000000000131f9
>    [ 5331.891488] R13: 0000000000000000 R14: 00000000ffffffd5 R15:
>    ffff880bccf2b000
>    [ 5331.891488] FS:  00007fac7de016e0(0000) GS:ffffffff80539600(0000)
>    knlGS:0000000000000000
>    [ 5331.891488] CS:  e033 DS: 0000 ES: 0000
>    [ 5331.891488] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>    0000000000000000
>    [ 5331.891488] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>    0000000000000400
>    [ 5331.891488]
>    [ 5331.891488] Call Trace:
>    [ 5331.891488]  [<ffffffff8022cc2b>] ? __call_console_drivers+0x5b/0x69
>    [ 5331.891488]  [<ffffffff8037c972>] ? force_evtchn_callback+0xa/0xb
>    [ 5331.891488]  [<ffffffff8022d104>] ? release_console_sem+0x1bd/0x202
>    [ 5331.891488]  [<ffffffff8035ea15>] ? write_chan+0x267/0x307
>    [ 5331.891488]  [<ffffffff80224d34>] ? default_wake_function+0x0/0xe
>    [ 5331.891488]  [<ffffffff8035c2cc>] ? tty_write+0x192/0x222
>    [ 5331.891488]  [<ffffffff8035e7ae>] ? write_chan+0x0/0x307
>    [ 5331.891488]  [<ffffffff8028a8d9>] ? vfs_write+0xad/0x156
>    [ 5331.891488]  [<ffffffff8028ae7b>] ? sys_write+0x45/0x6e
>    [ 5331.891488]  [<ffffffff8020b528>] ? system_call+0x68/0x6d
>    [ 5331.891488]  [<ffffffff8020b4c0>] ? system_call+0x0/0x6d
>    [ 5331.891488]
>    [ 5344.249476] clocksource/0: Time went backwards: ret=417a11d6ae4
>    delta=-24628914 shadow=417836e3b33 offset=1f2703df
>    [ 5376.819272] clocksource/0: Time went backwards: ret=41c4bc6219f
>    delta=-19754683 shadow=41c2b87a67b offset=216bfc5e
>    [ 5412.111985] clocksource/0: Time went backwards: ret=42287acc99c
>    delta=-75600329 shadow=42274ddcacf offset=1750e9ef
>
>    --
>    Best Regards,
>    [1][hidden email]
>
> References
>
>    Visible links
>    1. mailto:[hidden email]

> _______________________________________________
> Xen-users mailing list
> [hidden email]
> http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
http://lists.xensource.com/xen-users