Only one CPU available to Xen? (nr_cpus : 1)

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Only one CPU available to Xen? (nr_cpus : 1)

John Naggets
Hello,

I am running Xen 4.9.0 on Ubuntu 17.10 on a new Lenovo ThinkSystem
SR630 server and have noticed that Xen reports only one CPU available.
Is this normal? or is something wrong in my setup?

Here is the output of "xl info":

release                : 4.13.0-32-generic
version                : #35-Ubuntu SMP Thu Jan 25 09:13:46 UTC 2018
machine                : x86_64
nr_cpus                : 1
max_cpu_id             : 0
nr_nodes               : 1
cores_per_socket       : 1
threads_per_core       : 1
cpu_mhz                : 2095
hw_caps                :
bfebfbff:77fef3f7:2c100800:00000121:0000000f:d19ffffb:00000008:00000100
virt_caps              : hvm
total_memory           : 32308
free_memory            : 15534
sharing_freed_memory   : 0
sharing_used_memory    : 0
outstanding_claims     : 0
free_cpus              : 0
xen_major              : 4
xen_minor              : 9
xen_extra              : .0
xen_version            : 4.9.0
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          :
xen_commandline        : placeholder dom0_mem=4G,max:4G
dom0_max_vcpus=2 dom0_vcpus_pin no-real-mode edd=off
cc_compiler            : gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0
cc_compile_by          : stefan.bader
cc_compile_domain      : canonical.com
cc_compile_date        : Fri Oct 13 15:58:41 UTC 2017
build_id               : 889e50dffcb9ab064c376b1278be0a259e95dd43
xend_config_format     : 4

See under nr_cpus only "1" is available. Also have a look at the
output of "xl vcpu-list" where I have VM1 with 4 vCPUs and VM2 with 1
vCPU:

Name                                ID  VCPU   CPU State   Time(s)
Affinity (Hard / Soft)
Domain-0                             0     0    0   r--  125665.8  all / all
Domain-0                             0     1    -   --p       0.0  all / all
vm2.somefancydomaintest.co          10     0    0   -b-   17377.2  all / all
vm1.somefancydomaintest.co          11     0    0   -b-     617.9  all / all
vm1.somefancydomaintest.co          11     1    0   -b-     630.7  all / all
vm1.somefancydomaintest.co          11     2    0   -b-    1065.0  all / all
vm1.somefancydomaintest.co          11     3    0   -b-     590.2  all / all

Finally here is the output of "lscpu":

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              1
On-line CPU(s) list: 0
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
Stepping:            4
CPU MHz:             2095.140
BogoMIPS:            4190.17
Hypervisor vendor:   Xen
Virtualization type: none
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            11264K
NUMA node0 CPU(s):   0
Flags:               fpu de tsc msr pae mce cx8 apic sep mca cmov pat
clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc
rep_good nopl nonstop_tsc cpuid pni pclmulqdq est ssse3 fma cx16
sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor
lahf_lm abm 3dnowprefetch intel_ppin fsgsbase bmi1 hle avx2 bmi2 erms
rtm avx512f avx512dq rdseed adx clflushopt clwb avx512cd avx512bw
avx512vl xsaveopt xsavec xgetbv1

Here I should be seeing 2 CPUs as I am using the "dom0_max_vcpus=2
kernel parameter but the output only shows 1.

Any ideas what could be wrong in my setup? or is this normal? I have
the feeling my whole dom0 and domUs are running on a single core...

Best regards,
John

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xenproject.org/mailman/listinfo/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Only one CPU available to Xen? (nr_cpus : 1)

George Dunlap
On Sat, Mar 3, 2018 at 11:19 AM, John Naggets <[hidden email]> wrote:
> Hello,
>
> I am running Xen 4.9.0 on Ubuntu 17.10 on a new Lenovo ThinkSystem
> SR630 server and have noticed that Xen reports only one CPU available.
> Is this normal? or is something wrong in my setup?

No, that's distinctly not normal. Assuming your ThinkSystem server has
more than one logical cpu of course. :-)

Would you mind attaching the output of `xl dmesg` as well?

Thanks,
 -George

>
> Here is the output of "xl info":
>
> release                : 4.13.0-32-generic
> version                : #35-Ubuntu SMP Thu Jan 25 09:13:46 UTC 2018
> machine                : x86_64
> nr_cpus                : 1
> max_cpu_id             : 0
> nr_nodes               : 1
> cores_per_socket       : 1
> threads_per_core       : 1
> cpu_mhz                : 2095
> hw_caps                :
> bfebfbff:77fef3f7:2c100800:00000121:0000000f:d19ffffb:00000008:00000100
> virt_caps              : hvm
> total_memory           : 32308
> free_memory            : 15534
> sharing_freed_memory   : 0
> sharing_used_memory    : 0
> outstanding_claims     : 0
> free_cpus              : 0
> xen_major              : 4
> xen_minor              : 9
> xen_extra              : .0
> xen_version            : 4.9.0
> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
> hvm-3.0-x86_32p hvm-3.0-x86_64
> xen_scheduler          : credit
> xen_pagesize           : 4096
> platform_params        : virt_start=0xffff800000000000
> xen_changeset          :
> xen_commandline        : placeholder dom0_mem=4G,max:4G
> dom0_max_vcpus=2 dom0_vcpus_pin no-real-mode edd=off
> cc_compiler            : gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0
> cc_compile_by          : stefan.bader
> cc_compile_domain      : canonical.com
> cc_compile_date        : Fri Oct 13 15:58:41 UTC 2017
> build_id               : 889e50dffcb9ab064c376b1278be0a259e95dd43
> xend_config_format     : 4
>
> See under nr_cpus only "1" is available. Also have a look at the
> output of "xl vcpu-list" where I have VM1 with 4 vCPUs and VM2 with 1
> vCPU:
>
> Name                                ID  VCPU   CPU State   Time(s)
> Affinity (Hard / Soft)
> Domain-0                             0     0    0   r--  125665.8  all / all
> Domain-0                             0     1    -   --p       0.0  all / all
> vm2.somefancydomaintest.co          10     0    0   -b-   17377.2  all / all
> vm1.somefancydomaintest.co          11     0    0   -b-     617.9  all / all
> vm1.somefancydomaintest.co          11     1    0   -b-     630.7  all / all
> vm1.somefancydomaintest.co          11     2    0   -b-    1065.0  all / all
> vm1.somefancydomaintest.co          11     3    0   -b-     590.2  all / all
>
> Finally here is the output of "lscpu":
>
> Architecture:        x86_64
> CPU op-mode(s):      32-bit, 64-bit
> Byte Order:          Little Endian
> CPU(s):              1
> On-line CPU(s) list: 0
> Thread(s) per core:  1
> Core(s) per socket:  1
> Socket(s):           1
> NUMA node(s):        1
> Vendor ID:           GenuineIntel
> CPU family:          6
> Model:               85
> Model name:          Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
> Stepping:            4
> CPU MHz:             2095.140
> BogoMIPS:            4190.17
> Hypervisor vendor:   Xen
> Virtualization type: none
> L1d cache:           32K
> L1i cache:           32K
> L2 cache:            1024K
> L3 cache:            11264K
> NUMA node0 CPU(s):   0
> Flags:               fpu de tsc msr pae mce cx8 apic sep mca cmov pat
> clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc
> rep_good nopl nonstop_tsc cpuid pni pclmulqdq est ssse3 fma cx16
> sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor
> lahf_lm abm 3dnowprefetch intel_ppin fsgsbase bmi1 hle avx2 bmi2 erms
> rtm avx512f avx512dq rdseed adx clflushopt clwb avx512cd avx512bw
> avx512vl xsaveopt xsavec xgetbv1
>
> Here I should be seeing 2 CPUs as I am using the "dom0_max_vcpus=2
> kernel parameter but the output only shows 1.
>
> Any ideas what could be wrong in my setup? or is this normal? I have
> the feeling my whole dom0 and domUs are running on a single core...
>
> Best regards,
> John
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xenproject.org/mailman/listinfo/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Only one CPU available to Xen? (nr_cpus : 1)

John Naggets
Hi George,

Sure, I will post you the output of "xl dmesg" tomorrow as I am not in
the office any more.

In the meantime I am thinking that it must be the combination UEFI ->
GRUB -> Xen which creates this issue so I added the Xen EFI directly
in the UEFI boot of that server by following the Xen wiki
documentation (https://wiki.xenproject.org/wiki/Xen_EFI#Xen_as_EFI_binary_.28loading.29).
But until now I did not manage to make it boot using UEFI -> Xen. I
get the following error message right when starting to load the Xen
4.9.0 EFI loader:

Read failed for initrd.img-4.13.0-36-generic: ErrCode: 0x8000000000000004

Regards,
John




On Mon, Mar 5, 2018 at 4:21 PM, George Dunlap <[hidden email]> wrote:

> On Sat, Mar 3, 2018 at 11:19 AM, John Naggets <[hidden email]> wrote:
>> Hello,
>>
>> I am running Xen 4.9.0 on Ubuntu 17.10 on a new Lenovo ThinkSystem
>> SR630 server and have noticed that Xen reports only one CPU available.
>> Is this normal? or is something wrong in my setup?
>
> No, that's distinctly not normal. Assuming your ThinkSystem server has
> more than one logical cpu of course. :-)
>
> Would you mind attaching the output of `xl dmesg` as well?
>
> Thanks,
>  -George
>
>>
>> Here is the output of "xl info":
>>
>> release                : 4.13.0-32-generic
>> version                : #35-Ubuntu SMP Thu Jan 25 09:13:46 UTC 2018
>> machine                : x86_64
>> nr_cpus                : 1
>> max_cpu_id             : 0
>> nr_nodes               : 1
>> cores_per_socket       : 1
>> threads_per_core       : 1
>> cpu_mhz                : 2095
>> hw_caps                :
>> bfebfbff:77fef3f7:2c100800:00000121:0000000f:d19ffffb:00000008:00000100
>> virt_caps              : hvm
>> total_memory           : 32308
>> free_memory            : 15534
>> sharing_freed_memory   : 0
>> sharing_used_memory    : 0
>> outstanding_claims     : 0
>> free_cpus              : 0
>> xen_major              : 4
>> xen_minor              : 9
>> xen_extra              : .0
>> xen_version            : 4.9.0
>> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
>> hvm-3.0-x86_32p hvm-3.0-x86_64
>> xen_scheduler          : credit
>> xen_pagesize           : 4096
>> platform_params        : virt_start=0xffff800000000000
>> xen_changeset          :
>> xen_commandline        : placeholder dom0_mem=4G,max:4G
>> dom0_max_vcpus=2 dom0_vcpus_pin no-real-mode edd=off
>> cc_compiler            : gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0
>> cc_compile_by          : stefan.bader
>> cc_compile_domain      : canonical.com
>> cc_compile_date        : Fri Oct 13 15:58:41 UTC 2017
>> build_id               : 889e50dffcb9ab064c376b1278be0a259e95dd43
>> xend_config_format     : 4
>>
>> See under nr_cpus only "1" is available. Also have a look at the
>> output of "xl vcpu-list" where I have VM1 with 4 vCPUs and VM2 with 1
>> vCPU:
>>
>> Name                                ID  VCPU   CPU State   Time(s)
>> Affinity (Hard / Soft)
>> Domain-0                             0     0    0   r--  125665.8  all / all
>> Domain-0                             0     1    -   --p       0.0  all / all
>> vm2.somefancydomaintest.co          10     0    0   -b-   17377.2  all / all
>> vm1.somefancydomaintest.co          11     0    0   -b-     617.9  all / all
>> vm1.somefancydomaintest.co          11     1    0   -b-     630.7  all / all
>> vm1.somefancydomaintest.co          11     2    0   -b-    1065.0  all / all
>> vm1.somefancydomaintest.co          11     3    0   -b-     590.2  all / all
>>
>> Finally here is the output of "lscpu":
>>
>> Architecture:        x86_64
>> CPU op-mode(s):      32-bit, 64-bit
>> Byte Order:          Little Endian
>> CPU(s):              1
>> On-line CPU(s) list: 0
>> Thread(s) per core:  1
>> Core(s) per socket:  1
>> Socket(s):           1
>> NUMA node(s):        1
>> Vendor ID:           GenuineIntel
>> CPU family:          6
>> Model:               85
>> Model name:          Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
>> Stepping:            4
>> CPU MHz:             2095.140
>> BogoMIPS:            4190.17
>> Hypervisor vendor:   Xen
>> Virtualization type: none
>> L1d cache:           32K
>> L1i cache:           32K
>> L2 cache:            1024K
>> L3 cache:            11264K
>> NUMA node0 CPU(s):   0
>> Flags:               fpu de tsc msr pae mce cx8 apic sep mca cmov pat
>> clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc
>> rep_good nopl nonstop_tsc cpuid pni pclmulqdq est ssse3 fma cx16
>> sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor
>> lahf_lm abm 3dnowprefetch intel_ppin fsgsbase bmi1 hle avx2 bmi2 erms
>> rtm avx512f avx512dq rdseed adx clflushopt clwb avx512cd avx512bw
>> avx512vl xsaveopt xsavec xgetbv1
>>
>> Here I should be seeing 2 CPUs as I am using the "dom0_max_vcpus=2
>> kernel parameter but the output only shows 1.
>>
>> Any ideas what could be wrong in my setup? or is this normal? I have
>> the feeling my whole dom0 and domUs are running on a single core...
>>
>> Best regards,
>> John
>>
>> _______________________________________________
>> Xen-users mailing list
>> [hidden email]
>> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xenproject.org/mailman/listinfo/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Only one CPU available to Xen? (nr_cpus : 1)

John Naggets
In reply to this post by George Dunlap
Hi George,

You will find the output of "xl dmesg" below. I also managed to
reproduce this problem on another test server. That test server is an
IBM System x3250 M5 server which uses UEFI. So the hardware is not at
fault.

Regards,
John

(XEN) Xen version 4.9.0 (Ubuntu 4.9.0-0ubuntu3)
([hidden email]) (gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0)
debug=n  Fri Oct 13 15:58:41 UTC 2017
(XEN) Bootloader: GRUB 2.02~beta3-4ubuntu7
(XEN) Command line: placeholder dom0_mem=4G,max:4G dom0_max_vcpus=2
dom0_vcpus_pin no-real-mode edd=off
(XEN) Xen image load base address: 0
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 0 EDD information structures
(XEN) Multiboot-e820 RAM map:
(XEN)  0000000000000000 - 00000000000a0000 (usable)
(XEN)  00000000000a0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000009e3f8000 (usable)
(XEN)  000000009e3f8000 - 000000009e568000 (ACPI data)
(XEN)  000000009e568000 - 000000009efe1000 (ACPI NVS)
(XEN)  000000009efe1000 - 00000000a0117000 (usable)
(XEN)  00000000a0117000 - 00000000ab6b9000 (reserved)
(XEN)  00000000ab6b9000 - 00000000ab865000 type 20
(XEN)  00000000ab865000 - 00000000af3fc000 (usable)
(XEN)  00000000af3fc000 - 00000000af42e000 (reserved)
(XEN)  00000000af42e000 - 00000000af800000 (usable)
(XEN)  00000000af800000 - 00000000d0000000 (reserved)
(XEN)  00000000fd000000 - 00000000fe800000 (reserved)
(XEN)  00000000fed20000 - 00000000fed45000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000840000000 (usable)
(XEN) New Xen image base address: 0xaec00000
(XEN) ACPI Error (tbxfroot-0217): A valid RSDP was not found [20070126]
(XEN) System RAM: 32308MB (33083612kB)
(XEN) Domain heap initialised
(XEN) Found and enabled local APIC!
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) xstate: size: 0xa88 and states: 0x2ff
(XEN) CMCI: threshold 0x2 too large for CPU0 bank 6, using 0x1
(XEN) CMCI: threshold 0x2 too large for CPU0 bank 9, using 0x1
(XEN) CMCI: threshold 0x2 too large for CPU0 bank 10, using 0x1
(XEN) CMCI: threshold 0x2 too large for CPU0 bank 11, using 0x1
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Platform timer is 1.193MHz PIT
(XEN) Detected 2095.087 MHz processor.
(XEN) Initing memory sharing.
(XEN) I/O virtualisation disabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN) Allocated console ring of 16 KiB.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN)  - APIC Register Virtualization
(XEN)  - Virtual Interrupt Delivery
(XEN)  - Posted Interrupt Processing
(XEN)  - VMCS shadowing
(XEN)  - VM Functions
(XEN)  - Virtualisation Exceptions
(XEN)  - Page Modification Logging
(XEN)  - TSC Scaling
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 1 CPUs
(XEN) Dom0 has maximum 208 PIRQs
(XEN) ACPI is disabled, notifying Domain 0 (acpi=off)
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x2955000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   0000000820000000->0000000824000000 (1020569
pages to be allocated)
(XEN)  Init. ramdisk: 000000083d299000->000000083fffff40
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff81000000->ffffffff82955000
(XEN)  Init. ramdisk: 0000000000000000->0000000000000000
(XEN)  Phys-Mach map: 0000008000000000->0000008000800000
(XEN)  Start info:    ffffffff82955000->ffffffff829554b4
(XEN)  Page tables:   ffffffff82956000->ffffffff8296f000
(XEN)  Boot stack:    ffffffff8296f000->ffffffff82970000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
(XEN)  ENTRY ADDRESS: ffffffff824a4180
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Scrubbing Free RAM on 1 nodes using 1 CPUs
(XEN) ........................................................................................................................................................................................................................................................................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch
input to Xen)
(XEN) Freed 460kB init memory
(XEN) Platform timer appears to have unexpectedly wrapped 1 times.

On Mon, Mar 5, 2018 at 4:21 PM, George Dunlap <[hidden email]> wrote:

> On Sat, Mar 3, 2018 at 11:19 AM, John Naggets <[hidden email]> wrote:
>> Hello,
>>
>> I am running Xen 4.9.0 on Ubuntu 17.10 on a new Lenovo ThinkSystem
>> SR630 server and have noticed that Xen reports only one CPU available.
>> Is this normal? or is something wrong in my setup?
>
> No, that's distinctly not normal. Assuming your ThinkSystem server has
> more than one logical cpu of course. :-)
>
> Would you mind attaching the output of `xl dmesg` as well?
>
> Thanks,
>  -George
>
>>
>> Here is the output of "xl info":
>>
>> release                : 4.13.0-32-generic
>> version                : #35-Ubuntu SMP Thu Jan 25 09:13:46 UTC 2018
>> machine                : x86_64
>> nr_cpus                : 1
>> max_cpu_id             : 0
>> nr_nodes               : 1
>> cores_per_socket       : 1
>> threads_per_core       : 1
>> cpu_mhz                : 2095
>> hw_caps                :
>> bfebfbff:77fef3f7:2c100800:00000121:0000000f:d19ffffb:00000008:00000100
>> virt_caps              : hvm
>> total_memory           : 32308
>> free_memory            : 15534
>> sharing_freed_memory   : 0
>> sharing_used_memory    : 0
>> outstanding_claims     : 0
>> free_cpus              : 0
>> xen_major              : 4
>> xen_minor              : 9
>> xen_extra              : .0
>> xen_version            : 4.9.0
>> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
>> hvm-3.0-x86_32p hvm-3.0-x86_64
>> xen_scheduler          : credit
>> xen_pagesize           : 4096
>> platform_params        : virt_start=0xffff800000000000
>> xen_changeset          :
>> xen_commandline        : placeholder dom0_mem=4G,max:4G
>> dom0_max_vcpus=2 dom0_vcpus_pin no-real-mode edd=off
>> cc_compiler            : gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0
>> cc_compile_by          : stefan.bader
>> cc_compile_domain      : canonical.com
>> cc_compile_date        : Fri Oct 13 15:58:41 UTC 2017
>> build_id               : 889e50dffcb9ab064c376b1278be0a259e95dd43
>> xend_config_format     : 4
>>
>> See under nr_cpus only "1" is available. Also have a look at the
>> output of "xl vcpu-list" where I have VM1 with 4 vCPUs and VM2 with 1
>> vCPU:
>>
>> Name                                ID  VCPU   CPU State   Time(s)
>> Affinity (Hard / Soft)
>> Domain-0                             0     0    0   r--  125665.8  all / all
>> Domain-0                             0     1    -   --p       0.0  all / all
>> vm2.somefancydomaintest.co          10     0    0   -b-   17377.2  all / all
>> vm1.somefancydomaintest.co          11     0    0   -b-     617.9  all / all
>> vm1.somefancydomaintest.co          11     1    0   -b-     630.7  all / all
>> vm1.somefancydomaintest.co          11     2    0   -b-    1065.0  all / all
>> vm1.somefancydomaintest.co          11     3    0   -b-     590.2  all / all
>>
>> Finally here is the output of "lscpu":
>>
>> Architecture:        x86_64
>> CPU op-mode(s):      32-bit, 64-bit
>> Byte Order:          Little Endian
>> CPU(s):              1
>> On-line CPU(s) list: 0
>> Thread(s) per core:  1
>> Core(s) per socket:  1
>> Socket(s):           1
>> NUMA node(s):        1
>> Vendor ID:           GenuineIntel
>> CPU family:          6
>> Model:               85
>> Model name:          Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
>> Stepping:            4
>> CPU MHz:             2095.140
>> BogoMIPS:            4190.17
>> Hypervisor vendor:   Xen
>> Virtualization type: none
>> L1d cache:           32K
>> L1i cache:           32K
>> L2 cache:            1024K
>> L3 cache:            11264K
>> NUMA node0 CPU(s):   0
>> Flags:               fpu de tsc msr pae mce cx8 apic sep mca cmov pat
>> clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc
>> rep_good nopl nonstop_tsc cpuid pni pclmulqdq est ssse3 fma cx16
>> sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor
>> lahf_lm abm 3dnowprefetch intel_ppin fsgsbase bmi1 hle avx2 bmi2 erms
>> rtm avx512f avx512dq rdseed adx clflushopt clwb avx512cd avx512bw
>> avx512vl xsaveopt xsavec xgetbv1
>>
>> Here I should be seeing 2 CPUs as I am using the "dom0_max_vcpus=2
>> kernel parameter but the output only shows 1.
>>
>> Any ideas what could be wrong in my setup? or is this normal? I have
>> the feeling my whole dom0 and domUs are running on a single core...
>>
>> Best regards,
>> John
>>
>> _______________________________________________
>> Xen-users mailing list
>> [hidden email]
>> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xenproject.org/mailman/listinfo/xen-users
Reply | Threaded
Open this post in threaded view
|

Re: Only one CPU available to Xen? (nr_cpus : 1)

George Dunlap
[Moving over to xen-devel, cc'ing a few people]

On Tue, Mar 6, 2018 at 8:16 AM, John Naggets <[hidden email]> wrote:

> Hi George,
>
> You will find the output of "xl dmesg" below. I also managed to
> reproduce this problem on another test server. That test server is an
> IBM System x3250 M5 server which uses UEFI. So the hardware is not at
> fault.
>
> Regards,
> John
>
> (XEN) Xen version 4.9.0 (Ubuntu 4.9.0-0ubuntu3)
> ([hidden email]) (gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0)
> debug=n  Fri Oct 13 15:58:41 UTC 2017
> (XEN) Bootloader: GRUB 2.02~beta3-4ubuntu7
> (XEN) Command line: placeholder dom0_mem=4G,max:4G dom0_max_vcpus=2
> dom0_vcpus_pin no-real-mode edd=off
> (XEN) Xen image load base address: 0
> (XEN) Video information:
> (XEN)  VGA is text mode 80x25, font 8x16
> (XEN) Disc information:
> (XEN)  Found 0 MBR signatures
> (XEN)  Found 0 EDD information structures
> (XEN) Multiboot-e820 RAM map:
> (XEN)  0000000000000000 - 00000000000a0000 (usable)
> (XEN)  00000000000a0000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 000000009e3f8000 (usable)
> (XEN)  000000009e3f8000 - 000000009e568000 (ACPI data)
> (XEN)  000000009e568000 - 000000009efe1000 (ACPI NVS)
> (XEN)  000000009efe1000 - 00000000a0117000 (usable)
> (XEN)  00000000a0117000 - 00000000ab6b9000 (reserved)
> (XEN)  00000000ab6b9000 - 00000000ab865000 type 20
> (XEN)  00000000ab865000 - 00000000af3fc000 (usable)
> (XEN)  00000000af3fc000 - 00000000af42e000 (reserved)
> (XEN)  00000000af42e000 - 00000000af800000 (usable)
> (XEN)  00000000af800000 - 00000000d0000000 (reserved)
> (XEN)  00000000fd000000 - 00000000fe800000 (reserved)
> (XEN)  00000000fed20000 - 00000000fed45000 (reserved)
> (XEN)  00000000ff000000 - 0000000100000000 (reserved)
> (XEN)  0000000100000000 - 0000000840000000 (usable)
> (XEN) New Xen image base address: 0xaec00000
> (XEN) ACPI Error (tbxfroot-0217): A valid RSDP was not found [20070126]

Here's the reason Xen only sees one pcpu: It can't find the ACPI table
which tells it everything else about the system.

Jan / Boris, any ideas here?

Sorry, John seems to have top-posted the `xl dmesg` information; his
original description of his system setup and problem is further below.

 -George

> (XEN) System RAM: 32308MB (33083612kB)
> (XEN) Domain heap initialised
> (XEN) Found and enabled local APIC!
> (XEN) Not enabling x2APIC: depends on iommu_supports_eim.
> (XEN) xstate: size: 0xa88 and states: 0x2ff
> (XEN) CMCI: threshold 0x2 too large for CPU0 bank 6, using 0x1
> (XEN) CMCI: threshold 0x2 too large for CPU0 bank 9, using 0x1
> (XEN) CMCI: threshold 0x2 too large for CPU0 bank 10, using 0x1
> (XEN) CMCI: threshold 0x2 too large for CPU0 bank 11, using 0x1
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Platform timer is 1.193MHz PIT
> (XEN) Detected 2095.087 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) I/O virtualisation disabled
> (XEN) Enabled directed EOI with ioapic_ack_old on!
> (XEN) Allocated console ring of 16 KiB.
> (XEN) VMX: Supported advanced features:
> (XEN)  - APIC MMIO access virtualisation
> (XEN)  - APIC TPR shadow
> (XEN)  - Extended Page Tables (EPT)
> (XEN)  - Virtual-Processor Identifiers (VPID)
> (XEN)  - Virtual NMI
> (XEN)  - MSR direct-access bitmap
> (XEN)  - Unrestricted Guest
> (XEN)  - APIC Register Virtualization
> (XEN)  - Virtual Interrupt Delivery
> (XEN)  - Posted Interrupt Processing
> (XEN)  - VMCS shadowing
> (XEN)  - VM Functions
> (XEN)  - Virtualisation Exceptions
> (XEN)  - Page Modification Logging
> (XEN)  - TSC Scaling
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) detected
> (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
> (XEN) Brought up 1 CPUs
> (XEN) Dom0 has maximum 208 PIRQs
> (XEN) ACPI is disabled, notifying Domain 0 (acpi=off)
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN)  Xen  kernel: 64-bit, lsb, compat32
> (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x2955000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN)  Dom0 alloc.:   0000000820000000->0000000824000000 (1020569
> pages to be allocated)
> (XEN)  Init. ramdisk: 000000083d299000->000000083fffff40
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN)  Loaded kernel: ffffffff81000000->ffffffff82955000
> (XEN)  Init. ramdisk: 0000000000000000->0000000000000000
> (XEN)  Phys-Mach map: 0000008000000000->0000008000800000
> (XEN)  Start info:    ffffffff82955000->ffffffff829554b4
> (XEN)  Page tables:   ffffffff82956000->ffffffff8296f000
> (XEN)  Boot stack:    ffffffff8296f000->ffffffff82970000
> (XEN)  TOTAL:         ffffffff80000000->ffffffff82c00000
> (XEN)  ENTRY ADDRESS: ffffffff824a4180
> (XEN) Dom0 has maximum 2 VCPUs
> (XEN) Scrubbing Free RAM on 1 nodes using 1 CPUs
> (XEN) ........................................................................................................................................................................................................................................................................done.
> (XEN) Initial low memory virq threshold set at 0x4000 pages.
> (XEN) Std. Loglevel: Errors and warnings
> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch
> input to Xen)
> (XEN) Freed 460kB init memory
> (XEN) Platform timer appears to have unexpectedly wrapped 1 times.
>
> On Mon, Mar 5, 2018 at 4:21 PM, George Dunlap <[hidden email]> wrote:
>> On Sat, Mar 3, 2018 at 11:19 AM, John Naggets <[hidden email]> wrote:
>>> Hello,
>>>
>>> I am running Xen 4.9.0 on Ubuntu 17.10 on a new Lenovo ThinkSystem
>>> SR630 server and have noticed that Xen reports only one CPU available.
>>> Is this normal? or is something wrong in my setup?
>>
>> No, that's distinctly not normal. Assuming your ThinkSystem server has
>> more than one logical cpu of course. :-)
>>
>> Would you mind attaching the output of `xl dmesg` as well?
>>
>> Thanks,
>>  -George
>>
>>>
>>> Here is the output of "xl info":
>>>
>>> release                : 4.13.0-32-generic
>>> version                : #35-Ubuntu SMP Thu Jan 25 09:13:46 UTC 2018
>>> machine                : x86_64
>>> nr_cpus                : 1
>>> max_cpu_id             : 0
>>> nr_nodes               : 1
>>> cores_per_socket       : 1
>>> threads_per_core       : 1
>>> cpu_mhz                : 2095
>>> hw_caps                :
>>> bfebfbff:77fef3f7:2c100800:00000121:0000000f:d19ffffb:00000008:00000100
>>> virt_caps              : hvm
>>> total_memory           : 32308
>>> free_memory            : 15534
>>> sharing_freed_memory   : 0
>>> sharing_used_memory    : 0
>>> outstanding_claims     : 0
>>> free_cpus              : 0
>>> xen_major              : 4
>>> xen_minor              : 9
>>> xen_extra              : .0
>>> xen_version            : 4.9.0
>>> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
>>> hvm-3.0-x86_32p hvm-3.0-x86_64
>>> xen_scheduler          : credit
>>> xen_pagesize           : 4096
>>> platform_params        : virt_start=0xffff800000000000
>>> xen_changeset          :
>>> xen_commandline        : placeholder dom0_mem=4G,max:4G
>>> dom0_max_vcpus=2 dom0_vcpus_pin no-real-mode edd=off
>>> cc_compiler            : gcc (Ubuntu 7.2.0-8ubuntu2) 7.2.0
>>> cc_compile_by          : stefan.bader
>>> cc_compile_domain      : canonical.com
>>> cc_compile_date        : Fri Oct 13 15:58:41 UTC 2017
>>> build_id               : 889e50dffcb9ab064c376b1278be0a259e95dd43
>>> xend_config_format     : 4
>>>
>>> See under nr_cpus only "1" is available. Also have a look at the
>>> output of "xl vcpu-list" where I have VM1 with 4 vCPUs and VM2 with 1
>>> vCPU:
>>>
>>> Name                                ID  VCPU   CPU State   Time(s)
>>> Affinity (Hard / Soft)
>>> Domain-0                             0     0    0   r--  125665.8  all / all
>>> Domain-0                             0     1    -   --p       0.0  all / all
>>> vm2.somefancydomaintest.co          10     0    0   -b-   17377.2  all / all
>>> vm1.somefancydomaintest.co          11     0    0   -b-     617.9  all / all
>>> vm1.somefancydomaintest.co          11     1    0   -b-     630.7  all / all
>>> vm1.somefancydomaintest.co          11     2    0   -b-    1065.0  all / all
>>> vm1.somefancydomaintest.co          11     3    0   -b-     590.2  all / all
>>>
>>> Finally here is the output of "lscpu":
>>>
>>> Architecture:        x86_64
>>> CPU op-mode(s):      32-bit, 64-bit
>>> Byte Order:          Little Endian
>>> CPU(s):              1
>>> On-line CPU(s) list: 0
>>> Thread(s) per core:  1
>>> Core(s) per socket:  1
>>> Socket(s):           1
>>> NUMA node(s):        1
>>> Vendor ID:           GenuineIntel
>>> CPU family:          6
>>> Model:               85
>>> Model name:          Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
>>> Stepping:            4
>>> CPU MHz:             2095.140
>>> BogoMIPS:            4190.17
>>> Hypervisor vendor:   Xen
>>> Virtualization type: none
>>> L1d cache:           32K
>>> L1i cache:           32K
>>> L2 cache:            1024K
>>> L3 cache:            11264K
>>> NUMA node0 CPU(s):   0
>>> Flags:               fpu de tsc msr pae mce cx8 apic sep mca cmov pat
>>> clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc
>>> rep_good nopl nonstop_tsc cpuid pni pclmulqdq est ssse3 fma cx16
>>> sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor
>>> lahf_lm abm 3dnowprefetch intel_ppin fsgsbase bmi1 hle avx2 bmi2 erms
>>> rtm avx512f avx512dq rdseed adx clflushopt clwb avx512cd avx512bw
>>> avx512vl xsaveopt xsavec xgetbv1
>>>
>>> Here I should be seeing 2 CPUs as I am using the "dom0_max_vcpus=2
>>> kernel parameter but the output only shows 1.
>>>
>>> Any ideas what could be wrong in my setup? or is this normal? I have
>>> the feeling my whole dom0 and domUs are running on a single core...
>>>
>>> Best regards,
>>> John
>>>
>>> _______________________________________________
>>> Xen-users mailing list
>>> [hidden email]
>>> https://lists.xenproject.org/mailman/listinfo/xen-users
>
> _______________________________________________
> Xen-users mailing list
> [hidden email]
> https://lists.xenproject.org/mailman/listinfo/xen-users

_______________________________________________
Xen-users mailing list
[hidden email]
https://lists.xenproject.org/mailman/listinfo/xen-users