pass-through pci device disappear while rebooted

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

pass-through pci device disappear while rebooted


i got a problem with vm with passthrough pci devices, if i just restart
the vm the pci device disappear and i need to shutdown the guest and
start it again. After a complete shutdown and startup the pci device is
there again.

This is in xl logfile of the vm:
Domain 6 has shut down, reason code 1 0x1
Action for shutdown reason code 1 is restart
libxl: warning: libxl_domain.c:1739:libxl_retrieve_domain_configuration:
Domain 6:Device present in JSON but not in xenstore, ignored
Domain 6 needs to be cleaned up: destroying the domain
libxl: error: libxl_pci.c:1452:do_pci_remove: Domain
6:xc_physdev_unmap_pirq irq=141: Invalid argument
libxl: error: libxl_pci.c:1456:do_pci_remove: Domain
6:xc_domain_irq_permission irq=141: Operation not permitted
libxl: error: libxl_device.c:1419:libxl__wait_for_backend: Backend
/local/domain/0/backend/pci/6/0 not ready
Done. Rebooting now

xl info
host                   : stargate
release                : 4.17.11-gentoo
version                : #1 SMP Thu Aug 2 20:06:28 CEST 2018
machine                : x86_64
nr_cpus                : 12
max_cpu_id             : 11
nr_nodes               : 1
cores_per_socket       : 6
threads_per_core       : 2
cpu_mhz                : 2593.863
hw_caps                :
virt_caps              : hvm hvm_directio
total_memory           : 65471
free_memory            : 51307
sharing_freed_memory   : 0
sharing_used_memory    : 0
outstanding_claims     : 0
free_cpus              : 0
xen_major              : 4
xen_minor              : 11
xen_extra              : .0
xen_version            : 4.11.0
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          :
xen_commandline        : placeholder cpuidle dom0_mem=8G,max:8G
dom0_max_vcpus=2 dom0_vcpus_pin loglvl=warning guest_loglvl=warning
com1=115200,8n1,pci console=com1,vga iommu=1 intel_iommu=on
cc_compiler            : x86_64-pc-linux-gnu-gcc (Gentoo 8.1.0-r3 p1.3)
cc_compile_by          :
cc_compile_domain      :
cc_compile_date        : Thu Jul 19 17:49:29 CEST 2018
build_id               : b628dffad4433cbbe265a842ff197dc51fcd0e1e
xend_config_format     : 4

xl dmesg
Xen 4.11.0
(XEN) Xen version 4.11.0 ( (x86_64-pc-linux-gnu-gcc (Gentoo
8.1.0-r3 p1.3) 8.1.0) debug=n  Thu Jul 19 17:49:29 CEST 2018
(XEN) Latest ChangeSet:
(XEN) Bootloader: GRUB 2.02
(XEN) Command line: placeholder cpuidle dom0_mem=8G,max:8G
dom0_max_vcpus=2 dom0_vcpus_pin loglvl=warning guest_loglvl=warning
com1=115200,8n1,pci console=com1,vga iommu=1 intel_iommu=on
(XEN) Xen image load base address: 0
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 4 MBR signatures
(XEN)  Found 4 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009e800 (usable)
(XEN)  000000000009e800 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bbbec000 (usable)
(XEN)  00000000bbbec000 - 00000000bc02a000 (reserved)
(XEN)  00000000bc02a000 - 00000000bc138000 (ACPI data)
(XEN)  00000000bc138000 - 00000000bc775000 (ACPI NVS)
(XEN)  00000000bc775000 - 00000000bd6f5000 (reserved)
(XEN)  00000000bd6f5000 - 00000000bd6f6000 (usable)
(XEN)  00000000bd6f6000 - 00000000bd77c000 (ACPI NVS)
(XEN)  00000000bd77c000 - 00000000bdbc4000 (usable)
(XEN)  00000000bdbc4000 - 00000000bdff4000 (reserved)
(XEN)  00000000bdff4000 - 00000000be000000 (usable)
(XEN)  00000000e0000000 - 00000000f0000000 (reserved)
(XEN)  00000000fed1c000 - 00000000fed20000 (reserved)
(XEN)  00000000ff000000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000001040000000 (usable)
(XEN) New Xen image base address: 0xbb400000
(XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT BC060078, 0064 (r1 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: FACP BC06A408, 010C (r5 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: DSDT BC060170, A297 (r2 ALASKA    A M I       16 INTL 20051117)
(XEN) ACPI: FACS BC76C080, 0040
(XEN) ACPI: APIC BC06A518, 0100 (r3 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: FPDT BC06A618, 0044 (r1 ALASKA    A M I  1072009 AMI     10013)
(XEN) ACPI: TCPA BC06A660, 0032 (r2 APTIO4  NAPAASF        1 MSFT  1000013)
(XEN) ACPI: MCFG BC06A698, 003C (r1 ALASKA OEMMCFG.  1072009 MSFT       97)
(XEN) ACPI: HPET BC06A6D8, 0038 (r1 ALASKA    A M I  1072009 AMI.        5)
(XEN) ACPI: DMAR BC137890, 00BC (r1 A M I   OEMDMAR        1 INTL        1)
(XEN) ACPI: SSDT BC06A768, CD128 (r2  INTEL    CpuPm     4000 INTL 20051117)
(XEN) System RAM: 65471MB (67043196kB)
(XEN) Domain heap initialised
(XEN) ACPI: 32/64X FACS address mismatch in FADT -
bc76c080/0000000000000000, using 32
(XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47
(XEN) Enabling APIC mode:  Phys.  Using 2 I/O APICs
(XEN) Switched to APIC driver x2apic_cluster.
(XEN) xstate: size: 0x340 and states: 0x7
(XEN) Speculative mitigation facilities:
(XEN)   Hardware features:
(XEN)   Compiled-in support: INDIRECT_THUNK
(XEN)   Xen settings: BTI-Thunk RETPOLINE, SPEC_CTRL: No, Other:
(XEN)   XPTI (64-bit PV only): Dom0 enabled, DomU enabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Platform timer is 14.318MHz HPET
(XEN) Detected 2593.863 MHz processor.
(XEN) Initing memory sharing.
(XEN) Intel VT-d iommu 0 supported page sizes: 4kB, 2MB, 1GB.
(XEN) Intel VT-d Snoop Control enabled.
(XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
(XEN) Intel VT-d Queued Invalidation enabled.
(XEN) Intel VT-d Interrupt Remapping enabled.
(XEN) Intel VT-d Posted Interrupt not enabled.
(XEN) Intel VT-d Shared EPT tables enabled.
(XEN) I/O virtualisation enabled
(XEN)  - Dom0 mode: Relaxed
(XEN) Interrupt remapping enabled
(XEN) Enabled directed EOI with ioapic_ack_old on!
(XEN)  -> Using old ACK method
(XEN) Allocated console ring of 32 KiB.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Extended Page Tables (EPT)
(XEN)  - Virtual-Processor Identifiers (VPID)
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN)  - Unrestricted Guest
(XEN)  - APIC Register Virtualization
(XEN)  - Virtual Interrupt Delivery
(XEN)  - Posted Interrupt Processing
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) detected
(XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB
(XEN) Brought up 12 CPUs
(XEN) Dom0 has maximum 432 PIRQs
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x25f2000
(XEN)  Dom0 alloc.:   0000001008000000->000000100c000000 (2073923 pages
to be allocated)
(XEN)  Init. ramdisk: 000000103e543000->000000103ffffb30
(XEN)  Loaded kernel: ffffffff81000000->ffffffff825f2000
(XEN)  Init. ramdisk: 0000000000000000->0000000000000000
(XEN)  Phys-Mach map: 0000008000000000->0000008001000000
(XEN)  Start info:    ffffffff825f2000->ffffffff825f24b4
(XEN)  Xenstore ring: 0000000000000000->0000000000000000
(XEN)  Console ring:  0000000000000000->0000000000000000
(XEN)  Page tables:   ffffffff825f3000->ffffffff8260a000
(XEN)  Boot stack:    ffffffff8260a000->ffffffff8260b000
(XEN)  TOTAL:         ffffffff80000000->ffffffff82800000
(XEN)  ENTRY ADDRESS: ffffffff82451180
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Scrubbing Free RAM on 1 nodes using 6 CPUs
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Errors and warnings
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch
input to Xen)
(XEN) Freed 452kB init memory

Thanks for any help!

Xen-users mailing list
[hidden email]