| Rate this content |
Advisory: (Revision) Linux - KVM Virtual Machine Does Not Start and Displays "Device is ineligible for IOMMU domain attach due to platform RMRR requirement" Message on HPE ProLiant Systems with an Intel ProcessorSUPPORT COMMUNICATION -
CUSTOMER ADVISORY
Document ID: c04781229 Version: 1 Advisory: (Revision) Linux - KVM Virtual Machine Does Not Start and Displays "Device is ineligible for IOMMU domain attach due to platform RMRR requirement" Message on HPE ProLiant Systems with an Intel Processor
NOTICE: The information in this document, including products and software versions, is current as of the Release Date. This document is subject to change without notice.
Release Date: 2016-03-30 Last Updated: 2018-06-28 DESCRIPTION
HPE ProLiant systems with an Intel processor use regions of system memory to communicate device status information for management purposes. The system ROM sets up Reserved Memory Region Reporting (RMRR) structures to specify these memory regions and the devices that need to access them to the operating system. A conflict was discovered between the Linux kernel and the HPE ProLiant System ROM which impacts the device pass-through capability available through KVM due to the use of RMRR structures. This conflict may result in unexpected system behavior for the virtual machines (VMs) which utilize PCI device assignment, also referred to as PCI or device pass-through. The use of SRIOV is not affected. To avoid this conflict, a change was implemented in Version 3.16 of the Linux kernel and has been included in Red Hat Enterprise Linux 7.1. The result of this change is that many of the devices in the system will be restricted from utilizing pass-through to a VM. Devices may be identified via dmesg entries as follows:
IOMMU: Setting identity map for device 0000:03:00.2
In this case, PCI device 0000:03:00.2 is associated with an identity mapping for memory starting at 0xbdf7f000 through the use of an RMRR record. When an attempt is made to power on a VM with the PCI device directly assigned, the kernel will report the following dmesg entry in addition with the description of the affected device:
Device is ineligible for IOMMU domain attach due
When libvirt is used for VM management, libvirt will generate a message similar to the following when attempting to start a VM with such a device:
qemu-kvm: -device vfio- pci,host=03:00.2,
This is not HPE ProLiant system-specific. SCOPEAny HPE ProLiant system with an Intel processor running Red Hat Enterprise Linux Server 7.1 (or later) or running Linux with a kernel Version 3.16 (or later). For a list of ProLiant servers that support Red Hat Enterprise Server 7.1, refer to the support matrix available at: http://h17007.www1.hpe.com/us/en/enterprise/servers/supportmatrix/redhat_linux.aspx This does not affect SR-IOV functionality. HPE Moonshot servers are not affected. RESOLUTIONFor a subset of configurations, PCI device assignment can be enabled on systems affected by this change. The resolution requires a specific ROM update, configuration and in some cases a NIC firmware update. Configurations that can support PCI device assignment include:
ProLiant Gen8 and Gen9-series servers with GPUs ProLiant Gen8 and Gen9 servers support GPU device pass-through, if the GPU and driver support pass-through, with these firmware versions:
NIC pass-through with HPE ProLiant Gen8-series servers with HPE PCI network adapters using Intel Ethernet controllers or third-party NICs ProLiant Gen8-series servers, with the exception of the HP ProLiant DL580 Gen8 server, can be configured to support device pass-through for following set of NICs:
Third-party NICs may also be supported if the NIC and its driver support PCI pass-through. Contact the NIC vendor to confirm support. When using one of the above NICs or a third-party NIC, the server must be configured as follows:
NIC device pass-through with HPE ProLiant Gen9-series servers with HPE NICs using Intel Ethernet Controllers The following instructions apply to HPE ProLiant Gen9-series servers with the following NICs:
The server must be configured as follows:
Systems running the "Intel Active Health System Agent for HPE ProLiant Network Adapters for Linux x86_64"contained in the hp-ocsbbd RPM will see errors when starting the service in this configuration. The errors do not affect the operation or functionality of the server; however, the service is no longer necessary so the package should be removed.
NIC device pass-through with HPE ProLiant Gen9-series servers with HPE NICs using Mellanox ConnectX3 Controllers. The following instructions apply to HPE ProLiant Gen9-series servers with the following NICs:
The server must be configured as follows:
NIC device pass-through for HPE ProLiant Gen9 servers with third-party NICs. HPE ProLiant Gen9-series servers with firmware version 1.30_12-24-2014 (or later) support PCI device pass-through with third-party NICs, assuming that the NIC and driver support PCI device pass-through. Contact the NIC vendor for support.
Perform the following steps to obtain the appropriate System ROM/NIC firmware:
RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL: Proactive Updates Subscription Form. NAVIGATION TIP : For hints on navigating HP.com to locate the latest drivers, patches, and other support software downloads for ProLiant servers and Options, refer to the Navigation Tips document . SEARCH TIP : For hints on locating similar documents on HP.com, refer to the Search Tips document .
Hardware Platforms Affected: HPE ProLiant SL230s Gen8 Server, HPE ProLiant SL250s Gen8 Server, HPE ProLiant BL460c Gen8 Server Blade, HPE ProLiant DL360p Gen8 Server, HPE ProLiant DL380p Gen8 Server, HPE ProLiant ML350p Gen8 Server, HPE ProLiant DL160 Gen8 Server, HPE ProLiant BL420c Gen8 Server Blade, HPE ProLiant DL320e Gen8 Server, HPE ProLiant DL360e Gen8 Server, HPE ProLiant ML310e Gen8 Server, HPE ProLiant ML350e Gen8 Server, HPE ProLiant DL380e Gen8 Server, HPE ProLiant BL660c Gen8 Server Blade, HPE ProLiant DL560 Gen8 Server, HPE ProLiant DL320e Gen8 v2 Server, HPE ProLiant MicroServer Gen8, HPE ProLiant DL580 Gen8 Server, HPE ProLiant DL160 Gen9 Server, HPE ProLiant DL180 Gen9 Server, HPE ProLiant DL360 Gen9 Server, HPE ProLiant BL460c Gen9 Server Blade, HPE ProLiant DL380 Gen9 Server, HPE ProLiant ML350 Gen9 Server, HPE ProLiant XL230a Gen9 Server, HPE ProLiant XL250a Gen9 Server, HPE ProLiant DL120 Gen9 Server, HPE ProLiant ML150 Gen9 Server, HPE ProLiant DL60 Gen9 Server, HPE ProLiant DL80 Gen9 Server, HPE ProLiant ML110 Gen9 Server, HPE ProLiant BL660c Gen9 Server Blade, HPE ProLiant DL560 Gen9 Server, HPE ProLiant XL450 Gen9 Server
Software Affected: Not Applicable
Support Communication Cross Reference ID: IA04781229
©Copyright 2018 Hewlett Packard Enterprise Development LP
Hewlett Packard Enterprise Development shall not be liable for technical or editorial errors or omissions contained herein. The information provided is provided "as is" without warranty of any kind. To the extent permitted by law, neither HPE nor its affiliates, subcontractors or suppliers will be liable for incidental, special or consequential damages including downtime cost; lost profits; damages relating to the procurement of substitute products or services; or damages for loss of data, or software restoration. The information in this document is subject to change without notice. Hewlett Packard Enterprise Development and the names of Hewlett Packard Enterprise Development products referenced herein are trademarks of Hewlett Packard Enterprise Development in the United States and other countries. Other product and company names mentioned herein may be trademarks of their respective owners.
|
Legal Disclaimer: Products sold prior to the November 1, 2015 separation of Hewlett-Packard Company into Hewlett Packard Enterprise Company and HP Inc. may have older product names and model numbers that differ from current models.
Provide feedback |
Please rate the information on this page to help us improve our content. Thank you! |
- Was the information on this page helpful?
- Very helpful
- Somewhat helpful
- Not helpful