Print | Rate this content

Advisory: (Revision) Linux - DMAR Fault on Network Adapter With HP NC-Series Broadcom 1GbE Multifunction Driver for Linux Driver (bnx2x) When Linux "intel_iommu=on" Kernel Boot Parameter Is Used on HPE Servers

SUPPORT COMMUNICATION - CUSTOMER ADVISORY

Document ID: c04565693

Version: 1

Advisory: (Revision) Linux - DMAR Fault on Network Adapter With HP NC-Series Broadcom 1GbE Multifunction Driver for Linux Driver (bnx2x) When Linux "intel_iommu=on" Kernel Boot Parameter Is Used on HPE Servers
NOTICE: The information in this document, including products and software versions, is current as of the Release Date. This document is subject to change without notice.

Release Date: 2015-02-03

Last Updated: 2015-02-04


DESCRIPTION

Document Version
Release Date
Details
2
05/24/2016
Added additional network adapters as affected adapters and added workaround to disable the shared memory in the adapter ROM.
1
02/03/2015
Original document release.


On HPE ProLiant Gen9-series servers running Red Hat Enterprise Linux 6, Red Hat Enterprise Linux 7, SUSE Linux Enterprise Server 11 SP3, or SUSE Linux Enterprise Server 12 with the I/O Memory Management Unit (IOMMU) option Enabled in the ROM-Based Setup Utility (RBSU) and with "intel_iommu=on" added to the Linux kernel boot parameters, the IP addresses assigned to interface will not be accessible and a message similar to "CPU stuck" may be displayed on the console. In addition, DMAR fault messages are logged in the /var/log/messages as follows:

> dmar: DRHD: handling fault status reg 2
> dmar: DMAR:[DMA Write] Request device [02:00.1] fault addr 791dc000
> DMAR:[fault reason 05] PTE Write access is not set
> dmar: DMAR:[DMA Write] Request device [02:00.1] fault addr 791dc000
> DMAR:[fault reason 05] PTE Write access is not set
> dmar: DMAR:[DMA Write] Request device [02:00.1] fault addr 791dc000
> DMAR:[fault reason 05] PTE Write access is not set

This occurs because of a known limitation that the bnx2x driver has with the Option Card Black Box - Active Health (OCBB) feature when IOMMU is enabled. The network adapter firmware will attempt to access a memory area that is no longer assigned the network devices when bringing up/down the interface or loading/unloading the driver. When this occurs, a reboot is required.

SCOPE

Any HPE server running Red Hat Enterprise Linux 6, Red Hat Enterprise Linux 7, SUSE Linux Enterprise Server 11 SP3, or SUSE Linux Enterprise Server 12 with the IOMMU option Enabled in the RBSU and with "intel_iommu=on" added to the Linux kernel boot parameters and configured with any of the following network adapters:

  • HPE FlexFabric 10Gb 2-port 536FLB Adapter
  • HPE FlexFabric 20Gb 2-port 630FLB Adapter
  • HPE FlexFabric 20Gb 2-port 630M Adapter
  • HPE Ethernet 10Gb 2-port 530SFP+ Adapter
  • HPE Ethernet 10Gb 2-port 530T Adapter
  • HPE FlexFabric 10Gb 2-port 534FLR-SFP+ Adapter
  • HPE FlexFabric 10Gb 2-port 534FLR-SFP+
  • HPE FlexFabric 10Gb 2-port 533FLR-T Adapter
  • HP StoreFabric CN1100R Dual Port Converged Network Adapter
  • HPE StoreFabric CN1100R-T Dual Port Converged Network
  • HPE FlexFabric 10Gb 4-port 536FLR-T Adapter
  • HPE Synergy 3820C 10/20Gb Converged Network Adapter
  • HPE Synergy 10Gb 2-port 2820C Converged Network Adapter

RESOLUTION

This issue is due to a limitation of the current NX2 architecture.

As a workaround, perform any of the following:

Disable the IOMMU by performing either of the following:

  • Remove the intel_iommu=on from the Linux kernel boot parameters.

OR

  • Disable IOMMU in System ROM by performing the following:
  1. During system boot, press F9 to enter the ROM-Based Setup Utility (RBSU).
  2. Select System Configuration.
  3. Select Processor Settings.
  4. Select IOMMU or Intel-Vtd.
  5. Select Disable.
  6. Save and exit RBSU.

OR

Disable HP Shared Memory in the network adapter Option ROM by performing the following:

  1. During system boot, press F9 to enter the RBSU.
  2. Select System Configuration.
  3. Select the appropriate network adapter.
  4. Select Device Level Configuration.
  5. Select "Disabled" for "HP Shared Memory Features" to disable shared memory.
  6. Save the configuration and reboot the server.





RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively via e-mail through HPE Subscriber's Choice. Sign up for Subscriber's Choice at the following URL: Proactive Updates Subscription Form.

NAVIGATION TIP : For hints on navigating HP.com to locate the latest drivers, patches, and other support software downloads for ProLiant servers and Options, refer to the Navigation Tips document .

SEARCH TIP : For hints on locating similar documents on HP.com, refer to the Search Tips document .

To search for additional advisories related to Linux, use the following search string:

+Advisory +ProLiant -"Software and Drivers" +Linux

KEYWORDS:

ACCESS DENIED ERRORS : Click here if you encounter Access Denied Errors with the FTP link .


Hardware Platforms Affected: HPE Ethernet 10Gb 2-port 530SFP+ Adapter, HPE Ethernet 10Gb 2-port 530T Adapter, HPE FlexFabric 10Gb 2-port 533FLR-T Adapter, HPE FlexFabric 10Gb 2-port 534FLR-SFP+ Adapter, HPE StoreFabric CN1100R Dual Port Converged Network Adapter, HPE FlexFabric 20Gb 2-port 630FLB Adapter, HPE FlexFabric 20Gb 2-port 630M Adapter, HPE ProLiant DL160 Gen9 Server, HPE ProLiant DL180 Gen9 Server, HPE ProLiant DL360 Gen9 Server, HPE ProLiant BL460c Gen9 Server Blade, HPE ProLiant DL380 Gen9 Server, HPE ProLiant ML350 Gen9 Server, HPE FlexFabric 10Gb 2-port 536FLB Adapter
Operating Systems Affected: SUSE Linux Enterprise Server 11 (x86)
Software Affected: Not Applicable
Support Communication Cross Reference ID: IA04565693
©Copyright 2018 Hewlett Packard Enterprise Development LP
Hewlett Packard Enterprise Development shall not be liable for technical or editorial errors or omissions contained herein. The information provided is provided "as is" without warranty of any kind. To the extent permitted by law, neither HPE nor its affiliates, subcontractors or suppliers will be liable for incidental, special or consequential damages including downtime cost; lost profits; damages relating to the procurement of substitute products or services; or damages for loss of data, or software restoration. The information in this document is subject to change without notice. Hewlett Packard Enterprise Development and the names of Hewlett Packard Enterprise Development products referenced herein are trademarks of Hewlett Packard Enterprise Development in the United States and other countries. Other product and company names mentioned herein may be trademarks of their respective owners.

Legal Disclaimer: Products sold prior to the November 1, 2015 separation of Hewlett-Packard Company into Hewlett Packard Enterprise Company and HP Inc. may have older product names and model numbers that differ from current models.

Provide feedback

Please rate the information on this page to help us improve our content. Thank you!
Document title: Advisory: (Revision) Linux - DMAR Fault on Network Adapter With HP NC-Series Broadcom 1GbE Multifunction Driver for Linux Driver (bnx2x) When Linux "intel_iommu=on" Kernel Boot Parameter Is Used on HPE Servers
Document ID: emr_na-c04565693-2
How helpful was this document?
How can we improve this document?
Note: Only English language comments can be accepted at this time.
Please wait while we process your request.