vSMP Foundation 10.0.1595.57  -  Release Notes
==================================================================== 
Date: Jan 24, 2021


VALIDATED GUEST OPERATING SYSTEMS
====================================================================
1. Red Hat Enterprise Linux (or CentOS): ver. 4 to 8 (RHEL).
2. SuSE Linux Enterprise Server: ver. 10 to 15 (SLES).
3. Fedora Core: ver. 4 to 29 (FC).
4. Open SuSE: ver. 10 to 11 (SUSE).
5. Ubuntu Server: ver. 16.04 to 19.10 (UBUNTU).
6. Debian: 9.5.0 (DEBIAN).
7. Amazon Linux 2: 2.0.2019 and later (AMZN2).
8. Citrix XenServer: 7.5 (XEN).
9. Proxmox Virtual Environment: 6.2-1 (PXVE).


VALIDATED BOOT LOADERS
====================================================================
1. Boot loaders used by the validated Guest OSes.
2. SYSLINUX/PXELINUX: ver. 3.00 to 6.03 for loading the Guest OS.
3. SYSLINUX/PXELINUX: ver. 3.60 to 6.03 for loading vSMP Foundation.


VALIDATED HYPERVISORS
====================================================================
1. Linux KVM (RHEL 7 and later) (KVM).
2. AWS Nitro System (ANS).
3. VMware ESXi 7.0.1 Update 1 (ESX).
Validated L2 Guest Operating Systems: RHEL8, SLES15, AMZN2.


VALIDATED HARDWARE
====================================================================
Hardware compatibility list for the most recent release of vSMP 
Foundation is available at:
 - Systems: http://www.scalemp.com/spec
 - Devices: http://www.scalemp.com/IOcompat


KNOWN ISSUES
====================================================================
1. Guest OS is slow to load in System-expansion (SYX).
   Workarounds: (1) Change expansion mode to Memory-expansion (MEX),
   or set cpu_boards=0, (2) use kernels provided by ScaleMP, 
   or (3) download latest kernel.org kernel and compile with 
   CONFIG_X86_VSMP (see documentation). 
2. AnyIO requires Intel Virtualization Technology for Directed I/O 
   or AMD I/O Virtualization Technology.
3. Guest-controlled I/O devices can only address memory regions that 
   are smaller than the memory amount installed on the boards the 
   devices are attached to. 
4. Guest-controlled IOMMU is not supported.
5. Nested VMs are not supported on AMD platforms.
6. Citrix XenServer 7.5 requires that both x2apic and AnyIO will be
   disabled.
7. Hypervisor support requires 2nd Generation Intel Xeon Scalable
   Processors or later with legacy Guest OS.


CHANGE LOG
==================================================================== 
Version 10.0.1595.57
[FIX] Flash: Improved initialization and shutdown of NVMe in 
      Flash-expansion (FLX) mode.
[FIX] HCL\Boards: Reboot of AWS Nitro system (Issue: 9688, 9758).
[FIX] HCL\Boards: Support for Intel Core i9 (10th generation).
[FIX] HCL\Boards: VMware VGA memory access (Issue: 9701).
[FIX] HCL\Devices: LSI Fusion-MPT SAS and LSI MegaRAID devices in 
      System-expansion (SYX) mode.
[FIX] HCL\Devices: PCI hot plug support (Issue: 9761).
[FIX] Installer: Accessing NVMe when running in in Flash-expansion 
      (FLX) mode (Issue: 9807).
[FIX] vSMP CTL: Multiple profiling fixes (Issue: 9776).
[FIX] Configuration key scaling_devs when OS is loaded from NVMe 
      (Issue: 9810).
[FIX] Linux crash kernel (Issue: 9739).
[FIX] System restarts at early boot (Issue: 9686).
[CHG] HCL\Boards: Virtual hardware improvements.
[CHG] License: Updated licenses CPU list classification (Issue: 
      9730).
[CHG] Performance: Virtual hardware improvements (Issue: 9715, 9781, 
      9790).
[NEW] Flash: VMware virtual NVMe initial support (Issue: 9802, 
      9808).
[NEW] HCL\Boards: VMware paravirtual SCSI support (Issue: 9771).
[NEW] HCL\Devices: System-expansion (SYX) crash during high pressure 
      of automatic NASRAM UNPINNING (Issue: 9706).
[NEW] Installer: Use 'si -m' to record system performance info in
      addition to system info.
[NEW] Validated Linux kernels for Memory-expansion (MEX) mode and 
      Flash-expansion (FLX) mode: 5.7.12-1.el7.elrepo.x86_64 (RHEL).
--------------------------------------------------------------------
Version 10.0.1595.20
[FIX] HCL\Devices: LSI Fusion-MPT SAS devices in RAID used in 
      System-expansion (SYX) mode.
[FIX] HCL\Devices: AWS Elastic Network Adapter (ENA) (Issue: 9751).
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 9710).
[CHG] HCL\Boards: Remove system memory limit due to limited memory 
      address space of IOMMU if AnyIO not in use.
[CHG] HCL\Boards: Virtualized hardware defaults to legacy boot 
      (Issue: 9542).
[CHG] License: Updated licenses CPU list classification.
--------------------------------------------------------------------
Version 10.0.1595.11
[FIX] AWS Marketplace intergration.
--------------------------------------------------------------------
Version 10.0.1595.9
[FIX] HCL\Boards: Linux reports stack trace coming from 
      non_legacy_dev_irq().
[FIX] HCL\Boards: Support for Intel Core i9 (10th generation).
[FIX] HCL\Devices: Interrupt distribution logic should not use 
      posted interrupts (Issue: 9676).
[FIX] HCL\Devices: PCI hot plug support (Issue: 9568).
[CHG] Boot and UI: Remove NVMe SSD socket assignment warning on 
      virtualized hardware (Issue: 9698).
[CHG] Installer: Clear input buffer prior to any interaction (Issue: 
      9598).
[CHG] Performance: Prefetch ignores coherency-only transitions.
[CHG] Performance: Significantly improve system boot time for 
      systems with Mellanox devices with SR-IOV option (Issue: 
      9658).
[NEW] Performance: Caching policies - defaults to CPOL=2.
[NEW] Performance: Improved performance of asynchronous DSRAM.
[NEW] Performance: Prefetch engines use asynchronous DSRAM where 
      possible.
[NEW] vSMP CTL: Accurate profiling and statistics entries for 
      asynchronous transactions.
--------------------------------------------------------------------
Version 10.0.1595.2
[FIX] HCL\Devices: Correctly handle LSI MegaRAID 
      MR_DCMD_SYSTEM_PD_MAP_GET_INFO command.
[FIX] HCL\Devices: PCI hot plug support.
[FIX] Improved HPET consistency (Issue: 8820) in System-expansion 
      (SYX) mode (Issue: 9609).
[FIX] Installer: Integrated performance tests (Issue: 9577).
[FIX] A rare deadlock during remote PCI configuration space access 
      in System-expansion (SYX) mode (Issue: 9059).
[FIX] Correctly handle SHR instruction (Issue: 8620, 9192).
[FIX] System stuck or crash prior to loading the OS.
[CHG] HCL\Devices: LSI MegaRAID Fusion-MPT SAS with physical bar 
      mapping above 4GB (Issue: 9347).
[CHG] HCL\Devices: PCI capabilities hiding method and 
      implementation.
[CHG] HCL\Devices: PCI hot plug support: up to 48 devices.
[CHG] Installer: Tune-ups for integrated performance tests 
      (Segmented SGEMM).
[CHG] Performance: Increased cases supported by CPT and improve CPT 
      performance (SAP HANA use case).
[CHG] Performance: NNA is always on for single NUMA-node systems.
[CHG] vSMP Foundation Device: Change device address dynamically in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
[CHG] License: vSMP MemoryONE for EC2 license expires after 9 
      months (was 6 months).
[CHG] vSMP Foundation Free to support up to 3TB of RAM.
[NEW] APIC: IPI delivery performance improvements.
[NEW] Diagnostics: Run test defined in diag_test configuration key.
[NEW] Diagnostics: Save diagnostics to vSMP Foundation Device.
[NEW] Flash: Improved Flash-expansion (FLX) performance for NVMe 
      devices.
[NEW] Flash: Improved initialization and shutdown of NVMe in 
      Flash-expansion (FLX) mode.
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: Correctly handle IOMMU caching mode (for VMware 
      ESXi VIOMMU).
[NEW] HCL\Boards: Introduced vga_dev=bb:dd.f,bb:dd.f to force VGA 
      device on primary,secondary boards (Issue: 9127).
[NEW] HCL\Boards: Support for Intel DCPMM in app-direct mode.
[NEW] HCL\Boards: Support for Intel Core i9 (10th generation).
[NEW] HCL\Boards: Virtualized hardware support. See VALIDATED 
      HYPERVISORS section.
[NEW] HCL\Boards: Virtualized hardware OS validation: RHEL8, SLES15, 
      AMZN2.
[NEW] HCL\Devices: Improved multi-MSIX handling.
[NEW] HCL\Devices: Improved support for Intel 40GigE devices (i40e).
[NEW] HCL\Devices: Introducing LVDS to support for platforms without 
      IOMMU (ANS and KVM default configuration).
[NEW] HCL\Devices: Support for Intel UHD Graphics 630 with 64-bit 
      BARs.
[NEW] Installer: System info install missing packages (yum/zypper 
      only).
[NEW] Performance: Caching policies - automatic tunning based on 
      memory usage.
[NEW] Performance: Caching policies - improved granularity.
[NEW] Performance: Caching policies - user runtime control (via 
      vsmpctl) and reporting (via vsmpstat).
[NEW] Performance: Enhanced Guest code patching (ultravirt), 
      enabling greater performance and execution environments.
[NEW] Performance: Enhanced user-space hints (prefetch and 
      parallelization).
[NEW] Performance: Further improve CR3 reloading latency, leading to 
      a shorter OS context switch time.
[NEW] Performance: Improved performance for AMD systems by enhanced 
      use of SVM features.
[NEW] Performance: Improved performance for System-expansion (SYX) 
      by low-level backplane optimizations.
[NEW] Performance: Introduction of Array Address Prefetch (AAP).
[NEW] Performance: Many optimizations and micro-optimizations for 
      page-table updates.
[NEW] Performance: More robust Guest code patching (ultravirt).
[NEW] Performance: Optimized 1GB page-directory pointer table entry 
      handling.
[NEW] Performance: Over 35% performance improvement for 
      multi-process workloads mapping/unmapping same file.
[NEW] Performance: PXM aware prefetch.
[NEW] Performance: Significantly improve system boot time.
[NEW] UI and boot: Branding controls maximum memory expansion 
      capabilities.
[NEW] Validated Linux kernels for all operation modes: 
      5.9.1-1.el8.elrepo.x86_64 (RHEL).
[NEW] Validated Linux kernels for Memory-expansion (MEX) mode and 
      Flash-expansion (FLX) mode: 4.12.14-122.46-default (SLES), 
      4.15.0-122-generic (UBUNTU).
--------------------------------------------------------------------
Version 9.5.195.159
[FIX] HCL\Boards: PAT handling for AMD systems.
[FIX] HCL\Devices: Intel 40 Gigabit Ethernet in System-expansion 
      (SYX) mode - running out of interrupt space (Issue: 9565).
[FIX] HCL\Devices: Theoretical memory corruption coming from LSI 
      MegaRAID Fusion-MPT SAS 2.0 devices used in System-expansion 
      (SYX) mode systems - never seen in the field (not seen by a 
      customer).
[FIX] HCL\Devices: Using srvadmin crashes System-expansion (SYX) 
      with LSI Fusion-MPT SAS devices (Issue: 9594, 9597).
[FIX] Performance: Rare system crash during CPT operation (Issue: 
      9548).
[FIX] UI and boot: When system_memory is smaller than the DRAM 
      installed in the system in Memory-expansion (MEX) mode (Issue: 
      9603).
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 9518).
[FIX] Rare crash during system initialization in System-expansion 
      (SYX) mode (Issue: 8530).
[CHG] HCL\Boards: Improved VGA detection.
[CHG] License: vSMP MemoryONE for EC2 license expires after 6 
      months (was 3 months).
[CHG] Expose CPUID Structured Extended Feature Flags Enumeration 
      Leaf (0x7) in cases where all active processors are identical.
[NEW] Performance: Improved 4KB Guest page-table management.
--------------------------------------------------------------------
Version 9.5.195.143
[FIX] HCL\Boards: ACPI SRAT info on AMD EPYC systems with 1TB of 
      system memory may have an additional small PXM if NUMA layout 
      set to Expand (mem_topology=2) (Issue: 9085).
[FIX] HCL\Devices: Improved support for NVIDIA VGA/GPU devices 
      (Issue: 9129).
[FIX] Installer: Move persistent logs to folder when extracted on 
      native.
[FIX] Installer: System info data collection at low disk space 
      (Issue: 9369).
[FIX] Installer: Ubuntu support.
[FIX] vSMP CTL: Fixing BAR size to the actual size needed.
[FIX] vSMP Foundation Device: Improve compatibility for EHCI and 
      XHCI devices (Issue: 9391, 9477).
[FIX] AMD EPYC systems in System-expansion (SYX) mode may have boot
      issues - regression: 9.5.195.55 (Issue: 9399).
[FIX] Rare race of DSRAM during permissions upgrade - never seen in 
      the field (not seen by a customer).
[FIX] SPP may lead to instability in rare conditions.
[FIX] System crash due under heavy IO load using AnyIO in 
      System-expansion (SYX) mode.
[FIX] VM will not start on Citrix XenServer 7.5 occasionally - 
      regression: 9.5.195.87 (Issue: 9373).
[CHG] HCL\Boards: Correctly handle ESRT.
[CHG] HCL\Boards: Do not report PS2 compatibility if there is no 
      such.
[CHG] Improve HPET consistency (Issue: 8820).
[CHG] Xen dom0 command-line options tuneup based on system 
      configuration:
      - dom0 - if set to 'pvh' modify to 'pv'.
[NEW] Performance: Improved A/D bits management in Memory-expansion 
      (MEX) mode and Flash-expansion (FLX) mode.
[NEW] Performance: Improved file-IO performance.
[NEW] Performance: Improvements for AMD EPYC systems.
--------------------------------------------------------------------
Version 9.5.195.98
[FIX] vSMP Foundation Device: Improve compatibility with Lenovo
      sd650 and sr650 systems (Issue: 9097, 9297).
[FIX] vSMP Foundation Device: Improve compatibility with Ilo3
      systems (Issue: 8929).
[FIX] vSMP CTL: vsmpstat report of HPET update drift and frequency 
      is incorrect in periodic mode.
[FIX] System crash due under heavy IO load using AnyIO in 
      System-expansion (SYX) mode.
[FIX] Rare NVMe detection failure.
[FIX] Handling AMD EPYC 7xx2 (Rome) with less than 64 cores.
[FIX] 'Boot Mode' in system settings not showing up in some
      configurations.
[CHG] HCL\Boards: Increased the maximum number of shared-interrupts
      (Issue: 9300).
[NEW] Proxmox VE 6.2-1 support (Issue: 9204, 9274, 9276).
[NEW] HCL\Devices: Improve system response time and avoid crash
      during high pressure of automatic NASRAM UNPINNING (Issue:
      9217, 9225).
[NEW] Diagnostics: Save diagnostics in most error conditions.
--------------------------------------------------------------------
Version 9.5.195.78
[FIX] Flash: Timeout device during initialization.
[FIX] HCL\Devices: PCI hot plug support.
[FIX] License: Fix CPU license identification, leading to wrongly 
      classifying "Gold 6230".
[FIX] Performance: Significantly improve Linux boot time by aligning 
      last usable address to 2GB.
[FIX] vSMP Foundation Device: Improve compatibility for EHCI and 
      XHCI devices (Issue: 9097, 9169).
[FIX] Support for SHR instruction emulation (Issue: 8620, 9192).
[CHG] Installer: Enhanced System info data collection.
[NEW] Flash: Improved Flash-expansion (FLX) performance for NVMe 
      devices.
[NEW] HCL\Boards: Support for Intel NUC 9 Extreme with Intel Core 
      i7/i9 (9th generation) or Xeon processor families.
[NEW] Validated Linux kernels for System-expansion (SYX) mode: 
      5.5.1-1.el8.elrepo.x86_64.
--------------------------------------------------------------------
Version 9.5.195.66
[FIX] HCL\Backplane: Adhere to backplane_devX for Mellanox devices 
      even if the device class is Ethernet (Issue: 8944, 9077).
[FIX] HCL\Boards: Boot stuck on L882 (Issue: 8962, 9045).
[FIX] HCL\Boards: Critical fixe for AMD EPYC.
[FIX] HCL\Devices: Broadcom NetXtreme-C/E device preventing system 
      boot (Issue: 8991).
[FIX] HCL\Devices: Critical issue with AHCI devices not in non-AnyIO 
      mode that could lead to system crash (Issue: 8820).
[FIX] HCL\Devices: Improved support for NVIDIA VGA/GPU devices 
      (Issue: 8952, 9022).
[FIX] Installer: Alert the user to reboot after installation (Issue: 
      9015).
[FIX] UI and boot: Default system_memory expansion when branding 
      fails (Issue: 8890).
[FIX] UI and boot: Memory license limit when changing System Memory 
      in System Settings (F5) (Issue: 8838).
[FIX] UI and boot: Restart system with CTRL-ALT-DEL during boot 
      phase (Issue: 8973).
[FIX] UI and boot: Several fixes for boot flow (Issue: 8978).
[FIX] vSMP CTL: cumulative view.
[FIX] vSMP CTL: stats on AMD platforms (Issue: 8936).
[FIX] vSMP Foundation Device: Handling of log read when log device 
      is in use (Issue: 8933).
[FIX] vSMP Foundation Device: Handling of log write when diagnostics 
      device is set to None (Issue: 9000).
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 9097). 
[FIX] vSMP Foundation Device: Log device selection (Issue: 8985).
[FIX] vSMP Foundation Device: Minimum number of boards when booting 
      from USB (Issue: 8961).
[FIX] Error during system panic.
[FIX] IO hole alignment.
[FIX] Linux crashkernel (Issue: 8956).
[FIX] Rare crash during log collection (Issue: 8968).
[FIX] Rare race of DSRAM during evacuation on hugepage (Issue: 
      8861).
[FIX] System stuck during boot at "configuring system" in 
      System-expansion (SYX) mode.
[CHG] Diagnostics: Enhance 'Save to USB' (Issue: 8950, 9064).
[CHG] Flash: Properly shutdown device during initialization.
[CHG] UI and boot: If two devices with VGA bios found, use the first 
      one.
[CHG] Improve HPET consistency (Issue: 8820).
[NEW] HCL\Backplane: Support for additional Mellanox ConnectX-5 Ex 
      EDR HCAs (Issue: 8987).
[NEW] HCL\Backplane: Support for Mellanox ConnectX-6 EDR HCAs.
[NEW] HCL\Boards: Support for 2nd Generation Intel Xeon Scalable 
      Processors (Cascade Lake).
[NEW] HCL\Devices: Expanded support for LSI MegaRAID Fusion-MPT SAS 
      3.0 devices (SAS3408) (Issue: 8994).
[NEW] Performance: Enhanced Guest code patching (ultravirt).
[NEW] Validated Linux kernels for Memory-expansion (MEX) mode and 
      Flash-expansion (FLX) mode: 5.3.1-1.el7.elrepo.x86_64 (RHEL), 
      5.4.3-1.el7.elrepo.x86_64 (RHEL). 
--------------------------------------------------------------------
Version 9.5.195.14
[FIX] HCL\Boards: Support for AMD EPYC 7xx2 (Rome).
[FIX] HCL\Devices: Linux SW RAID as boot device (Issue: 8915).
[FIX] HCL\Devices: Support for VROC (Issue: 8906).
[FIX] Installer: 'in -b' (Issue: 8497).
[FIX] Installer: Alert the user to reboot after installation (Issue: 
      8940).
[FIX] Installer: RHEL 6.8 and 6.9 compatibility.
[FIX] Installer: Run from folders with whitespace in path (Issue: 
      8949).
[FIX] Installer: Setup image as default boot device in UEFI mode 
      (Issue: 8889).
[FIX] UI and boot: "Default" memory in System Settings (F5) (Issue: 
      8838, 8898, 8899, 8900).
[FIX] UI and boot: Blank display when loading OS in UEFI (Issue: 
      8922).
[FIX] UI and boot: Blank line(a) before 'Loading Operating System' 
      (Issue: 8916).
[FIX] UI and boot: Boot device identification in UEFI.
[FIX] UI and boot: Correctly select default diagnostics device 
      (Issue: 8891).
[FIX] UI and boot: Error message text (Issue: 8881).
[FIX] UI and boot: Save diagnostics error message if not enough 
      space (Issue: 8893).
[FIX] vSMP CTL: Statistics on AMD systems (Issue: 8936).
[FIX] Linux crashkernel on AMD systems.
[FIX] Rare system lockup in System-expansion (SYX) mode (Issue: 
      8693).
[FIX] Rare system stall in connecting phase (Issue: 8556).
[FIX] Reboot and kexec may not work on some platforms - regression: 
      9.5.195.7.
[FIX] Theoretical memory corruption - never seen in the field (not 
      seen by a customer).
[CHG] Cloud: Integration with cloud provisioning systems (Issue: 
      8904).
[CHG] Diagnostics: Save diagnostics at "No more boot devices" 
      message - changing key sequence from 'E' to 'LOG' (Issue: 
      8946).
[CHG] Flash: Properly shutdown device during initialization (Issue: 
      8863).
[CHG] Installer: Call sync after tools installation (Issue: 8913).
[CHG] Installer: Enhanced System info data collection (Issue: 8925, 
      8926).
[CHG] LAPIC frequency control in System-expansion (SYX) mode.
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: Support for Intel Core i7 (8th and 9th generation)
      processor family.
[NEW] Installer: Enhanced integrated performance tests with 
      'Extended system memory test (DSRAM)'.
[NEW] Performance: Improved Linux OS context switch time (Issue: 
      8942).
--------------------------------------------------------------------
Version 9.5.195.7
[FIX] HCL\Backplane: Adhere to backplane_devX for Mellanox devices 
      even if the device class is Ethernet (Issue: 8834).
[FIX] HCL\Boards: ACPI SRAT info may have an additional empty PXM if 
      NUMA layout set to Expand (mem_topology=2).
[FIX] HCL\Boards: Conflicting ACPI I/O ports regions for mixed 
      boards System-expansion (SYX) configurations.
[FIX] HCL\Boards: e820 map parsing for max address.
[FIX] HCL\Boards: Serial console redirection and serial log for 
      boards with PCI serial ports.
[FIX] HCL\Boards: UEFI memory layout (Issue: 8522).
[FIX] HCL\Devices: Disable MSI-X interrupt capability for devices 
      that do not adhere to MSI-X MASKALL bit.
[FIX] HCL\Devices: LSI Fusion-MPT SAS 3.0 initialization without 
      INTx.
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT SAS 2.0 device with FW 
      2.5 (Issue: 8813).
[FIX] HCL\Devices: Several fixes for Microsemi Smart Family SCSI 
      controllers.
[FIX] HCL\Devices: Support for Intel RAID AHCI devices (Issue: 
      8805).
[FIX] HCL\Devices: When flattening PCI hierarchy, do not relocate 
      primary board devices (Issue: 4569).
[FIX] Installer: Compatibility with systemd 241 on SLES12.
[FIX] Installer: Integrated performance tests (Issue: 8779).
[FIX] Installer: Integrated performance tests prerequisites.
[FIX] Installer: tput error while running through ssh.
[FIX] Installer: Validation for 'bo -b' and 'bo -w'.
[FIX] Performance: Fix MONITOR command handling (Issue: 8614, 8668, 
      8727).
[FIX] UI and boot: Several fixed OS PXE boot flow.
[FIX] vSMP CTL: Multiple profiling and statistics fixes (Issue: 
      8730, 8786, 8789, 8801).
[FIX] vSMP Foundation Device: Avoid update of unsupported device 
      (Issue: 8739).
[FIX] vSMP Foundation Device: Support NVMe devices.
[FIX] Improved Citrix XenServer support.
[FIX] Rare system stall in connecting phase (Issue: 8556).
[CHG] Diagnostics: Enhance 'Save to USB' (Issue: 8526, 8771).
[CHG] Flash: Properly shutdown device during initialization.
[CHG] HCL\Boards: Increase number of supported IOAPICs per board to 
      4 per NUMA node + 1.
[CHG] HCL\Devices: Increasing number of AnyIO devices per board to 
      144.
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Installer: Enhanced System info data collection.
[CHG] Installer: Multipath device Identification (Issue: 8850).
[CHG] Installer: Save vsmpversion output in together with integrated 
      performance tests results (Issue: 8836).
[CHG] Installer: Welcome Screen accept terminal size.
[CHG] Performance: Large-block-copy (LBC) in Memory-expansion (MEX) 
      mode.
[CHG] Performance: More robust Guest code patching (ultravirt) 
      (Issue: 8540, 8780).
[CHG] UI and boot: Console redirection cleanups.
[CHG] UI and boot: Perform system reset after changing physical 
      memory limit (board_memory) in System Settings (F5) (Issue: 
      8677).
[CHG] UI and boot: Preserve memory units (MB, GB) of board_memory 
      and system_memory configuration keys (Issue: 8689).
[CHG] DSDT ACPI table update version to 2.
[CHG] Reworked internal interrupt allocation (Issue: 8764).
[CHG] Tune asynchronous DSRAM starting conditions.
[NEW] Cloud: Integration with cloud provisioning systems. Contact 
      ScaleMP for list of supported cloud providers.
[NEW] Diagnostics: Introduce 'PXE test' to validate PXE boot 
      protocol.
[NEW] Diagnostics: Save diagnostics if pressing 'E' at "No more boot 
      devices" message.
[NEW] Flash: Correctly follow Intel SNC layout (Issue: 8636).
[NEW] Flash: Improved Flash-expansion (FLX) performance for NVMe 
      devices.
[NEW] Flash: Support expansion up to 16x available DRAM (Issue: 
      8679).
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: Added support for Supermicro H11DST-B board.
[NEW] HCL\Boards: HPET read performance (Issue: 8403, 8487, 8498).
[NEW] HCL\Boards: HWP awareness.
[NEW] HCL\Boards: Initial support for running in virtualized 
      environment.
[NEW] HCL\Boards: Serial console redirection and serial log follows 
      ACPI SPCR table.
[NEW] HCL\Boards: Support 15TB DRAM per board.
[NEW] HCL\Boards: Support for AMD EPYC 7xx2 (Rome).
[NEW] HCL\Boards: Support for boards with no VGA devices.
[NEW] HCL\Boards: Support for VGA devices placed on a non-BSP socket 
      (Issue: 8470).
[NEW] HCL\Boards: Validated Flash-expansion (FLX) configuration with 
      256 AMD EPYC 7xx2 (Rome) CPUs, 4TB system memory (4TB DRAM).
[NEW] HCL\Boards: Validated No-expansion (NOX) configuration with 
      448 CPUs.
[NEW] HCL\Boards: Validated System-expansion (SYX) configuration 
      with 4096 AMD EPYC 7xx2 (Rome) CPUs (16 boards x 2 processors 
      x 64 cores x 2 threads) CPUs, 4TB RAM, Mellanox ConnectX-4 EDR 
      (100Gbps) HCAs.
[NEW] HCL\Devices: PCI hot plug support.
[NEW] HCL\Devices: Support for Linux SW RAID as boot device.
[NEW] Installer: 'bo -x' extract boot image.
[NEW] Installer: Running as non-root user.
[NEW] Installer: System mode identification fallback to SMBIOS type 
      11.
[NEW] Installer: Tune integrated performance tests for AMD EPYC 7xx2 
      (Rome).
[NEW] Isolation: Support for no-expansion (NOX) mode for system 
      isolation.
[NEW] License: systemd support for network license server and agent.
[NEW] Performance: Improve Intel (Skylake or later) turbo mode 
      performance by 15% in Memory-expansion (MEX) mode and 
      Flash-expansion (FLX) mode.
[NEW] Performance: Improve Linux PTI kernel performance.
[NEW] Performance: Improved Linux OS context switch time.
[NEW] Performance: Improved MMIO access performance speed by keeping 
      PAT for 2MB mappings.
[NEW] Performance: Improved speed of parallel TLB flush operation.
[NEW] Performance: Nested VM performance improvement.
[NEW] Performance: Preset A/D bits in Memory-expansion (MEX) mode 
      and Flash-expansion (FLX) mode.
[NEW] Performance: Significantly improve Linux boot time by aligning 
      last usable address to 2GB.
[NEW] Performance: Significantly improve shadow page tables 
      performance.
[NEW] Performance: Significantly increase DSRAM performance on 
      high-core count systems.
[NEW] UI and boot: Branding controls configuration keys default 
      values: keep_smbios, mem_topology, system_memory expansion 
      ratio.
[NEW] UI and boot: vSMP Foundation default boot order iterate all 
      system drives.
[NEW] vSMP CTL: More detailed report of the number of free shadow 
      page tables in statistics.
[NEW] vSMP CTL: Present 'Reboot to access system settings' only when 
      needed (Issue: 8781).
[NEW] vSMP CTL: Present support period only when needed.
[NEW] Configuration key scaling_devs=<number> enables the first 
      <number> NVMe devices in Flash-expansion (FLX) mode.
[NEW] Configuration key scaling_devX as a synonym for backplane_devX 
      in Flash-expansion (FLX) mode.
[NEW] Configuration key system_memory expanded to specify expansion 
      ratio with 'x' postfix (example: system_memory=4x) in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
[NEW] Expand UEFI boot to support network boot with IPXE in SNP 
      mode.  iSCSI not supported.
[NEW] Expanded emulation for additional SSE and AVX instructions.
[NEW] Nested VM support for non-EPT guests.
[NEW] Validated Linux kernels for all operation modes: 
      3.10.0-1062.4.3.el7.x86_64 (RHEL), 5.3.8-1.el7.elrepo.x86_64
      (RHEL).
[NEW] Validated Linux kernels for Memory-expansion (MEX) mode and
      Flash-expansion (FLX) mode: 4.18.0-147.0.3.el8_1.x86_64
      (RHEL), 4.9.0-7-amd64 (DEBIAN), 3.12.74-60.64.40-default
      (SLES), 4.12.14-197.26-default, (SLES), 5.3.0-23-generic
      (UBUNTU).
[NEW] Xen and Xen dom0 command-line options tuneup - add 
      "smep=false".
--------------------------------------------------------------------
Version 9.0.3365.98
[FIX] HCL\Devices: AnyIO devices mapping large SG lists (Issue: 
      8824).
[FIX] HCL\Devices: Avoid crash when device access non-existing 
      memory address.
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT SAS 2.0 device with FW 
      2.5 (Issue: 8793).
[FIX] Flash: Correctly handle CPU startup in case the BSP's APICID 
      is not 0 (Issue: 7830).
[FIX] vSMP CTL: vsmpctl.conf file location (Issue: 8874).
[FIX] UI and boot: "Default" memory in System Settings (F5) (Issue: 
      8838, 8900).
[FIX] Fix a backplane starvation causing a system lockup and crash 
      in System-expansion (SYX) mode.
[FIX] Linux crashkernel (Issue: 8864).
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
--------------------------------------------------------------------
Version 9.0.3365.86
[FIX] Flash: Restart functionality in System Settings (F5) may get 
      stuck (Issue: 8753).
[FIX] HCL\Backplane: BSOD on Intel Xeon v2 (Issue: 8579).
[FIX] HCL\Boards: Primary board ACPI SLOT information (Issue 8589).
[FIX] HCL\Devices: Support for AMD AHCI devices (Issue: 8697).
[FIX] License: Fix CPU license identification, leading to wrongly 
      classifying "Gold 6140M".
[FIX] UI and boot: Fields in System Settings (F5) may be cut (Issue: 
      8750).
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 8478).
[FIX] BSOD upon reboot in System-expansion (SYX) and 
      Memory-expansion (MEX) (Issue: 8660).
[FIX] Improved Citrix XenServer support.
[FIX] NASRAM related race leading to system freeze or crash in 
      System-expansion (SYX) mode (Issue: 8719).
[FIX] Set ciaddr to 0 in DHCP request packet, for improved 
      compatibility (Issue: 8768).
[FIX] System stuck during boot at "configuring system" in 
      System-expansion (SYX) mode (Issue: 8556)
[CHG] Installer: Enhanced System info data collection.
[CHG] License: GPU handling in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes (Issue: 8778, 8785).
[CHG] Performance: More robust Guest code patching (ultravirt) 
      (Issue: 8716).
[CHG] vSMP CTL: periodic vsmpstat do not shutdown when stats are 
      stopped (Issue: 8773).
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Support for Debian 9.5 installed in UEFI.
--------------------------------------------------------------------
Version 9.0.3365.62
[FIX] HCL\Backplane: System initialization on AMD EPYC platforms 
      with Mellanox InfiniBand may occasionally fail (Issue: 8592).
[FIX] HCL\Boards: Primary board ACPI SLOT information.
[FIX] HCL\Devices: Improved support for NVIDIA VGA/GPU devices 
      (Issue: 8670).
[FIX] Performance: Guest code patching (ultravirt) (Issue: 8614).
[FIX] Nested VM may freeze - regression: 9.0.3365.41.
[FIX] Nested VM with host running Linux kernels 
      4.20.13-1.el7.elrepo.x86_64 (RHEL) (Issue: 8501).
[FIX] Race during Linux kernel BUG() could cause system crash 
      (Issue: 8580).
[CHG] Flash: Properly shutdown device during restart to avoid 
      firmware freeze in next boot (Issue: 8659).
--------------------------------------------------------------------
Version 9.0.3365.51
[FIX] Flash: Correctly handle reset for WDC Ultrastar ME200 devices 
      (Issue: 8520).
[FIX] Flash: Warn if NVMe SSDs are not equally distributed between 
      NUMA nodes (Issue: 8632).
[FIX] HCL\Boards: Boards with unpopulated PCI slots (Issue: 8645).
[FIX] UI and boot: Fix system memory handling (system_memory 
      configuration key / F5 system settings).  Previously, in some 
      cases the value ignored.
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 8548).
[FIX] BSOD upon reboot in System-expansion (SYX) and 
      Memory-expansion (MEX).
[CHG] Performance: Improve evacuation performance.
[NEW] HCL\Boards: Support for boards with no HPET.
--------------------------------------------------------------------
Version 9.0.3365.41
[FIX] APIC: Handling IPI when delivery mode is not fixed (Issue: 
      8503).
[FIX] APIC: MSR access range (Issue: 8507).
[FIX] Flash: Model name includes ':'.
[FIX] HCL\Boards: ACPI SLIT info is corrupted if NUMA layout set to 
      Follow (mem_topology=0) (Issue: 8537).
[FIX] HCL\Boards: Critical fixes for AMD EPYC 7xx1 (Naples).
[FIX] HCL\Boards: Rare race with Nested VM - regression: 
      9.0.3365.11.
[FIX] HCL\Boards: UEFI boot with long memory map (Issue: 8522).
[FIX] HCL\Devices: AnyIO in System-expansion (SYX) mode - 
      regression: 9.0.3365.11.
[FIX] HCL\Devices: ASPEED VGA graphics mode with CentOS 7.3 (Issue: 
      8515).
[FIX] HCL\Devices: Improved support for NVIDIA VGA/GPU devices 
      (Issue: 8514).
[FIX] HCL\Devices: Several fixes for Microsemi Smart Family SCSI 
      controllers (Issue: 8435).
[FIX] HCL\Devices: VROC as boot device (Issue: 8516).
[FIX] Installer: 'in -n' with '-q' (Issue: 8499).
[FIX] Installer: Avoid using 'strings' command.
[FIX] Performance: CMR may lead to system lockup (and BSOD).
[FIX] UI and boot: boot_device ignored in UEFI - regression: 
      9.0.3365.2.
[FIX] UI and boot: Support for loading the OS from NVMe (Issue: 
      8512).
[FIX] vSMP Foundation Device: Correctly handle USB 2.x (EHCI) device 
      reset (Issue: 8456).
[FIX] Improved MWAIT handling.
[FIX] Nested VM NMI (vnmi) support (Issue: 8482).
[FIX] SPP may lead to error during Linux kernel initialization.
[FIX] System reset with Ubuntu 16.04 in legacy mode (Issue: 8523).
[CHG] HCL\Boards: Use primary board ACPI SLOT information for guest 
      (Issue: 8519, 8531).
[CHG] Installer: Allow execution on removable device (Issue: 8533).
[CHG] Performance: More robust Guest code patching (ultravirt).
[NEW] Support for RDTSC instruction emulation (Issue: 8560).
--------------------------------------------------------------------
Version 9.0.3365.11
[FIX] HCL\Boards: Critical fixes for AMD EPYC 7xx1 (Naples).
[FIX] Installer: Support for quiet installation with "-q".
[FIX] Installer: Validate user privileges (Issue: 8408).
[FIX] vSMP CTL: Warn if user privileges are insufficient to run 
      (Issue: 8407).
[FIX] vSMP Foundation Device: Improve partition compatibility 
      (Issue: 8246).
[FIX] vSMP Foundation Device: Update from 8.6 to 9.0 may require 
      reinstallation (Issue: 8304).
[FIX] Crash in System-expansion (SYX) mode - not seen by a customer 
      (Issue: 8437, 8462).
[FIX] Offlining CPU may crash the system (Issue: 8316, 8334, 8442).
[FIX] Rare race during memory evacuation (Issue: 7993, 8139, 8189, 
      8296).
[FIX] RHEL6 support (Issue: 8443).
[FIX] Theoretical memory corruption when loading OS in UEFI - not 
      seen by a customer.
[CHG] Improved Guest OS boot mode automatic detection.
[CHG] Installer: Enhanced System info data collection.
[CHG] Installer: SLES15 support in System-expansion (SYX) mode.
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: HPET read performance (Issue: 8403).
[NEW] HCL\Devices: Better support for Microsemi Smart Family SCSI 
      controllers.
[NEW] HCL\Devices: Improved support for AMD/ATI VGA/GPU devices.
[NEW] HCL\Devices: Improved support for NVIDIA VGA/GPU devices.
[NEW] Performance: Nested VM performance improvement.
[NEW] Report memory topology in accordance with physical topology 
      when NUMA layout (Guest OS view) set to Expand (or 
      mem_topology=2).
[NEW] Validated Linux kernels 4.20.13-1.el7.elrepo.x86_64 (RHEL) in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
[NEW] vSMP CTL: vsmpstat correctly reports #PTf. 
--------------------------------------------------------------------
Version 9.0.3365.2
[FIX] Diagnostics: Correctly report DHCP IP acquisition error 
      (Issue: 8037).
[FIX] Diagnostics: InfiniBand bandwidth test reports inconsistent 
      results (Issue: 8091).
[FIX] HCL\Boards: Avoid crash due to malformed SMBIOS (DMI).
[FIX] HCL\Boards: Boot from CDROM/DVDROM (Issue: 7938, 8282).
[FIX] HCL\Boards: InfiniBand backplane device behind VMD in 
      System-expansion mode (SYX).
[FIX] HCL\Boards: Memory regions below 4GB are missing when OS loads 
      in UEFI.
[FIX] HCL\Boards: SMBIOS (DMI) info is corrupted (Issue: 8181).
[FIX] HCL\Boards: System will not boot after BIOS update (Issue: 
      8112).
[FIX] HCL\Devices: Critical issue relating to HPSA devices (Issue: 
      7800, 8351).
[FIX] Installer: Some keys are overridden at boot (Issue: 7968).
[FIX] Partitioner: Merging two partitions ends with "System 
      Partitioner Error" (Issue: 8212).
[FIX] Performance: CMR may lead to system lockup (and BSOD).
[FIX] Performance: Several fixes to memory PINNING in 
      System-expansion mode (SYX).
[FIX] UI and boot: Degraded link rate warning may show up for 
      topologies with single node (Issue: 7990).
[FIX] UI and boot: Fixes to physical memory limit (board_memory) 
      (Issue: 8313).
[FIX] UI and boot: Loading OS from PXE when booting from UEFI 
      (Issue: 7984).
[FIX] UI and boot: OS installs in Legacy although Boot Mode is set 
      to UEFI (Issue: 7942).
[FIX] UI and boot: Screen will not refresh after UEFI boot file 
      selection (Issue: 8231).
[FIX] UI and boot: Several improvements to Devices tab (Issue: 
      8171).
[FIX] vSMP CTL: 'vsmpctl --cmr' to only accept integers (Issue: 
      8140, 8249).
[FIX] vSMP CTL: Don't exit the vsmpstat process if file write failed 
      (Issue 8040).
[FIX] vSMP CTL: Multiple profiling fixes (Issue: 8165).
[FIX] vSMP CTL: Partial command line parsing result with error 
      (Issue: 5571).
[FIX] vSMP CTL: Report feature list post kernel identification.
[FIX] vSMP Foundation Device: Improve compatibility for XHCI devices 
      (Issue: 8246).
[FIX] BSOD not in sync in System-expansion mode (SYX) in some rare 
      cases (Issue: 8108).
[FIX] Configuration key board_memory gets corrupted.
[FIX] Ignore saved_verion configuration key if booting vSMP 
      Foundation over network.
[FIX] Improved MWAIT handling.
[FIX] Intel VMX Preemption Timer virtualization.  Prior to this fix 
      exits could be missed.
[FIX] LAPIC version register is read-only.
[FIX] Mishandling of configuration keys with boolean value (Issue: 
      8059).
[FIX] Offlining CPU may crash the system (Issue: 8252, 8321, 8360).
[CHG] Flash: Adhere to RAB.
[CHG] Flash: Flash-expansion (FLX) NVMe to support up to 24 NVMe 
      devices.
[CHG] Flash: Format NAND to optimal LBAF at boot.
[CHG] Flash: Skip DSM if unsupported (Issue: 8291).
[CHG] HCL\Backplane: Alert if outdated Mellanox HCA firmware found 
      (Issue: 7989).
[CHG] HCL\Boards: Deliver MCE to Guest (Issue: 7955).
[CHG] HCL\Boards: Follow X2APIC BIOS mode if enabled (Issue: 8067).
[CHG] HCL\Boards: Ignore X2APIC BIOS mode if disabled by 
      configuration key.
[CHG] HCL\Boards: More robust VGA detection for both UEFI and legacy 
      more - even for systems with multiple displays.
[CHG] HCL\Boards: SMBIOS (DMI) socket info use only populated 
      sockets.
[CHG] HCL\Boards: Support HPET non-legacy interrupts.
[CHG] HCL\Devices: Improve PCI relocation logic to account for 
      multi-function devices.
[CHG] HCL\Devices: LSI MegaRAID support 64-bit SGEs (Issue: 8354).
[CHG] HCL\Devices: PMC PCIe switch - reset only first function.
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] HPET ACPI table to report no page protection.
[CHG] Installer: Alert when image creation fails when using 'bo'.
[CHG] Installer: Enhanced System info data collection.
[CHG] Installer: Image crated with 'bo -p' is designated for a 
      primary board only.
[CHG] Installer: Specify "recommended" only for question with 
      positive default response (Issue: 8077).
[CHG] Installer: Validate '-c' and '-k' order for 'up' and 'bo'.
[CHG] Installer: Validate 'in -n' when no NVMe device.
[CHG] Installer: Validate 'si -p' arguments.
[CHG] Installer: Validate file/directory permissions for 'bo -p' and 
      'si -s'.
[CHG] Installer: Validate user privileges when needed (Issue: 8299).
[CHG] Performance: Guest MMU performance - regression: 8.5.1955.1.
[CHG] Performance: More robust Guest code patching (ultravirt) 
      (Issue: 7956).
[CHG] UI and boot: Improved user friendly BSOD messages for common 
      hardware errors.
[CHG] UI and boot: Nested vendorclass used for PXE boot to follow 
      branding in the format {brand_name}.{abbreviation} (like 
      ScaleMP.vsmp).
[CHG] UI and boot: Update copyright to 2019.
[CHG] Avoid loading OS in UEFI in System-expansion (SYX) mode 
      (Issue: 8004).
[CHG] Improved Guest OS boot mode automatic detection (Issue: 8020, 
      8204).
[CHG] Improved Int13 specification compatibility.
[CHG] UEFI boot from dedicated partition.
[EOL] Flash: EOL - Xeon Phi x100 virtualization.
[EOL] HCL\Boards: Systems with no Hardware Virtualization (Intel 
      VMX, AMD SVM).
[NEW] HCL\Boards: Enable PCID and INVPCID command.
[NEW] HCL\Boards: Improve image layout compatibility with new BIOSes 
      (Lenovo, Dell) (Issue: 8287).
[NEW] HCL\Boards: Support for AMD EPYC 7xx1 (Naples).
[NEW] HCL\Boards: vSMP Foundation Device: USB device with Intel Xeon 
      E3 v6 processor family.
[NEW] HCL\Devices: Improved LSI MegaRAID Fusion-MPT performance in 
      System-expansion (SYX) mode.
[NEW] HCL\Devices: Improved support for NVIDIA VGA/GPU devices.
[NEW] HCL\Devices: Validated support for Intel Optane DC Persistent 
      Memory in memory mode and initial support for App-Direct mode.
      Intel Optane DC Persistent Memory in App-Direct mode are not
      yet functional.
[NEW] HCL\Devices: VMD hot plug support.
[NEW] Installer: Additional integrated performance tests (Segmented 
      SGEMM).
[NEW] Installer: Execute integrated performance tests via SSH 
      (Issue: 8347).
[NEW] Installer: Multiple fixes to integrated performance tests.
[NEW] Installer: Warn if partition is mounted as RAID (Issue: 8172).
[NEW] License: Network license manager updated to 13.0.1.
[NEW] Performance: Additional frequent pass-thru MSRs.
[NEW] Performance: Enhanced Guest code patching (ultravirt).
[NEW] Performance: Improved remote and local I/O performance for 
      devices not in AnyIO mode.
[NEW] Performance: Improved working set detection for 
      Memory-expansion (MEX) and Flash-expansion (FLX).
[NEW] Performance: Nested VM performance improvement.
[NEW] Performance: Reduced boot time.
[NEW] Performance: Significantly improved remote performance of LSI 
      MegaRAID Fusion-MPT and LSI Fusion-MPT SAS devices not used in 
      AnyIO mode (Issue: 8028).
[NEW] UI and boot: Improve responsiveness of System Settings (F5) 
      and Welcome Screen scroll by automatically turning off serial 
      redirection if unused (no key press).  Enabled by default in 
      System Settings (F5) by setting "Console Redirection" to 
      "Auto" (Issue: 8087).
[NEW] UI and boot: Restart system with CTRL-ALT-DEL during boot 
      phase.
[NEW] vSMP CTL: Allow multiple instances of vsmpstat to coexist 
      (Issue: 8046).
[NEW] vSMP CTL: Correctly report IRP for recent Linux kernels (such 
      as 4.18) in System-expansion mode (SYX).
[NEW] vSMP CTL: Report CPU and I/O board masks.
[NEW] vsmppp: Only install vsf_tools if newer then already installed 
      version.
[NEW] vsmppp: Revamp package management engine.
[NEW] Configuration key anyio_devX=bb:dd.f support for negative 
      logic.  Example anyio_devX=bb:!dd.!f.
[NEW] Linux kernel command-line options tuneup - add 
      "relax_domain_level=2" for System-expansion (SYX) mode.
[NEW] Nested VM NMI (vnmi) support.
[NEW] Support for Citrix XenServer 7.5 is PV mode (HVM/PVH not 
      supported).
[NEW] Support for Linux crashkernel (Issue: 7997).
[NEW] Validated Linux kernels 4.4.0-116-generic (UBUNTU), 
      4.4.140-94.42-default (SLES12SP3), 4.9.0-8-amd64 (DEBIAN), 
      4.18.16-300.fc29.x86_64 (FC), 4.20.12-1.el7.elrepo.x86_64 
      (RHEL) in Memory-expansion (MEX) mode and Flash-expansion 
      (FLX) mode.
[NEW] Xen and Xen dom0 command-line options tuneup based on system 
      configuration.  All options will be skipped if "vSF_add=no" is 
      added to the command-line.  Controlled command-line options 
      are (in order of appearance): 
      - iommu - always set to 'off'.
      - tdt - always set to 'false'.
      - x2apic - always set to 'off'.
      - dom0 - always set to 'pv'.
      - watchdog - if exists, set to '0'.
--------------------------------------------------------------------
Version 8.6.2535.142
[FIX] HCL\Boards: Correctly handle vector shared between MSI and 
      IOAPIC interrupts (Issue: 8237).
[FIX] HCL\Boards: e820 map handling in some configuration could lead 
      to an early failure.
[FIX] HCL\Boards: Error 878 for boards supporting screen resolution 
      of 800x600 only.
[FIX] HCL\Boards: More robust VGA detection, eliminating error 874.
[FIX] HCL\Boards: System with AMD processors does not boot (Issue: 
      7947).
[FIX] Performance: Guest code patching (ultravirt).
[FIX] DSDT ACPI table checksum error (since 8.6.2535.9).
[FIX] Emulation of INVEPT instruction.
[FIX] OS load stalls with kernel 3.10.0-957.1.3.el7.x86_64 and
      E5-2630 processor.
[FIX] System-expansion (SYX) may fail to boot in large config (since 
      8.6.2535.9) (Issue: 8268).
--------------------------------------------------------------------
Version 8.6.2535.126
[FIX] HCL\Boards: Access to AnyIO devices with addresses well beyond 
      DRAM address space (Issue: 8125).
[FIX] HCL\Boards: Avoid crash due to malformed SMBIOS (DMI).
[FIX] HCL\Boards: Correctly align ACPI port allocation (Issue: 
      8205).
[FIX] HCL\Devices: Capabilities hiding flow (Issue: 8221).
[FIX] Performance: CMR not working with Linux kernel 4.16 and on.
[FIX] Performance: Guest code patching (ultravirt): SLES12SP3 since 
      8.6.2535.57.
[FIX] UI and boot: Devices tab.
[FIX] Stability fix for AnyIO.
[FIX] System crash with when using 1GB pages in userspace.
[FIX] System will not load vSMP Foundation from UEFI, error may be 
      reported.
[FIX] UEFI boot file name detection (Issue: 8204).
[CHG] Correctly identify GPT boot partition with protective MBR 
      (Issue: 8041, 8205).
[NEW] Installer: Improved file corruption detection.
--------------------------------------------------------------------
Version 8.6.2535.113
[FIX] HCL\Boards: Crash at early OS start in Memory-expansion (MEX)
      mode (Issue: 8123).
[FIX] HCL\Boards: Improved VGA BIOS compatibility.
[FIX] HCL\Boards: System reset after GRUB during switch to legacy 
      VGA mode.
[FIX] Installer: "bo" need writable working directory.
[FIX] Installer: "in -n -k board_memory=" overridden at boot (Issue: 
      8115, 8161).
[FIX] Installer: Cleanup on CTRL-C.
[FIX] Installer: Multiple UI fixes.
[FIX] Installer: Silence error in Debian 9.x environment.
[FIX] License: Early crash during connection to network license 
      server (Issue: 8156).
[FIX] UI and boot: Several fixes for boot flow.
[FIX] DEBUG builds.
[FIX] Rare Linux kernel crash in System-expansion (SYX) (Issue: 
      8098).
[FIX] vsmplog may lead to system freeze (Issue: 8117).
[CHG] Record additional system state information at failure.
[NEW] Validated CentOS kernel 2.6.32-696.18.7.el6.x86_64 in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode
      (Issue: 8149).
--------------------------------------------------------------------
Version 8.6.2535.100
[FIX] HCL\Devices: Fix a crash of systems with Broadcom NetXtreme I 
      (1GigE, tg3) devices not in AnyIO mode (Issue: 8110).
[FIX] Installer: Multiple UI fixes.
[FIX] vSMP Foundation Device: Update XHCI devices (Issue: 8061).
[FIX] Cache size too small in System-expansion (SYX) mode since 
      8.5.1955.1 (Issue: 8018).
[FIX] OS loaded in UEFI cannot access ECAM PCI device access.
[FIX] Several stability fixes for AnyIO.
[CHG] HCL\Boards: Better handle iLo2 and Ilo3 systems (Issue: 7658, 
      8066).
[CHG] Installer: Enhanced System info data collection.
[NEW] Installer: Allow selecting devices to install.
[NEW] Installer: Warn if partition is used as SWAP.
[NEW] Performance: Improved Linux OS context switch time.
[NEW] vsmppp: Revamp package management engine.
[NEW] Debian support in Memory-expansion (MEX) and Flash-expansion 
      (FLX) modes. 
[NEW] HCL\Boards: Support for Intel Xeon E3 v6 processor family.  
      Maximum memory when AnyIO is in use, such as in 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes, is 
      limited to 512GB (Issue: 8027, 8111).
[NEW] Validated CentOS kernels 4.17.14-1.el7.elrepo.x86_64, 
      4.18.9-1.el7.elrepo.x86_64 in Memory-expansion (MEX) mode and 
      Flash-expansion (FLX) mode.
--------------------------------------------------------------------
Version 8.6.2535.77
[FIX] HCL\Boards: Better handle ACPI S5 sleep state so shutdown now 
      works correctly on additional boards (Issue: 8026).
[FIX] HCL\Boards: OS may not load on older Intel platforms after 
      update to 8.6.2535.10 or later.
[FIX] Installer: "up" command not working (Issue: 7311, 8035).
[FIX] Installer: Multiple fixes (Issue: 8007, 8008, 8009, 8010, 
      8013, 8014).
[FIX] Crash due to race when using AnyIO in System-expansion (SYX) 
      mode.
[CHG] Improved UEFI Guest OS boot mode automatic detection.
[NEW] Flash: Updated Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: Support ledctl utility for AHCI devices (Issue: 
      7981).
[NEW] HCL\Boards: Validated Flash-expansion (FLX) configuration with 
      384 CPUs, 38TB RAM, 8 NVMes.
[NEW] HCL\Devices: AnyIO auto-enablement for additional NVIDIA GPU 
      and GPGPU devices.
[NEW] HCL\Devices: Improve I/O performance in System-expansion (SYX)
      mode for devices not in AnyIO mode.
[NEW] HCL\Devices: Improve LSI MegaRAID Fusion-MPT performance in 
      System-expansion (SYX) mode.
[NEW] Installer: Use 'si -p' to run integrated performance tests.
[NEW] Performance: Further improve CR3 reloading latency, leading to 
      a shorter OS context switch time.
[NEW] Validated CentOS 7.5 kernel 3.10.0-862.11.6.el7.x86_64 when 
      used with SWAP.
--------------------------------------------------------------------
Version 8.6.2535.51
[FIX] HCL\Devices: VMD hot replace (Issue: 7949).
[FIX] Installer: Reboot lop for image created with "bo -x" (Issue: 
      7948).
[FIX] Installer: Remove "Supported NVMe SSDs not found. Exiting" if 
      all NVMes using device license.
[FIX] Performance: CMR not working in Linux PTI kernel environment.
[FIX] UI and boot: Alert if DIMM population is unbalanced or 
      sub-optimal, when sub-NUMA cluster (SNC) is on (Issue: 7999).
[FIX] UI and boot: Diagnostics device selection in System Settings 
      (F5) (Issue: 7953).
[FIX] UI and boot: Misaligned print in system message (Issue: 7943).
[FIX] UI and boot: Several fixes for boot flow.
[FIX] UI and boot: System stuck with error R062 (Issue: 7832).
[FIX] vSMP CTL: May end with crash or corrupted update in 
      System-expansion (SYX) mode.
[FIX] vSMP Foundation Device: Crash when accessing VFD connected to 
      XHCI (Issue: 7975).
[FIX] vSMP Foundation Device: Possible NVMe corruption during boot - 
      various scenarios (Issue: 8002).
[FIX] Crash due to race when using AnyIO in System-expansion (SYX) 
      mode.
[FIX] Crash when accessing InfiniBand Device in System-expansion 
      (SYX) mode.
[FIX] Installer: Multiple UI fixes (Issue:7988).
[FIX] OS loaded in UEFI may see difference CPU than the one exists.
[CHG] Installer: Enhanced System info data collection.
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] HCL\Boards: Fix ACS mode set by the BIOS (Issue: 7926, 7996).
[NEW] HCL\Boards: Handle MWAIT-disable by BIOS (Issue: 7962).
[NEW] HCL\Boards: Handle SMI decreasing turbo state.
[NEW] HCL\Devices: Intel 40 Gigabit Ethernet in System-expansion 
      (SYX) mode.
[NEW] HCL\Devices: Support for VROC.
[NEW] Installer: Improved image installation capability - support 
      for configuration key setting and file merge with "-k kev=val"
      and "-c CFG_FILE".
[NEW] Installer: Setup image as default boot device in UEFI mode.
[NEW] Installer: Support for quiet installation with "-q".
[NEW] Performance: Significant performance/stability issue in 
      System-expansion (SYX) mode.
[NEW] Linux kernel command-line options tuneup - 
      - nvidia.NVreg_RegistryDwords="ForceEnableHypervisor=1" - 
        expanded NVIDIA GPGPU device identification.
      - udev.children-max - set to 2 x number of CPUs on the 
        primary board in System-expansion (SYX) mode. 
[NEW] Support for hiding vSMP Foundation SMBIOS identity with 
      keep_smbios=yes configuration key.
--------------------------------------------------------------------
Version 8.6.2535.19
[FIX] HCL\Devices: Several fixes to Intel VMD.
[FIX] Installer: Change "in -p FILE" (without "-s FILE") to create 
      just primary file.
[FIX] Installer: Correct "in -b FILE" operation.
[FIX] Installer: Usage text.
[FIX] vSMP CTL: vsmpprof crash (Issue: 7885, 7915).
[FIX] vSMP Foundation Device: Located behind VMD (Issue: 7759, 
      7939).
[FIX] Emulation of SSE and AVX instructions.
[FIX] Fix configuration key cpu_boards key when used with multiple 
      boards.
[FIX] Rare system lockup in System-expansion (SYX) mode.
[CHG] Display full system message for serial crash logs.
[CHG] Memory footprint reduction.
[NEW] HCL\Devices: Enable Guest OS access to Intel VMD devices with 
      private device behind them.
[NEW] HCL\Devices: Remove hanging PCI-to-PCI bridges behind Intel
      VMD due to private device removal.
[NEW] Installer: "bo -t" to accept terms and conditions.
[NEW] Installer: Presents and prompts to accept terms and conditions 
      for boot image manipulation.
[NEW] License: Enable PXE boot of vSMP Foundation for 
      Flash-expansion (FLX) devices.
[NEW] Performance: Further improve CR3 reloading latency, leading to 
      a shorter OS context switch time.
[NEW] vSMP CTL: vsmpctl --tcs=accept to accept terms and conditions.
--------------------------------------------------------------------
Version 8.6.2535.10
[FIX] Diagnostics: InfiniBand Bandwidth and health test doesn't 
      complete (Issue: 7839).
[FIX] Flash: Systems with single NVMe may stuck at boot.
[FIX] HCL\Boards: Boot from CDROM/DVDROM (Issue: 7887, 7910).
[FIX] HCL\Boards: Private device NUMA node is not reported (Issue: 
      7821).
[FIX] HCL\Devices: Intel VMD BAR without 256MB alignment.
[FIX] Installer: Several fixes (Issue: 7908, 7928).
[FIX] License: Network license race (Issue: 7853).
[FIX] License: NVMe license recovery process change to avoid data 
      loss (Issue: 7873).
[FIX] vSMP Foundation Device: Located behind VMD.
[FIX] vSMP Foundation Device: Located on XHCI controller behind USB3 
      port (Issue: 7094).
[FIX] BSOD not showing boot device (Issue: 7918, 7925).
[FIX] Linux kernel command-line options tuneup for OS in UEFI boot 
      mode.
[FIX] Rare system crash (not observed by customer) (Issue: 7920).
[FIX] Several fixes to backplane_devX key management (Issue: 7820, 
      7892, 7893).
[FIX] System crash upon PCI PIO BAR update.
[CHG] HCL\Boards: Remove VGA BIOS dependency for OS in UEFI boot 
      mode.
[CHG] HCL\Devices: MSI-X interrupts for AnyIO devices to total of 
      6144 (was 4096).
[CHG] Performance: More robust Guest code patching (ultravirt).
[CHG] Support wider range BIOS int calls.
[CHG] UI and boot: Several fixes for boot flow (Issue: 7903, 7909, 
      7919, 7927).
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Report crash logs to serial.
[NEW] UI and boot: Support for loading the OS from NVMe.
--------------------------------------------------------------------
Version 8.6.2535.9
[FIX] HCL\Backplane: Probing InfiniBand fabric using product 
      branding (Issue: 7591).
[FIX] HCL\Boards: Correctly calculate and display minimum memory in 
      System Settings (F5) (Issue: 7686).
[FIX] HCL\Boards: Correctly handle CPU startup in case the BSP's 
      APICID is not 0 (Issue: 7830).
[FIX] HCL\Boards: e820 map parsing (Issue: 7703).
[FIX] HCL\Devices: System crash with LSI MegaRAID Fusion-MPT in 
      System-expansion (SYX) mode (Issue: 7894).
[FIX] Installer: Several fixes.
[FIX] License: Server-locked license for Memory-expansion (MEX) mode 
      (Issue: 7587, 7652, 7673, 7689, 7693).
[FIX] Improved MWAIT handling (Issue: 7701).
[FIX] IPMI SI fixes (Issue: 7668).
[FIX] Performance and correction for AnyIO devices sharing the same 
      naturally-aligned 4KB memory region simultaneously, across 
      boards.
[FIX] Rare system lockup (not observed by customer) (Issue: 7763).
[FIX] vSMP Foundation Device: Error 504 when booting from USB.
[CHG] HCL\Devices: Extend hardware compatibility list to support 
      complete PCI device classes:
      - Communication controller: Serial controller (0x0700).
      - Display controller (0x03).
      - Mass storage controller: IDE interface (0x0101).
      - Mass storage controller: Non-Volatile memory controller, NVM 
        Express (0x010802).
      - Mass storage controller: SATA controller (0x0106).
      - Network controller: Ethernet controller (0x0200) - Intel 
        (0x8086) only.
[CHG] HCL\Devices: Increasing number of AnyIO devices per board to 
      64.
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Installer: Correctly identify target NVMe devices using 
      product branding.
[CHG] Installer: Improve network license activation speed.
[CHG] License: NVMe license recovery process change to avoid data 
      loss.
[CHG] License: Socket-based licensing model (Issue: 7638).
[CHG] Performance: Improve evacuation performance in 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
[CHG] Performance: More robust Guest code patching (ultravirt).
[CHG] UI and boot: Additional boot time progress codes.
[CHG] UI and boot: Several fixes for boot errors (Issue: 7616).
[CHG] vSMP CTL: Better identification of private device NUMA node 
      (for --pinfo).
[CHG] ACPI table OEM Revision to list vSMP Foundation build number 
      for DSDT as well.
[NEW] HCL\Devices: Expanded support for LSI MegaRAID Fusion-MPT SAS 
      3.0 devices (SAS3008).
[NEW] HCL\Devices: Support Intel VMD.  NVMe devices behind each VMD 
      are available either as private device or to the Guest OS (but 
      not for both).
[NEW] Increase the number of PCI filters from 15 to 24 for 
      pci_dev_filterX, backplane_devX, anyio_devX.
[NEW] Installer: 'si' collect system information with '-s'.
[NEW] Installer: 'si' list of supported PCI devices with '-l' / 
      '-la'.
[NEW] Installer: Be more interactive.  Print during preparation 
      phase.
[NEW] Installer: Handling installation to pre-licensed NVMe devices.
[NEW] Installer: Presents and prompts to accept terms and conditions 
      during install, instead of during system boot.
[NEW] Installer: Support installation in UEFI OS.
[NEW] Performance: Additional frequent pass-thru MSRs.
[NEW] Performance: Guest code patching (ultravirt): nested VMs with 
      RHEL 7.4.
[NEW] Performance: Guest code patching (ultravirt): redzone 
      handling.
[NEW] Performance: Improved Linux OS context switch time.
[NEW] Performance: Nested VM performance improvement.
[NEW] UI and boot: Alert if DIMM population is unbalanced or 
      sub-optimal.
[NEW] UI and boot: Devices tab handle larger device list.
[NEW] UI and boot: Introducing user friendly BSOD messages for 
      common hardware errors.
[NEW] vSMP CTL: Several fixes to command UI.
[NEW] vSMP CTL: stats to account for ultravirt time.
[NEW] vSMP CTL: vsmpctl --tcs presents and prompts to accept terms 
      and conditions during install, instead of during system boot.
[NEW] vSMP CTL: vsmpstat st (system traffic: --st) adding --level=0 
      support.
[NEW] vSMP Foundation Device: Support USB 3.x (XHCI) boot behind 
      hub.
[NEW] BSOD on system lockup.
[NEW] Control system boot mode with 'boot_mode' configuration key.  
      Possible values: 'legacy' / 'uefi'.  If key undefined, legacy 
      will be tried first, then uefi.
[NEW] Correctly report PKU support in CPUID. 
[NEW] Initial support for PCI BAR updates.
[NEW] Memory footprint reduction - grow internal structures at 
      runtime.
[NEW] SR-IOV device capability removal.
[NEW] Support for PCI extended configuration space access.
[NEW] Support loading OS in UEFI boot mode in Memory-expansion (MEX)
      mode and Flash-expansion (FLX) mode.
[NEW] Validated CentOS 7.4 kernel 3.10.0-693.21.1.el7.x86_64 in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
--------------------------------------------------------------------
Version 8.5.1955.150
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT in large HDD 
      configuration (Issue: 7837).
[FIX] Installer: Correct "bo -f" operation.
[FIX] Installer: Usage.
[FIX] Performance: Several fixes to memory PINNING in 
      System-expansion mode (SYX).
[FIX] AnyIO devices sharing the same naturally-aligned 4KB memory 
      region simultaneously, across boards.
[FIX] Avoid system lockup under high memory pressure (Issue: 7755).
[FIX] Improved MWAIT handling.
[FIX] Possible memory corruption on high concurrency access to ECAM 
      range (not seen by a customer) (Issue: 7835).
[FIX] Rare nested VM memory corruption issue (Issue: 7189).
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Installer: Themes update.
[CHG] SSE and AVX instruction emulation robustness.
[NEW] HCL\Devices: Alert and halt boot process if Intel VMD enabled
      in BIOS (Issue: 7758).
[NEW] Several Nested VM performance and stability improvement.
[NEW] SMEP support.
--------------------------------------------------------------------
Version 8.5.1955.128
[FIX] HCL\Boards: Log and ignore non-critical IOMMU errors.
[FIX] HCL\Boards: Systems with Reserved Memory Region is used (RMRR) 
      (Issue: 7522).
[FIX] HCL\Devices: Critical issue relating to HPSA devices (Issue: 
      7800).
[FIX] Performance: Regression: 8.5.1955.109.
[FIX] vSMP CTL: stats correctness (Issue: 7747).
[FIX] 4.15.12-1.el7.elrepo.x86_64 KVM may crash.
[FIX] Fix emulation of CRC32 instructions.
[FIX] Rare crash in System-expansion (SYX) mode (not seen by a 
      customer) (Issue: 7763).
[CHG] Performance: More robust Guest code patching (ultravirt) 
      (Issue: 7774).
[CHG] Improved vSMP Foundation heartbeat (keep alive) mechanism 
      (Issue: 7771).
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Flash: Intel NVMe SSD latest firmware release (Issue: 7775).
[NEW] Installer: Handle process termination during upgrade.
--------------------------------------------------------------------
Version 8.5.1955.109
[FIX] HCL\Boards: Correctly handle secondary board devices in 
      IO-expansion (IOX) mode (Issue: 7751).
[FIX] HCL\Devices: Broadcom NetXtreme-C/E device preventing system 
      boot (Issue: 7738).
[FIX] HCL\Devices: Critical AHCI issue (Issue: 7688).
[FIX] HCL\Devices: HPSA device access in System-expansion (SYX) 
      mode.
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT not booting in 
      System-expansion (SYX) mode (Issue: 7750).
[FIX] License: Fix license verification error.
[FIX] License: Fixes to Guest OS (dmesg and console) notification on 
      unlicensed system (Issue: 7661).
[FIX] Performance: Concurrent memory requests (CMR) may be disabled.
[FIX] UI and boot: More fixes to physical memory limit 
      (board_memory) (Issue: 7697).
[FIX] vSMP Foundation Device: Critical error affecting recovery of 
      failure log from NVMe devices.
[FIX] vSMP Foundation Device: Critical error preventing recording 
      more than one failure log in rare cases.
[FIX] vSMP Foundation Device: Restore USB controller status.
[FIX] vSMP Foundation Device: Support USB 3.x (XHCI) boot (Issue: 
      7663).
[FIX] Restore Guest state if log retrieval stopped during operation.
[FIX] System crash during parallel memory allocation, or during 
      vsmpprof (Issue: 7705).
[CHG] APIC: Defualt to APIC physical interrupt delivery mode.
[CHG] HCL\Boards: Increase UEFI boot error reporting granularity.
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Performance: Faster response to page-table updates.
[CHG] Performance: Nested VM may crash when launching many nested 
      VMs (Issue: 7732).
[CHG] Performance: Nested VM performance improvement.
[CHG] Improved Meltdown/Spectre exploits mitigation support.
[CHG] Improved vSMP Foundation heartbeat (keep alive) mechanism.
[NEW] APIC: IPI delivery performance improvements.
[NEW] Flash: Complex PCIe hierarchy support.
[NEW] HCL\Devices: Reduce MSI-X interrupt latency.
[NEW] Installer: Validate license files.
[NEW] Performance: Performance of boards with large core count.
[NEW] Performance: Significant improvements for Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.
[NEW] Validated Linux kernels RHEL: 3.10.0-693.11.6.el7.x86_64, 
      3.10.0-693.17.1.el7.x86_64, 4.15.12-1.el7.elrepo.x86_64; SLES: 
      4.4.103-6.38-default; Community 4.15.3 in Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.
--------------------------------------------------------------------
Version 8.5.1955.37
[FIX] License: Fixes to Guest OS (dmesg and console) notification on 
      unlicensed system (Issue: 7661).
[FIX] License: Server-locked license expiration (Issue: 7654).
[FIX] Rare system crash in System-expansion (SYX) mode (Issue: 
      7681).
[FIX] UI and boot: Several fixes to physical memory limit 
      (board_memory).
[FIX] vSMP CTL: vsmpstat fix: CPU restart (Issue: 7656).
[FIX] vSMP Foundation Device: Support USB 3.x (XHCI) boot (Issue: 
      7663, 7675).
[CHG] vSMP CTL: prof/stats read speed improvement (up to 300x).
[CHG] Improved Meltdown/Spectre exploits mitigation support.
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Linux kernel command-line options tuneup - add 
      "transparent_hugepage=always" unless 
      "transparent-hugepage=never" is being used.
[NEW] Set the default NUMA layout (Guest OS view) for 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes to 
      Expand.  Only affects new installations.
[NEW] Validated CentOS 7.4 kernel 3.10.0-693.11.6.el7.x86_64 in 
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
[NEW] Validated Linux kernel 4.14.16 in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes.
--------------------------------------------------------------------
Version 8.5.1955.14
[FIX] License: Improved handling of device-based license expiration.
[FIX] License: Secondary nodes handling of server-locked license 
      (Issue: 7605).
[FIX] Partitioner: Secondary node stuck after merge (Issue: 7623).
[FIX] Possible crash in System-expansion (SYX) mode (not seen by a 
      customer) (Issue: 7625).
[FIX] UI and boot: Several fixes to physical memory limit 
      (board_memory).
[FIX] vSMP CTL: profiling fixes: single board (Issue: 7610).
[FIX] vSMP Foundation Device: Correctly handle superspeed devices 
      (Issue: 7646).
[FIX] vSMP Foundation Device: Device access error.
[FIX] vSMP Foundation Device: Improved update error handling (Issue: 
      7617).
[FIX] Access PCI-to-PCI bridge in System-expansion (SYX) mode 
      (Issue: 7635).
[FIX] AnyIO devices sharing the same naturally-aligned 4KB memory 
      region simultaneously, across boards.
[CHG] Installer: Message text.
[CHG] Performance: Improve idle performance resulting in up to 10% 
      application performance increase.
[CHG] vSMP Foundation Device: Deprecating vsmpctl '--vfd=on' 
      parameter.
[NEW] Installer: Enforce vsmptools branding.
[NEW] vSMP CTL: vsmpctl --binfo reports private device NUMA node.
[NEW] Meltdown/Spectre exploits mitigation support.
[NEW] Validated Linux kernel 4.14.13 in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes.
[NEW] Validated RHEL6.9 and RHEL7.4 latest kernels.
--------------------------------------------------------------------
Version 8.5.1955.1
[FIX] UI and boot: Prevent changing expansion mode in 
      Flash-expansion (FLX) mode (Issue: 7465).
[FIX] Flash: Expired licenses may corrupt data if the device with 
      the expired license is used in the very next boot.
[FIX] HCL\Boards: Handling of 'cpus_per_socket' key (Issue: 7415, 
      7489).
[FIX] HCL\Boards: Systems with Reserved Memory Region is used (RMRR) 
      may crash (Issue: 7536).
[FIX] HCL\Devices: Avoid crash on systems with more than 4 Broadcom 
      NetXtreme I (1GigE, tg3) devices in System-expansion (SYX) 
      mode.
[FIX] HCL\Devices: Correctly handle PCI BAR restore (Issue: 7520, 
      7525).
[FIX] HCL\Devices: Critical issue with AHCI devices that could lead 
      to system crash (Issue: 7248).
[FIX] HCL\Devices: Support for Intel Storage Controller Unit (SCU) 
      with Linux kernel 4.4 or later in System-expansion (SYX) mode 
      (Issue: 7393).
[FIX] Partitioner: Cancelling merge leads to system crash (Issue: 
      7604).
[FIX] Partitioner: Correctly handle partition lock/unlock after 
      changing expansion mode (Issue: 7499).
[FIX] UI and boot: Fix system memory handling (system_memory 
      configuration key / F5 system settings).  Previously, in some 
      cases the value ignored (Issue: 7582).
[FIX] UI and boot: Improve baton stability.
[FIX] vSMP CTL: profiling fixes: full profiling accounts for post 
      system event, correctly report group members, correctly report 
      flags.
[FIX] vSMP CTL: vsmpstat fixes: idle accounting, others.
[FIX] vSMP Foundation Device: Log device must be created 
      specifically for that purpose (using 'in -bl' options).
[FIX] AnyIO issue that may lead to crash on System-expansion (SYX) 
      configurations (not seen by a customer).
[FIX] Correctly handle VMCALL and VMPTRST instructions.
[FIX] Correctly handle XSAVES and XRSTORS instructions.
[FIX] Do not crash on unsupported PIC OCW2 operations.
[FIX] Fix emulation of SHIFT instructions.
[FIX] No crash logs for systems with HT disabled.
[FIX] Rare system lockup immediately after OS load.
[FIX] ssh terminates under load (Issue: 7470).
[FIX] System crash when turning off concurrent memory requests (CMR) 
      for systems with HT disabled (Issue: 7484).
[CHG] UI and boot: Increase the wait time prior to auto-boot, if 
      partition is not locked (Issue: 7585) - System-expansion (SYX) 
      and Memory-expansion (MEX) modes.
[CHG] Diagnostics: Improve the process of saving diagnostics to USB.
[CHG] HCL\Boards: Disable PCID.
[CHG] HCL\Devices: Mellanox InfiniBand support for guest is 
      permitted for one board only (Issue: 7443).
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Installer: Message text.
[CHG] Installer: Rename vsf_installer.sh to vsmp_installer.sh.
[CHG] License: Network license agent improved diagnostics info and 
      stability.
[CHG] License: Updated licenses CPU list classification.
[CHG] Performance: Improve batched operations.
[CHG] Performance: Improve idle performance (HLT/MONITOR/MWAIT).
[CHG] Performance: Improved concurrent memory requests (CMR) learn 
      and forget algorithm.
[CHG] Performance: More robust Guest code patching (ultravirt).
[CHG] Performance: Nested VM performance improvement.
[CHG] UI and boot: Update copyright to 2018.
[CHG] vSMP Foundation Device: Device (USB) access with use OS 
      bind/unbind interface prior to accessing it.
[CHG] vSMP Foundation Device: Improve boot identification and remove 
      errors 700-710.
[EOL] Flash: EOL - Flash-expansion (FLX) supported devices: Diablo 
      MCS devices (IBM eXFlash DIMM and SanDisk ULLtraDIMM).
[EOL] HCL\Devices: EOL - Diablo MCS devices (IBM eXFlash DIMM and 
      SanDisk ULLtraDIMM).
[EOL] HCL\Backplane: EOL - Intel True Scale HCAs.
[NEW] Flash: Improved Flash-expansion (FLX) performance for NVMe 
      devices.
[NEW] Flash: Intel NVMe SSD experimental mode.
[NEW] HCL\Backplane: Support for Mellanox ConnectX-5 EDR HCAs.
[NEW] HCL\Boards: Support for TSC_DEADLINE - in Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.
[NEW] HCL\Boards: Support for UEFI boot without any legacy BIOS 
      (including legacy VGA) support (and removal of error 1311).
[NEW] HCL\Devices: Better handling of PCI-to-PCI bridges.
[NEW] HCL\Devices: Handle FLR.
[NEW] Installer: 'bo' supports section removal with '-c' / '-w' / 
      '-b' pointing to /dev/null.
[NEW] Installer: 'in' supports introduce server-based licensing with 
      '-d', replacing '-b' in some cases.
[NEW] Installer: 'in' supports installation to file with '-n' / '-b' 
      / '-d'.
[NEW] Installer: Better handling of non-supported NVMe SSDs.
[NEW] Installer: Change license agent default installation directory 
      to /usr/local/bin.
[NEW] Installer: Product branding controls the installation of 
      network license agent.
[NEW] Installer: Product branding sets the first 4 letters for 
      vsmptools (vsmpctl, vsmplog, vsmpprof, vsmpstat, vsmpversion) 
      as well as license agent and server executable name.  Previous 
      instance of vsmptools (non-branded) will be removed.
[NEW] Installer: Rename license agent (vsf_lmgr_agentd -> vsmplmgrd) 
      and server (vsf_lmgrd -> vsmplmgr) executable name.
[NEW] Installer: SUID is set based on user decision.
[NEW] Installer: Warn and exit if running in Cygwin.
[NEW] License: Introduce server-locked license for Memory-expansion 
      (MEX) mode.
[NEW] Performance: Further improve CR3 reloading latency, leading to 
      a shorter OS context switch time.
[NEW] Performance: Improved AnyIO performance for Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.
[NEW] Performance: More efficient cache management - up to 15% 
      improved performance.
[NEW] Performance: Single process memory initialization speed.
[NEW] UI and boot: Control the amount of physical memory used on 
      primary board via System Settings (F5) or using board_memory 
      configuration parameter.
[NEW] UI and boot: Devices tab allows "Reset to Defaults" with F9.
[NEW] UI and boot: Graphical mode compatibility improvement for both 
      UEFI and legacy BIOS modes (Issue: 7581).
[NEW] vSMP CTL: Add vSMP Foundation Device info SMBIOS (DMI) 
      information changes to Type 11 (OEM Strings) structure.
[NEW] vSMP CTL: vsmpctl --binfo reports current SMART info (and not 
      cached one).
[NEW] vSMP CTL: vsmpversion flags changes:
      - --full - will be deprecated.
      - --long - version with no system topology details. - -v - 
      version with some system topology details. Multiple v can be 
      added to increase system topology detail level.
[NEW] vSMP CTL: Write protection for read-only PCI BARs.
[NEW] vSMP Foundation Device: Do not filter USB 2.x (EHCI) devices 
      that has USB 1.0 device.
[NEW] vSMP Foundation Device: Support USB 3.x (XHCI) boot.
[NEW] vSMP Foundation Device: USB 1.0 (UHCI) devices will work in 
      AnyIO mode.
[NEW] Two (or more) AnyIO devices, located on different boards, can 
      now access the same naturally-aligned 4KB memory region 
      simultaneously.
[NEW] Validated Linux kernel 4.11.12, 4.12.9 and 4.14.6 in 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
--------------------------------------------------------------------
Version 8.2.1455.104
[FIX] Flash: NVMe SSD to socket assignment fix.
[FIX] UI and boot: Fix system memory handling (system_memory 
      configuration key / F5 system settings).  Previously, in some 
      cases the value ignored.
[FIX] vSMP CTL: stats to correctly account for concurrent memory 
      requests (CMR).
[FIX] vSMP CTL: stats to correctly handle system with HT disabled 
      (Issue: 7409, 7419).
[FIX] Boot warning on Linux kernel 4.4 (Issue: 7461).
[FIX] Fix emulation of REP instruction.
[FIX] Rare race leading to memory corruption (not seen by a 
      customer) (Issue: 7413, 7521).
[FIX] Rare race leading to system crash (Issue: 7447).
[FIX] System crash in System-expansion (SYX) mode using AnyIO remote 
      memory access (Issue: 7432).
[CHG] Guest code patching (ultravirt) improvements (Issue: 7479, 
      7501).
[CHG] HCL\Boards: Increase number of supported IOAPICs per board to 
      20 (Dell R940 requires 17).
[CHG] License: Network license agent improved diagnostics info.
[CHG] Performance: Critical improvement for idle performance in 
      System-expansion (SYX) mode (HLT/MONITOR/MWAIT).
[CHG] UI and boot: Several fixes for Devices tab.
[NEW] HCL\Devices: Initial support for Intel Omni-Path.
[NEW] HCL\Devices: Support for LSI Fusion-MPT SAS 3.0 and LSI 
      MegaRAID Fusion-MPT SAS 3.0 devices.
[NEW] Installer: Improve compatibility.
[NEW] Installer: Ubuntu support (Issue: 7492).
[NEW] Installer: Warn if running in UEFI (Issue: 7453).
[NEW] Several Nested VM performance and stability improvement.  
      Certain KVM VMs operations measured to run 100x faster (Issue: 
      7542).
--------------------------------------------------------------------
Version 8.2.1455.74
[FIX] HCL\Boards: Boards with >5.8TB will fail to boot.
[FIX] Performance: Several fixes to memory PINNING in 
      System-expansion mode (SYX).
[FIX] Cache size too large on systems with memory-less processors.
[FIX] Rare system crash (not seen by a customer) (Issue: 7447).
[FIX] RHEL7.2 KVM may crash (Issue: 7428).
[FIX] RHEL7.3 KVM will not start in some memory layouts (Issue: 
      7424).
[CHG] HCL\Devices: Set USB 1.0 (UHCI) devices to AnyIO mode if not 
      used for vSMP Foundation Device.
[CHG] Performance: Improve idle performance (HLT/MONITOR/MWAIT).
[CHG] Improve internal log of failed NVMe commands.
[NEW] Performance: NNA defaults to on if system NUMA layout (Guest 
      OS view) set to Expand (or mem_topology=2).
[NEW] Support for RHEL7.4 (Issue: 7376).
--------------------------------------------------------------------
Version 8.2.1455.56 
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT SAS 2.0 device not used
      in AnyIO crash with LSI Storage Authority installation (Issue: 
      7410).
[CHG] Installer: Sync after vsmptools installation to avoid binary 
      corruption due to uncleaned shutdown.
[CHG] Linux kernel command-line options tuneup - always add 
      "intel_iommu=off". 
[NEW] Flash: Support for systems with memory-less processors.
[NEW] HCL\Boards: Purley platform System-expansion (SYX) mode 
      validation. 
[NEW] HCL\Devices: Support for LSI MegaRAID Fusion-MPT SAS 2.0 
      driver 07.700.00.00-rh1 (device not used in AnyIO). 
--------------------------------------------------------------------
Version 8.2.1455.50
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT SAS 2.0 device not used 
      in AnyIO crash with latest firmware. 
[FIX] Performance: Critical fix to memory PINNING.
[FIX] Performance: HLT/MONITOR/MWAIT handling (Issue: 7387, 7397).
[FIX] Correctly report the lack of AMD IBS support.
[FIX] Rare system crash (not seen by a customer) (Issue: 7392).
[FIX] System-expansion (SYX) and Memory-expansion (MEX) mode - 
      system restart after inserting license (Issue: 7381).
[FIX] System-expansion (SYX) rare system-crash during instruction 
      emulation.
[CHG] UI and boot: Several fixes for Devices tab (Issue: 7382).
[CHG] System-expansion (SYX) and Memory-expansion (MEX) mode - 
      better backplane timeout reporting.
[NEW] HCL\Boards: Support for Intel C620 (Lewisburg) chipset Super 
      SKUs.
[NEW] Internal log improvements.
--------------------------------------------------------------------
Version 8.2.1455.29
[FIX] HCL\Boards: Crash when Reserved Memory Region is used (RMRR).
[FIX] vSMP CTL: vsmpstat file-descriptor runoff.
[FIX] Guest OS might crash with NULL pointer dereference during boot
      in System-expansion mode.
[FIX] Performance: Guest code patching (ultravirt): avoid code
      collisions (Issue: 7349).
[FIX] System may freeze at boot.
[CHG] Installer: vsmptools installation and update UI (Issue: 7374).
[CHG] vSMP CTL: Improved vsmpstat periodic time slice measurement.
[CHG] vSMP CTL: vsmpstat exit code change in bad termination (0->1). 
[NEW] HCL\Devices: Control AnyIO device level enablement 
      (anyio_devX) via System Settings (F5) in Memory-expansion
      (MEX) and Flash-expansion (FLX) modes.
[NEW] Performance: Improved 4KB Guest page-table management.
[NEW] vSMP Foundation Device: Support USB 3.x (XHCI) boot in 
      Flash-expansion (FLX) mode.
--------------------------------------------------------------------
Version 8.2.1455.6 
[FIX] HCL\Backplane: Boot may hang if primary board has multiple 
      ports where some are disconnected (Issue: 6623).
[FIX] HCL\Backplane: Memory allocation when backplane_dev is set to 
      !*:!*.!* (Issue: 7336).
[FIX] HCL\Boards: Memory corruption on boards with host bridge that 
      has a non-zero interrupt pin (Lenovo x3550m5) (Issue: 7322).
[FIX] HCL\Devices: Issue with LSI MegaRAID Fusion-MPT SAS 2.0 not 
      used in AnyIO, that could lead to a system crash (not seen by 
      a customer) (Issue: 7275).
[FIX] Installer: 'in' with -mq flags should not wait for 
      installation path (Issue: 7303).
[FIX] Installer: Alternative image file using 'bo' with -f flag 
      produce error 791 (Issue: 7300).
[FIX] Installer: Correct message of 'in' with -n flag.
[FIX] Installer: Correctly name image files when 'bo' is used 
      (Issue: 7293).
[FIX] Installer: Dump config using 'bo' with -d flag prints 
      "Configuration dump:" header which confuse 'bo' with -c flag.
[FIX] Installer: Dump config using 'bo' with -d flag produce error 
      if image has no config (Issue: 7298).
[FIX] Installer: Merge config using 'up' with -c flag reports "File 
      config not found" (Issue: 7342).
[FIX] Installer: up flag -m should not be used without -c or -d.
[FIX] Installer: Use bash instead of systems default shell (for 
      installation on Ubuntu and Debian).
[FIX] License: Network license error 271 produce incorrect message 
      (Issue: 2769).
[FIX] vSMP CTL: Profiling buffer allocation.
[FIX] vSMP CTL: Profiling buffer has large chunk of zeroes.
[FIX] vSMP CTL: vsmpctl may hang SLES12 SP2 (and any Linux 3.11 
      kernel and on) in System-expansion (SYX) mode when using 
      memory PINNING (Issue: 7310).
[FIX] vSMP CTL: vsmpprof may crash the system if statistics are 
      active (Issue: 7264).
[FIX] vSMP CTL: vsmpprof memory corruption during graph creation.
[FIX] vSMP CTL: vsmpstat SEGV on native.
[FIX] vSMP Foundation Device: Fixed update for USB 1.x (UHCI) 
      devices.
[FIX] vSMP Foundation Device: Guest access to vSMP Foundation device 
      on EHCI interface using --vfd=on may fail with 'No medium 
      found' error (Issue: 7122).
[FIX] BSOD may not show up.
[FIX] Critical issue in HPET transition from legacy to non-legacy 
      and back (affecting Citrix XenServer 7.0).
[FIX] Rare system crash in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes when memory size of primary board 
      is significantly larger than one or more secondary boards.
[FIX] Upgrade program may get stuck in System-expansion (SYX) mode 
      when primary board has less CPUs than others (Issue: 7311).
[FIX] vSMP CTL: vsmpstat not working on boards with 320 or more 
      CPUs.
[CHG] Flash: Better handling of system with high ratio of CPUs per 
      NVMe SSD, observed on Lenovo x3950 X6 with single NVMe SSD 
      with 32 queues.
[CHG] Flash: Correctly handle power states (Issue: 7265).
[CHG] Flash: Improved Flash-expansion (FLX) NVMe initialization 
      process for robustness.  Format command will not be used at 
      boot time.
[CHG] Flash: Support for longer NVMe SSD format operations.
[CHG] HCL\Boards: Use ACPI to read HPET address if LPC access (or 
      reading) fails.
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] Installer: Clearly report vsmptools installation progress, 
      errors and completion.
[CHG] Installer: Skip optimal LBAF format for Intel DC P4800X NVMe 
      if current LBAF ms=0 and ds<=12.
[CHG] Installer: Support drives with up to 128GB for 'in' with -b 
      flag.
[CHG] UI and boot: Align backplane link rate report (Issue: 7174).
[CHG] UI and boot: Align System Settings (F5) Hardware tab fields 
      (Issue: 7313).
[CHG] vSMP CTL: Improved vsmpctl help.
[CHG] vSMP CTL: Increase profiling buffer size to reduce lost events 
      in large machines.
[CHG] vSMP CTL: Prohibit use of --cpu-boards and --io-boards in 
      Flash-expansion (FLX) mode (Issue: 7231).
[CHG] Improve PAT handling for Citrix XenServer 7.0 support.
[CHG] System memory layout changed to increase amount of free memory 
      below 4GB (Issue: 7143).
[NEW] Flash: Warn if number of NVMe SSDs is smaller than the number 
      of processor Sockets (Issue: 7326).
[NEW] Flash: Warn if NVMe SSDs are not equally distributed between 
      NUMA nodes (Issue: 7326).
[NEW] HCL\Boards: Expand use of APIC virtualization (APICv) if 
      available - for improved performance.
[NEW] HCL\Boards: Handle APIC's directed EOI flag (for Citrix 
      XenServer 7.0 support).
[NEW] HCL\Boards: Memory-expansion (MEX) and Flash-expansion (FLX) 
      modes to follow board APIC/X2APIC cluster model and 
      destination mode (ACPI FADT flags bits 18-19).
[NEW] HCL\Boards: Support for Intel C620 (Lewisburg) chipset. 
[NEW] HCL\Devices: AnyIO device level enablement (anyio_devX) will 
      apply independently from board level enablement 
      (anyio_boards).  Now these keys can be enable and disabled 
      devices independently from each other.  This simplifies adding 
      non-supported devices to a system. 
[NEW] Installer: 40% size reduction.
[NEW] Installer: Check for network connectivity before using it.
[NEW] Installer: Passed firewall compliance tests.
[NEW] Installer: Improved handling of installation to mounted 
      devices and warn if target device has a filesystem.
[NEW] Installer: Install vsmptools when 'in' used with -n or -b 
      flags.
[NEW] Installer: Show progress bar when initializing NVMe devices 
      (Issue: 7258).
[NEW] Installer: Validate installation device selection.
[NEW] Performance: Allow fast-path handling of Linux's madvise 
      (MADV_DONTNEED) syscall.  Disabled by default.
[NEW] Performance: Faster page-table updates. Up to 100x in 
      micro-benchmarks. Up to 40% improvement in 4KB memory 
      allocators (jemalloc).
[NEW] Performance: Guest code patching (ultravirt): improve TLB 
      flushing speed.
[NEW] Performance: Improved Linux OS context switch time.
[NEW] Performance: Improved memory map work distribution between 
      multiple CPUs and scalability.  Also improve sequential writes 
      for Flash-expansion (FLX) mode.
[NEW] Performance: Improved AnyIO performance for Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.  Up to 50% improvement 
      for small-size IO.
[NEW] Performance: Improved HLT/MONITOR/MWAIT handling.  Up to 15% 
      improvement in mixed workloads.
[NEW] UI and boot: Added progress indicator for Loading Operating 
      System stage (Issue: 7305).
[NEW] UI and boot: Warn if AMD virtualization (SVM) is not 
      enabled/supported by BIOS (Issue: 7324).
[NEW] UI and boot: Warn if memory settings are too low (Issue: 
      7267).
[NEW] vSMP CTL: Granular permission control with  
      /usr/local/etc/vsmpctl.conf. Documentation in that file as 
      well.
[NEW] vSMP CTL: vsmpstat output file size reducion by 50% or more 
      in Memory-expansion (MEX) mode and Flash-expansion (FLX) mode. 
[NEW] vSMP CTL: vsmpstat revamped for stand-alone periodic data 
      collection (Issue: 7361):
      - Compressed output support.  Can be controlled by 
        --compress=yes|no.  Default is yes.
      - New output flag: --outfile[=filename].  Will save to file 
        without any output.  Can be used without filename, which 
        will save to stat.<DATE>.stat.  The --output will be 
        deprecated.
      - Allow running periodically and one shot in parallel.  New 
        flag --exclusive will prevent one-shot as before.
      - Periodic run (using delay) will reset stats.
      - Periodic run (using delay) will start stats if stopped.
      - Periodic run (using delay) will collect system info if used 
        with --outfile[=filename].  Display with --sys. 
      - Improved help.
[NEW] Correctly handle local-APIC one-shot timer mode (SLES 12 SP2 
      and Citrix XenServer 7.0).
[NEW] Instruction emulation required for Citrix XenServer 7.0.
[NEW] Linux kernel command-line options tuneup - add "nokaslr". 
[NEW] Revamped NX bit handling (for Citrix XenServer 7.0 support).
[NEW] Validated Linux kernels 4.7 to 4.11 in Memory-expansion (MEX) 
      mode and Flash-expansion (FLX) mode. 
[NEW] Various local-APIC timer issues (Citrix XenServer 7.0).
--------------------------------------------------------------------
Version 8.1.1145.57
[FIX] HCL\Boards: Correctly handle boards with mixed IOMMU snoop 
      control support (System-expansion (SYX) mode).
[FIX] HCL\Boards: Resolve Flash-expansion (FLX) boot Error 104. 
[FIX] HCL\Boards: Resolve Flash-expansion (FLX) boot Error 249 
      (Issue: 7333).
[FIX] Installer: Removing leftover file.
[FIX] Nested VM issue with Intel Xeon v3 and later (Issue: 7307). 
[CHG] HCL\Boards: Better hotplug device detection.
[NEW] HCL\Devices: Support for USB 3.0 (XHCI) devices in AnyIO mode 
      only.
[NEW] Initial support for Linux kernel 4.11 (Issue: 7334).
--------------------------------------------------------------------
Version 8.1.1145.43
[FIX] Installer: Error messages when some NVMe SSDs are not 
      supported.
[FIX] Installer: Removing leftover file.
[FIX] Installer: Theme removed during upgrade or network boot 
      (Issue: 7285).
[FIX] vSMP Foundation Device: Error 279 when booting from USB device 
      (legacy).
[FIX] vSMP Foundation Device: Error 850 when booting from UEFI 
      (Issue: 7286).
[FIX] CPU wakeup in System-expansion (SYX) mode (Issue: 7281).
[FIX] System crash in System-expansion (SYX) mode using AnyIO remote 
      memory access.
[CHG] UI and boot: Increased OS PXE boot DHCP timeout.
[NEW] Image Manager: -k accepts section name, in format of 
      SECTION:KEY=VALUE.
[NEW] vSMP Foundation Device: Enhanced UEFI boot functionality to 
      support additional server platforms.
--------------------------------------------------------------------
Version 8.1.1145.28
[FIX] HCL\Boards: Intel NVMe SSDs on 4 socket platforms.
[FIX] vSMP Foundation Device: UEFI boot from USB device - missing
      keyboard (Issue: 7247).
[FIX] Rare crash during asynchronous DSRAM (not seen by a customer).
[FIX] Rare crash under imbalanced memory allocations with non-NUMA
      allocations (NNA) is turned off (which is the default).
[CHG] HCL\Devices: Support for RHEL6.9 driver for Emulex OneConnect 
      10GbE (BladeEngine 3) network adapters (Issue: 7270).
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] System SMBIOS (DMI) information changes:
      - Version changed from 2.4.0 to 3.0.0.
      - Type 9 (System Slots) structure: List device PCI address if
        slot is in-use. List objects only for I/O boards.
      - Type 41 (Onboard Devices Extended Information) structure:
        Added for single I/O board systems (MEX/FLX) due to Linux
        bug.
[CHG] UI and boot: Improved VT and VT-d BIOS misconfiguration 
      warning.
[CHG] UI and boot: Improved early error 119 status reporting.
--------------------------------------------------------------------
Version 8.1.1145.21
[FIX] Installer: "bo -x" creates two files.
[FIX] Installer: Warn if bzip2 is missing.
[FIX] System SMBIOS (DMI) information missing when booting in UEFI. 
[CHG] UI and boot: Block AnyIO control in System Settings (F5) for
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode.
[CHG] UI and boot: Improved VT and VT-d BIOS misconfiguration 
      warning.
[NEW] Installer: Avoid installation to mounted devices.
[NEW] Installer: Enable active config file management.
[NEW] Installer: Format NVMe to optimal LBAF.
[NEW] Installer: Software update also update vsmptools.
[NEW] Installer: vsmptools update identify previous installation 
      path and use it.
[NEW] UI and boot: Halt boot if VGA bios could not be found.
--------------------------------------------------------------------
Version 8.1.1145.13
[FIX] Installer: "in -b" doesn't handle <ENTER> correctly (Issue:
      7244).
[FIX] Installer: Boot devices smaller than 10GB presented with wrong
      size.
[FIX] Installer: Fix network license server installation and other
      various fixes.
[FIX] Installer: Various minor fixes.
[FIX] UI and boot: Welcome Screen might appear cut after upgrade
      (Issue: 7242).
[CHG] vSMP CTL: Hide multipath control in Flash Flash-expansion
      (FLX) mode.
[NEW] vSMP Foundation Device: UEFI boot functionality is now
      supported for USB devices as well.
--------------------------------------------------------------------
Version 8.1.1145.4
[CHG] HCL\Backplane: Reinstate link rate reporting and warnings 
      during system boot (Issue: 7173).
[CHG] HCL\Boards: Expose XSAVE support only if it is supported by 
      all CPUs on all boards.
[CHG] Performance: Improved concurrent memory requests (CMR) 
      performance as well as learn and forget algorithm.
[CHG] UI and boot: Put Guest RSDP in EBDA if RSDP not found.
[CHG] UI and boot: System Settings (F5) AnyIO control in
      Memory-expansion (MEX) mode and Flash-expansion (FLX) mode 
      provide only enable/disable options (Issue: 7191).
[CHG] vSMP CTL: Changing concurrent memory requests (CMR) is 
      prohibited is CMR is inactive by config (Issue: 7224).
[CHG] System SMBIOS (DMI) information changes:
      - Type 0 (BIOS Information) and 1 (System Information) 
        structures: Providing vSMP Foundation information.
      - Type 11 (OEM Strings) structure: Provide consolidated system 
        info.
[FIX] Diagnostics: Missing separator line in diagnostics tab (Issue: 
      7215).
[FIX] License: Retry to connect to network license manager rather 
      than fail (Issue: 7229).
[FIX] License: Several fixes to host and device license control.
[FIX] UI and boot: Improve boot device selection and speed when boot 
      device list depleted (Issue: 7220).
[FIX] vSMP CTL: Misaligned print in vsmpversion (Issue: 7151).
[FIX] vSMP CTL: vsmpstat to correctly exit when running in native 
      (Issue: 7200).
[FIX] vSMP CTL: vsmpstat to correctly handle CPU idle time.
[FIX] Error 58296:648:-1 reported during early boot.
[FIX] Improved Linux Crash Kernel support (Issue: 6569).
[FIX] Internal log buffer size - regression: 8.0.925.3.
[FIX] NASRAM related race leading to system freeze or crash in 
      System-expansion (SYX) mode.
[FIX] Nested VM issue with RHEL7.2 and later (Issue: 7189).
[FIX] Possible memory corruption when non-NUMA allocations (NNA) is 
      turned off (not seen by a customer).
[FIX] Rare crash under heavy pressure in System-expansion (SYX) mode 
      (Issue: 6488, 7170, 7184).
[FIX] Theoretical memory corruption - never seen in the field (not 
      seen by a customer) (Issue: 7169).
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Flash: Flash-expansion (FLX) reserves the device first 32MB 
      for vSMP Foundation, primarily for UEFI boot functionality.
[NEW] Flash: Improved Flash-expansion (FLX) performance for NVMe 
      device with large number of I/O queues.
[NEW] Flash: Select devices can load vSMP Foundation in UEFI mode, 
      without vSMP Foundation Device.
[NEW] HCL\Devices: Possible memory corruption for Broadcom NetXtreme 
      II not used in AnyIO.
[NEW] HCL\Devices: Support for SLES12 SP2 driver for AHCI devices 
      (Issue: 7178).
[NEW] Performance: Guest code patching (ultravirt): improve timer 
      management.
[NEW] Support for SLES12 SP2 in System-expansion (SYX) mode.
[NEW] UI and boot: Control private device (SYX/MEX: backplane, FLX: 
      NVMe) ownership in System Settings (F5) (Issue: 7159).
[NEW] UI and boot: Improved theme support for customized Welcome 
      Screen.
[NEW] vSMP CTL: Rename vsmpctl --binfo option to --pinfo, reporting 
      vSMP Foundation private devices.
[NEW] vSMP Foundation Device: Manufacturer and Product fields 
      controlled by theme file (can be seen by lsusb).
[NEW] Interrupt Routing mode value in System Settings (F5) not saved
      to config (Issue: 7175).
[NEW] Installer: Introduce vsf_installer.sh - single file to perform 
      all vSMP Foundation installation activities.  Replacing all 
      previous *.sh and *.img outside vsmppp.  Run vsmp_installer.sh 
      for detailed usage description.
[NEW] Installer: Enable Intel NVMe SSD online and offline 
      activation.
--------------------------------------------------------------------
Version 8.0.925.7
[FIX] RHEL7.2 KVM may crash (Issue: 6976).
[FIX] Flash: Read cache in Flash-expansion (FLX) disabled even if 
      system size is more than 3x available DRAM.
--------------------------------------------------------------------
[FIX] Performance: 
Version 8.0.925.5
[FIX] vSMP CTL: vsmpstat may show >100%.
[FIX] Upgrade program fails in Memory-expansion (MEX) mode (Issue:
      7157).
[FIX] Upgrade program falsely warn about Fault-Tolerant mode when
      used on a locked partition (Issue: 7163).
--------------------------------------------------------------------
Version 8.0.925.3
[FIX] Diagnostics: InfiniBand health test showing low performance 
      (Issue: 6982).
[FIX] Flash: Several Flash-expansion (FLX) NVMe initialization 
      errors.
[FIX] HCL\Backplane: Fix backplane redundancy for Memory-expansion 
      (MEX) mode and for Direct-Connect (2 boards) configurations in 
      System-expansion (SYX) mode (Issue: 6992).
[FIX] HCL\Backplane: System restart when switching from
      Memory-expansion (MEX) to System-expansion (SYX) in System 
      Settings (F5) (Issue: 6960).
[FIX] HCL\Boards: Interrupt storm from IDE device (Issue: 6266).
[FIX] HCL\Boards: Issues with Intel Xeon Phi Processor 72xx with 64
      cores used in Memory-expansion (MEX) and Flash-expansion (FLX) 
      modes.
[FIX] HCL\Devices: LSI MegaRAID Fusion-MPT SAS 2.0 error condition 
      handling (Issue: 7055).
[FIX] HCL\Devices: Performance regression on boards with USB 1.x
      (UHCI) ports.
[FIX] HCL\Devices: USB 2.0 (EHCI) support fixes.
[FIX] Image Manager: Fix usage and wrong error message for -l
      (Issue: 7095, 7096).
[FIX] Partitioner: Can't unlock locked partition (Issue: 6949, 6950,
      6951).
[FIX] UI and boot: Correctly display errors 70x (Issue: 6959).
[FIX] UI and boot: Correctly display PCI addresses of NVMe devices
      used for Flash-expansion (FLX) (Issue: 6963).
[FIX] UI and boot: Correctly display system summary in
      Flash-expansion (FLX) mode (Issue: 6964).
[FIX] UI and boot: Fix discard changes in System Settings (F5)
      (Issue: 6211).
[FIX] UI and boot: Fix to scaling mode control via System Settings
      (F5).
[FIX] UI and boot: Misaligned print in system message (Issue: 7082).
[FIX] UI and Boot: Warning about failed boot from CDROM when using
      the default boot list (Issue: 7069).
[FIX] UI and boot: Some topologies were unused with implicit
      consistent_topologies=no (Memory-expansion (MEX) mode) used in 
      Fault-Tolerant mode (Issue: 6138).
[FIX] vSMP CTL: Correctly record CR3 in profiling info.
[FIX] vSMP CTL: Fix profiling of CPT to use PROF_IS_LBC_ON_LINEAR
      and not PROF_IS_LBC_ON_DMA. 
[FIX] vSMP CTL: Missing usage for vsmpctl --multipath-count (Issue:
      4494).
[FIX] vSMP CTL: Show usage after loading the theme.
[FIX] vSMP CTL: vsmpprof reports "Waited 30 seconds with no
      profiling data received..." (Issue: 7042).
[FIX] vSMP CTL: vsmpstat to correctly handle CPU idle time.
[FIX] vSMP Foundation Device: First board CPUs always active even if
      CPU tokens depleted (Issue: 7106).
[FIX] vSMP Foundation Device: Log device handling - regression: 
      6.5.295.3 (Issue: 7102).
[FIX] vSMP Foundation Device: System boot in IO-expansion (IOX) mode
      instead of Memory-expansion (MEX) mode if all memory tokens 
      not depleted (Issue: 7084).
[FIX] vsmppp: Identify RHEL7.x release properly.
[FIX] ACPI Current Resource Settings (_CRS) doesn't list busses
      correctly (Issue: 7092).
[FIX] BSOD may not show up.
[FIX] Correctly handle NX bit.
[FIX] Crash when VT is disabled (Issue: 6907). 
[FIX] Improved Linux Crash Kernel support (Issue: 6569).
[FIX] MSI device capability removal may accidently remove additional
      capabilities.
[FIX] Offlining CPU may crash the system (Issue: 7051).
[FIX] Possible memory corruption - regression: 6.0.135.1
[FIX] Possible memory corruption when using CMR (Issue: 6916, 6926,
      6995).
[FIX] Rare crash during early boot phase (Issue: 6770).
[FIX] Rare race under high load (seen once by a customer) -
      regression: 7.0.215.3 (Issue: 7117).
[FIX] System crash under high-pressure (Issue: 6962).
[FIX] System may stuck after GRUB (Issue: 7015).
[FIX] Various fixes to automatic memory size calculations.
[CHG] Diagnostics: Save diagnostics info to USB significantly faster
      (Issue: 3652).
[CHG] Diagnostics: Upload results to ScaleMP support site only for
      ScaleMP-branded product.
[CHG] Flash: Expose NVMe devices not used (either unlicensed or
      filtered) for Flash-expansion (FLX) to the Guest.
[CHG] Flash: Flash-expansion (FLX) NVMe license update to enable
      more refined drive sizes.  Licenses provided prior to this 
      release will have to be regenerated.
[CHG] Flash: Improved Flash-expansion (FLX) NVMe initialization
      process for stability, speed, and license fault-recovery.
[CHG] Flash: vsf_nvme_util.sh will correctly display device size.
[CHG] Flash: vsf_nvme_util.sh will format devices together with
      license installation (if needed).
[CHG] Flash: vsf_nvme_util.sh will only install missing licenses.
[CHG] HCL\Backplane: Switch to redundant Mellanox InfiniBand link
      faster.
[CHG] HCL\Boards: Improved memory layout to support devices with
      larger high memory requirements (Issue: 6965). 
[CHG] HCL\Devices: Increase MSI-X interrupts for AnyIO devices, by
      using all possible interrupts and allocating at least 22 for 
      Mellanox devices and 16 to any other device.
[CHG] HCL\Devices: Minor performance improvement on boards with USB
      1.x (UHCI) ports.
[CHG] HCL\Devices: Significant performance improvement on boards 
      with USB 2.x (EHCI) only (non-UHCI) devices (Issue: 7107) not 
      used in AnyIO.  Mass storage devices demonstrated 5X 
      performance improvement.
[CHG] Performance: Improve evacuation performance in 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
[CHG] Performance: Improve evacuation performance of Flash-expansion
      (FLX) mode with large-board count, resulting in 10-15% CMR 
      performance improvement.
[CHG] Performance: Improve evacuation performance on system with
      small-board count.
[CHG] Performance: More robust Guest code patching (ultravirt).  
[CHG] Performance: Override BIOS turbo setting for CPU boards as
      well (was for non CPU boards only).
[CHG] UI and boot: Console redirection do not send clear screen.
[CHG] UI and boot: Round memory size to the nearest integer instead
      of round-down.
[CHG] UI and boot: System memory can be updated in GB (was only in
      MB).
[CHG] UI and boot: Update copyright attribution to ScaleMP.
[CHG] UI and boot: Updated boot UI.
[CHG] vSMP CTL: be (board events: --be) table changed to provide
      more granular information.
[CHG] vSMP CTL: Concurrent memory requests (CMR) semantics allows
      for setting CMR to 1 (single asynchronous request) and use the 
      value of 0 for disablement.
[CHG] vSMP CTL: Increase profiling buffer size to reduce lost events
      in large machines.
[CHG] vSMP CTL: vsmpstat (like other vsmptools) will warn if license
      expired.
[CHG] vsmppp: Handle kernel installation dependency properly.
[CHG] Limit system memory so vSMP Foundation footprint will not be
      larger than single NUMA node.
[CHG] Memory footprint reduction.
[CHG] More robust System SMBIOS (DMI) board information scanning.
[CHG] System SMBIOS (DMI) information changes:
      - Import structures type 3 (System Enclosure or Chassis), 4
        (Processor Information), 7 (Cache Information), 9 (System
        Slots), 16 (Physical Memory Array), 17 (Memory Device) from
        each board (was structures 0 (BIOS Information), 1 (System
        Information), 2 (Baseboard (or Module) Information), and
        only Diablo MCS structures of type 16 and 17).
      - Type 0 and 1 structures: Reduced number of structures to
        one, and aggregate information from different boards by 
        concatenating their values.
      - Type 2 structure: Reduced Number of Contained Object Handles
        to 0 for imported structures.
      - Type 4 structure: Mark processors on memory-only nodes as
        "other" rather than "active".
      - Type 4 structure: Prepend Socket Designation with board
        number.
      - Type 9 structure: Mark slots on memory-only nodes as "other"
        rather than "active".
      - Type 9 structure: Prepend Slot designation with board
        number.
      - Type 17 structure: Prepend Device Locator and Bank Locator
        with board number.
      - Type 11 (OEM Strings) structure: List system information
        vSMP Foundation version information and set it as the first 
        structure.
      - Handle enumeration changed to accommodate large number of
        handles.
[CHG] System memory layout changed to increase amount of free memory
      below 4GB (Issue: 7109).
[NEW] Diagnostics: Introduce USB drive format option to extract
      system diagnostics info.
[NEW] Diagnostics: Save diagnostics info in case of early errors.
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact
      ScaleMP for list of supported devices.
[NEW] Flash: Improved Flash-expansion (FLX) performance and device
      endurance management.
[NEW] Flash: Improved vsf_nvme_util.sh UI and device selection.
[NEW] Flash: System Settings (F5) can enable Flash-expansion (FLX)
      to supports more than 8x available DRAM (Issue: 7134).
[NEW] HCL\Boards: Improved remote VGA performance for some chipsets 
      (Issue: 7016).
[NEW] HCL\Boards: Increase the number of interrupts available for
      the Guest OS.  The number of interrupts in Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes are almost unlimited.
[NEW] HCL\Boards: Support for boards with X2APIC enabled and less
      than 255 CPUs (Issue: 7045).
[NEW] HCL\Boards: Support for up to 384 CPUs per board - for
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
[NEW] HCL\Boards: Validated Memory-expansion (MEX) configuration
      with 384 CPUs, 36TB RAM, 4 dual-port Mellanox Connect-IB HCAs 
      and total of 11 boards.
[NEW] HCL\Devices: Fix interrupt delivery for Intel e1000/e1000e/igb
      devices not used in AnyIO (Issue: 5906).
[NEW] HCL\Devices: Possible memory corruption for Broadcom NetXtreme
      I (1GigE, tg3) not used in AnyIO.
[NEW] HCL\Devices: Possible memory corruption for Intel
      e1000/e1000e/igb devices not used in AnyIO (Issue: 7090).
[NEW] Partitioner: Lock partition when using Direct-Connect and
      Direct-Connect 2 (DC2) (Issue: 7083, 7085).
[NEW] Partitioner: Warn if partition is not locked (Issue: 4609).
[NEW] Performance: Improved Linux OS context switch time for SLES12
      SP1.
[NEW] Performance: Improved performance of memory migration when
      non-NUMA allocations (NNA) is turned off (which is the 
      default).
[NEW] Performance: Improved CPT handling of PINNED memory used as
      source - providing over 2X improvement to Mellanox InfiniBand 
      remote performance in some scenarios.
[NEW] Performance: Improvements for boards with high CPU count.
[NEW] Performance: Improvements for systems with large number of
      boards.
[NEW] Performance: Introduce Sequential Virtual Address (SVA)
      Parallel Prefetch (SPP).  Enabled by default and could be 
      disabled with vsmpctl.
[NEW] Performance: Optimized 1GB page-directory pointer table entry
      handling.
[NEW] Performance: Parallelize long serial Guest operations.
      Overall Guest OS boot time reduction of 30% for 4TB system, 
      and 3X improvement for certain serial operations.
[NEW] Performance: Reduced boot time of boards with large number of
      CPUs.
[NEW] Performance: Significantly reduced vSMP Foundation
      initialization time, using turbo and other techniques.
[NEW] UI and boot: Do not list boot device if default device is
      used.
[NEW] UI and boot: Improved backplane connection setup time.
[NEW] UI and boot: Provide error codes for all early errors.
[NEW] UI and boot: Reduced number of ESC characters in boot UI
      console redirection.
[NEW] UI and boot: Remove Fault-Tolerant control in System Settings
      (F5) of Flash-expansion (FLX) mode (Issue: 7141).
[NEW] UI and Boot: Reset system memory in System Settings (F5) to
      default.
[NEW] UI and boot: Start console redirection of boot UI as early as
      possible (Issue: 4451).
[NEW] UI and boot: Theme support updated to allow total of 30
      characters for vendor name and product name combined. 
[NEW] UI and boot: Warn if board has more than 255 CPUs and used in
      System-expansion (SYX) mode (Issue: 6920).
[NEW] vSMP CTL: Profiling records grouped messages 
      (PROF_IS_LBC_ON_x).
[NEW] vSMP CTL: Profiling records if DSRAM message is asynchronous,
      due to concurrent memory requests (CMR).
[NEW] vSMP CTL: Profiling records no-data DSRAM messages.
[NEW] vSMP CTL: Profiling records pending DSRAM messages due to same
      message in flight by other CPU.
[NEW] ACPI table OEM Revision to list vSMP Foundation build number.
[NEW] Control system NUMA layout (Guest OS view) for 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes in 
      System Settings (F5) and configuration file (mem_topology= 
      key).  Possible values are:
      - Follow the hardware (0).
      - Unify the far memory to a single domain (1, default).
      - Expand the local domains with the far memory (2, recommended
        for SAP HANA).
      - Disable NUMA (3).
[NEW] Enhanced SSE and AVX instruction emulation.
[NEW] Linux kernel command-line options tuneup - 
      - clocksource=tsc - remove (was for Memory-expansion (MEX) and
        Flash-expansion (FLX) modes).
      - nohz=off - remove for Memory-expansion (MEX) and 
        Flash-expansion (FLX) modes.
      - highres=off - remove for Memory-expansion (MEX) and 
        Flash-expansion (FLX) modes.
      - skew_tick=1 - add for System-expansion (SYX) mode.
      - numa_balancing=disable - add even if more than one CPU
        board.
[NEW] Support for CRC32 instruction emulation (Issue: 7133).
[NEW] Support for SLES12 SP2 in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes.
[NEW] Use the 64-bit SMBIOS Entry Point Structure (3.0) if total 
      information is larger than 64KB.  Possible also have the 
      32-bit SMBIOS Entry Point Structure (2.0) in that case. 
--------------------------------------------------------------------
Version 7.5.245.37
[CHG] UI and boot: Update copyright to 2017.
--------------------------------------------------------------------
Version 7.5.245.36
[FIX] UI and boot: Fixed OS PXE boot (PXELINUX) using TIMEOUT
      keyword (Issue: 6971, 7015, 7024).
[FIX] HCL\Devices: Support for HPSA devices firmware 4.52 (Issue:
      7047).
[FIX] NASRAM related race leading to system freeze in 
      System-expansion (SYX) mode.
[NEW] HCL\Devices: Support for RHEL6.8 driver for Broadcom NetXtreme 
      II 577xx/578xx (Issue: 6986).
--------------------------------------------------------------------
Version 7.5.245.30
[FIX] Correctly handle partition lock/unlock without system restart 
      (Issue: 6854, 6950, 6951).
[FIX] HCL\Backplane: Correctly report link errors for Mellanox 
      Connect-IB and Connect-X.
[FIX] HCL\Backplane: Possible crash with Intel True Scale HCA under 
      high pressure (Issue: 6768).
[FIX] IO-expansion (IOX) crash during boot (Issue: 6958).
[FIX] MTRR size (Issue: 6924, 6925).
[FIX] Performance: Sequential Virtual Address (SVA) prefetch 
      performance - regression: 7.5.245.2.
[FIX] Rare race during memory evacuation (Issue: 6935).
[FIX] UI and boot: Misaligned NVMe print in system message (Issue: 
      6963, 6964).
[CHG] Flash: Support for longer NVMe format operations.
[NEW] Report errors during system initialization phase (Issue: 
      6932).
--------------------------------------------------------------------
Version 7.5.245.22
[FIX] Flash: Flash-expansion (FLX) NVMe reset memory address 0 
      during startup (Issue: 6903).
[FIX] Flash: Some devices may not be resized correctly (Issue: 
      6923).
[FIX] HCL\Backplane: System stuck at boot when using Intel True 
      Scale HCAs (Issue: 6915).
[FIX] HCL\Boards: Relax memory layout requirements.
[FIX] License: License server installer was not provided with 
      previous build.
[FIX] Partitioner: Several issues (Issue: 6255, 6854, 6867, 6868, 
      6869, 6873).
[FIX] Performance: Possible performance loss on IPI acceptance.
[FIX] Performance: MWAIT may sleep longer than it should.
[FIX] UI and boot: Fixed nested PXE boot of vSMP Foundation show 
      warning again (Issue: 6920).
[FIX] vSMP CTL: vsmpstat st (system traffic: --st) table not updated
      correctly in System-expansion (SYX) mode.
[FIX] vSMP Foundation Device: Image truncated to 31MB (Issue: 6914).
[FIX] Miscalculating cache size in Memory-expansion (MEX) and 
      Flash-expansion (FLX) is some rare scenarios.
[FIX] Mishandling first non-legacy interrupt (Issue: 6874).
[FIX] Rare race during Linux OS context switch for platforms with 
      APICv support (Issue: 6912).
[FIX] UHCI device may not be recognized.
[FIX] vSMP Foundation Free may crash during boot (Issue: 6922).
[CHG] Flash: Do not use read cache in Flash-expansion (FLX) if 
      system size is less than 3x available DRAM.
[CHG] vSMP Foundation Free to support up to 1.5TB of RAM.
[NEW] HCL\Devices: Support for SLES12 driver for LSI MegaRAID SAS 
      devices (Issue: 6919).
--------------------------------------------------------------------
Version 7.5.245.2
[FIX] Flash: Upgrade program fails when using device-based license. 
[FIX] HCL\Devices: Support for RHEL7.2 driver for Intel e1000 
      devices (Issue: 6767).
[FIX] License: Correctly report server connectivity issue (Issue: 
      6579).
[FIX] Partitioner: Several issues (Issue: 6828, 6838, 6853).
[FIX] Performance: Avoid low package C-states, which negatively 
      affects backplane performance (and I/O in general).
[FIX] Performance: Fix MONITOR command handling on RHEL7 (Issue: 
      6772).
[FIX] Performance: System-expansion (SYX) imbalanced memory pressure 
      - regression: 7.5.215.3.
[FIX] Performance: Use of concurrent memory requests (CMR) may lead 
      to a system lockup.
[FIX] UI and boot: Serval fixes to System Settings (F5) (Issue: 
      6818).
[FIX] vSMP CTL: Fix profiling of NASRAM to use PROF_IS_LBC_ON_DMA 
      and PROF_IS_PINNING when appropriate.
[FIX] vSMP CTL: vsmpstat be (board events: --be) table off by one 
      issue.
[FIX] vSMP CTL: vsmpstat reading from a file shows bet as 0%.
[FIX] vSMP CTL: vsmpstat to correctly handle CPU idle time (Issue: 
      6843).
[FIX] vSMP CTL: vsmpstat to correctly mark Brd vs. Sys events.
[FIX] vSMP CTL: vsmpstat to correctly report Guest code patching 
      (ultravirt) events.
[FIX] vSMP CTL: vsmpversion reports Serial Number: 00000000000 for 
      Flash-expansion (FLX) configurations (Issue: 6851).
[FIX] BSOD appears with no additional information at early boot 
      phase (Issue: 6830).
[FIX] BSOD appears with red background on very large configurations 
      (Issue: 6721).
[FIX] BSOD is missing from on secondary boards in Memory-expansion 
      (MEX) mode (Issue: 6837).
[FIX] Concurrent interrupt delivery to two different CPUs (Issue: 
      6855).
[FIX] CPU offlining and onlining may crash the system (Issue: 6778, 
      6779).
[FIX] Interrupt delivery to offline CPU (Issue: 6827).
[FIX] Nested VM issue with RHEL7.0 and later (Issue: 6808).
[FIX] PIC interrupts may cause system instability.
[FIX] Possible NASRAM related race (not seen by a customer).
[FIX] Rare issue preventing reading persistent logs (UHCI devices) 
      in runtime (Issue: 6849).
[FIX] System-expansion (SYX) stability issue when boards are vastly 
      different (Issue: 6809). 
[CHG] Flash: Flash-expansion (FLX) NVMe to support up to 16 NVMe 
      devices.
[CHG] Flash: Reduced vSMP Foundation memory footprint for 
      Flash-expansion (FLX) NVMe.
[CHG] Flash: Various performance and stability improvements for 
      Flash-expansion (FLX) NVMe.
[CHG] HCL\Boards: Improved PCI probing to avoid missing devices at 
      the Guest.
[CHG] Performance: Improved (type 19) Guest code patching 
      (ultravirt).
[CHG] Performance: Improved concurrent memory requests (CMR) 
      handling.
[CHG] Performance: Improved performance for Memory-expansion (MEX) 
      and Flash-expansion (FLX) under disk I/O load.
[CHG] Performance: Limit (type 2) Guest code patching (ultravirt) to 
      System-expansion (SYX) mode only.
[CHG] Performance: More robust Guest code patching (ultravirt).  
[CHG] Performance: Prevent evacuation in low pressure leading to 
      better performance overall.
[CHG] Performance: Reduced boot time of systems with large number of 
      CPUs and InfiniBand links.
[CHG] Performance: Significantly improved NASRAM performance.
[CHG] Performance: Various improvements to working set detection for 
      Memory-expansion (MEX) and Flash-expansion (FLX).
[CHG] vSMP CTL: New DID (0x1011) to identify Memory-expansion (MEX) 
      and Flash-expansion (FLX) modes, requiring upgrading vsmptools 
      to the latest revision.
[CHG] Improved NASRAM deadlock detection.
[CHG] Improved vSMP Foundation heartbeat (keep alive) mechanism.
[CHG] Simplify vsf_tools_installer.sh.
[CHG] vSMP Foundation Device: Size increased to 32MB.  Devices 
      smaller than 31MB are no longer supported.
[NEW] APIC: IPI delivery performance improvements.
[NEW] Diagnostics: Some failures in early boot phase can allow 
      extracting diagnostics info.
[NEW] Flash: Endurance-aware prefetching.
[NEW] Flash: Expanded Flash-expansion (FLX) NVMe support. Contact 
      ScaleMP for list of supported devices.
[NEW] Flash: Flash-expansion (FLX) resize system to 8x available 
      DRAM by default. Resizing system memory to more than 8x the 
      available DRAM will result in performance degradation message.
[NEW] Flash: Introduced vsf_nvme_util.sh for Flash-expansion (FLX) 
      NVMe license management.
[NEW] Flash: Resize and reformat NVMe for optimal performance based 
      on VM and NVMe characteristics.
[NEW] HCL\Boards: Improved remote VGA performance for some chipsets 
      (Issue: 6571).
[NEW] HCL\Boards: Support for boards with X2APIC enabled and more 
      than 255 CPUs, in Memory-expansion (MEX) and Flash-expansion 
      (FLX) modes.  Validated 288 CPUs.
[NEW] HCL\Boards: Use APIC virtualization (APICv) if available, in 
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
[NEW] HCL\Boards: Use X2APIC if enabled at the BIOS.
[NEW] HCL\Boards: Validated Memory-expansion (MEX) configuration 
      with 288 CPUs, 36TB RAM, 4 dual-port Mellanox Connect-IB HCAs 
      and total of 11 boards.
[NEW] HCL\Devices: Improved remote AnyIO performance by executing 
      automatic NASRAM UNPINNING periodically.
[NEW] License: New processors support: E5-2698 v3, E5-26xx v4, 
      E7-x8xx v3, E7-x8xx v4.
[NEW] Performance: Concurrent memory requests (CMR) improved scan 
      time.
[NEW] Performance: CPT support for additional patterns, incresing 
      performance of mlx4/mlx5 Linux drivers.
[NEW] Performance: Guest code patching (ultravirt) to support 
      RHEL7.2.
[NEW] Performance: Introduced additional (type 29) Guest code 
      patching (ultravirt).
[NEW] UI and boot: Detail vSMP Foundation memory usage 
      (private/cache/system) per board in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes.
[NEW] UI and boot: Improved background image sharpness.
[NEW] UI and boot: Improved Flash-expansion (FLX) boot UI (Issue: 
      6756).
[NEW] UI and boot: Improved system configuration display during boot 
      (Also fixes Issue: 6730).
[NEW] UI and boot: Memory-expansion (MEX) do not listed unused CPUs.
[NEW] UI and boot: Prevent dialog background color to be same as the 
      dialog's text color (Issue: 6765).
[NEW] UI and boot: vSMP Foundation default boot device and order 
      changed to: CDROM0, HDD0, NET0 - in all boot modes.
[NEW] vSMP CTL: Hide vSMP Foundation from kernels booting on 
      Memory-expansion (MEX) and Flash-expansion (FLX) 
      configurations.
[NEW] vSMP CTL: Improved system configuration reporting with 
      vsmpversion (Also fixes Issue: 6730).
[NEW] vSMP CTL: Introduce vsmpctl --binfo to report of vSMP 
      Foundation backplane devices.
[NEW] vSMP CTL: Introducing vsmpstat st (system traffic: --st) table.
[NEW] vSMP CTL: Support for more than 255 CPUs per board.
[NEW] vSMP CTL: vsmpversion -v, -vv, -vvv as a synonym to 
      --full[=0|1|2].
[NEW] vSMP CTL: vsmpversion will report network license as "invalid" 
      if network license agent didn't start yet.
[NEW] vSMP Foundation Device: Support for Dell vFLASH on recent 
      iDRAC systems.
[NEW] Linux kernel command-line options tuneup - add "nomodeset" for 
      System-expansion (SYX) with AMD ES1000 VGA.
[NEW] Compact SRAT table by consolidating consecutive entries.
[NEW] Reduce vSMP Foundation TLB footprint.
[NEW] Support for Intel Xeon (broadwell) v4 processor family.
[NEW] Support for Intel Xeon Phi Processor 72xx in Memory-expansion 
      (MEX) and Flash-expansion (FLX) modes.  It is recommended to 
      use Cahce mode, or alternatively turn NNA on (vsmpctl 
      --nna=on).
[NEW] Support Server Platform Management Interface (SPMI) forwarding 
      to the first board.
--------------------------------------------------------------------
Version 7.0.215.43
[FIX] APIC: IPI sent in logical broadcast x2apic mode had a double 
      delivery.
[FIX] Performance: Guest code patching (ultravirt) may hit a race 
      during boot.
[FIX] Performance: System-expansion (SYX) imbalanced memory pressure 
      - regression: 5.1.135.15.
[FIX] Rare NASRAM related race that led to a system lockup on 
      System-expansion (SYX).
[FIX] vSMP Foundation Device: Correctly handle software upgrade when 
      boards are vastly different (Issue: 6841).
[FIX] vSMP Foundation Device: Boot halts with version mismatch error 
      message.
[FIX] NMI support.
[NEW] Support for PCMPISTRI instruction emulation.
--------------------------------------------------------------------
Version 7.0.215.36
[FIX] HCL\Devices: Critical issue relating to 'backplane_devX' 
      filters, when booting from vSMP Foundation Device.
[FIX] Critical issue affecting performance of System-expansion (SYX) 
      under imbalanced memory pressure.
[FIX] Rare NASRAM related race that led to a system lockup on 
      System-expansion (SYX).
[CHG] Better handling of boards with small contiguous memory areas 
      below 4GB.
[CHG] Last support year extended to 2023 or 2027, depending on 
      license type.
--------------------------------------------------------------------
Version 7.0.215.32
[FIX] Rare NASRAM related race that led to a system lockup on 
      System-expansion (SYX).
[FIX] Several CPT scenarios that could lead to memory corruption.
[CHG] Improved page-table handling (caching, prefetching).
--------------------------------------------------------------------
Version 7.0.215.28
[FIX] APIC: Fixed self-IPI register support.
[FIX] UI and boot: Flash-expansion (FLX) with more than 1TB crash on 
      boot (Issue: 6741).
[FIX] Rare case in System-expansion (SYX) mode causing system 
      lockup.
[CHG] HCL\Boards: Correctly handle boards with mixed IOMMU snoop 
      control support.
--------------------------------------------------------------------
Version 7.0.215.21
[FIX] Critical issue preventing vSMP Foundation Free from loading.
--------------------------------------------------------------------
Version 7.0.215.20
[FIX] Flash: Flash-expansion (FLX) using NVMe may crash under high 
      load (Issue: 6716).
[FIX] Flash: Flash-expansion (FLX) using NVMe may lose its license.
[FIX] HCL\Boards: Correctly initialize intel IOMMU (Issue: 5977, 
      6019, 6215).
[FIX] HCL\Devices: System freeze on boards with Broadcom NetXtreme 
      II 577xx/578xx (Issue: 6655).
[FIX] Performance: Use of concurrent memory requests (CMR) may lead 
      to a system crash.
[FIX] UI and boot: Improved memory usage reporting in 
      Flash-expansion (FLX) mode.
[FIX] UI and boot: Memory size reporting (MB instead of GB) (Issue: 
      6730).
[FIX] UI and boot: Several inconsistencies that may lead to system 
      crash during boot (Issue: 6718, 6728, 6722).
[FIX] vSMP CTL: vsmpversion having segmentation fault (Issue: 6692).
[FIX] Fix emulation of instructions that cross page boundary when 
      the first page is pinned to a board.
[CHG] HCL\Backplane: Increased resources to support more Mellanox 
      Connect-IB HCAs devices.
[CHG] Performance: Improved concurrent memory requests (CMR) 
      handling.
[CHG] vSMP Foundation Device: Retry failed commands.
--------------------------------------------------------------------
Version 7.0.215.3
[FIX] HCL\Backplane: Secondary boards dropping during "Finding" 
      phase (Issue: 6687).
[FIX] HCL\Boards: Support for cases where one board has much smaller 
      memory than others.
[FIX] Image Manager: -k after -c doesn't work (Issue: 6670).
[FIX] License: Issue related to handling large number of boards in 
      same VM.
[FIX] Partitioner: Error codes correction (Issue: 6657).
[FIX] Partitioner: UI fix (Issue: 6534).
[FIX] UI and boot: Boot device selection dialog may be misprinted 
      (Issue: 6631).
[FIX] UI and boot: Handling unavailable boot device (Issue: 6580).
[FIX] UI and boot: Serval fixes to System Settings (F5).
[FIX] Fix emulation of various instructions and emulation of 
      instructions that cross page boundary.
[FIX] Nested VM issue with RHEL7.0 and later (Issue: 6332).
[FIX] Race that led to system lockup on System-expansion (SYX).
[FIX] Rare issue preventing reading persistent logs in runtime 
      (Issue: 6607).
[FIX] Rare race that may cause memory corruption (not seen by a 
      customer).
[CHG] HCL\Boards: Change memory layout to support boards with low 
      memory footprint (<16GB/board) and support for mixing boards 
      with low memory footprint and high memory footprint. 
[CHG] HCL\Devices: Support for RHEL6.5 driver for Emulex LightPulse 
      Fibre-Channel HBAs (Issue: 6126).
[CHG] HCL\Devices: Support for RHEL7.0 and 10.4.255.20 driver for 
      Emulex OneConnect 10GbE (BladeEngine 3) (Issue: 6551, 6582, 
      6588).
[CHG] HCL\Devices: Updated supported device list.  Supported devices 
      are published at http://www.scalemp.com/IOcompat.
[CHG] HCL\Devices: USB controller will automatically work in AnyIO 
      mode if vSMP Foundation is not loaded from that controller.  
      If vSMP Foundation is loaded from a USB device, the controller 
      where the USB device is connected will be filtered (if that is 
      the only use of this controller), or work in AnyIO mode with 
      the device port filtered (if other devices on other controller 
      ports), or alternatively work in legacy mode (if HUB is used 
      for vSMP Foundation device and other devices).
[CHG] License: Allow for longer grace until network license agent 
      starts to accommodate boot of larger systems.
[CHG] License: Diablo MCS devices serial-number handling.
[CHG] Performance: Forget-rate calculation for several prefetch 
      mechanisms.
[CHG] Performance: Guest code patching (ultravirt): improve TLB 
      flushing speed.
[CHG] Performance: Improve context identification for several 
      prefetch mechanisms.
[CHG] Performance: More robust Guest code patching (ultravirt).  
      Additionally - support Linux OS compiled with CONFIG_DEBUG_SG.
[CHG] UI and boot: More details about devices used in 
      Flash-expansion (FLX) mode.
[CHG] UI and boot: Update copyright to 2016.
[CHG] vSMP CTL: vsmpversion --full[=0|1|2] for more details about 
      devices used in Flash-expansion (FLX) mode.
[CHG] Diablo MCS boot process robustness.
[CHG] Properly report SMAP and SMEP support in CPUID.
[NEW] Diagnostics: List of Flash-expansion (FLX) devices and 
      licenses.
[NEW] Diagnostics: Report Diablo MCS and NVMe devices in 
      Flash-expansion (FLX) system diagnostics.
[NEW] Flash: Flash-expansion (FLX) NVMe support. Contact ScaleMP for 
      list of supported devices.
[NEW] HCL\Backplane: Support for Mellanox ConnectX-4 EDR HCAs.
[NEW] HCL\Boards: Support for up to 288 CPUs per board - for
      Memory-expansion (MEX) and Flash-expansion (FLX) modes.
[NEW] HCL\Boards: Support for boards with X2APIC enabled (but less 
      than 255 CPUs).
[NEW] HCL\Devices: AnyIO auto-enablement for Micron Technology Inc 
      RealSSD P320h devices.
[NEW] HCL\Devices: Expanded support for HP Smart Array Gen9 storage 
      devices.
[NEW] HCL\Devices: Initial support for Diablo MCS DDR4 devices. 
[NEW] HCL\Devices: Support for driver for Broadcom NetXtreme II 
      577xx/578xx (Issue: 6295).
[NEW] HCL\Devices: Warn if number of Diablo MCS per socket is too 
      low.
[NEW] License: Updated licenses CPU list classification for AMD 
      Opteron 6338P and AMD Opteron 6370P.
[NEW] Performance: Change OS context to increase number of 
      concurrent memory requests, and report it in vsmpstat output 
      (CMR).  Number of supported OS contexts controlled by vsmpctl 
      --cmr.  Currently set to 8 in Memory-expansion (MEX) and 
      Flash-expansion (FLX) modes, and disabled in System-expansion 
      (SYX) mode. 
[NEW] Performance: Improved MONITOR instruction performance for 
      RHEL7.0 and later.
[NEW] Performance: Improved working set detection for 
      Memory-expansion (MEX) and Flash-expansion (FLX).
[NEW] Performance: Increased cases supported by CPT and improve CPT 
      performance.
[NEW] Performance: Introduce Associated Virtual Address (AVA) 
      prefetch.
[NEW] Performance: Reduced Memory-expansion (MEX) and 
      Flash-expansion (FLX) boot time by reducing memory 
      initialization time (>40X reduction).
[NEW] Performance: Sequential Virtual Address (SVA) prefetch support 
      for reversed streams.
[NEW] Performance: Show memory added by Memory-expansion (MEX) and 
      Flash-expansion (FLX) as single NUMA domain (can be changed by 
      configuration file).
[NEW] Performance: Significantly improve Linux OS context switch for 
      leading to a shorter OS context switch time.
[NEW] Performance: Significantly improved Memory-expansion (MEX) 
      performance.
[NEW] vSMP CTL: vsmpstat to report usage of Guest code patching 
      (ultravirt).
[NEW] vsmppp: Support for RHEL7.x.
[NEW] Linux kernel command-line options tuneup - add 
      "numa_balancing=disable" if "numa_balancing=" is not specified 
      and one CPU board.
[NEW] Report the following values in vsmpversion for Diablo MCS: Max 
      Temperature, Percentage of Remaining Warranty, Predictive 
      Failure Detected.
--------------------------------------------------------------------
Version 6.5.295.48
[FIX] HCL\Devices: Correctly handle PCI BAR alignment (Issue: 6613).
[FIX] License: Fixes to Guest OS (dmesg and console) notification on 
      unlicensed system.
[FIX] Consider RMRR earlier in the boot process.  Prior to this fix 
      systems with RMRR could have crash during boot.
[FIX] Critical issue that may lead to crash when AnyIO is used on 
      systems with high CPU count.
[FIX] Fix emulation of various instructions (Issue: 5649).
[FIX] Missing Guest OS updates to VGA console (Issue: 6579).
[FIX] Several AnyIO issues that may lead to crash on 
      Memory-expansion (MEX) configurations.
[FIX] Several CPT scenarios that could lead to memory corruption 
      (Issue: 6503).
[CHG] Performance: Improve evacuation performance and prevent 
      evacuation storm during idle time (Issue: 6600).
[CHG] Performance: Improve performance on systems with large number 
      of CPUs accessing same address concurrently.
[CHG] Performance: Reduced boot time of Star-Connect topology which 
      use switch (Issue: 6546).
[CHG] Performance: Reduced boot time of systems with large number of 
      CPUs and InfiniBand links (Issue: 6546).
[NEW] HCL\Boards: Validated Memory-expansion (MEX) configuration 
      with 240 CPUs, 30TB RAM, 4 dual-port Mellanox Connect-IB HCAs 
      and total of 9 boards.
[NEW] HCL\Devices: Support for RHEL6.7 driver for Broadcom NetXtreme 
      II 577xx/578xx.
[NEW] vSMP CTL: Control non-NUMA allocations (NNA) from 
      configuration file.
--------------------------------------------------------------------
Version 6.5.295.25
[FIX] HCL\Devices: Fix PCI bus hierarchy reporting in ACPI, leading 
      to a crash while loading RHEL7.1 (Issue: 6540).
[FIX] License: Fix network license acquisition in MEX (Issue: 6566).
[FIX] vSMP CTL: Correctly handle Flash-expansion (FLX) mode (Issue: 
      6492).
[FIX] UI and boot: Correctly reporting vSMP Foundation device behind 
      USB HUB (Issue: 6557).
[FIX] Critical issue that may lead to crash when AnyIO is used on 
      systems with high CPU count.
[FIX] Potential race that may lead to memory corruption in Memory 
      Expansion (MEX) operational mode.  This delicate race has not 
      been observed at any deployment yet.
[FIX] Several fixes to CPT (Issue: 6594).
[NEW] HCL\Devices: Support for SLES12 driver for Intel igb devices 
      (Issue: 6539).
--------------------------------------------------------------------
Version 6.5.295.16
[FIX] Flash: Correctly report Diablo MCS devices in DMI (type 17 and 
      219), when used in Flash-expansion (FLX) mode.
[FIX] HCL\Backplane: Several issues affecting Intel True Scale HCAs 
      (Issue: 6537).
[FIX] Critical issue that may lead to crash when AnyIO is used on 
      systems with high CPU count.
[CHG] vSMP CTL: non-NUMA allocations (NNA) are disabled by default, 
      as in pre 6.5.295.3.
[NEW] HCL\Devices: Support for SLES12 SP1 driver for LSI MegaRAID 
      Fusion-MPT SAS devices (Issue: 6919).
--------------------------------------------------------------------
Version 6.5.295.9
[FIX] vSMP CTL: Rare race that could lead to system lockup when 
      profiling is stopped.
[FIX] vSMP Foundation Device: Correctly handle software upgrade when 
      Diablo MCS devices are used in Flash-expansion (FLX) 
      operational mode.
[FIX] UI and boot: Several issues relating to theme creation and 
      rollout process.
[FIX] Correctly handle UD exception coming from an application.
[CHG] vSMP CTL: Record control-register information in board-events 
      profiling.
[NEW] HCL\Boards: Validated Memory-expansion (MEX) configuration 
      with 240 CPUs, 24TB RAM, 4 dual-port Mellanox Connect-IB HCAs 
      and total of 7 boards.
[NEW] HCL\Devices: Support for Diablo MCS driver 1.6.0.89.
[NEW] Performance: Further improve CR3 reloading latency, leading to 
      a shorter OS context switch time. 
--------------------------------------------------------------------
Version 6.5.295.3
[FIX] HCL\Backplane: Increased HCAs per board from 4 to 8.
[FIX] HCL\Backplane: Tuned performance of Mellanox Connect-IB HCAs 
      (Issue: 6423).
[FIX] HCL\Boards: Issue with boards with less CPUs than NUMA nodes 
      (Issue: 6307). 
[FIX] Image Manager: Open source files for read (and not for write).
[FIX] UI and boot: System crash when ESC is pressed to continue X 
      out of Y boards (Issue: 6369). 
[FIX] UI and boot: System stuck after F5 (Issue: 6425).
[FIX] vSMP CTL: Improved MWAIT and interrupt delivery statistics 
      recording. 
[FIX] vsmppp: Support for RHEL7.
[FIX] Support for 2PB total system memory size.  
[FIX] Load vSMP Foundation on system with low amount of memory per 
      socket (Issue: 6301, 6413).
[FIX] Pending interrupts on halted CPU.
[FIX] Performance: Several issues leading to mmory corruption driven 
      by CPT. 
[FIX] Possible memory corruption in Memory-expansion (MEX) 
      operational mode primarily driven by non-AnyIO devices.
[FIX] Sporadic crash at system start (Issue: 6395).
[CHG] APIC: HyperThreads are enable by default, unless set otherwise 
      prior to this release.
[CHG] HCL\Backplane: Backplane-load-balancing order HCAs by PCI 
      order. 
[CHG] HCL\Boards: Correctly report MCE error address.
[CHG] HCL\Devices: Disable Intel MFD devices (ICH5 to latest), while 
      keep the ICH available. 
[CHG] HCL\Devices: Support up to 32 MC MSR groups.
[CHG] Performance: Disable AMD Turbo-core support by default to 
      improve the platform InfiniBand performance.  This improves 
      vSMP Foundation performance by 2X. 
[CHG] Performance: Improved handling of MWAIT instruction for 
      reduced interrupt latency. 
[CHG] Ignore HyperThreading on memory-only boards.
[CHG] Support for ACPI 2.0.
[NEW] APIC: Performance of X2APIC physical interrupt delivery mode.
[NEW] Diagnostics: Backplane health test supported for Mellanox HCAs 
      only. 
[NEW] Diagnostics: List Flash-expansion (FLX) supported devices and 
      licenses. 
[NEW] Flash: Flash-expansion (FLX) operational mode leveraging 
      Memory-expansion (MEX) operational mode, but using flash 
      storage devices locally installed on the system as an 
      alternative to memory boards connected with InfiniBand. 
[NEW] Flash: Flash-expansion (FLX) supported devices: Diablo MCS
      devices (IBM eXFlash DIMM and SanDisk ULLtraDIMM).
[NEW] HCL\Backplane: Backplane-load-balancing making use of board 
      ScaleMPy for improved performance. 
[NEW] HCL\Devices: AnyIO auto-enablement for Intel DC 
      P3700/3600/3500 SSD. 
[NEW] HCL\Devices: AnyIO devices support routing interrupts to the 
      I/O initiator (I2I) board. 
[NEW] HCL\Devices: Expanded support for Intel igb devices (Intel 
      I210). 
[NEW] HCL\Devices: Improved remote AnyIO performance and stability 
      with better heuristics for automatic NASRAM UNPINNING (Issue: 
      6366). 
[NEW] HCL\Devices: Support for Diablo MCS devices (IBM eXFlash DIMM 
      and SanDisk ULLtraDIMM) for storage. 
[NEW] HCL\Devices: Support for RHEL6.6 driver for Broadcom NetXtreme 
      II 577xx/578xx.
[NEW] License: Introduce device-locked licensing for Flash-expansion 
      (FLX) supported devices.
[NEW] Performance: CPT support for remote MMIO regions - improved 
      performance for NVIDIA devices. 
[NEW] Performance: Improved CR3 reloading latency, leading to a 
      shorter OS context switch time.
[NEW] Performance: Memory-expansion (MEX) first touch does not 
      require DSRAM. 
[NEW] Performance: Parallel evacuation operation in Memory-expansion 
      (MEX) operational mode for much improved performance. 
[NEW] Performance: Reduced boot time of systems with large memory 
      configurations (2X reduction on 8 socket system with 2TB). 
[NEW] Performance: Significantly improved Memory-expansion (MEX) 
      performance. 
[NEW] Performance: Significantly improved performance of boards with 
      high CPU count.
[NEW] Performance: Support for posted write for remote MMIO regions.
[NEW] UI and boot: Revamped boot UI to graphical mode with theme 
      support and many other fixes. 
[NEW] vSMP CTL: Provide control for non-NUMA allocations (NNA).  
      Enabling NNA will avoid static board-level NUMA allocations.
[NEW] Expanded emulation for additional SSE and AVX instructions.
[NEW] Report Mellanox InfiniBand HCA firmware version to internal 
      log. 
[NEW] Support for ALL and NOT operation in pci_dev_filterX and 
      backplane_devX.  05:*.* will match all devices on bus 5 and 
      05:!*.!* will match no device on that bus.
--------------------------------------------------------------------
Version 6.0.135.64
[FIX] Critical error introduced in 6.0.135.63.
--------------------------------------------------------------------
Version 6.0.135.63
[FIX] HCL\Backplane: Probing InfiniBand fabric that has Mellanox 
      Connect-IB HCAs (Issue: 6423).
[FIX] Crash under load due to use of AnyIO in System-expansion (SYX) 
      mode.
[FIX] Crash under load in System-expansion (SYX) mode with high CPU 
      count per board (Issue: 6437).
[FIX] Possible memory corruption of systems with concurrent but 
      infrequent page-table updates - enhanced fix (issue: 6361).
[CHG] HCL\Backplane: Mellanox HCA device order to follow PCI order. 
--------------------------------------------------------------------
Version 6.0.135.58 
[FIX] Rare system crash when memory area used by AnyIO recycled for 
      atomic operations.
[CHG] Performance: Improved evacuation performance.
[CHG] Performance: Large-block-copy (LBC) in Memory-expansion (MEX) 
      mode.
[CHG] Performance: MONITOR instruction performance.
[NEW] HCL\Devices: Expanded Broadcom NetXtreme I (1GigE, tg3) to 
      support BCM5717.
[NEW] HCL\Devices: Support for additional Intel C610 chipset's AHCI 
      devices.
[NEW] HCL\Devices: AnyIO auto-enablement for LSI SAS3008 devices.
[NEW] HCL\Devices: Support for RHEL7.0 driver for Broadcom NetXtreme 
      II 577xx/578xx (Issue: 6295).
--------------------------------------------------------------------
Version 6.0.135.47
[FIX] HCL\Backplane: Critical fixes for issues during system setup 
      of Star-Connect topology.
[FIX] License: Could not acquire all licenses on large setup (Issue: 
      6424).
[FIX] vSMP Foundation Device: Fixed update for USB 1.x (UHCI) 
      devices (Issue: 6405).
[FIX] Possible memory corruption of systems with concurrent but 
      infrequent page-table updates - enhanced fix (issue: 6361).
[CHG] Performance: Single board system to use Memory-expansion (MEX) 
      operational mode.
[NEW] HCL\Devices: Support for Intel C610 chipset's AHCI devices. 
[NEW] Linux kernel command-line options tuneup - add 
      "transparent_hugepage=always" if "transparent_hugepage=never" 
      is being used.
--------------------------------------------------------------------
Version 6.0.135.35
[FIX] Possible memory corruption of systems with concurrent but 
      infrequent page-table updates (issue: 6361).
[CHG] Allow the Guest OS to use interrupt remapping even on Intel 
      chipsets with known interrupt remapping ERRATA.
[CHG] License: Network license agent connection management 
      improvement (Issue: 6329, 6362).
[NEW] HCL\Devices: Expanded support for HP Smart Array P830i storage 
      device.
--------------------------------------------------------------------
Version 6.0.135.29
[FIX] HCL\Backplane: System hang when using Direct-Connect 2 (DC2) 
      topology (Issue: 6323).
[FIX] Performance drop that could lead to a crash when using MWAIT 
      instruction (Issue: 6319).
[FIX] RHEL7 freeze in Memory-expansion (MEX) (Issue: 6257).
--------------------------------------------------------------------
Version 6.0.135.26
[FIX] HCL\Devices: HPSA devices not accessible to the Guest OS 
      (Issue: 6158).
[FIX] Image Manager: Read only first 32MB (Issue: 6303).
[FIX] Interrupts sent to offline CPUs are handled correctly (Issue:
      6297, 6300).
[FIX] License: License files with more than one serial number and
      different expiry dates (Issue: 6298, 6315, 6317).
[FIX] Performance: Fix regression of large SYX configurations.
[FIX] vSMP Foundation Device: Correctly support large USB devices
      (Issue: 6305, 6321).
[FIX] Rare race that can lead to memory corruption on systems with
      large core count (Issue: 6280).
[FIX] Rare system crash when memory area used by AnyIO recycled for
      page tables (Issue: 6288).
[FIX] System crash on boards with more than two processors under
      heavy memory pressure.
[CHG] Enable internal log by default.
[NEW] Report InfiniBand MTU to internal log.
--------------------------------------------------------------------
Version 6.0.135.14 
[FIX] HCL\Backplane: System crash when using Intel True Scale HCAs
      (Issue: 6253).
[FIX] HCL\Boards: Memory corruption due to non-snooping AnyIO 
      devices (NVIDIA GPGPU).
[FIX] UI and boot: Bad parsing of configuration file (Issue: 6264).
[FIX] UI and boot: Detection of USB boot device (Issue: 6267).
[FIX] Possible corruption for systems with total memory over 16TB.
[FIX] Rare system crash when memory area used by AnyIO recycled for
      code pages, stack pages, or page tables (Issue: 6252, 6278).
[CHG] HCL\Backplane: Alert if faulty Mellanox HCA firmware found.
[CHG] UI and boot: Update copyright to 2015.
[CHG] vSMP CTL: Correctly record profiling attributes of 
      board-events.
[NEW] HCL\Boards: Support for Intel C610 chipset. 
[NEW] Performance: Faster page-table updates. 
--------------------------------------------------------------------
Version 6.0.135.1
[FIX] HCL\Backplane: System crash during bring-up of Direct-Connect 
      setup (Issue: 5160).
[FIX] HCL\Backplane: System failure if more than four HCAs per 
      board (Issue: 6122).
[FIX] HCL\Boards: Incorrect DMAR PCI device path definition under 
      some conditions leading to lack of interrupts of AnyIO 
      devices.
[FIX] HCL\Boards: Interrupt management on Intel Sandy-bridge and 
      Ivy-bridge processors (Issue: 5253).
[FIX] HCL\Boards: Spurious interrupt generated by AnyIO devices 
      which do not have INTx.
[FIX] HCL\Devices: Critical issue relating to 'backplane_devX' 
      filters.
[FIX] HCL\Devices: Critical issue relating to HPSA devices used with 
      AnyIO (Issue: 6114).
[FIX] HCL\Devices: Keyboard support (startup to Guest OS boot) on 
      AMD platforms (Issue: 6187).
[FIX] HCL\Devices: USB device will be unstable if interrupts is 
      shared with AnyIO device (Issue: 6155, 6220, 6226).
[FIX] Image Manager: Configuration dump (-d) creates temporary files 
      fix robustness (Issue: 6073, 6076).
[FIX] License: Correctly handle license files with more than one 
      serial number (Issue: 6072).
[FIX] License: Correctly handle processor tokens acquisition when 
      not enough tokens (Issue: 6105).
[FIX] License: Do not equire DNS if server IP address provided.
[FIX] License: Improved CPU detection for Intel Xeon v2 and v3 
      processors (Issue: 6108).
[FIX] Partitioner: Handling of processor tokens required by AnyIO 
      (Issue: 6159).
[FIX] Partitioner: Handling of token-based licenses (Issue: 6080, 
      6081, 6255).
[FIX] Partitioner: System crash on merge (Issue: 6151).
[FIX] UI and boot: Early stage system blank panic screen (Issue: 
      5632).
[FIX] UI and boot: Fix BIOS consistency checks and reporting for HT, 
      Turbo, VT, and VT-d (Issue: 5977, 6019, 6215).
[FIX] UI and boot: vsmppp installation warning is not turned off by 
      vsmpctl --cpu_boards (Issue: 6262).
[FIX] UI and boot: vsmppp installation warning should not be 
      presented for vSMP Foundation Fre  (Issue: 6104). 
[FIX] vSMP CTL: Fix board-events profiling timestamps.
[FIX] vSMP CTL: Fix profiling of prefetched PIN events 
      (PROF_IS_LBC_ON_PINNING) to include prefetch size.
[FIX] vSMP CTL: vsmpctl --status shows values according to vSMP  
      Foundation boot mode (network or device). 
[FIX] vSMP CTL: Improved vsmpctl help for --cpu-boards and 
      --io-boards.
[FIX] Correctly handle interrupts with destination shorthand (Issue: 
      6116).
[FIX] MP-Table had Incorrect BUS ID for ISA bus.
[FIX] Nested VM issue that can occur during nested VM migration 
      (Issue: 6234).
[FIX] PCI Interrupt Routing (PIR) Table had was not initializaed 
      correctly.  Affected Guest OS platform enumeration.  PIR is 
      not presented to Guest OS anymore.
[FIX] Remove unused keys from configuration file (Issue: 6225). 
[FIX] System crash during startup (Issue: 5924, 6232). 
[FIX] System crash during system error flow (Issue: 6100).
[FIX] System crash under load in Memory-expansion (MEX) mode (Issue: 
      6145).
[FIX] Unaligned reads or unexpected-size reads of PCI configuration 
      address space returned incorrect values.
[CHG] APIC: HyperThreads will be listed at the end of the 
      APIC/X2APIC APCI MADT, resulting in OS enumerating them last 
      instead of in siblings order.  With this change, all logical 
      CPUs of thread 0 will be reported first, and then ones of 
      thread 1, rather than reporting them in sequential manner.
[CHG] HCL\Boards: Remove support for PIC-generated interrupts.
[CHG] HCL\Devices: AnyIO MSI-X interrupts limited for Mellanox 
      devices set to 22 (was 16).  With this change the OS will be 
      able to configure 8 RX queues per 10GigE device.
[CHG] HCL\Devices: Support for SLES12 driver for Emulex OneConnect 
      10GbE (BladeEngine 3) network adapters (Issue: 6169).
[CHG] License: Handle IP address in license_mgr key without DNS 
      lookup. 
[CHG] License: Network license agent connection management 
      improvements.
[CHG] License: Network license agent diagnostics and warning 
      messages.
[CHG] License: Network license agent exit status when running in 
      native or if network license is not required.
[CHG] License: Network license is not required for single board boot 
      (Issue: 6129).
[CHG] Performance: Enable AMD Turbo-core only for supported 
      processors (not AMD Operon 61xx, 6204, 6308).
[CHG] Performance: Further reduce number of TLB flushes using 
      delayed flush operation.
[CHG] Performance: Override BIOS turbo setting for non CPU boards.
[CHG] UI and boot: Improved boot speed (Issue: 6026).
[CHG] UI and boot: Overhaul of pre-boot environment for robustness 
      (no functional changes).
[CHG] vSMP CTL: List all board-events, even if leading to 
      system-event.
[CHG] vSMP CTL: Next boot cpu_boards and io_boards controls is 
      allowed only if vSMP Foundation was loaded from vSMP 
      Foundation device (Issue: 6188).
[CHG] vSMP CTL: vsmpversion output removes first empty line.
[CHG] Allow up to 256 PCI busses per board (was 64 before).  
      Changing PCI bus ID enumeration method: every board will be 
      associated with a separate domain.
[CHG] Block changes to rmw mode in Memory-expansion (MEX) mode 
      (Issue: 6099).
[CHG] Increased internal log buffer size - will result in slower log 
      operation, but with more historical data.
[CHG] Reduce vSMP Foundation and system cache memory footprint in 
      Memory-expansion (MEX) mode.
[CHG] Skip board enumeration in case of consistent_topologies=no or 
      if less than three boards (Issue: 6128).
[NEW] HCL\Backplane: Support for Mellanox Secure Host.
[NEW] HCL\Backplane: Introducing Star-Connect: connect multiple 
      systems in Memory-expansion (MEX) mode without InfiniBand 
      switch, only to primary board.  Link redundancy and 
      backplane-load-balancing are supported as well.
[NEW] HCL\Boards: Hide Intel TCO (iTCO) devices (Issue: 4621, 4714).
[NEW] HCL\Devices: AnyIO auto-enablement for Adaptec Series 7 6G SAS 
      devices. 
[NEW] HCL\Devices: AnyIO auto-enablement for QLogic Corp. 
      ISP2532-based 8Gb Fibre Channel to PCI Express HBA.
[NEW] HCL\Devices: AnyIO auto-enablement for supported dual-mode 
      Mellanox HCAs, if set by firmware as 10GigE devices.
[NEW] License: Support for Intel Xeon E5-26xx v3 processors.
[NEW] Performance: Improved AnyIO interrupt management.
[NEW] Performance: Interrupt Routing mode defaults to comply in 
      Memory-expansion (MEX) mode, if AnyIO is is use.
[NEW] Performance: PCI bus proximity is provided on socket 
      granularity, instead of board granularity.  In combination 
      with comply Interrupt Routing mode, it allows the OS to route 
      the interrupts to the closest processor.
[NEW] Performance: Significantly improved AnyIO (local and remote) 
      performance and stability (Issue: 6094, 6167).
[NEW] Performance: Significantly improved Memory-expansion (MEX) 
      performance.
[NEW] Performance: Significantly improved performance of boards with 
      high CPU count.
[NEW] UI and boot: Display an error if configuration file includes 
      both anyio_devX and anyio_boards.
[NEW] vSMP CTL: Introducing vsmpversion --short.
[NEW] Expanded emulation for additional SSE and AVX instructions.
[NEW] Enhanced total system memory size to 2PB.
[NEW] Expose CPUID Extended Topology Enumeration Leaf (0xb) in cases 
      where all active processors are identical.
[NEW] Serial logs will be dumped again if 'D' was sent to the serial 
      port.
[NEW] Linux kernel command-line options tuneup based on system 
      configuration.  Each option will be skipped if found in the 
      command-line.  All options will be skipped if "vSF_add=no" is 
      added to the command-line.  Controlled command-line options 
      are (in order of appearance):
      - intel_iommu - always set to 'off'.
      - nmi_watchdog - always set to '0'.
      - nohz - always set to 'off'.
      - highres - always set to 'off'.
      - nortsched - set if more than one CPU board.
      - cgroup_disable - set to 'memory' if more than one CPU board.
      - clocksource - set to 'tsc' if more than one CPU board.
      - nvidia.NVreg_RegistryDwords="ForceEnableHypervisor=1" - set 
        if NVIDIA GPGPU exists in the system.
--------------------------------------------------------------------
Version 5.5.295.16
[FIX] HCL\Backplane: Issues in System Settings (F5) that could lead 
      to a system crash (Issue: 6050, 6051).
[FIX] HCL\Backplane: System stuck at boot when using Intel True 
      Scale HCAs.
[FIX] HCL\Devices: 'backplane_devX' value without a comma leads to a 
      system crash (Issue: 6062).
[FIX] HCL\Devices: Critical fix to AnyIO that could lead to random 
      crashes (Issue: 6068, 6069).
[FIX] Image Manager: Configuration dump (-d) creates temporary files 
      (Issue: 6073, 6076).
[FIX] License: Several issues with memory tokens consumption (Issue: 
      6075, 6078).
[FIX] UI and boot: Reporting memory at 1GB granularity if total 
      memory is more than 1TB (Issue: 6067, 6070).
[FIX] UI and boot: Reporting vSMP Foundation branch name at boot 
      time (Issue: 6084).
[FIX] System crash during bringup (Issue: 6053).
[CHG] HCL\Backplane: Tune memory consumption for larger boards with 
      high number of HCAs.
[CHG] Configuration keys accepts several values for negative 
      indication ("no", "off", "disable", "disabled", "0", "lo") and 
      positive indication ("yes", "on",  "enable",  "enabled", "1", 
      "ken").
[NEW] HCL\Backplane: Redundant backplane on Direct-Connect (2 
      boards) configurations. 
[NEW] License: Support for Intel Xeon E5-46xx v2 processors.
--------------------------------------------------------------------
Version 5.5.295.3
[FIX] Diagnostics: UI fix for FTP results export when no network 
      connectivity (Issue: 4975).
[FIX] HCL\Backplane: Mellanox Connect-IB HCAs may lead to system 
      crash during vSMP Foundation early boot phase (Issue: 5916).
[FIX] HCL\Backplane: Redundant backplane support - regression: 
      5.5.85.
[FIX] HCL\Devices: Critical fix that increase robustness of AnyIO.
[FIX] UI and boot: Memory corruption during Welcome Screen (Issue: 
      5776).
[FIX] UI and boot: term_type configuration parameter added to 
      configuration file unnecessarily (Issue: 5817).
[FIX] UI and boot: vsmppp installation warning for first time SYX
      users should not be presented for MEX users (Issue: 6045).
[FIX] vSMP CTL: vsmpctl --pin and --unpin usage and help (Issue: 
      4530). 
[FIX] vSMP CTL: vsmpstat output file ownership (Issue: 5111).
[FIX] Add RMRR segments to e820 map (if missing from e820).
[CHG] Automatic addition of OS boot flag intel_iommu=off or 
      modification of intel_iommu=on if exists on RHEL6.5 (Issue: 
      6005, 6006).
[FIX] Freeze during early vSMP Foundation startup (Issue: 5713, 
      5810, 5832, 5997). 
[FIX] Ignored "," at the end of pci_dev_filterX.
[FIX] PCI device representation with '*'.
[FIX] Properly handle lowest-priority interrupt delivery mode.
[CHG] APIC: Expose only single Local APIC/X2APIC NMI entry in MADT.
[CHG] HCL\Backplane: Always use backplane-load-balancing if possible 
      and allowed by license.
[CHG] HCL\Backplane: Remove Mellanox InfiniBand switch firmware 
      update support.
[CHG] HCL\Backplane: Verbose link rate reporting and warnings during 
      system boot.
[CHG] HCL\Boards: Increase number of supported IOAPICs per board to 
      12 (IBM x3950 X6).
[CHG] HCL\Devices: AnyIO board level enablement (anyio_boards) will 
      apply for all supported devices, if device level enablement 
      (anyio_devX) is not being used.
[CHG] HCL\Devices: Enable AnyIO in Memory-expansion (MEX) and enable 
      AnyIO for all possible devices by default (anyio_boards=1).
[CHG] HCL\Devices: Increase number of Intel Storage Controller Unit 
      (SCU) controllers to 2 (Issue: 5890).
[CHG] HCL\Devices: Increase number of serial ports to 3 by addition 
      COM2-4.
[CHG] HCL\Devices: Increasing number of AnyIO devices per board to 
      32.
[CHG] HCL\Devices: Proper PCI device reset for devices used by the 
      Guest OS (Issue: 5886).
[CHG] Image Manager: Do not accept images with embedded config, 
      unless -f is used.
[CHG] Image Manager: Introducing -d to dump configuration file used 
      to create an existing image.
[CHG] License: Improve license agent status reporting.
[CHG] Performance: AMD Turbo-core and Intel Turbo Mode (collectively 
      'Turbo') is on by default.
[CHG] Performance: Improved performance for boards with lower core 
      count (20% increase on 16 cores boards).
[CHG] Performance: Improved performance for boards with unused CPUs 
      using Turbo.
[CHG] Performance: Improved performance when AnyIO is actually being 
      used on only one board.
[CHG] Performance: Intel Turbo Mode is supported only Sandy-Bridge 
      processors or later.
[CHG] Performance: Tune Memory-expansion (MEX) cache aggressiveness.
[CHG] UI and boot: Correctly identify vSMP Foundation version in 
      System Settings (F5) UI (Issue: 5639, 5719).
[CHG] UI and boot: Various cleanups and more verbose reporting 
      during boot.
[CHG] vSMP CTL: Improved event classification and correctness of 
      reporting (Issue: 5926 and non-reported).
[CHG] vSMP CTL: Remove dependency on libnuma.
[CHG] FADT boot flag indicates no ASPM.
[CHG] FADT century value is read from the hardware (was 0 before).
[NEW] HCL\Backplane: Introducing backplane-load-balancing uneven 
      topologies.  Board ordering follows system_boards 
      configuration key (set by System Setting (F5) Lock operation).  
      Alternative topologies will be supported even if unordered or 
      partial compared to the primary topology.  In case 
      system_boards is undefined, the first topology will be defined 
      as main topology, and all other alternative topologies must 
      match the main topology board ordering, unless 
      consistent_topologies=no is set in configuration file.  
      Memory-only boards does not require specific board ordering, 
      and can use all possible topologies.
[NEW] HCL\Devices: AnyIO licensed devices without proper licenses 
      are visible non-functional.
[NEW] HCL\Devices: Enable InfiniBand support for guest.  Enablement 
      via System Settings (F5) and 'backplane_devX' configuration 
      key.
[NEW] HCL\Devices: Support for RHEL6.5 driver for Broadcom NetXtreme 
      II 577xx/578xx and fix of several issues.
[NEW] License: Guest OS (dmesg and console) is notified on 
      unlicensed system.
[NEW] License: Introducing token-based licensing support, with full 
      backward compatibility to class-based licenses.  Token-based 
      licensing requires new license agent.
[NEW] License: vsmptools cannot be used on unlicensed system.
[NEW] Performance: Expose MWAIT instruction, and improve Intel Turbo 
      Mode performance with correct ACPI PSS values.
[NEW] Performance: Improved cache management for guest 2MB pages.
[NEW] Performance: Improved remote AnyIO performance with better 
      heuristics for automatic NASRAM UNPINNING.
[NEW] Performance: Nested VM performance improvement.  Windows 7 KVM 
      VMs measured to run 100x faster (Issue: 5950).
[NEW] Performance: Prevent package access to C1E or deep sleep to 
      maintain backplane performance.
[NEW] Performance: Significantly improved board local AnyIO 
      performance.
[NEW] UI and boot: Improve backplane initialization time during 
      system bring up.
[NEW] UI and boot: Improve memory initialization time during system 
      bring up for Memory-expansion (MEX).
[NEW] UI and boot: Reporting memory at 1GB granularity if total 
      memory is more than 1TB (Issue: 5728).
[NEW] UI and boot: Robust BIOS consistency checks for HT, Turbo, VT, 
      and VT-d.  Validate conformance with System Settings.
[NEW] UI and boot: Support for 'M'/'G' to specify MB/GB in 
      system_memory configuration key (Issue: 6010).
[NEW] Board SMBIOS (DMI) partial information (type 0, 1 and 2 only) 
      are reported by vSMP Foundation as handles 0x0TNN, where T is 
      the type and NN is the board number counting from 1.  Handle 
      0x0T00 is used by vSMP Foundation to reports its information.
[NEW] Support for Guest OS-guided interrupt routing.  Interrupt 
      Routing mode in System Settings (F5) can be set to comply to 
      follow the OS-guided interrupt routing.  Set "irp=no" in the 
      configuration file for same result.
--------------------------------------------------------------------
Version 5.5.155.39
[FIX] HCL\Devices: Use 32bit address space for private buffers of 
      LSI MegaRAID Fusion-MPT SAS 3.0 devices (Invader, Fury).  This 
      is required in case single device seems by the guest as 
      multiple devices (Issue: 5851).
[FIX] Performance: Regression in memory PINNING performance (Issue: 
      5814, 5895, 5920).
[FIX] Critical issue resulting in long delay during evacuation 
      operation.  Affects both performance and stability.
--------------------------------------------------------------------
Version 5.5.155.27
[FIX] HCL\Boards: Use of 'cpus_per_socket' puts other CPUs in deep 
      sleep.
[FIX] HCL\Devices: Limit number of Intel Storage Controller Unit 
      (SCU) controllers to 1 (Issue: 5854, 5868).
[FIX] Performance: Regression: 5.5.155.6 (Issue: 5814, 5895, 
      5920).
[FIX] UI and boot: Internal error printouts during system 
      initialization.
[FIX] Possible memory corruption when turbo=yes.
[FIX] Possible memory corruption when using 2MB page-directory entry 
      (Issue: 5931).
[CHG] HCL\Boards: Significant issue leading to system freeze under 
      I/O load.  This affects vSMP Foundation interrupts management 
      in boards with IOAPIC version greater or equal to 0x20 and 
      LAPIC that supports EOI broadcast suppression (Issue: 5923).
[CHG] HCL\Devices: Expanded support of Intel Storage Controller Unit 
      (SCU) devices.
--------------------------------------------------------------------
Version 5.5.155.13
[FIX] HCL\Backplane: Several fixes for Intel True Scale HCAs (Issue: 
      5786, 5823, 5845).
[FIX] HCL\Devices: Cannot connect to license manager over Broadcom 
      NetXtreme II 577xx/578xx (10GigE) devices (Issue: 5837).
[FIX] System reset during guest boot loader (Issue: 5841).
[CHG] HCL\Backplane: Support 32 characters in 'vmid' key (Issue: 
      5821).
[CHG] HCL\Devices: Support up to 4 Broadcom NetXtreme II 577xx/578xx 
      (10GigE) devices per board.
[CHG] vSMP Foundation Device: New image layout.  Requires MEMDISK 
      3.53 or higher to load vSMP Foundation from network.
[NEW] HCL\Boards: Support for limiting active cores in a processor 
      using 'cpus_per_socket' configuration key.
[NEW] HCL\Devices: Expanded support for LSI MegaRAID Fusion-MPT SAS 
      3.0 devices (Invader, Fury) (Issue: 5756).
--------------------------------------------------------------------
Version 5.5.155.6
[FIX] HCL\Devices: Correctly reset LSI MegaRAID devices.
[FIX] HCL\Devices: Critical issue with AHCI devices that could lead 
      to memory corruption.
[FIX] HCL\Devices: Incorrect packet handling of I350 leading to 
      memory corruption (Issue: 5688).
[FIX] Image Manager: Source image should be opened for only for read 
      (Issue: 5216).
[FIX] Performance: Slowness during boot loader (such as GRUB) 
      operation (Issue: 5713).
[FIX] UI and boot: Issue with boot device list (Issue: 5681). 
[FIX] vSMP CTL: -V exit code correction.
[FIX] vSMP CTL: Make sure statistics present all possible events.
[FIX] vSMP Foundation Device: Donï¿½t allow log to a device if it 
      doesn't exist.
[FIX] vSMP Foundation Device: Donï¿½t support loading vSMP Foundation 
      from device and over network in same VM.
[FIX] Do now create zero size e820 entries (Issue: 5081).
[FIX] Fix emulation of various instructions (Issue: 5649).
[FIX] Interrupts sent to offline CPUs are handled correctly (Issue: 
      5476).
[FIX] Upgrade program can run in Fault-Tolerant mode with -i 
      parameter (Issue: 4513).
[FIX] Upgrade program UI when run on native and vSMP Foundation 
      which booted over network (Issue: 5127, 5180, 5182).
[CHG] HCL\Boards: Enhanced support for boards with large I/O hole 
      under 4GB.
[CHG] HCL\Boards: Prioritize ACPI interrupt routing info over 
      MP-Table.
[CHG] HCL\Boards: Update maximum RAM per board to 8TB.
[CHG] HCL\Boards: Update maximum sockets per board to 8.
[CHG] HCL\Devices: Support for RHEL6.5 driver for Emulex OneConnect 
      10GbE (BladeEngine 3) network adapters and fix of several 
      issues (Issue: 5648, 5740).
[CHG] HCL\Devices: Updated hardware compatibility list.  Details 
      available at http://www.scalemp.com/spec.
[CHG] HCL\Devices: Updated supported device list.  Supported devices 
      are published at http://www.scalemp.com/IOcompat.
[CHG] License: Switch to Memory-expansion (MEX) if number of 
      licensed sockets match the primary board (Issue: 5528).
[CHG] Performance: CPT to correctly handle memcpy of 0 bytes.
[CHG] Performance: Guest code patching (ultravirt): enhanced TLB 
      flushing for latest Linux kernels.
[CHG] UI and boot: Control scaling mode (System-expansion (SYX) / 
      IO-expansion (IOX) / Memory-expansion (MEX)) via System 
      Settings (F5) (Issue: 5568).
[CHG] vSMP CTL: Accept partial command line switches (Issue: 5571).
[CHG] vSMP CTL: Enhanced output for vsmpctl --status (Issue: 5376, 
      5390).
[CHG] vSMP CTL: Improve board-events profiling to show VM linear 
      address.
[CHG] vSMP CTL: Show statistics for board with active CPUs only.  
      Eliminate phantom records in Memory-expansion (MEX) mode as 
      well as incorrect %use report (Issue: 5799).
[CHG] vSMP Foundation Device: Present correct product and iproduct 
      strings (viewable with lsusb -v).
[CHG] Allow up to 64 PCI busses per board (was 16 before).  Changing 
      PCI bus ID enumeration method.
[CHG] Expose ECAM PCI device access for all bus segments (adding 
      segment 0).
[CHG] Improved performance in AMD Turbo-core and Intel Turbo Mode.
[CHG] Reduced vSMP Foundation startup time.
[CHG] Reduced vSMP Foundation memory consumption in Memory-expansion 
      (MEX) mode. 
[NEW] HCL\Backplane: Support for Intel True Scale HCAs.
[NEW] HCL\Backplane: Support for Mellanox Connect-IB HCAs.
[NEW] HCL\Devices: AnyIO auto-enablement for Fusion-IO ioDimm3.
[NEW] HCL\Devices: AnyIO auto-enablement for Samsung Electronics 
      NVMe SSD Controller.
[NEW] HCL\Devices: AnyIO support for MSI/MSI-X with round-robin 
      interrupt distribution.  MSI-X interrupts are limited to 16 
      per device.
[NEW] HCL\Devices: Improved networking devices performance: Intel 
      1GigE and 10GigE, Broadcom NetXtreme II 1GigE and 10GigE.
[NEW] HCL\Devices: Improved performance of Intel Xeon Phi 
      virtualization as host cores (fuzed mode).
[NEW] HCL\Devices: Improved storage devices performance: LSI 
      Fusion-MPT SAS, LSI MegaRAID, LSI MegaRAID Fusion-MPT SAS 2.0.
[NEW] License: Display VM resource trimming due to license.
[NEW] License: Enforce license requirements for accelerators.
[NEW] License: Network license manager updated to RLM10.1BL2, which 
      provides the following major enhancements:
      - Browsers connecting on rlm's main port are redirected to the 
        webserver port.
      - Report log logs all licenses in use both at start and at the 
        end.
      - RLM web interface allows editing license files.
      - RLM web interface doesn't display "Manage Windows Service" 
        on non-Windows systems.
      - RLM web interface now supports user login, with access 
        rights.
      - RLM web interface only displays commands which the user can 
        execute.
[NEW] License: Report license inventory on agent and server (Issue: 
      5473). 
[NEW] Performance: Access to PCI configuration address space.
[NEW] Performance: Guest code patching (ultravirt): AnyIO 
      performance - DMA handling.
[NEW] Performance: Improved performance for Memory-expansion (MEX) 
      VMs.
[NEW] Performance: Improved performance of interrupt handling (fast 
      EOI) - critical for low-latency I/O intensive workloads.  
      Leveraging Guest code patching (ultravirt).
[NEW] Performance: Improved performance of IPI delivery.
[NEW] Performance: Improvements for boards with high CPU count.
[NEW] Performance: Optimized 2MB page-directory entry handling.
[NEW] Performance: Significant improvements for high CPU count (240 
      CPUs) boards.
[NEW] UI and boot: Changed in System Settings (F5) do not require a 
      system restart (Issue: 5539).
[NEW] UI and boot: Control AnyIO board level enablement (first 
      board, all boards, none) via System Settings (F5).
[NEW] UI and boot: Control AnyIO board level enablement via 
      anyio_boards configuration key (default set to 0) or 
      alternatively via anyio_devX=bb:dd:f key for a device-specific 
      enablement.
[NEW] UI and boot: Correctly display interconnect bandwidth (Issue: 
      5336).
[NEW] UI and boot: Enforce use of hardware virtualization if 
      supported by the hardware.  Can be disabled via System 
      Settings (F5) or configuration file with vt=off key (Issue: 
      5488, 5500, 5509).
[NEW] UI and boot: Warning for first time SYX users to install
      vsmppp and then switch to SYX (default is MEX) (Issue: 5525).
[NEW] UI and boot: Improved configuration file error reporting 
      (Issue: 5413).
[NEW] vSMP CTL: Control next boot cpu_boards and io_boards thru 
      --cpu-boards and --io-boards switches (Issue: 5567).
[NEW] vSMP Foundation Device: More robust vSMP Foundation Device 
      read and update (Issue: 5342).
[NEW] vSMP Foundation Device: Support for setting device filter from 
      System Settings (F5) - for USB 1.x (UHCI) devices.  Alert 
      during startup if device shares controller with other devices.
[NEW] Enabling AnyIO on multiple boards will align Linux caches on 
      4KB using guest code patching (ultravirt).
[NEW] Enhanced PCI device representation to allow: bb:dd.f, bb:dd.*, 
      bb:*.f, bb:*.*, *:dd.*, *:*.f, *:*.*.
[NEW] Support for Linux Crash Kernel.
--------------------------------------------------------------------
Version 5.1.135.79
[FIX] License: Several fixes to licensing module that may lead to a 
      smaller VM than allowed by license (Issue: 5773, 5803, 5804).
[FIX] System stuck when network card and EHCI device share interrupt 
      (Issue: 5625, 5637).
--------------------------------------------------------------------
Version 5.1.135.76
[FIX] Delicate issue leading to a memory corruption that can lead to
      Guest OS stalls.
[FIX] License: Handle cases where license consumed multiple times if
      boards were connected thru several topologies (Issue: 5543).
[FIX] Unidentified characters are written to system console (Issue: 
      5593).
--------------------------------------------------------------------
Version 5.1.135.73
[FIX] License: Handle Fault-Tolerant mode correctly (Issue: 5616).
[FIX] License: Handle MEX memory boards correctly (Issue: 5597).
[FIX] UI and boot: Fix matrix display (Issue: 5546).
[FIX] vSMP CTL: Fix erroneously automatic page unpins that leads to 
      significant performance drop for MPI applications (Issue: 
      5584).
[FIX] Issue related to memory initialization for VMs with more than 
      8TB RAM (Issue: 5581).
[CHG] Automatic change of OS boot flag intel_iommu=on to 
      intel_iommu=off.
--------------------------------------------------------------------
Version 5.1.135.67
[FIX] HCL\Devices: Deadlock during extensive use.
[FIX] Performance: Stability of Issue 5516 fix (Issue: 5527).
[FIX] UI and boot: Guest OS loading is stuck at early boot phase due
      to critical issue (Issue: 5532).
[FIX] vSMP Foundation Device: Rare race preventing logs from being 
      written (Issue: 5285).
[NEW] HCL\Devices: Broadcom NetXtreme II 5771x (10GigE) support for 
      multi-function mode.
--------------------------------------------------------------------
Version 5.1.135.64
[FIX] HCL\Devices: Serial ports not working in guest for recent RHEL 
      kernels (Issue: 5150).
[FIX] Critical issue that could lead to memory corruption on 
      Memory-expansion (MEX) (Issue: 5517).
[NEW] Performance: Significantly improve system performance for 
      Sandy-bridge platform following chip ERRATA (Issue: 5516).
--------------------------------------------------------------------
Version 5.1.135.60
[FIX] HCL\Devices: Critical issue with AHCI devices that could lead 
      to system freeze (Issue: 5366).
[FIX] Image Manager: Check destination path exists (Issue: 5464). 
[FIX] vSMP CTL: vsmpctl fixed to support memory PINNING on systems 
      with >512 CPUs.  Now supporting 8192 CPUs.
[FIX] vsmppp: Distinguish between different version of RHEL releases 
      (6.0/6.1/6.2, etc).
[FIX] Nested VM issue that can occur during nested VM migration.
[CHG] HCL\Boards: Expand board list which is using ACPI-only 
      interrupt routing.
[CHG] Image Manager: Expanded command line control with a mix of -k 
      and -c (Issue: 5493).
[CHG] UI and boot: Control scaling mode (System-expansion (SYX) or 
      Memory-expansion (MEX)) via System Settings (F5) (Issue: 
      5478).
[CHG] UI and boot: Show '_' instead of '-' when asking for serial 
      number and CSum.
[CHG] vSMP Foundation Device: Set default logs to none if no device.
[CHG] Ignore broken BIOS MP-Table info.
[NEW] HCL\Devices: Improved performance for Emulex OneConnect 10GbE 
      (BladeEngine 3) network adapters.
--------------------------------------------------------------------
Version 5.1.135.49
[FIX] Diagnostics: Stuck when disconnecting device (Issue: 5154).
[FIX] HCL\boards: Critical error leading to crash during system 
      bringup LSI Fusion-MPT on systems with ICH9 (Issue: 5186, 
      5230).
[FIX] UI and boot: Error handling (Issue: 5446).
[FIX] Fix a race in vSMP Foundation internal messaging system that 
      could lead to a system crash.
[FIX] Selective scaling with more than one CPU boards (but less than 
      maximum) (Issue: 5453).
[CHG] HCL\Devices: Support for Intel 82599 and X540 (10GigE) for 
      physical bar mapping above 4GB.
[NEW] HCL\Devices: Support for Additional EMULEX LightPulse 
      Fibre-Channel HBAs.
[NEW] HCL\Devices: Support for Intel X540 (10GigE).
--------------------------------------------------------------------
Version 5.1.135.43
[FIX] License: Report network license agent states correctly.
[FIX] License: Retry to connect to network license manager rather 
      than fail (Issue: 5436).
[FIX] Critical issue resulting in long delay during evacuation 
      operation.  Affects both performance and stability (Issue: 
      5326).
[FIX] Possible issue related to memory initialization for VMs with 
      more than 6TB RAM.
[FIX] Some JVMs may get stuck (Issue: 5202, 5268).
[CHG] HCL\Devices: Zero LSI MegaRAID unused memory BAR (Issue: 
      5447).
[CHG] UI and boot: bootstrap_mem=1 configuration parameter will not 
      cleanup bootstrap devices.
[CHG] Increase IOAPIC legs to support systems with large number of 
      devices.
[CHG] Serial logs dumped to both serial ports.
[NEW] Performance: Improvements for boards with high CPU count.
[NEW] UI and boot: consistent_topologies=no configuration parameter 
      will allow backplane redundancy in case topologies do not 
      follow port ordering rules.  Default is set to yes.
--------------------------------------------------------------------
Version 5.1.135.31
[FIX] HCL\Backplane: Redundant backplane was failing since 
      5.0.75.63.
[FIX] HCL\Devices: Disable Broadcom NetXtreme II 577xx/578xx MCP, to 
      prevent system reset during initialization (Issue: 5318).
[FIX] HCL\Devices: Support for Intel Storage Controller Unit (SCU) 
      for physical bar mapping above 4GB.
[Fix] License: Report network license manager connectivity issues 
      (Issue: 5387).
[FIX] Partitioner: Correctly detect Fault-Tolerant mode (Issue: 
      5393).
[FIX] vsmppp: Check on invocation if Guest OS changed (RHEL6.x and 
      clones) and act accordingly.
[FIX] Booting systems with more than 32 sockets.
[FIX] Nested VM with latest kernels needing support of RDPMC exit 
      (Issue: 5380).
[CHG] HCL\Boards: Update maximum RAM per board to 8TB.
[CHG] Expose unused CPU threads in ACPI (Issue: 5382).
[CHG] Reduce memory initialization time during system bring up.
[CHG] Reduced vSMP Foundation memory consumption in Memory-expansion 
      (MEX) mode.
[NEW] HCL\Backplane: Stop vSMP Foundation's internal SM with 
      configuration key 'sm=no'.
[NEW] HCL\Devices: Improved performance for Emulex OneConnect 10GbE 
      (BladeEngine 3) network adapters.
[NEW] UI and boot: Boot device selection via UI for two HDD0 (Issue: 
      5300).
[NEW] vSMP Foundation Device: More robust vSMP Foundation Device 
      read and update (Issue: 5349, 5388).
[NEW] vSMP Foundation Device: Support for 64 boards.
[NEW] Improved memory initialization for non-VMX and AMD systems.
[NEW] Present full version string during update.
[NEW] Support upgrade from vSMP Foundation Free to vSMP Foundation.
--------------------------------------------------------------------
Version 5.1.135.15
[FIX] HCL\Boards: Support for IBMï¿½s x3850X5 / X3950X5 systems.
[FIX] HCL\Devices: Correctly ignore Broadcom NetXtreme II 
      577xx/578xx MF devices.
[FIX] License: Correctly detect CPUs (Issue: 5228).
[FIX] Performance: Issue in guest code patching (ultravirt) 
      preventing Guest OS from booting (Issue: 4925).
[FIX] UI and boot: Garbled input keys (Issue: 5280).
[FIX] vSMP CTL: Correctly place within host-bridge address range.
[FIX] vSMP Foundation Device: Read logs from guest.
[FIX] Correctly present vSMP Foundation Private and Cache memory 
      footprint.
[FIX] Critical issue in HPET consistency mechanisms, leading to a 
      long synchronization of HPET main counter reads.
[FIX] Fix emulation of CMP instruction in 64bit mode.
[FIX] Support for extended keys in GRUB (Issue: 5368).
[FIX] Two issues leading to memory corruption during evacuation 
      (Issue: 5308, 5348).
[CHG] License: Fault-tolerant mode selection based on amount of 
      licensed memory in addition to number of licensed sockets.
[CHG] Performance: Reduce number of TLB flushes using delayed flush 
      operation.
[CHG] UI and boot: Request for system key now refers to 
      http://www.scalemp.com/activate.
[CHG] Reduced memory consumption of vSMP Foundation, increasing 
      memory available for system's use.
[NEW] APIC: Allow for large VMs (using X2APIC or APICid compression) 
      event without Intel VT.
[NEW] HCL\Devices: Introducing AnyIO, allow pass-through support for 
      I/O devices (with some limitations).  Initially supported for 
      Intel Xeon Phi.  Note Intel Xeon Phi require additional 
      license which is currently not being tested for.
[NEW] HCL\Devices: Prevent registration of CNIC device on Broadcom 
      NetXtreme II 57xx devices.
[NEW] HCL\Devices: Support for Intel Storage Controller Unit (SCU).
[NEW] License: Introducing Memory-expansion licensing.  Require 
      socket license only for active sockets.
[NEW] Performance: Out of order directory request processing.
[NEW] Performance: Several improvements for boards with high CPU 
      count.
[NEW] Introduce selective scaling, allow selection of physical 
      resource to be aggregated using two new configuration keys: 
      cpu_boards (default set to 0,!0) and io_boards (set to 
      cpu_boards by default).  When cpu_boards is set to 0, the a 
      higher performance Memory-expansion (MEX) memory coherency 
      model will be used.
[NEW] Introducing vSMP Foundation Free.  Provide Memory-expansion 
      with up to 8 boards and 1TB of RAM.
[NEW] Support for Intel Turbo Mode technology.
[NEW] UI and boot: Presenting the board resources being used by the 
      VM.
--------------------------------------------------------------------
Version 5.0.75.76
[FIX] HCL\Boards: Correctly report TSC_DEADLINE feature support in 
      cpuid (Issue: 5332).
[FIX] License: Correctly handle Fault-Tolerant mode (Issue: 5299).
[FIX] Partitioner: UI fix (Issue: 5236).
[FIX] UI and boot: Boards reset at boot time (Issue: 5318).
[FIX] vSMP Foundation Device: Correctly reset when the device 
      installed behind hub on high port number (Issue: 5341, 5349).
[NEW] HCL\Devices: Support for additional LSI MegaRAID Fusion-MPT 
      MGI commands.
[NEW] HCL\Devices: Support for RHEL6.4 driver for Broadcom NetXtreme 
      II 577xx/578xx and fix of several issues.
[NEW] License: License manager agent and vsmptools now included 
      within vsf_tools_installer.sh.
--------------------------------------------------------------------
Version 5.0.75.63
[FIX] HCL\Backplane: Memory leakage in mlx4 driver (Issue: 5215).  
[FIX] UI and boot: minor fix for network license manager status 
      reporting (Issue: 5199).
[FIX] UI and boot: Network license manager status reporting (Issue: 
      5167).
[FIX] vSMP Foundation Device: Correctly reset when the device 
      installed behind multiple cascaded hubs (Issue: 5281).
[CHG] HCL\Backplane: Periodically check and report for leftover 
      messages.
[CHG] HCL\Devices: Support for RHEL6.4 driver for Emulex OneConnect 
      10GbE (BladeEngine 3) network adapters and fix of several 
      issues (Issue: 5284, 5218).
[NEW] UI and boot: bootstrap_mem=1 configuration parameter will not 
      release bootstrap memory.  Default is set to 0.
--------------------------------------------------------------------
Version 5.0.75.58
[FIX] Critical issue in HPET consistency mechanisms, leading to a 
      system crash on high CPU count boards.
[FIX] HCL\Boards: Boot from CDROM (Issue: 4234).
[FIX] HCL\Boards: Interrupt management on ICH9 (Issue: 5186, 5230).
[FIX] License: Correctly detect Fault-Tolerant mode - preventing 
      system upgrade without using the port lock.
[FIX] UI and boot: minor fix for network license manager status 
      reporting (Issue: 5199).
[FIX] vSMP Foundation Device: Correctly reset when the device 
      installed behind hub (Issue: 5252).
[FIX] vsmppp: run even if numactl does not exists.
[CHG] HCL\Devices: Support for 32-bit addressing for LSI MegaRAID 
      (Issue: 4853).
[CHG] HCL\Devices: Support larger ring-size on Broadcom NetXtreme II 
      577xx/578xx (Issue: 5266).
[CHG] HCL\Devices: Support unaligned access to PCI base-address 
      registers (Issue: 5213, 5219).
[CHG] License: Network license manager installer requiring serial 
      number and CSUM - providing system identification for 
      self-activation.
--------------------------------------------------------------------
Version 5.0.75.49
[FIX] Fix several issues with BCM5720 handling (Issue: 5102).
[FIX] HCL\Backplane: Significant (up to 25%) performance improvement 
      for Mellanox ConnectX (all families) HCAs performance.
[FIX] HCL\Devices: USB 2.0 (EHCI) support fixes (Issue: 4645, 5050).
[FIX] License: Done use network license manager is booting from vSMP 
      Foundation Device (Issue: 5194).
[FIX] License: Report when not enough licenses and support for 
      memory-only board (Issue: 5178, 7179, 5181).
[FIX] Partitioner: Fix several issues (Issue: 4785, 4789, 4816, 
      4822, 5141, 5142, 5143, 5144, 5175, 5176, 5177).
[FIX] UI and boot: Keep needed configuration options on secondary 
      boards (Issue: 5130).
[FIX] vSMP Foundation Device: USB 2.0 (EHCI) support behind hub.
[CHG] HCL\Boards: Expand board list which is using ACPI-only 
      interrupt routing.
[CHG] HCL\Devices: Improve LSI MegaRAID performance (up to 33%% on 
      some configurations).
[CHG] vSMP CTL: vsmpversion active license and serial number 
      reporting format.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 577xx/578xx 
      (10GigE) driver version 7.2.
[NEW] Performance: Optimized 2MB page-directory entry handling.
[NEW] Support for AMD Turbo-core technology.
--------------------------------------------------------------------
Version 5.0.75.32
[FIX] HCL\Devices: Correctly reset devices upon VM bring up (Issue: 
      5110).
[FIX] HCL\Devices: Routing interrupts to the I/O initiator (I2I) 
      when target board has an offlined CPU.
[FIX] A rare deadlock under high memory pressure (Issue: 5146).
[FIX] Return invalid-opcode for VEX instructions (prefix 0xc5 / 
      0xc4) emulated on the non-AVX CPUs (Issue: 5161).
[CHG] HCL\Boards: Expand board list which is using ACPI-only 
      interrupt routing.
[CHG] HCL\Devices: Support for RHEL6.3 driver for Emulex OneConnect 
      10GbE (BladeEngine 3) network adapters.
[CHG] License: Network license manager and agent installer file name 
      includes version number.
[CHG] License: Network license manager support for concurrent VM 
      initialization (Issue: 5165).
[CHG] License: New license file required for network license manager 
      for built 5.0.75.30 and later.
[CHG] License: Updated licenses CPU list classification for AMD 
      Opteron 63xx.
[NEW] APIC: Notify user if Guest OS will not be able to enumerate 
      all CPUs.
[NEW] HCL\Devices: Expanded support for HP Smart Array P220i storage 
      device (Issue: 5166).
[NEW] HCL\Devices: Fix port I/O virtualization for Intel 
      e1000/e1000e/igb devices (Issue: 5164).
--------------------------------------------------------------------
Version 5.0.75.11
[FIX] HCL\Devices: Added support for Broadcom NetXtreme II 57712 and 
      578xx (10GigE).
[FIX] HCL\Devices: Allow for multiple transactions on different DMAE 
      to execute at the same time (Issue: 4695).
[FIX] HCL\Devices: Correctly reset HP Smart Array (Issue: 4755, 
      4519).
[FIX] HCL\Devices: Disable Broadcom NetXtreme II CNIC support 
      (Issue: 5117).
[FIX] HCL\Devices: Expose all EHCI devices on secondary boards if no 
      UHCI devices present.
[FIX] HCL\Devices: Fixed initialization of LSI MPT device indexes.
[FIX] HCL\Devices: Hide device BARs for regions above 4GB.
[FIX] vSMP CTL: Fix profiling of DMA events and mark them if 
      appropriate as PROF_IS_LBC_ON_DMA.
[FIX] vSMP CTL: Fixing BAR size to the actual size needed (Issue: 
      4936).
[FIX] vSMP Foundation Device: Enable guest access to vSMP Foundation 
      device on EHCI interface with 'vsmpctl cmd --vfd=on'.
[CHG] APIC: Enforcing CPUID's X2APIC bit only if needed.
[CHG] HCL\Boards: Correctly virtualize MCE interrupts and 
      registers.
[CHG] HCL\Boards: Significantly expanded supported server list.  
      Supported server are published at http://www.scalemp.com/spec.
[CHG] HCL\Devices: Correctly hide hardware TPM capabilities.
[CHG] HCL\Devices: Introducing buffered MMIO write infrastructure to 
      allow posted writes to be transferred over the fabric more 
      efficiently.
[CHG] HCL\Devices: Rewrote network devices support for improved 
      stability and performance: Intel e1000 (1Gige), e1000e 
      (1Gige), igb (1Gige), 82599 (10Gige); Broadcom NetXtreme I 
      (1GigE); Broadcom NetXtreme II (1GigE, 10GigE).  Tested for 
      compatibility with latest drivers.
[CHG] HCL\Devices: Significantly expanded supported device list.  
      Supported devices are published at 
      http://www.scalemp.com/IOcompat.
[CHG] Performance: Disable I/O prefetch when coming from device 
      emulation, use explicit prefetch only.
[CHG] Performance: Fix I/O prefetch (when coming from user space).
[CHG] Performance: Improved performance in cases of using hardware 
      virtualization (VMX/SVM).
[CHG] Rewrote device interrupt delivery scheme for increased 
      correctness and performance.
[CHG] Significantly reduced memory consumption of vSMP Foundation, 
      increasing memory available for system's use.
[NEW] Diagnostics: Allow to upload results to ScaleMP support site 
      or export them from vSMP Foundation using TFTP.
[NEW] HCL\Boards: Support for 1GB pages.
[NEW] HCL\Boards: Support for up to 255 CPUs per board.
[NEW] HCL\Devices: Added support for Emulex OneConnect 10GbE 
      (BladeEngine 3) network adapters.
[NEW] HCL\Devices: Expanded Broadcom NetXtreme I (1GigE, tg3) to 
      support BCM5719 and BCM5720.
[NEW] HCL\Devices: Initial support for Intel Xeon Phi 
      virtualization.  With this capability device Xeon Phi cores 
      presented as host cores.
[NEW] License: Introduce licensing support where boards without 
      socket licenses can be joined to a VM, without exposing its 
      CPUs.
[NEW] License: Introduce network license server and provide license 
      server and agent software packages.
[NEW] vSMP CTL: Introducing new NASRAM PIN/UNPIN command: 
      PINREG_CMD_PIN_LIST_CNT which returns the number of pages for 
      the specified APICID.
[NEW] Introduced *:*.* for pci_dev_filterX to filter out all board 
      devices.
[NEW] Support for ECAM PCI device access.
[NEW] Support for configurations with boards different VMX support 
      capabilities.
[NEW] Support for configurations where the primary board has more 
      CPUs than the secondary boards.
--------------------------------------------------------------------
Version 4.0.225.68
[FIX] HCL\Devices: Critical update for Intel e1000 devices
      preventing interrupt loss and performance degradation.
[FIX] HCL\Devices: Support for mutilpe LSI MPT devices on same 
      board.
[FIX] Critical issue in HPET consistency mechanisms, leading to a
      long synchonization of HPET during bootup.
[CHG] License: Static network license expiration set for March 12th, 
      2013.
--------------------------------------------------------------------
Version 4.0.225.64
[FIX] Critical issue in HPET consistency mechanisms, leading to a
      stale global counter value.
--------------------------------------------------------------------
Version 4.0.225.63
[FIX] vSMP Foundation Device: USB 2.0 (EHCI) support fixes (Issue:
      4801).
[FIX] Critical issue in HPET consistency mechanisms, leading to a 
      significant slowdown on AMD Interlagos platforms.
[FIX] Nested VM issue on platforms with EPT and large page support 
      (Issue: 5048).
[CHG] HCL\Boards: Reading Dell R720 and Dell R720xd interrupts table 
      from ACPI.
[CHG] License: Static network license expiration set for January 
      15th, 2013.
--------------------------------------------------------------------
Version 4.0.225.53
[FIX] HCL\Devices: Support for recent driver (RHEL6.3, FC17) of LSI
      MegaRAID Fusion-MPT SAS 2.0 storage devices (Issue: 4962,
      5011).
[FIX] Critical issue causing global HPET inconsistency, which
      results in Linux freezing some processes for 300 seconds
      (Issue: 5004).
--------------------------------------------------------------------
Version 4.0.225.51
[FIX] Diagnostics: Correctly save PCI device list (test: Save to 
      USB) (Issue: 4958).
[FIX] vSMP Foundation Device: USB 2.0 (EHCI) support fixes.
[CHG] Performance: Issue in guest code patching (ultravirt) 
      preventing some kernels from booting (Issue: 4991).
[CHG] Reduce data transfer amount during system bring-up.
[CHG] License: Static network license expiration set for November 
      27th, 2012.
[NEW] HCL\Backplane: Support for Mellanox ConnectX-3 FDR HCAs.
[NEW] HCL\Devices: Support for additional LSI MegaRAID Fusion-MPT 
      SAS 2.0 storage devices.
--------------------------------------------------------------------
Version 4.0.225.41
[FIX] Diagnostics: Save to USB supports removable HDD as well as 
      other minor fixes (Issue: 3619, 4706).
[FIX] HCL\Boards: Interrupt storm driven by a legacy devices (Issue:
      4897).
[FIX] HCL\Boards: Support for boards with large number of hardware 
      interrupts (Issue: 4488).
[FIX] HCL\Devices: Critical issue with LSI MegaRAID Fusion-MPT SAS 
      2.0 storage devices (Issue: 4772).
[FIX] HCL\Devices: Reduce memory consumption of Intel 82599 (10GigE) 
      device.
[CHG] License: Updated licenses CPU list classification.
[CHG] License: Static network license expiration set for October 
      9th, 2012.
--------------------------------------------------------------------
Version 4.0.225.33
[FIX] HCL\Backplane: Critical regression preventing boot past
      Initializing Backplane on large VMs.
[FIX] HCL\Devices: Critical issue relates to I2I in case where CPUs
      are not initiated on a device board (Issue: 4871).
[CHG] License: Static network license expiration set for September 
      2rd, 2012.
--------------------------------------------------------------------
Version 4.0.225.29
[FIX] HCL\Backplane: Correctly handle 'vmid' key when unlocking a 
      partition (Issue: 4810).
[FIX] UI and boot: Correct boot order when primary has no disk 
      (Issue: 4803).
[FIX] vSMP CTL: Fixing several issues with statistics: double 
      accounting of devices, correctly classify VDSM events.
[NEW] HCL\Backplane: Support for Mellanox ConnectX-3 FDR10 HCAs.
--------------------------------------------------------------------
Version 4.0.225.23
[FIX] HCL\Devices: Critical Intel 82599 (10GigE) fix that could lead 
      to a memory corruption and/or system crash.
[FIX] HCL\Devices: Critical USB 1.x (UHCI) stability fix (Issue: 
      4391).
[CHG] Performance: Guest code patching (ultravirt): enhanced TLB 
      flushing for RHEL6.2 kernels.
[CHG] License: Updated licenses CPU list classification.
[NEW] HCL\Backplane: Support for VM detection using 'vmid' key.
[NEW] Performance: Improved system responsiveness under load.
--------------------------------------------------------------------
Version 4.0.225.8
[FIX] HCL\Devices: Broadcom NetXtreme II 5771x (10GigE) - prevent 
      MCP from taking the control over the PHY.
[FIX] HCL\Devices: Critical update for Intel 82599 (10GigE) and 
      Intel e1000 devices.
[FIX] HCL\Devices: When flattening PCI hierarchy, do not relocate 
      VGA (Issue: 4569).
[FIX] Partitioner: Fix several issues.
[FIX] Performance: Critical fix to memory PINNING.
[FIX] Performance: Fixes I/O prefetch.
[CHG] HCL\Devices: Significantly improved stability and performance 
      of Broadcom NetXtreme II devices.
[CHG] Reduced memory consumption of vSMP Foundation, increasing 
      memory available for system's use.
[CHG] UI and boot: Boot order support same format as boot_device.
[CHG] License: Updated licenses CPU list classification.
[CHG] vSMP Foundation device: Improved reliability and speed of 
      device update.
[NEW] HCL\Boards: Read system interrupt table from ACPI if no 
      MP-Table exists.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 5771x (10GigE) 
      devices with firmware 7.x.
[NEW] HCL\Devices: Support for LSI MegaRAID Fusion-MPT SAS 2.0 
      storage devices.
[NEW] Support for few AVX instructions to allow Guest OS boot in 
      mixed environments where AVX is not supported on all 
      processors.
--------------------------------------------------------------------
Version 4.0.175.21
[CHG] HCL\Devices: HP Smart Array not supported in Performant mode 
      (Issue: 4404).
[CHG] HCL\Devices: Routing interrupts to the I/O initiator (I2I) 
      board now supported by LSI MegaRAID devices.
[CHG] UI and boot: Stop boot on below threshold InfiniBand degraded 
      link rate.
[CHG] License: Updated licenses CPU list classification.
[NEW] HCL\Devices: Support for USB 2.0 (EHCI) devices.
--------------------------------------------------------------------
Version 4.0.115.14
[FIX] vSMP Foundation Device: USB 2.0 (EHCI) support fixes.
[CHG] Performance: Improved CPT performance and correctness.
[CHG] UI and boot: Fixed nested PXE boot to send vendorclass option 
      only once (was two).
--------------------------------------------------------------------
Version 4.0.115.2
[CHG] Changes in system memory layout: I/O hole size, PCI BARs using 
      64 bit address space.
[CHG] HCL\Devices: Improved stability for USB 1.x (UHCI) devices.
[CHG] HCL\Devices: Rewrote Broadcom NetXtreme II support for 
      improved stability and performance.
[CHG] HCL\Devices: Rewrote HP Smart Array storage devices support 
      for improved stability and performance.
[CHG] HCL\Devices: Routing interrupts to the I/O initiator (I2I) 
      board now supported by LSI Fusion-MPT SAS 2.0, Intel 82599 
      (10GigE) and Intel e1000 devices.
[CHG] Performance: Reworked memory PINNING support: increased 
      PIN/UNPIN performance, increased PINNED cachelines to 
      5,000,000.
[NEW] HCL\Backplane: Enhanced semantics of system topology control 
      (system_boards) - using relative port numbers in addition to 
      absolute port numbers.
[NEW] HCL\Backplane: Improve InfiniBand fabric scan - over 100x 
      faster for large fabrics.
[NEW] HCL\Backplane: Support for Mellanox ConnectX-3.
[NEW] HCL\Boards: Enhanced mixed board support and control.
[NEW] HCL\Boards: Support 128 CPUs per board.
[NEW] HCL\Boards: Support for AMD 6100/6200 processors and AMD 
      SR56x0/SP5100 chipset.
[NEW] HCL\Boards: Support for Intel Sandy-bridge processors and 
      Patsburg chipset.
[NEW] HCL\Boards: Support for I/O devices across all system boards 
      (up from 16 before).  Every 16 boards will consume new PCI 
      segment. 
[NEW] HCL\Devices: Enhanced e1000 support for I350.
[NEW] HCL\Devices: Introduce asynchronous interrupt processing mode 
      (AIPM), initially supported for LSI Fusion-MPT SAS 2.0 storage 
      devices.
[NEW] HCL\Devices: Support for Intel 82599 (10GigE) device.
[NEW] HCL\Devices: Support for LSI Fusion-MPT SAS 2.0 storage 
      devices.
[NEW] Performance: Guest code patching (ultravirt): enhanced TLB 
      flushing.
[NEW] Performance: Improved nested VM performance (supported on 
      Intel VMX platforms only).
[NEW] Performance: Sequential Virtual Address (SVA) prefetch support 
      multiple streams.
[NEW] License: Socket-based licensing model.
[NEW] UI and boot: Simplified boot device selection via 
      configuration file.  boot_device now support 
      {HDD,NET,CD}[board:]index format.  If no 'board:' index is 
      considered globally, otherwise it considered within the board.
[NEW] vSMP CTL: Support for variable number of profiling and 
      statistics events.
[NEW] vSMP Foundation Device: same image for primary and secondary 
      boards, assigning roles at first system boot.
[NEW] vSMP Foundation Device: USB 2.0 (EHCI) support.
--------------------------------------------------------------------
Version 3.5.175.55
[FIX] Fix a race in vSMP Foundation internal messaging system that 
      could lead to a system crash.
--------------------------------------------------------------------
Version 3.5.175.53
[FIX] Mixed boards support with different core count (Issue: 4257).
[FIX] Fix a critical race in extensive I/O activity.
[FIX] HCL\Devices: Fix critical issue related to Broadcom NetXtreme 
      II 577xx (10GigE) in use with recet 5.2 version of the driver.
[FIX] HCL\Devices: Support for RMW operations for VGA devices.
[NEW] Upgrade program can downgrade to previous release (Issue: 
      4265).
--------------------------------------------------------------------
Version 3.5.175.46
[FIX] HCL\Devices: Fix critical issue related to Broadcom NetXtreme 
      II 577xx (10GigE) stability - resulting in corrupted packets 
      and link failures (Issue: 4201).
[NEW] HCL\Devices: Support for LSI MegaRAID devices using IEEE SGE
      (Issue: 4116).
--------------------------------------------------------------------
Version 3.5.175.44
[FIX] Crash under high memory pressure (Issue: 4099).
[FIX] HCL\Backplane: correctly handle InfiniBand memory 
      registration.
[FIX] HCL\Devices: Fix critical issue related to Broadcom NetXtreme 
      II 57xx (1GigE) stability - resulting in corrupted packets 
      (Issue: 4168).
[FIX] HCL\Devices: Fix multiple issues related to Broadcom NetXtreme 
      II 5771x (10GigE) stability (Issue: 3901, 3927).
[FIX] Partitioner: Fix critical issues affecting merge stability on 
      large configurations (Issue: 4025, 4090, 4121).
[CHG] To prevent BIOS corruption, vSMP Foundation will use original 
      BIOS table pointers for guest BIOS (Issue: 4188).
[CHG] UI and boot: Serial console terminal type can now be selected 
      in System Setting (F5).
[CHG] vSMP Foundation reports of missing BIOS MP-Table and will not 
      continue is such case.
[NEW] HCL\Boards: Added support for Fujitsu RX300S6 (Issue: 4173).
--------------------------------------------------------------------
Version 3.5.175.29
[FIX] Critical fix relates to deferred operation during evacuation 
      (Issue: 4009).
[FIX] Do not present extended topology in ACPI if Intel VT is in use 
      (Issue: 4041).
[FIX] HCL\Devices: LSI MegaRAID needs to reread PCI register (Issue: 
      4060).
[FIX] HCL\Devices: Possible LSI MegaRAID race for boards with more 
      than one device.
[FIX] Possible IPI race - affecting network connectivity (Issue: 
      4036).
[FIX] Rare race that can lead to memory corruption on systems with 
      large core count.
[FIX] Significant guest memory corruption when writing on DRHD 
      (Issue: 3976).
[FIX] Total memory calculation (Issue: 4029, 4039).
[CHG] UI and boot: Serial console redirection will detect the 
      terminal type and use VT100/ANSI accordingly (Issue: 4026).
[NEW] HCL\Boards: Support for 64 boards with redundant backplane.
[NEW] HCL\Devices: Introducing support of LSI MegaRAID SAS 
      controller (PCI IDs = 0x78).
[NEW] HCL\Devices: Introducing support of LSI MegaRAID SAS2 
      controller (PCI IDs = 0x71/0x73) (Issue: 4008).
--------------------------------------------------------------------
Version 3.5.175.16
[FIX] Distribute guest pages evenly among boards (Issue: 3989).
[FIX] Performance: Some DSRAM transactions taking too long.
[FIX] Remove BIOS32 Service Directory (Issue: 3455).
[FIX] Upgrade program cannot run from removable media (Issue: 3447).
[CHG] HCL\Backplane: Allow user to cancel warning about 
      non-certified HCA (Issue: 3812).
[CHG] HCL\Backplane: Find the shortest path between two boards and 
      use this route.
[CHG] HCL\Backplane: Force primary board to be first on 
      system_boards.
[CHG] HCL\Backplane: Warn before HCA firmware update and allow user 
      to cancel the warning.
[CHG] IOAPIC legs are calculated the minimum possible to reduce 
      fragmentation of GSI address space.
[CHG] Performance: Do not prefetch exclusive state (RMW) if 
      exclusive operations takes too long.
[CHG] Performance: Dynamically calculate number of free shadow page 
      tables based on total RAM and number of CPUs.
[CHG] Performance: Reduced BSP CPU load by leveling it with BSP 
      socket.
[CHG] vSMP CTL: Increase profiling buffer size to reduce lost events 
      in large machines (more than 16 cores per board).
[NEW] Added support for rdtscp instruction.
[NEW] HCL\Backplane: Report the link-rate of the HCA's PCI slot and 
      warn if PCI slot link-rate is lower than InfiniBand link-rate.
[NEW] HCL\Boards: Support for 64 boards.  I/O devices available on 
      first 16 boards only.
[NEW] HCL\Boards: Use board ACPI SLIT values as basis for guest SLIT.
[NEW] HCL\Boards: Validated 1TB RAM per board.
[NEW] HCL\Devices: Performance enhancement for Broadcom NetXtreme II 
      57xx and 5771x (1GigE and 10GigE) - asynchronous operation 
      support, descriptor and data prefetch, routing interrupts to
      the I/O initiator (I2I) board.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 5771x (10GigE) 
      devices with firmware 4.x and 5.x.
[NEW] HCL\Devices: Support for jumbo frames on Broadcom NetXtreme II 
      57xx (1GigE) devices. 
[NEW] Performance: Guest PXM-aware evacuator.
[NEW] Performance: Improve CPT work on PINNED memory - in case of 
      missing destination, copy data directly to the appropriate 
      addresses.
[NEW] Performance: Improve DSRAM performance under extreme load 
      situation (more than 16 cores per board).
[NEW] Performance: NASRAM supports up to 64K cache-lines (was 256).
[NEW] Performance: Significantly increase DSRAM performance.
[NEW] Support for mix-CPUs - use board with different processors 
      (core count or CPU speed) or host bridge as processor boards.
[NEW] UI and boot: Reduce time to connect to other boards upon 
      startup.
[NEW] UI and boot: Show percentage of connection bring-up during 
      system startp.
[NEW] vSMP CTL: Present board matrix in vsmpversion and BSOD output 
      (Issue: 3832).
[NEW] vSMP CTL: Provide interconnect redundancy information.
[NEW] vSMP CTL: support for batching of NASRAM PIN/UNPIN commands 
      using a command area (4K page aligned).
[NEW] vSMP Foundation Device: support for logging facility when 
      booting vSMP Foundation over network.
[NEW] vSMP Foundation Device: Will not start if device connected to 
      USB hub.
--------------------------------------------------------------------
Version 3.0.45.80
[FIX] vSMP CTL: NASRAM PIN/UNPIN error value for unknown command.
[CHG] Last support year extended to 2022.
[NEW] HCL\Boards: Added support for Supermicro X8DAH+-F board.
[NEW] HCL\Devices: Support for LSI MPT connected to SAS Expander.
--------------------------------------------------------------------
Version 3.0.45.74
[FIX] Critical issue related to same-CPU concurrent PIO access 
      (Issue: 3913).
[FIX] HCL\Backplane: Cleanup of garbage prints during fabric probing 
      (Issue: 3911).
--------------------------------------------------------------------
Version 3.0.45.72
[FIX] Critical issue that could lead to a memory corruption when 
      system is under significant memory pressure.
[FIX] vSMP CTL: Profiling issue on systems with HyperThreads sets to
      off (Issue: 3813).
[NEW] HCL\Devices: Support for LSI MPT High Priority Queue.
--------------------------------------------------------------------
Version 3.0.45.56
[FIX] An excess of 33MB per board was taken from the VM (Issue: 
      3732).
[FIX] HCL\Devices: Correctly reset LSI MPT and LSI MegaRAID devices 
      - preventing a memory corruption by these devices (Issue: 
      3692, 3759).
[FIX] HCL\Devices: Fix critical issue for systems with LSI MPT 
      devices that could lead to system crash (Issue: 3788, 3798).
[NEW] HCL\Devices: Expanded support for Intel e1000e devices (Intel 
      82567LM-2) (Issue: 3749).
--------------------------------------------------------------------
Version 3.0.45.47
[FIX] Fixed a critical issue that presented some cores as 
      HyperThreads.
[FIX] vSMP Foundation Device: Fixed a critical issue affecting vSMP 
      Foundation Device (USB) access in rare situations.
--------------------------------------------------------------------
Version 3.0.45.45
[FIX] Fixed ACPI memory location to prevent BIOS corruption (Issue 
      3807).
[NEW] HCL\Backplane: Expanded HCA firmware update support - IBM: 
      Eagle DDR R5.
--------------------------------------------------------------------
Version 3.0.45.42
[FIX] HCL\Boards: USB hotplug Issue: prevented keyboard from working 
      (Issue: 3293).
[FIX] HCL\Devices: Correctly handle LSI MPT MPI_DIAG_RESET_ADAPTER 
      command (Issue: 3480).
[FIX] HCL\Devices: Fix PCI bridge subordinate bus numbers in case of 
      orphan subordinated as exists on IBM HS22 (Issue: 3686).
[FIX] HCL\Devices: Fixed a race condition related to USB mass 
      storage device handling that can cause a system crash (Issue: 
      3680).
[FIX] Performance: Fixed I/O prefetch (Issue: 3436).
[FIX] UI and boot: Long boot device names are truncated (Issue: 
      3401).
[FIX] vSMP CTL: Correctly report HPET statistics.
[FIX] Added support for Int13/AH=4300h (extended write) which 
      prevented Ubuntu 9.10 from booting (Issue: 3421).
[FIX] Fixed several issues regarding global HPET inconsistencies 
      causing Linux to report 300 seconds "Soft lockup" (Issue: 
      3671, 3466).
[FIX] Fixed several issues related to SLES11 SP1 boot (Issue: 3385, 
      3504).
[CHG] HCL\Backplane: vSMP Foundation does not update InfiniBand 
      switch firmware.
[CHG] HCL\Backplane: vSMP Foundation updates firmware of several 
      Mellanox HCAs to latest available (CX: 2.7.700, CX2: 
      2.7.8100).
[CHG] HCL\Devices: Do not naturally align PCI devices (beside VGA) 
      to same 32-bit address space on large systems (bug 3429, 3438, 
      3413).
[CHG] HCL\Devices: Remove legacy IDE devices on secondary boards 
      (Issue: 3325, #3053).
[CHG] UI and boot: Significantly reduced connection time.
[CHG] UI and boot: vSMP video resolution during boot was changed 
      from 80X34 to 80X50.
[CHG] vSMP CTL: Set the first VMX exit reason statistics entry at 
      0x110.
[CHG] Change MTRR's mask entries to set the LSB of its reserved 
      bits.  Fixes a Linux kernels bug (starting from 2.6.25.17) 
      which caused these kernels not to use all memory reported by 
      vSMP Foundation.
[CHG] Increase usable memory to be 97%*((boards-1)/ boards) of total 
      RAM available, and change default memory to be 95% of the 
      usable memory.
[CHG] Reorganize MMIO address space (LAPIC, HPET and IOAPIC 
      addresses).
[CHG] SMBIOS date was set to 2007.
[NEW] APIC: Improved APICid compression algorithm for configurations 
      with less than 255 CPUs.
[NEW] APIC: Introduce X2APIC support.  X2APIC is forced for 
      configurations with more than 255 CPUs.
[NEW] APIC: Virtualize APIC (APICid, threads and cores per socket, 
      etc.) information from CPUID if Intel VT is used.
[NEW] APIC: Intel VT must be used for configurations with more than 
      255 CPUs.
[NEW] HCL\Backplane: Check only for boards running vSMP Foundation 
      in "Finding" phase.
[NEW] HCL\Backplane: Expanded HCA firmware update support - HP: 
      406855-001, 448262-B21 (D2); Mellanox: MHJH29B-XTR (A2), 
      MHQH29B-XTR (A2), MHGH29-XTC (A1); Dell: MCQH29B-XCC.
[NEW] HCL\Backplane: Introduced backplane-load-balancing - using two 
      to four HCAs in parallel for improved performance.
[NEW] HCL\Backplane: Support for switches with up to 288 ports.
[NEW] HCL\Boards: Handle large memory holes.
[NEW] HCL\Boards: If 1GB pages are supported by the processor, force 
      use of Intel VT and turn off 1GB pages support from CPUID.
[NEW] HCL\Boards: PCI bus scanning handles busses with high bus 
      numbers (Issue: 3422).
[NEW] HCL\Boards: Support 8 socket boards / 64 CPUs per board.
[NEW] HCL\Boards: Support for 32 boards.  I/O devices available on 
      first 16 boards only.
[NEW] HCL\Boards: Use Intel VT Control registers to expose Intel QPI 
      Interrupt Control register and set it to round-robin.
[NEW] HCL\Devices: Added support for Broadcom NetXtreme II 57xx 
      packets of up to 64KB.
[NEW] HCL\Devices: Added support for MegaRAID SAS 2.0 9260 HBAs.
[NEW] HCL\Devices: Expanded support for Intel igb devices (Intel 
      82576NS).
[NEW] HCL\Devices: Present one DRHD unit per each board.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 5715 devices.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 5771x (10GigE) 
      devices with firmware 4.x.
[NEW] vSMP CTL: Add the number of free shadow page tables to the 
      statistics.
[NEW] vSMP CTL: Statistics and profiling reports VMX non-root events 
      separately from VMX root events.
[NEW] Introduce VMX instructions virtualization.  Allows transparent 
      usage of VMX instructions by the Guest OS and running
      hypervisors (currently supporting Red Hat KVM).
--------------------------------------------------------------------
Version 2.1.85.33
[FIX] Fixed a race condition related to USB mass storage device 
      handling that can cause a system crash (Issue 3237).
[FIX] Fixed issue related to EMULEX LightPulse Fibre-Channel HBAs 
      when using latest Linux kernels (Issue 3517).
[FIX] Fixed VDSM when using Intel VT.
--------------------------------------------------------------------
Version 2.1.85.29
[FIX] Fixed critical issue causing slowdown when handling IPIs 
      (Issue 3431).
[FIX] Fixed critical locking issue causing system crash under high 
      messaging load (Issue 3461).
[FIX] Fixed a race condition related to USB mass storage device 
      handling that can cause a system crash (Issue 3237).
[NEW] HCL\Devices: Expanded support for Intel e1000 devices (Intel 
      ET QUAD 82576).
--------------------------------------------------------------------
Version 2.1.85.23
[FIX] Fixed critical issue causing the system crash under high 
      messaging load (Issue 3427).
[FIX] HCL\Devices: Correctly reset LSI MegaRAID and LSI MPT devices 
      (Issue 3394).
[FIX] UI and boot: Fixed direction of PgUp/PgDn System Settings (F5) 
      (Issue: 3446).
[CHG] Performance: Enhanced NASRAM UNPIN logic to automatically 
      perform UNPIN command if CPU protection changes while 
      accessing the PINNED memory (Issue: 3425).
--------------------------------------------------------------------
Version 2.1.85.21
[FIX] Fixed issue causing to system reset during power-off or 
      shutdown (Issue: 3012).
[FIX] HCL\Backplane: Multiple fixes to topology detection issues 
      (Issue: 3009).
[FIX] HCL\Backplane: Proper detection and handling of Subnet 
      Manager (SM) existence on the fabric.
[FIX] HCL\Devices: Disable MSI-X interrupt support correctly.
[FIX] HCL\Devices: Handle holding CTRL/SHIFT properly (Issue: 3018).
[FIX] HCL\Devices: Reset all PCI devices used by the Guest OS
      correctly (Issue: 3218).
[FIX] Notify in IA32_MISC_ENABLE MSR that BTS (branch trace storage) 
      and PEBS (performance event based sampling) are not supported 
      (Issue: 2929).
[FIX] Performance: Several stability bugs of the system profiler 
      (Issue: 3209).
[FIX] Properly report interrupt polarity in ACPI (Issue: 1974).
[CHG] HCL\Devices: Support up to 120MB per single command 
      (previously was 8MB).
[CHG] UI and boot: Added countdown to most system messages (Issue: 
      3008, 3149, 3183, 3275).
[CHG] UI and boot: Backplane device format change to include PCI 
      device ID and port.
[CHG] UI and boot: Color codes for success (greed), errors (red) and 
      warning/attention (yellow) messages.
[CHG] UI and boot: Resolution changed to 80x50 (from 80x34).
[CHG] UI and boot: Tabbed UI for System Settings (F5).
[CHG] UI and boot: Welcome Screen closes itself after 300 seconds of 
      inactivity.
[CHG] vSMP CTL: SBE bit signal for at least one board in SBE mode 
      (not all boards as before) (Issue: 3378).
[NEW] HCL\Backplane: Expanded HCA firmware update support - IBM 
      Eagle DDR R5, Mellanox ConnectX2.
[NEW] HCL\Backplane: Increased number of HCAs per board from 1 to 4.
[NEW] HCL\Backplane: Introducing Direct-Connect 2 (DC2): connect 
      multiple systems without InfiniBand switch.  Up to 9 boards 
      supported (1 + 4 HCAs * 2 ports) are supported.  Validated up 
      to 4 boards.
[NEW] HCL\Backplane: Introducing fully redundant mode (FRM): traffic 
      load balancing across HCAs.
[NEW] HCL\Boards: Supermicro X8DTT-IBX, X8DTT-IBXF.
[NEW] HCL\Devices: Expanded support for more Intel e1000 devices 
      (82574L).
[NEW] HCL\Devices: Support for Broadcom NetXtreme II iSCSI devices 
      (cnic).
[NEW] Improved mechanism for waking-up stuck CPUs when saving system 
      log (Issue: 3012).
[NEW] Introducing vSMP Foundation for cloud: support for booting 
      vSMP Foundation over network.
[NEW] Performance: Accelerated performance using Intel 
      VT (Virtualization Technology - VMX instructions) per System 
      Settings (F5).  Default is to use Intel VT.
[NEW] Performance: Improved memory handling by matching the board 
      memory locality with the virtualized NUMA topology.
[NEW] Performance: Improved profiler to report VMX exit reasons.
[NEW] Performance: Introduce Sequential Virtual Address (SVA) 
      prefetch.
[NEW] Performance: Reduced boot time of systems with large memory 
      configurations (by 30 seconds per 1TB).
[NEW] Support for boot from device connected to secondary board.
[NEW] Support for NMI (Issue: 1644).
[NEW] UI and boot: Support for boot device ordering.
[NEW] License: Upgrade program can remove or change the license key.
[NEW] Validated SYSLINUX and PXELINUX version 3.84.
--------------------------------------------------------------------
Version 2.0.65.55
[FIX] Fix emulation of CMP instruction in 64bit mode.
--------------------------------------------------------------------
Version 2.0.65.54
[NEW] Support for Intel Matrix RAID (fakeRAID) for ICH10.
--------------------------------------------------------------------
Version 2.0.65.53
[FIX] Fixed two rare cases where vSMP Foundation internal structures
      got corrupted due to mishandling of CPT on MMIO region or EVAC
      on non existing memory (Issue: 3102, 3231).
[FIX] Distribute interrupts to maximum processors on Intel 55xx 
      chipset (Issue: 3262).
--------------------------------------------------------------------
Version 2.0.65.49
[FIX] Fixed mishandling of Int15/AH=24h which prevented Nehalem 
      systems from booting some versions of grub (specifically
      RHEL4.8) (Issue: 3187).
[FIX] Fixed interrupt mishandling of Intel igb devices that caused 
      performance issues.
[FIX] Fixed interrupt mishandling of Intel igb devices that caused 
      Guest OS (Linux 2.6.31) crash (Issue: 3152).
[FIX] Turning off MSI support in early phase usage of HP Smart Array 
      storage devices (Issue: 3218).
[NEW] Added support for HP Smart Array storage devices: P700m, P212, 
      P410, P410i, P411, P812 (Issue: 3214, 3215, 3216, 3218).
--------------------------------------------------------------------
Version 2.0.65.45
[FIX] Fix system crash due to wrong NASRAM handling of 16 byte 
      instructions (Issue: 3221).
[FIX] Fixed wrong interrupt handling of Intel e1000 devices that 
      resulted in Guest OS crash (Issue: 3184).
--------------------------------------------------------------------
Version 2.0.65.43
[FIX] Fix a lock starvation causing a system lockup on Intel 55xx 
      platforms.
[FIX] Fix a delicate timing issue during startup when boards are 
      not started at the same time.
[FIX] HCL\Devices: Fix restart of Broadcom NetXtreme II 5708 
      devices (Issue: 3169).
[FIX] Fix PXE boot issue in 82575/6 (Issue: 3169).
[NEW] HCL\Backplane: Expanded HCA firmware update support - 
      Mellanox: MHGH18-XTC (A1).
--------------------------------------------------------------------
Version 2.0.65.35
[FIX] Fix for a case where CPT scans a code which was unmapped 
      (Issue: 3117, 3120).
[FIX] Handle APIC broadcast (destination=0xFF) correctly.
[CHG] IOAPIC interrupt routing is always comply, unless set by 
      vSMP CTL.  Please use appropriate support in the Guest OS for 
      improved performance.
[NEW] HCL\Devices: Support for Broadcom NetXtreme II 5716 and 5716S 
      devices.
[NEW] HCL\Backplane: Expanded HCA firmware update support - 
      Mellanox: MHQH19-XTC (A1).
--------------------------------------------------------------------
Version 2.0.65.27
[FIX] HCL\Backplane: Fixed rare race in InfiniBand initialization 
      code that could trigger by large memory.
--------------------------------------------------------------------
Version 2.0.65.25
[FIX] HCL\Backplane: Fixed case where redundant backplane did not 
      take action fast enough at backplane failure.
[FIX] HCL\Backplane: Read second port GUID from the HCA rather than 
      assuming its value it based on the first port GUID.
[FIX] HCL\Devices: Correctly handle init and restart of Broadcom 
      NetXtreme II 5709S devices.
[FIX] HCL\Devices: Correctly handle multiple MegaRAID controllers on 
      same board.
[FIX] HCL\Devices: Correctly identify DELL PERC5 devices.
[FIX] UI and boot: Fixed System settings UI to support system memory 
      of more than 999999MB.
[FIX] vSMP CTL: Correctly report statistics records when 
      HyperThreading is available but not enabled.
[CHG] Expose extended topology in ACPI only when more than 8 boards 
      are in use.
[CHG] vSMP Foundation Device: Fix layout to include valid partition 
      table with active partition.
[NEW] HCL\Backplane: Expanded HCA firmware update support - Dell: 
      0Y773M.
[NEW] HCL\Devices: Support for Intel 82571PT Gigabit PT Quad Port 
      Server ExpressModule.
--------------------------------------------------------------------
Version 2.0.65.13
[FIX] HCL\Backplane: Fixed case where redundant backplane prevented 
      the system from booting.
[FIX] HCL\Devices: Correctly reset Intel Gigabit Ethernet devices 
      (82575/6).
[FIX] HCL\Boards: Correctly report board memory in configuration 
      with over 8 boards based on Intel 55xx processor and chipset.
--------------------------------------------------------------------
Version 2.0.65.12
[FIX] Partitioner: Initialization of backplane redundancy 
      configuration may fail in some cases and restart the system.
[FIX] Fix of a rare deadlock under extreme I/O load.
[NEW] HCL\Boards: Validated 256 CPUs configuration (16 boards x 2 
      processors x 4 cores x 2 threads).  Due to x86 specifications 
      only 255 CPUs will be used.
--------------------------------------------------------------------
Version 2.0.65.9
[FIX] HCL\Devices: Broadcom NetXtreme II can have zero L2_context.
[FIX] HCL\Devices: Correctly reset devices upon startup.
[CHG] HCL\Backplane: Backplane update can be controlled from System 
      Settings.
[CHG] HCL\Boards: Increase max number of CPUs per board to 16 (was 
      8).
[CHG] HCL\Devices: Up to 4 PCI devices of same type per board, with 
      the exception of USB (8) and HP Smart Array storage devices 
      (1).
[CHG] Performance: NASRAM support 256 cache-lines (was 100).
[CHG] UI and boot: Restart due to missing board will restart all 
      boards.
[NEW] HCL\Backplane: Support for active-active backplane redundancy.
[NEW] HCL\Backplane: Verified QDR InfiniBand (Mellanox HCA and 
      Switch).
[NEW] HCL\Boards: Improved interrupts mapping and CPU detection.
[NEW] HCL\Boards: Relaxed board shift in APICID register.  If 
      possible, keep the original APICID and use the leftover bits 
      in the APICID register for board number.  The original APICID 
      will change to use a minimal form if board number does not fit 
      the leftover bits.
[NEW] HCL\Boards: Support for Intel 55xx processor and chipset 
      series as well as ICH10.
[NEW] HCL\Boards: Support for up to 256GB per board.  Addresses 
      beyond 256GB are not supported.
[NEW] HCL\Boards: Validated 1024GB RAM configuration (16 boards x 
      64GB).
[NEW] HCL\Boards: Verified Appro gB222X; Dell PowerEdge R610, R710, 
      M610; IBM System dx360 M2 (iDataPlex); Sun Fire X2270, X4170; 
      Supermicro X8DTT-IBQ, X8DTN+.
[NEW] HCL\Devices: Support for additional Intel Gigabit Ethernet 
      devices (82575/6).
[NEW] HCL\Devices: Support for EMULEX LightPulse Fibre-Channel HBAs.
[NEW] HCL\Devices: Support for SATA in mixed mode.
[NEW] Partitioner: Introducing System Partitioner.  Boards can now 
      be assigned to different partitions allowing better resource 
      management.
[NEW] Performance: CPT support for intel_new_memcpy() pattern 
      (ifort11).
[NEW] vSMP CTL: Introducing profiling and statistics counters to 
      analyze system and application performance.
[NEW] Performance: NASRAM PIN/UNPIN command accepts virtual 
      addresses.
[NEW] Support for local-APIC one-shot timer mode.
[NEW] UI and boot: Introduced timeout (with down counter) to most 
      error messages.
[NEW] UI and boot: Support for serial redirection of boot UI.
[NEW] vSMP CTL: report APICID board shift.
--------------------------------------------------------------------
Version 1.7.576.34
[NEW] HCL\Backplane: Expanded HCA firmware update support - 
      Mellanox: MHQH29-XTC (A2).
--------------------------------------------------------------------
Version 1.7.576.33
[FIX] HCL\Devices: Properly reset of LSI MegaRAID XSCALE devices.
--------------------------------------------------------------------
Version 1.7.576.32
[FIX] Performance: Fixed issue leading to performance degradation 
      under extreme memory pressure.  This could also lead to system
      freeze or crash.
[FIX] HCL\Devices: Properly reset of LSI MegaRAID devices in case 
      the Guest OS does not make use of them.
--------------------------------------------------------------------
Version 1.7.576.30
[FIX] HCL\Devices: Fixed memory corruption issue due to incorrect 
      reset of LSI MegaRAID devices.
--------------------------------------------------------------------
Version 1.7.576.29
[FIX] HCL\Devices: Fixed issues with Broadcom NetXtreme II devices 
      connected to 100Mbit networks.
--------------------------------------------------------------------
Version 1.7.576.26
[FIX] HCL\Devices: Fixed multiple issues related to Broadcom 
      NetXtreme II devices.
[FIX] HCL\Devices: Fixed multiple issues related to USB devices.
[FIX] HCL\Devices: Fixed issue caused the Guest OS to fail in
      probing LSI MegaRAID devices (Issue: 2519, 2685).
[FIX] HCL\Boards: Fixed multiple issues related to handling of 
      shared-interrupts (USB, MegaRAID, Broadcom NetXtreme II, 
      Legacy IDE.
[FIX] Fixed issue with concurrent DSRAM request that led to a system 
      failure. 
[CHG] HCL\Boards: Improved robustness of interrupt detection 
      mechanism.
[NEW] HCL\Backplane: Expanded HCA firmware update support - Dell: 
      0H288M; Mellanox: MHGH28-XTC (A4).
[NEW] HCL\Devices: Introducing support for additional LSI XSCALE 
      MegaRAID SAS controller (SAS1064R, DELL PERC5).
--------------------------------------------------------------------
Version 1.7.576.12
[FIX] Fix DHCP packet parsing to get the pxeclient file name from 
      option 67.
[FIX] Prevent system lockup on boot is some configuration due to 
      memory setup.
[FIX] HCL\Devices: Fix issue preventing SLES10 from booting on 
      system with MegaRAID adapters (Issue: 2755, 2774).
[CHG] Improved UI of Save to USB test.
[NEW] Performance: Faster interrupt processing.
--------------------------------------------------------------------
Version 1.7.576.6
[FIX] HCL\Boards: Fixed IBM HS21XM (BladeCenter) Advanced Management 
      Module USB keyboard/mouse access.
[FIX] HCL\Boards: Fixed issues related to support of 64GB on 
      boards with Intel 5400 chipset (such as Intel S5400SF boards) 
      (Issue: 2031, 2618).
[FIX] HCL\Backplane: Fixed significant correctness issue in handling 
      Mellanox ConnectX HCA that could result in a system crash 
      (Issue: 2677).
[FIX] Improved SLES graphical boot time (Issue: 1621).
[FIX] Ignore malformed IPIs (Issue: 2505).
[FIX] Fix SRAT creation for low-memory configuration (Issue: 2359).
[FIX] Fix issue relates to filtering single function of
      multi-function PCI device.
[FIX] Inform user when MBR is zeroed (Issue: 2287).
[FIX] Fix multiple issues regarding global HPET inconsistencies.
[CHG] HCL\Devices: Support up to 4MB SCSI commands with LSI MPT 
      devices.
[CHG] Version number always consist 4 numbers: X.Y.M.B, where X.Y is 
      the major version (1.7, for example), M is the minor version, 
      and B is the build version.
[CHG] Minimum number of boards in Fault-Tolerant mode reduced to 2.
[CHG] Improved MSI device capability removal.
[NEW] Performance: Introducing new mechanism to prefetch of I/O 
      originated data.
[NEW] HCL\Devices: Introducing support of HP Smart Array storage 
      devices.
[NEW] HCL\Boards: Added support for HP BL460c-G1 (BladeSystem) and 
      Sun X6250 (Blade 6000).
[NEW] HCL\Boards: Support for boards with PCI bus ID larger than 
      0x0F (such busses will be relocated to free busses lower than 
      0x0F).
[NEW] HCL\Backplane: Expanded HCA support - all Mellanox InfiniHost 
      III and Connect-X are supported.  vSMP Foundation will request 
      the user to send report about non-certified HCA to ScaleMP.
[NEW] HCL\Backplane: Support for redundant InfiniBand switch 
      configuration.  vSMP Foundation will use single switch for 
      communication, and switch to the other switch on switch 
      failure (requires restart).
[NEW] HCL\Backplane: Expanded HCA support - HP: 448262-B21 - HP 4X 
      DDR InfiniBand Mezzanine HCA (BladeSystem).
[NEW] UI and boot: Introduced down counter to all timers.
[NEW] UI and boot: Improved UI of vSMP Foundation update program.
[NEW] License: Improved license handling and block vSMP Foundation 
      update in case of support expiration.
[NEW] Support heterogeneous board configurations: Boards with 
      different PCI host-bridge than the primary board will be 
      considered memory-only boards.
--------------------------------------------------------------------
Version 1.7.438 SP12
[CHG] HCL\Devices: Remove of the limitation on maximum supported 
      AHCI ports per controller (was 2).
--------------------------------------------------------------------
Version 1.7.438 SP11
[FIX] HCL\Devices: Turn off AHCI NCQ capabilities as it is not 
      supported (Issue: 2356).
--------------------------------------------------------------------
Version 1.7.438 SP9
[FIX] HCL\Boards: Correctly handle CPU startup in case the BSP's 
      APICID is not 0 (Issue: 2413).
[FIX] Fix multiple issues which caused HPET to intermittently go 
      back in time.
[CHG] Provide pass-thru access to HPET which result in 9x 
      performance improvement in synthetic GTOD benchmark.
[CHG] Handle HPET sync in more efficient manner to reduce sync cost 
      (up to 50% reduction).
[CHG] Dynamically allocate I/O hole to allow access to all I/O 
      devices in large system setups.
[NEW] Performance: Significantly improve performance for multi-core 
      systems with high-board-count (synthetic benchmark shows 40% 
      reduction in runtime).
[NEW] HCL\Boards: Added support for Supermicro X7DGT-INF board.
[NEW] HCL\Backplane: Expanded HCA support - Sun: X4217A-Z - Sun Dual 
      Port DDR IB Host Channel Adapter PCIe Express Module (Sun 
      Blade 6000 Modular System); IBM: Voltaire BC-HSEC-128-SDR-Rev1 
      (BladeCenter).
[NEW] vSMP CTL: Separate extended statistic in vSMP CTL to increase 
      statistics reading responsiveness.
[NEW] vSMP CTL: Statistics now accounts for board events privilege 
      level.
[NEW] vSMP CTL: Statistics now accounts HPET sync rate and drift.
[NEW] Introduce vSMP Dedicated Service Mode (VDSM) for CPUs in HLT 
      with interrupts disabled.  A CPU in VDSM does the following:
      (1) Synchronizes the board's clock every 100us, and
      (2) Processes all the board backplane activity (which improves 
      performance for the other CPUs).
[NEW] Support for CPU hotplug.  CPUs can be put in HLT with 
      interrupts disabled and be woken up with INIT-SIPI-SIPI 
      sequence.
--------------------------------------------------------------------
Version 1.7.438 SP8
[FIX] HCL\Devices: Fix issue related to USB interrupt handling, 
      leading to delays in interrupt delivery (Issue: 2484).
[FIX] HCL\Devices: Fix issue related to polling of LSI MegaRAID that 
      could hog the processor (Issue: 2484).
[FIX] HCL\Devices: Fix issue related to polling of LSI MegaRAID 
      devices when polling is from remote board (Issue: 2484).
[FIX] HCL\Backplane: Periodic backplane verification could fail in 
      some cases where none of the CPUs on a board initialized 
      (Issue: 2479).
[FIX] Do not filter PCI devices with function other than 0.  This 
      could prevent user access to all USB devices on some boards.
[FIX] Some interrupts were lost when sent from remote board (Issue: 
      2530).
[CHG] HCL\Devices: Optimized memory required to support LSI MegaRAID 
      device.
[CHG] HCL\Devices: Support up to 8 USB devices on the first board 
      (previously 2).  This could prevent user access to all USB 
      devices on some boards.
--------------------------------------------------------------------
Version 1.7.438 SP7
[FIX] vSMP Foundation Device: Correctly handle upgrade with all 
      types of USB devices.
[NEW] HCL\Boards: Added support for Supermicro X7DWT-INF+ board.
--------------------------------------------------------------------
Version 1.7.438 SP2
[FIX] Diagnostics: Fix issue related to diagnostics output display 
      and collection.
--------------------------------------------------------------------
Version 1.7.438 SP1
[FIX] HCL\Boards: Support for USB hotplug.
[CHG] vSMP CTL: Full version does not report of Embedded or 
      Standalone.
[CHG] MTRR to correctly report memory size.
[NEW] Performance: Backplane implementation optimization - up to 15% 
      performance improvement in 4 board/32 core setup in a 
      ping-pong test.
[NEW] Performance: Allow CPT to work on PINNED memory.
[NEW] HCL\Devices: Support for NetXtreme II Gigabit Ethernet NIC.
[NEW] HCL\Boards: Added support for IBM HS21XM (BladeCenter) and 
      Dell M600 (M1000e).
[NEW] HCL\Backplane: Automatic switch reset upon firmware update 
      (single switch).
[NEW] HCL\Backplane: Verify backplane status every 30 seconds.
[NEW] HCL\Backplane: Expanded HCA support - Dell: 0HX271 (Dell 
      PowerEdge M600 - ConnectX IB MDI Dual-Port InfiniBand 
      Mezzanine Card).
[NEW] HCL\Backplane: Expanded InfiniBand switch support - all 
      switches are supported.  System will report switches for which 
      firmware upgrade cannot be performed and continue.
[NEW] UI and boot: Introducing Welcome Screen.
[NEW] UI and boot: Introducing System identification checksum to 
      prevent typing errors. 
[NEW] Support for emulation of 128bit XMM instructions.
--------------------------------------------------------------------
Version 1.7.407 SP5
[FIX] HCL\Devices: Added missing PCI bridges interrupts to MP-Table 
      and ACPI (Issue: 1307).
[FIX] HCL\Devices: Fixed LSI MPT port I/O support (Issue: 2405).
[FIX] Diagnostics: Correctly identifying InfiniBand HCA port.  
      Zeroing port counters correctly as well.
[FIX] PXE's LOCALBOOT ends with error message rather than crash 
      (Issue: 2254).
[FIX] Handle #SS faults correctly - pass them to the Operating 
      System (Issue: 2343).
[FIX] Support for INT3 code scanning (Issue: 2367).
[FIX] Correctly report APICIDs in MP-Table (Issue: 2393).
[FIX] Fix Issue with OpenSuSE 10.2 and 10.3 boot loader (Issue: 
      2345).
[FIX] Fixed Knoppix boot (Issue: 1384).
[CHG] HCL\Devices: Intel ICH5 SATA devices presented as SATA and not 
      as PATA (Issue: 2170).
[CHG] Diagnostics: Correctly handle USB devices with no partitions 
      (Issue: 2338).
[CHG] Diagnostics: Output folder name follows test name rather than 
      test number.
[CHG] ACPI oem_revision and asl_compiler_revision reports vSMP 
      Foundation build date.
[NEW] HCL\Devices: Support for jumbo frames on Intel e1000 devices.
[NEW] HCL\Devices: Expanded support for more Intel e1000 devices 
      (hopefull all of them).
[NEW] HCL\Devices: Introducing support of LSI 1078 MegaRAID SAS 
      controller.
[NEW] HCL\Boards: Added support for IBM System x iDataPlex DX340 
      system.
[NEW] HCL\Boards: Added support for Supermicro SBI-7125W-S6 
      (SuperBlade) system.
[NEW] HCL\Backplane: Expanded HCA support - Mellanox: MHEH28-XTC, 
      MHEH28-XSC; Supermicro: AOC-IBH-001 (SuperBlade); IBM: 43W4421 
      (BladeCenter - Cisco 4X InfiniBand DDR).
[NEW] HCL\Backplane: Expanded InfiniBand switch support - 
      Supermicro: SBM-IBS-001 (SuperBlade).
[NEW] Diagnostics: Report pre-boot environment logs.
[NEW] Support Linux reboot=triple command-line option.
[NEW] Validated SYSLINUX and PXELINUX version 3.63.
[NEW] Support for management BIOS (SMBIOS).
--------------------------------------------------------------------
Version 1.7.349 SP4
[FIX] Resolved faulty log marker search that led to hang upon 
      boot-up (Issue: 2350).
[CHG] Change PCI bus renaming to be less aggressive on primary 
      board, allowing maximum devices to maintain native PCI 
      addressing.  This modification helps X11 VGA probing to be 
      consistent between native and aggregated modes.
[CHG] Improve system responsiveness by not masking local-APIC timer.
--------------------------------------------------------------------
Version 1.7.349
[FIX] Fixed black screen appearing during system initialization due 
      to persistent diagnostics log area scan (Issue: 1958).
[FIX] Distribute system shutdown to all boards, preventing them from 
      being reset (Issue: 2070).
[FIX] Fixed dependency on flat e820 map for vSMP Foundation 
      structures.
[FIX] SLES support graphical install (VGA BIOS emulation) (Issue: 
      2269).
[FIX] Issues related to queuing of internal messages that could lead 
      to memory corruption.
[CHG] Reduced memory consumption of vSMP Foundation, increasing 
      memory available for system's use (2.1GB increase of system 
      memory in 6-boards configuration with 192GB RAM).
[NEW] Performance: Significantly improved performance of workloads 
      that map same memory area (mmap file, threaded workloads).
[NEW] Performance: Significantly improved performance of large-core 
      count boards.
[NEW] Performance: Significant performance improvement for 
      large-memory applications.
[NEW] Performance: Added caching of I/O lookup tables to provide 
      better performance in large-board count scenarios.
[NEW] HCL\Devices: Support boards that work only with USB 2.0 
      (EHCI).
[NEW] HCL\Devices: Support all lsiutils commands.
[NEW] HCL\Boards: Added support for Intel S5400SF board (SR1560SF / 
      SR1560SFHS).
[NEW] HCL\Boards: Added support for Supermicro X7DWT-INF board 
      (SuperServer 6015TW-INFB / 6015TW-INFV).
[NEW] HCL\Boards: Verified 64GB per-board configuration on 
      Flextronics DPK66 and Intel S5400SF boards.
[NEW] HCL\Boards: Minimum memory per board changed to 2GB.
[NEW] HCL\Boards: Support for boards where the BSP's APICID is not 
      0.
[NEW] HCL\Backplane: Expanded HCA support - Mellanox: MHES18-XTC, 
      MHGS18-XTC; Intel: AXXIBIOMOD (IB module).
[NEW] Diagnostics: Present vSMP Foundation Serial and System Key.
[NEW] Diagnostics: Report of board snoop-filter status (Intel 5000X 
      and 5400 chipsets).
[NEW] Diagnostics: Read and clear System Event Log (SEL) of all 
      system boards (if available).
[NEW] Diagnostics: Save diagnostics results and persistent logging 
      to USB memory stick.
[NEW] UI and boot: System initialization UI (loading, settings and 
      diagnostics) and process.
[NEW] UI and boot: System failure displays error message rather than 
      restart (controlled by system settings).
[NEW] vSMP Foundation Device: USB device support.
[NEW] vSMP Foundation Device: More robust vSMP Foundation Device 
      detection.
[NEW] vSMP Foundation Device: vSMP Foundation Device content 
      encryption.
[NEW] vSMP CTL: Report full-version as well as system summary.
[NEW] vSMP CTL: Statistics interface to report cache-lines accesses, 
      which is used as a threshold for evacuation.
[NEW] Support for different amount of memory per board.
[NEW] Support for memory-only boards: processors of boards with 
      lesser cores or lesser speed than the primary not presented to 
      the Guest OS.
[NEW] Added PXE boot option.
[NEW] Support for XEN kernels.
[NEW] Improved SP version handling at startup and upgrade.
--------------------------------------------------------------------
Version 1.7.239 SP7
[FIX] Resolved system responsiveness Issue: while under high cache 
      pressure (Issue: 2145).
--------------------------------------------------------------------
Version 1.7.239 SP1
[FIX] Resolved correctness Issue: that affect LSI MPT users under 
      high load.
--------------------------------------------------------------------
Version 1.7.239
[FIX] Fixed memory size handling under Fault-Tolerant mode 
      correctly; Fault-Tolerant memory settings doesn't override 
      regular settings (Issue: 1810).
[FIX] Fixed code scanning beyond CALL instruction (Issue: 1387).
[FIX] Fixed internal interrupt allocation on some boards (Issue: 
      1986).
[FIX] Fixed FP instruction support requires by recent Linux kernels 
      (Issue: 1912).
[CHG] HCL\Backplane: vSMP Foundation updates Mellanox HCA firmware 
      to 5.2.000.
[CHG] Improved utilization of persistent diagnostics log area.
[NEW] Performance: Significantly improved performance of workloads 
      that span memory of more than single board.
[NEW] Performance: Significantly improved performance in case of 
      high mapping count for single-page.
[NEW] Performance: Improved boot time of large memory systems.
[NEW] Performance: Improved backplane performance.
[NEW] HCL\Devices: Introducing support of LSI MPT storage devices: 
      FCAL, SAS, SCSI; Verified LSI devices: FC: FC929XL, FC949X; 
      SAS: SAS3801E; SCSI: 53c1030.
[NEW] HCL\Devices: Introducing support of USB 1.x (UHCI) devices.
[NEW] HCL\Boards: Added support for Flextronics DPK66 boards.
[NEW] HCL\Boards: Verified 60GB per-board configuration on 
      Flextronics DPK66 boards.
[NEW] HCL\Boards: Verified support for up to 960GB total system 
      memory size (16 boards).
[NEW] HCL\Backplane: Expanded HCA support- Mellanox: MHGA28-XTC Rev. 
      A4.
[NEW] HCL\Backplane: Automatic backplane interface port detection.
[NEW] Introducing new diagnostics module (F12 in System Settings 
      (F5) screen).
[NEW] Introducing IRQ routing mode reporting with vSMP CTL.
[NEW] Added support of logical flat-model IOAPIC destination mode.
--------------------------------------------------------------------
Version 1.7.191 SP4
[FIX] Fixed Issue: of no-restart upon backplane firmware upgrade 
      (Issue: 1929).
[FIX] Fixed ordering of multi-chassis in cascaded backplane 
      environment (Issue: 1938).
[FIX] Prevent system restart upon IDE ABORT command (Issue: 1991).
[FIX] Fixed system failure to boot in presence of extended 
      partitions on the HDD connected to the primary board.
[NEW] Enablement of changes to system configuration in runtime.
--------------------------------------------------------------------
Version 1.7.191
[FIX] UI and boot: Corrected message wording and display format at 
      system initialization.
[FIX] Fixed SLES10 graphical install issues (Issue: 1346).
[FIX] vSMP CTL: Fixed incorrect reset functionality for statistic
      and profiling counters (Issue: 1343).
[FIX] Fixed an Issue: with handling of multibyte-nop created by 
      RHEL5 compilation with GCC (Issue: 1883).
[FIX] Fixed validation for equal number of processors across boards 
      (Issue: 1669).
[FIX] Fixed pop instruction emulation that affected SLES10 (Issue: 
      1470).
[CHG] HCL\Backplane: vSMP Foundation updates Mellanox MTS2400 
      firmware to 1.0.0.
[CHG] Removed hanging PCI-to-PCI bridges and chipset resource 
      devices.
[CHG] Use hard-reset upon restart - remove BIOS dependencies.
[NEW] Performance: DSRAM handling and performance under extreme load 
      situation (multi-core).
[NEW] HCL\Boards: Validated 16 boards configuration.
[NEW] UI and boot: Changed system boot UI resolution to 80x34 - 
      providing more information to the user per console screen.
[NEW] UI and boot: Check and report board consistency (number of 
      processors).
[NEW] Enabled upgrading from vSMP versions 1.6.68 or higher.
[NEW] Persistent logging - system/diagnostic messages can be logged 
      to the on-board vSMP device.
[NEW] Auto-restart option in fault-tolerant situations.
[NEW] New memory coherency model (NASRAM).
--------------------------------------------------------------------
Version 1.7.146
[FIX] Fixed VESA driver support issues - Guest OS graphic-mode 
      installation now works.
[FIX] Fixed issues exhibited when attempting to boot from a CDROM 
      device with unbootable content.
[FIX] Fixed IOAPIC interrupt routing - 'fixed' and 'logical' 
      delivery modes are supported.
[CHG] Reduced memory consumption of vSMP Foundation, increasing 
      memory available for system's use.
[NEW] HCL\Boards: Verified support for up to 384GB total system 
      memory size (12 boards).
[NEW] HCL\Backplane: Enhanced backplane speed to DDR - improved 
      system performance.
[NEW] HCL\Backplane: Support multi-chassis environment with cascaded 
      backplane. 
[NEW] UI and boot: Check and report backplane link rate.
[NEW] UI and boot: Check and report board consistency (memory 
      amount, BIOS settings, etc). 
[NEW] License: Added hardware-based licensing.
[NEW] Support all IOAPIC interrupt routing modes.
[NEW] Support debug breakpoints (gdb).
--------------------------------------------------------------------
Version 1.6.69
[FIX] Fixed an Issue: with incorrect setting of the NT flag, 
      required by latest Linux kernels.
--------------------------------------------------------------------
Version 1.6.68
[FIX] Fixed an Issue: with HPET subsystem causing time drifts and 
      non-monotonic time-reads across system boards (Issue: 1564).
[CHG] Modified copyless-pointer-transfer (CPT) not to handle 
      scenarios affecting only one cache-line.
--------------------------------------------------------------------
Version 1.6.66
[FIX] Fixed missing mmx instruction emulation (MOVQ), which could 
      cause system crash by X server (Issue: 1176).
[FIX] Fixed CPT REP MOVS handling: ignore cases where DF=1 (reverse 
      copy).
[NEW] Initial CPT support for glibc-2.4-31.2 (SLES10).
--------------------------------------------------------------------
Version 1.6.64
[FIX] Fixed critical issues in the implementation of 
      copyless-pointer-transfer (CPT) and large-block-copy (LBC), 
      which could cause data corruption.
[FIX] Fixed interrupt flag during CPU initialization.  Interrupts 
      are disabled at CPU initialization as required by spec (Issue: 
      1371).
[CHG] Performance: Improved system performance under workloads 
      consuming large (>10GB RAM per board) memory of single board.
[CHG] Improved HPET device responsiveness.
[CHG] Reduced system restart time (Issue: 1456).
[CHG] Reduced threshold of copyless-pointer-transfer (CPT) to 32 
      bytes (down from 8192).
[NEW] HCL\Boards: Verified support for up to 192GB total system 
      memory size (6 boards).
--------------------------------------------------------------------
Version 1.6.56
[FIX] Fixed a critical bug (1454) in the implementation of 
      copyless-pointer-transfers, which could cause application 
      crashes.
[CHG] Performance: Improvements performance of large memory (>16GB 
      RAM) workloads.
--------------------------------------------------------------------
Version 1.6.46
[FIX] Fixed System Settings (F5) UI to allow more than 99,999MB.
[NEW] HCL\Boards: Verified 32Gb per-board configuration on 
      Supermicro 'X7DB8+' boards.
[NEW] HCL\Boards: Verified support for up to 144GB total system 
      memory size (6 boards).
[NEW] HCL\Boards: Verified support for up to 192GB total system 
      memory size (12 boards).
[NEW] HCL\Backplane: Expanded HCA support- Mellanox: MHGA28-1TC in 
      SDR speed.