[prev in list] [next in list] [prev in thread] [next in thread]
List: linux-rdma
Subject: OFED-1.5 GA is available
From: Vladimir Sokolovsky <vlad () dev ! mellanox ! co ! il>
Date: 2009-12-30 16:24:02
Message-ID: 4B3B7EA2.4060605 () dev ! mellanox ! co ! il
[Download RAW message or body]
Hi,
I am pleased to announce that OFED-1.5 GA release is done
Notes:
The tarball is available on:
http://www.openfabrics.org/builds/ofed-1.5/release/OFED-1.5.tgz
Or
http://69.55.239.13/builds/ofed-1.5/release/OFED-1.5.tgz
To get BUILD_ID run ofed_info
Please report any issues in bugzilla https://bugs.openfabrics.org/ for
OFED 1.5
Vladimir & Tziporet
========================================================================
Release information:
--------------------
Linux Operating Systems:
- RedHat EL4 up7 2.6.9-78.ELsmp
- RedHat EL4 up8 2.6.9-89.ELsmp
- RedHat EL5 up3 2.6.18-128.el5
- RedHat EL5 up4 2.6.18-164.el5
- SLES10 SP2 2.6.16.60-0.21-smp
- SLES10 SP3 2.6.16.60-0.54-smp
- SLES11 2.6.27.19-5-default
- OEL 4 up7 2.6.9-78.ELsmp
- OEL 4 up8 2.6.9-89.ELsmp
- CentOS5.3 2.6.18-128.el5
- CentOS5.4 2.6.18-164.el5
- Fedora Core12 2.6.31.5-127.fc12 *
- OpenSuSE 11.2 2.6.31.5-0.1-default *
- kernel.org 2.6.29, 2.6.30,
2.6.31 and 2.6.32 *
* Minimal QA for these versions
Systems:
* x86_64
* x86
* ia64
* ppc64
Main Changes from OFED-1.4.2
============================
1. General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact location
o Qlogic replaced low level driver from ipath to qib.
- SDP
o Performance improvements
o Zero copy in beta level
- uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD based CM per process. More
scalable then rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1.
o Bug fixes.
- perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
- Management
o OpenSM
- Mesh Analysis for LASH routing algorithm.
- Reloadable OpenSM configuration (preliminary implemented)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted Lid Matrices calculation (for UpDown, MinHop and DOR).
- I/O nodes connectivity (for FatTree).
- MGID to MLID compression - infrastructure for many MGIDs to single MLID
compression.
* OpenSM release notes are not updated in the OFED-1.5 docs. Please refer
to opensm_release_notes-3.3.txt coming with opensm RPM
- MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
- iSER:
o Available only on kernel.org 2.6.30, 2.6.31 and 2.6.32
- NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in beta level. Will be GA in OFED-1.5.1
2. Bug fixes
See attached.
["bugs-2009-12-30.csv" (text/csv)]
bug_id,"bug_severity","priority","op_sys","assigned_to","bug_status","resolution","short_short_desc"
1720,"major","P3","RHEL 5","amirv@mellanox.co.il","RESOLVED","FIXED","Crash \
unloading ib_sdp" 1724,"normal","P3","All","amirv@mellanox.co.il","RESOLVED","FIXED","QP \
creation sometimes fail due to unsupported capabilities" \
1729,"normal","P3","All","amirv@mellanox.co.il","RESOLVED","FIXED","Driver restart, \
after running sdp tests, results in kernel panic" 1732,"normal","P3","Windows \
XP","amirv@mellanox.co.il","RESOLVED","FIXED","Parallel execution of SDP and MPI \
(PSM) gives "sdp_bz_cleanup" messages" \
1796,"critical","P3","All","amirv@mellanox.co.il","RESOLVED","FIXED","Running \
iperf-2.0.4 with 1K buffer consumes too much memory on the server machine" \
1845,"blocker","P3","RHEL 5","amirv@mellanox.co.il","RESOLVED","FIXED","Iperf multi \
stream ZCopy corrupt server's memory" \
1846,"major","P3","All","amirv@mellanox.co.il","RESOLVED","FIXED","Memory leak in \
ers/infiniband/ulp/sdp/sdp_rx.c" 1855,"normal","P3","RHEL \
5","amirv@mellanox.co.il","RESOLVED","FIXED","SDP netperf got a kernel exception on \
OFED1.5rc3 and RHEL5.4" 1747,"normal","P3","RHEL \
5","andy.grover@oracle.com","RESOLVED","FIXED","Cant build 1.5 on RHEL 5.4 GA" \
1804,"major","P3","RHEL 5","andy.grover@oracle.com","RESOLVED","FIXED","RDS panic" \
1691,"major","P3","All","arlin.r.davis@intel.com","RESOLVED","FIXED","dapl-utils RPM \
conflicts with compat-dapl-utils on SLES11 but not on SLES10 or RHEL5" \
1707,"normal","P3","SLES 10","jackm@mellanox.co.il","RESOLVED","FIXED","Installation \
fails on PPC64 with SLES10.2" 1709,"major","P3","SLES \
11","jackm@mellanox.co.il","RESOLVED","FIXED","kernel panic after running dd traffic \
over a nfs-rdma volume." \
1711,"normal","P3","Other","jackm@mellanox.co.il","RESOLVED","FIXED","nfsrdma mount \
failure on 2.6.30.4" 1760,"normal","P3","RHEL \
5","jackm@mellanox.co.il","RESOLVED","FIXED","deadlock when running FMR test" \
1806,"normal","P3","Other","jackm@mellanox.co.il","RESOLVED","FIXED","IB_CQ_VECTOR_LEAST_ATTACHED \
not defined" 1741,"normal","P3","SLES \
10","jon@opengridcomputing.com","RESOLVED","FIXED","Attempting to find files on NFS \
mount gives a NULL pointer dereference" 1810,"critical","P3","RHEL \
5","jon@opengridcomputing.com","RESOLVED","FIXED","OFED-1.5- NFSoverRDMA- ""Lock \
tests"" of Connectathon fails to run on RHEL5U2-32 bit platform" \
1822,"normal","P3","SLES \
11","jon@opengridcomputing.com","RESOLVED","FIXED","Compilation error building \
ofa_kernel-1.5/fs/nfs/file.c" 1852,"normal","P3","CentOS \
5","jon@opengridcomputing.com","RESOLVED","FIXED","NFSoRDMA: Can't restart NFS \
server" 1821,"major","P3","RHEL 5","monis@voltaire.com","RESOLVED","FIXED","Crash in \
bonding" 1663,"blocker","P3","RHEL \
5","orenk@dev.mellanox.co.il","RESOLVED","FIXED","mstflint crashing on HP gen6 hosts \
running RHEL 5 - HCAs cannot be used at all." \
1674,"normal","P3","Other","swise@opengridcomputing.com","RESOLVED","FIXED","ucmatose \
stalls on cxgb3 due to unsignaled WRs" 1763,"blocker","P3","RHEL \
5","swise@opengridcomputing.com","RESOLVED","FIXED","OFED-1.5- Unable to add Chelsio \
interfaces to VLAN" 1768,"critical","P3","SLES \
10","swise@opengridcomputing.com","RESOLVED","FIXED","OFED-1.5-After recompilation of \
ofa_kernel-1.5 single instance of IMB test with OPENMPI on SLES10SP2-x86_64 bit gives \
a softlockup" 1748,"normal","P3","Other","vlad@mellanox.co.il","RESOLVED","FIXED","Installer \
does not build QLogic ib_qib module" 1767,"blocker","P3","SLES \
11","vlad@mellanox.co.il","RESOLVED","FIXED","OFED-1.5- OFED1-1.5-20091005-0600 does \
not get install on SLES11-x86_64 bit if the inbox OFED that comes with SLES 11 x86_64 \
bit is already installed." 1774,"critical","P3","SLES \
11","vlad@mellanox.co.il","RESOLVED","FIXED","Installing OFED1.5 RC1 on SLES11 on \
machine with OFED-distro does not remove ofed-kmp" \
1836,"blocker","P3","Other","yevgenyp@mellanox.co.il","RESOLVED","FIXED","Errors \
loading mlx4_ib, regression since 1.5-rc2" \
1671,"blocker","P1","Other","jon@opengridcomputing.com","RESOLVED","FIXED","NFSRDMA \
backport headers being used even when NFSRDMA is not being used" \
1838,"blocker","P1","Other","jon@opengridcomputing.com","RESOLVED","FIXED","[REG]OFED-1.5 \
: OFED-1.5-20091119-0915 installtion fails while installing rnfs-utils RPM." \
1829,"blocker","P1","RHEL \
5","kliteyn@mellanox.co.il","RESOLVED","FIXED","[REG]OFED-1.5 -OFED-1.5-20091116-0600 \
installation fails while building ibutils RPM on RHEl 5u3 64 bit" \
1830,"blocker","P1","RHEL \
5","perkinjo@cse.ohio-state.edu","RESOLVED","FIXED","REG]OFED-1.5 \
-OFED-1.5-20091115-0600 installtion fails while building mvapich2_gcc-1.4 RPM on RHEl \
5u3 64 bit" 1867,"blocker","P1","Other","vlad@mellanox.co.il","RESOLVED","FIXED","IPoIB \
exports lro_flush_all() which conflicts with igb on RHEL 4 U8" \
1859,"normal","P2","All","eli@mellanox.co.il","RESOLVED","FIXED","IPOIB Can miss a \
change in dgid" 1756,"major","P2","SLES \
10","Jeffrey.C.Becker@nasa.gov","RESOLVED","FIXED","NFS Inode reference error" \
1758,"normal","P2","Other","Jeffrey.C.Becker@nasa.gov","RESOLVED","FIXED","Hang in \
addr_resolve_local() with ipv6 address." 1823,"major","P2","SLES \
11","vu@mellanox.com","RESOLVED","FIXED","OFED-1.5-rc2 opensm fails to discover SRP \
direct connect targets" 1765,"critical","P4","RHEL \
5","swise@opengridcomputing.com","RESOLVED","FIXED","OFED-1.5-Kernel panic on the \
server side while running krping test on S320E-CR cards" 1820,"blocker","P5","SLES \
10","jon@opengridcomputing.com","RESOLVED","FIXED","OFED-1.5-NFSoverRDMA-Unable to \
mount the NFSoverRDMA shared directory with NFS Client as SLES10SP2-x86 bit and NFS \
Server as RHEL-5u3-x86 bit platform" 1664,"critical","P3","SLES \
11","monis@voltaire.com","VERIFIED","FIXED","Bonding: Multicast over bond interface \
not working on SLES11" \
1762,"critical","P3","Other","vlad@mellanox.co.il","VERIFIED","FIXED","Failed to \
compile daily ofed (4-10-09) on sles10 sp3" 1776,"critical","P3","SLES \
11","vlad@mellanox.co.il","VERIFIED","FIXED","After installing OFED1.5 RC1 with \
customize to load MLX4_EN openibd restart failed" \
1781,"blocker","P3","Other","vlad@mellanox.co.il","VERIFIED","FIXED","Failed co \
compile OFED1.5 RC1 on ia64 with sles10 sp3" \
1782,"blocker","P3","Other","vlad@mellanox.co.il","VERIFIED","FIXED","Failed to \
compile OFED1.5 RC1 on ppc with sles10 sp3" 1791,"blocker","P3","RHEL \
4","vlad@mellanox.co.il","VERIFIED","FIXED","OFED1.5-rc1 compilation on RH4 up8 \
failed" 1792,"blocker","P3","SLES \
10","vlad@mellanox.co.il","VERIFIED","FIXED","OFED1.5-rc1 compilation on SLES10 UP3 \
failed" 1737,"blocker","P5","RHEL \
4","swise@opengridcomputing.com","VERIFIED","FIXED","rping fails to start on \
rhel4u7-x86_64 bit" 1770,"critical","P3","RHEL \
4","eli@mellanox.co.il","CLOSED","FIXED","openibd restart after configure pkey on RH4 \
up8 cause to kernel panic" 1831,"critical","P3","RHEL \
5","eli@mellanox.co.il","CLOSED","FIXED","ofed-1.5rc2 crashed RHEL5.4 linux kernel \
running IPoIB bi-directional UD test" \
1783,"blocker","P3","Other","vlad@mellanox.co.il","CLOSED","FIXED","mismatch btween \
device mcast list and ipoib mcast list" 1746,"normal","P2","SLES \
11","jon@opengridcomputing.com","CLOSED","FIXED","Cant build 1.5 on SLES11"
["OFED_release_notes.txt" (text/plain)]
Open Fabrics Enterprise Distribution (OFED)
Version 1.5
Release Notes
December 2009
===============================================================================
Table of Contents
===============================================================================
1. Overview, which includes:
- OFED Distribution Rev 1.5 Contents
- Supported Platforms and Operating Systems
- Supported HCA and RNIC Adapter Cards and Firmware Versions
- Tested Switch Platforms
- Third party Test Packages
- OFED sources
4. Main Changes from OFED 1.4.2
5. Known Issues
===============================================================================
1. Overview
===============================================================================
These are the release notes of OpenFabrics Enterprise Distribution (OFED)
release 1.5. The OFED software package is composed of several software modules,
and is intended for use on a computer cluster constructed as an InfiniBand
subnet or iWARP network.
Note: If you plan to upgrade the OFED package on your cluster, please upgrade
all of its nodes to this new version.
1.1 OFED 1.5 Contents
-----------------------
The OFED package contains the following components:
- OpenFabrics core and ULPs:
- IB HCA drivers (mthca, mlx4, qib, ehca)
- iWARP RNIC driver (cxgb3, nes)
- core
- Upper Layer Protocols: IPoIB, SDP, SRP Initiator and target, iSER
Initiator and target, RDS, uDAPL, qlgc_vnic and NFS-RDMA.
- OpenFabrics utilities:
- OpenSM (OSM): InfiniBand Subnet Manager
- Diagnostic tools
- Performance tests
- MPI:
- OSU MPI stack supporting the InfiniBand and iWARP interface
- Open MPI stack supporting the InfiniBand and iWARP interface
- OSU MVAPICH2 stack supporting the InfiniBand and iWARP interface
- MPI benchmark tests (OSU benchmarks, Intel MPI benchmarks, Presta)
- Extra packages:
- open-iscsi: open-iscsi initiator with iSER support
- ib-bonding: Bonding driver for IPoIB interface
- Sources of all software modules (under conditions mentioned in the modules'
LICENSE files)
- Documentation
Notes:
1. iSER target and NFS-RDMA is of Beta quality.
2. All other OFED components are of production quality.
3. See release notes for each package in the docs directory.
4. Any Topspin copyright belongs to Cisco Systems, Inc.
1.2 Supported Platforms and Operating Systems
---------------------------------------------
o CPU architectures:
- x86_64
- x86
- ppc64
- ia64
o Linux Operating Systems:
- RedHat EL4 up7 2.6.9-78.ELsmp
- RedHat EL4 up8 2.6.9-89.ELsmp
- RedHat EL5 up3 2.6.18-128.el5
- RedHat EL5 up4 2.6.18-164.el5
- SLES10 SP2 2.6.16.60-0.21-smp
- SLES10 SP3 2.6.16.60-0.54-smp
- SLES11 2.6.27.19-5-default
- OEL 4 up7 2.6.9-78.ELsmp
- OEL 4 up8 2.6.9-89.ELsmp
- CentOS5.3 2.6.18-128.el5
- CentOS5.4 2.6.18-164.el5
- Fedora Core12 2.6.31.5-127.fc12 *
- OpenSuSE 11.2 2.6.31.5-0.1-default *
- kernel.org 2.6.29, 2.6.30,
2.6.31 and 2.6.32 *
* Minimal QA for these versions
1.3 HCAs and RNICs Supported
----------------------------
This release supports IB HCAs by Mellanox Technologies, Qlogic and IBM as
well as iWARP RNICs by Chelsio Communications and Intel.
o Mellanox Technologies HCAs (SDR, DDR and QDR Modes are Supported):
- InfiniHost (fw-23108 Rev 3.5.000)
- InfiniHost III Ex (MemFree: fw-25218 Rev 5.3.000
with memory: fw-25208 Rev 4.8.200)
- InfiniHost III Lx (fw-25204 Rev 1.2.000)
- ConnectX IB (fw-25408 Rev 2.7.000)
For official firmware versions please see:
http://www.mellanox.com/content/pages.php?pg=firmware_download
o Qlogic HCAs:
- QHT7140 QLogic InfiniPath SDR HTX HCA
- QLE7140 QLogic InfiniPath SDR PCIe HCA
- QLE7240 QLogic InfiniPath DDR x8 PCIe HCA
- QLE7280 QLogic IniniPath DDR x16 PCIe HCA
o IBM HCAs:
- GX Dual-port SDR 4x IB HCA
- GX Dual-port SDR 12x IB HCA
- GX Dual-port DDR 4x IB HCA
- GX Dual-port DDR 12x IB HCA
o Chelsio RNICs:
- S310/S320 10GbE Storage Accelerators
- R310/R320 10GbE iWARP Adapters
o Intel RNICs:
- NE020 10Gb iWARP Adapter
1.4 Switches Supported
----------------------
This release was tested with switches and gateways provided by the following
companies:
- Voltaire
- Qlogic
- Flextronics
- Sun
- Mellanox
1.5 Third Party Packages
------------------------
The following third party packages have been tested with OFED 1.5:
- Intel MPI, Version 3.2.2
- Intel MPI, Version 4.0 beta
1.6 OFED Sources
----------------
All sources are located under git://git.openfabrics.org/
Kernel sources: git://git.openfabrics.org/ofed_1_5/linux-2.6.git ofed_kernel
User level Sources are downloaded from http://www.openfabrics.org/downloads/
as written in the BUILD_ID
The kernel sources are based on Linux 2.6.30 mainline kernel. Its patches
are included in the OFED sources directory.
For details see HOWTO.build_ofed.
===============================================================================
2. Main Changes from OFED 1.4.2
===============================================================================
Note: For details regarding the various changes, please see the release notes
for each package in the docs directory.
2.1 General changes
o Kernel code based on 2.6.30
o libraries location - all userspace libraries can be downloaded from
http://www.openfabrics.org/downloads/
See BUILD_ID for exact location
o Qlogic replaced low level driver from ipath to qib.
2.2 SDP
o Performance improvements
o Zero copy in beta level
2.3 uDAPL
o New UCM provider (ofa-v2-mlx4_0-1u) with IB UD based CM per process. More
scalable then rdma_cm (cma) or socket cm (scm).
o Common code base with WinOF 2.1.
o Bug fixes.
2.4 perftest
o Renamed tests:
ib_rdma_bw -> rdma_bw
ib_rdma_lat -> rdma_lat
2.5 Management
o OpenSM
- Mesh Analysis for LASH routing algorithm.
- Reloadable OpenSM configuration (preliminary implemented)
- Routing paths sorted balancing (for UpDown and MinHops)
- Weighted Lid Matrices calculation (for UpDown, MinHop and DOR).
- I/O nodes connectivity (for FatTree).
o Diagnostic tools:
2.6 MPI:
a. OSU MVAPICH 1.2.0
b. Open MPI 1.4
c. OSU MVAPICH2 1.4
d. MPI tests 3.2
2.7 iSER:
o Available only on kernel.org 2.6.30, 2.6.31 and 2.6.32
2.8 NFS-RDMA
o Added support for RHEL5.4, SLES10 SP3, kernel.org 2.6.25 and 2.6.30.
kernels 2.6.26 and 2.6.27 are not supported
o NFS-RDMA is in beta level. Will be GA in OFED-1.5.1
===============================================================================
3. Known Issues
===============================================================================
The following is a list of general limitations and known issues of the various
components of the OFED 1.5 release.
1. When upgrading from an earlier OFED version, the installation script does not
stop the earlier OFED version prior to uninstalling it.
Workaround: Stop the old OFED stack (/etc/init.d/openibd stop) before
upgrading to OFED 1.5.
2. Memory registration by the user is limited according to administrator
setting. See "Pinning (Locking) User Memory Pages" in OFED_tips.txt for
system configuration.
3. Fork support from kernel 2.6.12 and above is available provided
that applications do not use threads. The fork() is supported as long
as the parent process does not run before the child exits or calls exec().
The former can be achieved by calling wait(childpid), and the latter can be
achieved by application specific means. The Posix system() call is
supported.
4. The qib driver is supported only on 64-bit platforms.
5. When installing OFED on OpenSuse or Ubuntu one should use the
--without-depcheck option of the install.pl script
6. IPoIB: brctl utilities do not work on IPoIB interfaces. The reason for that
is that these utilities support devices of type Ethernet only.
7. "openibd stop" can sometime fail with the error:
Unloading ib_cm [FAILED]
ERROR: Module ib_cm is in use by ib_ipoib
Workaround: run "openibd stop" again.
8. When working with ISCSI over IPoIB or mlx4_en, you must disable LRO (even
if IPoIB is set to connected mode). This is because there is a bug in older
kernels which causes a kernel panic.
9. On SLES11 in case that uninstall is failing, need to look at the error log
and remove the RPMs manually using 'rpm -e <rpms list>'
10. On SLES11 one should set allow_unsupported_modules parameter to 1 in file:
/etc/modprobe.d/unsupported-modules. Without this the modules will not
load.
11. iSER is supported on kernel.org: 2.6.30, 2.6.31 and 2.6.32 only
OFED-1.5 will not install iSER on other kernels and original iSER
module coming with Linux Distribution will stop working because of
mismatch in symbols version.
Note: See the release notes of each component for additional issues.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic