[prev in list] [next in list] [prev in thread] [next in thread]
List: lustre-discuss
Subject: Re: [lustre-discuss] Question about Install OFED with --with-nvmf
From: Xinliang Liu via lustre-discuss <lustre-discuss () lists ! lustre ! org>
Date: 2023-06-28 9:56:41
Message-ID: CAKoKPbwZHgJ=_r_73MLUON6c1_HTYZpXYd66H0RLxgDK8Ext2w () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/related)]
[Attachment #4 (multipart/alternative)]
Hi Shuobin,
On Tue, 27 Jun 2023 at 15:01, 王烁斌 via lustre-discuss <
lustre-discuss@lists.lustre.org> wrote:
> Hi~
>
> I want to use RDMA between sever and storages.
>
> I try this and get error as follow:
> *root@172-0-37-44 rdma]# nvme discover -t rdma -a 192.168.11.12 -5 4420*
> *Failed to write to /dev/nvme-fabrics: Invalid argument*
>
> log message in kernel :
> *26 20:44:22 172-0-37-44 kernel: nvme fabrics: no handler found for
> transport rdma.*
>
> After investigation, it was found that the issue was due to the "OFED"
> driver not being installed with the "-- with nvmf" option. So I tried the
> following installation method:
> *./mlnxofedinstall --add-kernel-support --kmp --with-nvmf*
>
> *but I get this：*
> *WARNING: NVMEoF is not supported over kernel
> 4.18.0-425.3.1.el8_lustre.x86_64, will continue installation without it.*
>
>
> *so，How should I locate the problem？*
>
You can check the script where the WARNING prints, I think it should check
the kernel configuration something like this:
$ egrep "CONFIG_NVME_FABRICS|CONFIG_NVME_RDMA" -rn
/boot/config-4.18.0-477.10.1.el8_8.aarch64
1810:CONFIG_NVME_FABRICS=m
1811:CONFIG_NVME_RDMA=m
Best,
Xinliang
>
> Thanks！
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
[Attachment #7 (text/html)]
<div dir="ltr"><div dir="ltr">Hi Shuobin,</div><br><div class="gmail_quote"><div \
dir="ltr" class="gmail_attr">On Tue, 27 Jun 2023 at 15:01, 王烁斌 via \
lustre-discuss <<a \
href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div \
style="line-height:1.7;color:rgb(0,0,0);font-size:14px;font-family:Arial"><div>Hi~<br></div><div><br></div><div>I \
want to use RDMA between sever and storages. </div><div><br></div><div>I try this \
and get error as follow:</div><div><b>root@172-0-37-44 rdma]# nvme discover -t rdma \
-a 192.168.11.12 -5 4420</b></div><div><b>Failed to write to /dev/nvme-fabrics: \
Invalid argument</b></div><div><br></div><div>log message in kernel :</div><div><b>26 \
20:44:22 172-0-37-44 kernel: nvme fabrics: no handler found for transport \
rdma.</b></div><div><br></div><div>After investigation, it was found that the issue \
was due to the "OFED" driver not being installed with the "-- with \
nvmf" option. So I tried the following installation \
method:</div><div><b>./mlnxofedinstall --add-kernel-support --kmp \
--with-nvmf</b></div><div><b><br></b></div><div><b>but I get \
this：</b></div><div><b>WARNING: NVMEoF is not supported over kernel \
4.18.0-425.3.1.el8_lustre.x86_64, will continue installation without \
it.</b></div><div><img src="cid:1890169bd10cb971f161" style="vertical-align: bottom; \
width: 928px; height: 272px;"> </div><div><b><br></b></div><div><b>so，How should I \
locate the problem？</b></div></div></blockquote><div><br></div><div>You can check \
the script where the WARNING prints, I think it should check the kernel \
configuration something like this:</div><div>$ egrep \
"CONFIG_NVME_FABRICS|CONFIG_NVME_RDMA" -rn \
/boot/config-4.18.0-477.10.1.el8_8.aarch64 \
<br>1810:CONFIG_NVME_FABRICS=m<br>1811:CONFIG_NVME_RDMA=m<br></div><div><br></div><div>Best,</div><div>Xinliang</div><div> \
</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px \
solid rgb(204,204,204);padding-left:1ex"><div \
style="line-height:1.7;color:rgb(0,0,0);font-size:14px;font-family:Arial"><div><b><br> \
</b></div><div>Thanks！<b><br></b></div></div>_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" \
target="_blank">lustre-discuss@lists.lustre.org</a><br> <a \
href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" \
rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div></div>
["image.png" (image/png)]
_______________________________________________
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic