[prev in list] [next in list] [prev in thread] [next in thread]
List: freebsd-hackers
Subject: No physically installed OS can boot if a device is passed through at the same time,using any kind of
From: Mario Marietto <marietto2008 () gmail ! com>
Date: 2022-02-23 18:10:56
Message-ID: CA+1FSiiVUCBrD2kxS38RSf8PaHCkBS+8yANOBxF-t5u97FwcOA () mail ! gmail ! com
[Download RAW message or body]
Hello to everyone.
I'm using bhyve on FreeBSD 13R p7 and I'm trying to pass thru my USB
controller and / or my graphic card (Geforce RTX 2080 ti) while at the same
time I would like to boot a physically installed OS. I can choose between 3
operating systems (Ubuntu,Windows and FreeBSD 13) that I have installed
physically on a SATA and / or NVME disk and I'm trying to call them inside
the bhyve parameter using the virtio-blk driver and the ahci-hd driver. The
problems that come out from this setup are different and concatenated.
Anyway,those OS won't boot because it seems that the devices that I pass
thru interferes with the booting process. If I don't pass thru any
device,they can boot properly. In addition,my graphic card seems to have an
additional problem. It seems that it is not passed correctly when I use
FreeBSD 13R (it is if I use FreeBSD 14 Current and 13-stable). Below I want
to show you different cases to explain the problems that I'm experimenting :
CASE 0) Without passing thru the USB controller and the graphic card on
Ubuntu 21.10 / Windows 11 (installed physically) can boot properly with
these parameters On FreeBSD 13R :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
BdsDxe: loading Boot0001 "UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385" from
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0)
BdsDxe: starting Boot0001 "UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385" from
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0)
CASE 1) Passing thru the USB controller and the graphic card and booting
from a physical installation of Ubuntu 21.10 / Windows 11 (and also with
the physical installation of FreeBSD 14 CURRENT as guest os) on a nvme disk
on FreeBSD 13R :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2,passthru,1/0/0 \
-s 3:0,passthru,2/0/0 \
-s 3:1,passthru,2/0/1 \
-s 3:2,passthru,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
Sometimes Assertion failed: (error == 0), function modify_bar_registration,
file /usr/src/usr.sbin/bhyve/pci_emul.c, line 501: Abort / sometimes black
screen frozen
CASE 2) Passing thru the USB controller and booting from a physical
installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and also with the
physical installation of FreeBSD 14 CURRENT as guest os) on FreeBSD 13R :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2,passthru,1/0/0 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
= BdsDxe: failed to load Boot0001 "UEFI BHYVE SATA DISK
BHYVE-51F3-061F-A385" from PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0):
Not Found
CASE 3) Passing thru the graphic card and booting from a physical
installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and also with the
physical installation of FreeBSD 14 CURRENT as guest os) on FreeBSD 13R :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2:0,passthru,2/0/0 \
-s 2:1,passthru,2/0/1 \
-s 2:2,passthru,2/0/2 \
-s 2:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
= Assertion failed: (error == 0), function modify_bar_registration, file
/usr/src/usr.sbin/bhyve/pci_emul.c, line 501 : Abort
case 4) Booting from a physical installation of Ubuntu 21.10 / Windows 11
on a nvme disk (and also with the physical installation of FreeBSD 13R as
guest os) on FreeBSD 13-STABLE :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
it can boot.
case 5) Passing thru the graphic card and booting from a physical
installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and also with the
physical installation of FreeBSD 13R as guest os) on FreeBSD 13-STABLE :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2:0,passthru,2/0/0 \
-s 2:1,passthru,2/0/1 \
-s 2:2,passthru,2/0/2 \
-s 2:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
it won't boot : BdsDxe: failed to load Boot0001 "UEFI BHYVE SATA DISK
BHYVE-EE1E-05D9-14BB" from PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0):
Not Found
case 6) Passing thru my USB controller and the graphic card and booting
from a physical installation of Ubuntu 21.10 / Windows 11 on a nvme disk
(and also with the physical installation of FreeBSD 13R as guest os) on
FreeBSD 13-STABLE :
bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \
-s 0,hostbridge \
-s 1,ahci-hd,/dev/nvd0 \
-s 2:0,passthru,1/0/0 \
-s 3:0,passthru,2/0/0 \
-s 3:1,passthru,2/0/1 \
-s 3:2,passthru,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio \
vm1
it won't boot : BdsDxe: failed to load Boot0001 "UEFI BHYVE SATA DISK
BHYVE-EE1E-05D9-14BB" from PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0):
Not Found.
SUMMARY : It seems there is some serious bug in every version of freebsd,13
release,13 stable and 14 current,that does not allow to boot any kind of
physically installed OS if it is passed through any kind of device. I've
already opened a bug report and no one seems to work on it. Would someone
take care of these bugs ? thanks.
--
Mario.
[Attachment #3 (text/html)]
<div dir="ltr">Hello to everyone.<br><br>I'm using bhyve on FreeBSD 13R p7 and \
I'm trying to pass thru my USB controller and / or my graphic card (Geforce RTX \
2080 ti) while at the same time I would like to boot a physically installed OS. I can \
choose between 3 operating systems (Ubuntu,Windows and FreeBSD 13) that I have \
installed physically on a SATA and / or NVME disk and I'm trying to call them \
inside the bhyve parameter using the virtio-blk driver and the ahci-hd driver. The \
problems that come out from this setup are different and concatenated. Anyway,those \
OS won't boot because it seems that the devices that I pass thru interferes with \
the booting process. If I don't pass thru any device,they can boot properly. In \
addition,my graphic card seems to have an additional problem. It seems that it is not \
passed correctly when I use FreeBSD 13R (it is if I use FreeBSD 14 Current and \
13-stable). Below I want to show you different cases to explain the problems that \
I'm experimenting :<br><br>CASE 0) Without passing thru the USB controller and \
the graphic card on Ubuntu 21.10 / Windows 11 (installed physically) can boot \
properly with these parameters On FreeBSD 13R :<br><br>bhyve -S -c \
sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \<br>-s \
1,ahci-hd,/dev/nvd0 \<br>-s 8,virtio-net,tap1 \<br>-s 29,fbuf,tcp=<a \
href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s 30,xhci,tablet \
\<br>-s 31,lpc \<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l \
com1,stdio \<br>vm1<br><br>BdsDxe: loading Boot0001 "UEFI BHYVE SATA DISK \
BHYVE-51F3-061F-A385" from \
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0)<br>BdsDxe: starting Boot0001 \
"UEFI BHYVE SATA DISK BHYVE-51F3-061F-A385" from \
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0)<br><br>CASE 1) Passing thru the USB \
controller and the graphic card and booting from a physical installation of Ubuntu \
21.10 / Windows 11 (and also with the physical installation of FreeBSD 14 CURRENT as \
guest os) on a nvme disk on FreeBSD 13R :<br><br>bhyve -S -c \
sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \<br>-s \
1,ahci-hd,/dev/nvd0 \<br>-s 2,passthru,1/0/0 \<br>-s 3:0,passthru,2/0/0 \<br>-s \
3:1,passthru,2/0/1 \<br>-s 3:2,passthru,2/0/2 \<br>-s 3:3,passthru,2/0/3 \<br>-s \
8,virtio-net,tap1 \<br>-s 29,fbuf,tcp=<a \
href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s 30,xhci,tablet \
\<br>-s 31,lpc \<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l \
com1,stdio \<br>vm1<br><br>Sometimes Assertion failed: (error == 0), function \
modify_bar_registration, file /usr/src/usr.sbin/bhyve/pci_emul.c, line 501: Abort / \
sometimes black screen frozen<br><br>CASE 2) Passing thru the USB controller and \
booting from a physical installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and \
also with the physical installation of FreeBSD 14 CURRENT as guest os) on FreeBSD 13R \
:<br><br>bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \
\<br>-s 1,ahci-hd,/dev/nvd0 \<br>-s 2,passthru,1/0/0 \<br>-s 8,virtio-net,tap1 \
\<br>-s 29,fbuf,tcp=<a href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \
\<br>-s 30,xhci,tablet \<br>-s 31,lpc \<br>-l \
bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l com1,stdio \
\<br>vm1<br><br>= BdsDxe: failed to load Boot0001 "UEFI BHYVE SATA DISK \
BHYVE-51F3-061F-A385" from PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0): Not \
Found<br><br>CASE 3) Passing thru the graphic card and booting from a physical \
installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and also with the physical \
installation of FreeBSD 14 CURRENT as guest os) on FreeBSD 13R :<br><br>bhyve -S -c \
sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \<br>-s \
1,ahci-hd,/dev/nvd0 \<br>-s 2:0,passthru,2/0/0 \<br>-s 2:1,passthru,2/0/1 \<br>-s \
2:2,passthru,2/0/2 \<br>-s 2:3,passthru,2/0/3 \<br>-s 8,virtio-net,tap1 \<br>-s \
29,fbuf,tcp=<a href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s \
30,xhci,tablet \<br>-s 31,lpc \<br>-l \
bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l com1,stdio \
\<br>vm1<br><br>= Assertion failed: (error == 0), function modify_bar_registration, \
file /usr/src/usr.sbin/bhyve/pci_emul.c, line 501 : Abort<br><br>case 4) Booting from \
a physical installation of Ubuntu 21.10 / Windows 11 on a nvme disk (and also with \
the physical installation of FreeBSD 13R as guest os) on FreeBSD 13-STABLE \
:<br><br>bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \
\<br>-s 1,ahci-hd,/dev/nvd0 \<br>-s 8,virtio-net,tap1 \<br>-s 29,fbuf,tcp=<a \
href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s 30,xhci,tablet \
\<br>-s 31,lpc \<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l \
com1,stdio \<br>vm1<br><br>it can boot.<br><br>case 5) Passing thru the graphic card \
and booting from a physical installation of Ubuntu 21.10 / Windows 11 on a nvme disk \
(and also with the physical installation of FreeBSD 13R as guest os) on FreeBSD \
13-STABLE :<br><br>bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s \
0,hostbridge \<br>-s 1,ahci-hd,/dev/nvd0 \<br>-s 2:0,passthru,2/0/0 \<br>-s \
2:1,passthru,2/0/1 \<br>-s 2:2,passthru,2/0/2 \<br>-s 2:3,passthru,2/0/3 \<br>-s \
8,virtio-net,tap1 \<br>-s 29,fbuf,tcp=<a \
href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s 30,xhci,tablet \
\<br>-s 31,lpc \<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l \
com1,stdio \<br>vm1<br><br>it won't boot : BdsDxe: failed to load Boot0001 \
"UEFI BHYVE SATA DISK BHYVE-EE1E-05D9-14BB" from \
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0): Not Found<br><br>case 6) Passing thru \
my USB controller and the graphic card and booting from a physical installation of \
Ubuntu 21.10 / Windows 11 on a nvme disk (and also with the physical installation of \
FreeBSD 13R as guest os) on FreeBSD 13-STABLE :<br><br>bhyve -S -c \
sockets=1,cores=2,threads=2 -m 4G -w -H \<br>-s 0,hostbridge \<br>-s \
1,ahci-hd,/dev/nvd0 \<br>-s 2:0,passthru,1/0/0 \<br>-s 3:0,passthru,2/0/0 \<br>-s \
3:1,passthru,2/0/1 \<br>-s 3:2,passthru,2/0/2 \<br>-s 3:3,passthru,2/0/3 \<br>-s \
8,virtio-net,tap1 \<br>-s 29,fbuf,tcp=<a \
href="http://0.0.0.0:5901">0.0.0.0:5901</a>,w=1440,h=900,wait \<br>-s 30,xhci,tablet \
\<br>-s 31,lpc \<br>-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \<br>-l \
com1,stdio \<br>vm1<br><br>it won't boot : BdsDxe: failed to load Boot0001 \
"UEFI BHYVE SATA DISK BHYVE-EE1E-05D9-14BB" from \
PciRoot(0x0)/Pci(0x1,0x0)/Sata(0x0,0xFFFF,0x0): Not Found.<br><br>SUMMARY : It seems \
there is some serious bug in every version of freebsd,13 release,13 stable and 14 \
current,that does not allow to boot any kind of physically installed OS if it is \
passed through any kind of device. I've already opened a bug report and no one \
seems to work on it. Would someone take care of these bugs ? thanks.<br \
clear="all"><br>-- <br><div dir="ltr" \
data-smartmail="gmail_signature">Mario.<br></div></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic