Date: Thu, 24 Dec 2015 12:12:17 +0800 From: Alex Torres <torres.g.alex@gmail.com> To: freebsd-virtualization@freebsd.org Subject: Re: 10.2-RELEASE-p7 - bhyve crash ... Message-ID: <CAP9WUUHAtoaAd0EhxSYdEDjjRqvjrqZSHzw%2BurexE_qXF4TDow@mail.gmail.com> In-Reply-To: <CAP9WUUHhu0s21GdswaJ%2BcN_wnRhr9bbdg9AM%2BdO6q=1X8r2LBQ@mail.gmail.com> References: <CAP9WUUHhu0s21GdswaJ%2BcN_wnRhr9bbdg9AM%2BdO6q=1X8r2LBQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
After further testing this does not happen on -CURRENT but DOES happen on
-STABLE.
-Alex
On Wed, Dec 23, 2015 at 1:48 PM, Alex Torres <torres.g.alex@gmail.com>
wrote:
> Hi all,
>
> I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon
> installation on either of these guest installs bhyve crashes.
>
> OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel)
> GUEST: ubuntu-14.10-server-amd64.iso
> GUEST: debian-8.2.0-amd64-CD-1.iso
>
> Hardware:
>
> IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions:
> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID.
>
> Load + installation bootstrap:
>
> #grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server
> #bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s
> 3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso
> -l com1,stdio -c 4 -m 2048M ubuntu-14.10-server
>
> The Crash Upon installation:
>
> Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=
=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=
=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=
=E2=94=80=E2=94=80=E2=94=90
>
> =E2=94=82 =
=E2=94=82
> =E2=94=82
> 50% =E2=94=82
>
> =E2=94=82 =
=E2=94=82
> =E2=94=82 [ 158.064496] BUG: unable to handle kernel paging request at
> 0000000010000000
> [ 158.065128] IP: [<ffffffff81370281>]
> __blk_bios_map_sg+0x1b1/0x3c0 =E2=94=82
> [ 158.065668] PGD 7065b067 PUD 79126067 PMD 0
> =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=
=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=
=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=
=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98
> [ 158.066071] Oops: 0000 [#1] SMP
> [ 158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10
> raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor
> raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel
> aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(=
E)
> usb_storage(E) ahci(E) libahci(E)
> [ 158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G E
> 3.16.0-23-generic #31-Ubuntu
> [ 158.069905] Hardware name: BHYVE, BIOS 1.00 03/14/2014
> [ 158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0)
> [ 158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti:
> ffff88007a600000
> [ 158.071532] RIP: 0010:[<ffffffff81370281>] [<ffffffff81370281>]
> __blk_bios_map_sg+0x1b1/0x3c0
> [ 158.072265] RSP: 0018:ffff88007a603820 EFLAGS: 00010206
> [ 158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX:
> ffff88007a6038a8
> [ 158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI:
> ffff88007bb1ea20
> [ 158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09:
> 0000160000000000
> [ 158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12:
> 0000000000000000
> [ 158.075091] R13: 0000000000001000 R14: 000000000000001d R15:
> ffff88007a7ef420
> [ 158.075688] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000)
> knlGS:0000000000000000
> [ 158.076360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4:
> 00000000000406f0
> [ 158.077439] Stack:
> [ 158.077617] ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00
> 000000000000001d
> [ 158.078290] ffff88007a6038a8 0100000000000025 ffffea0001cf2c40
> 0000000000001000
> [ 158.078962] ffffea0001cf2c80 0000000000001000 ffff88007bb1e400
> ffff880000093e00
> [ 158.079632] Call Trace:
> [ 158.079852] [<ffffffff813704c5>] blk_rq_map_sg+0x35/0x170
> [ 158.080316] [<ffffffff814f410d>] virtio_queue_rq+0x9d/0x260
> [ 158.080795] [<ffffffff8137426f>] __blk_mq_run_hw_queue+0x1bf/0x320
> [ 158.081321] [<ffffffff813748e5>] blk_mq_run_hw_queue+0x65/0x80
> [ 158.081821] [<ffffffff8137562f>] blk_mq_insert_requests+0xcf/0x130
> [ 158.082346] [<ffffffff81376189>] blk_mq_flush_plug_list+0x129/0x140
> [ 158.082882] [<ffffffff8136bdb1>] blk_flush_plug_list+0xd1/0x230
> [ 158.083387] [<ffffffff8136c2d4>] blk_finish_plug+0x14/0x50
> [ 158.083859] [<ffffffff81267359>] ext4_writepages+0x3e9/0xcf0
> [ 158.084343] [<ffffffff81174810>] ? global_dirtyable_memory+0x50/0x50
> [ 158.084885] [<ffffffff81176fee>] do_writepages+0x1e/0x30
> [ 158.085341] [<ffffffff8120a520>] __writeback_single_inode+0x40/0x210
> [ 158.085883] [<ffffffff810b91a5>] ? wake_up_bit+0x25/0x30
> [ 158.086338] [<ffffffff8120b457>] writeback_sb_inodes+0x247/0x3b0
> [ 158.086849] [<ffffffff8120b65f>] __writeback_inodes_wb+0x9f/0xd0
> [ 158.087356] [<ffffffff8120b8b3>] wb_writeback+0x223/0x2c0
> [ 158.087820] [<ffffffff8120dc59>] bdi_writeback_workfn+0x1b9/0x430
> [ 158.088337] [<ffffffff8108d8e2>] process_one_work+0x182/0x4e0
> [ 158.088829] [<ffffffff8108dcab>] worker_thread+0x6b/0x6a0
> [ 158.089290] [<ffffffff8108dc40>] ? process_one_work+0x4e0/0x4e0
> [ 158.089796] [<ffffffff81094aeb>] kthread+0xdb/0x100
> [ 158.090215] [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
> [ 158.090764] [<ffffffff81787c3c>] ret_from_fork+0x7c/0xb0
> [ 158.091218] [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
> [ 158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 4=
8
> 8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 0=
1
> <48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07
> [ 158.094199] RIP [<ffffffff81370281>] __blk_bios_map_sg+0x1b1/0x3c0
> [ 158.094736] RSP <ffff88007a603820>
> [ 158.095035] CR2: 0000000010000000
> [ 158.095320] ---[ end trace 86aa70b9ee9da8be ]---
> [ 158.095900] BUG: unable to handle kernel paging request at
> ffffffffffffffd8
> [ 158.096532] IP: [<ffffffff810952a0>] kthread_data+0x10/0x20
> [ 158.097041] PGD 1c16067 PUD 1c18067 PMD 0
> [ 158.097447] Oops: 0000 [#2] SMP
> [ 158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10
> raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor
> raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel
> aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(=
E)
> usb_storage(E) ahci(E) libahci(E)
> [ 158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G D E
> 3.16.0-23-generic #31-Ubuntu
> [ 158.101278] Hardware name: BHYVE, BIOS 1.00 03/14/2014
> [ 158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti:
> ffff88007a600000
> [ 158.102350] RIP: 0010:[<ffffffff810952a0>] [<ffffffff810952a0>]
> kthread_data+0x10/0x20
> [ 158.103032] RSP: 0018:ffff88007a603470 EFLAGS: 00010002
> [ 158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX:
> 0000000000000001
> [ 158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI:
> ffff88007ba532f0
> [ 158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09:
> 0000000000000001
> [ 158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12:
> ffff88007fc14800
> [ 158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15:
> 0000000000000000
> [ 158.106457] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000)
> knlGS:0000000000000000
> [ 158.107132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4:
> 00000000000406f0
> [ 158.108212] Stack:
> [ 158.108390] ffff88007a603488 ffffffff8108e761 0000000000000000
> ffff88007a6034e8
> [ 158.109064] ffffffff81782c9d ffff88007ba532f0 0000000000014800
> ffff88007a603fd8
> [ 158.109737] 0000000000014800 ffff88007ba532f0 ffff88007ba53a48
> ffff88007ba532e0
> [ 158.110410] Call Trace:
> [ 158.110624] [<ffffffff8108e761>] wq_worker_sleeping+0x11/0x90
> [ 158.111116] [<ffffffff81782c9d>] __schedule+0x6ed/0x890
> [ 158.111578] [<ffffffff81782e69>] schedule+0x29/0x70
> [ 158.112001] [<ffffffff81072a90>] do_exit+0x840/0xab0
> [ 158.112430] [<ffffffff81016c3d>] oops_end+0xad/0x150
> [ 158.112859] [<ffffffff8105c5bc>] no_context+0x12c/0x310
> [ 158.113308] [<ffffffff81169fe0>] ?
> __add_to_page_cache_locked+0x140/0x2b0
> [ 158.113886] [<ffffffff8105c81d>] __bad_area_nosemaphore+0x7d/0x210
> [ 158.114412] [<ffffffff8105c9c3>] bad_area_nosemaphore+0x13/0x20
> [ 158.114918] [<ffffffff8105cd4e>] __do_page_fault+0xce/0x580
> [ 158.115394] [<ffffffff81213800>] ? __find_get_block_slow+0xd0/0x170
> [ 158.115930] [<ffffffff8129449f>] ? ext4_mb_generate_buddy+0x28f/0x330
> [ 158.116479] [<ffffffff813767ff>] ? __bt_get+0x10f/0x1c0
> [ 158.116926] [<ffffffff8105d231>] do_page_fault+0x31/0x70
> [ 158.117382] [<ffffffff81789d88>] page_fault+0x28/0x30
> [ 158.117816] [<ffffffff81370281>] ? __blk_bios_map_sg+0x1b1/0x3c0
> [ 158.118329] [<ffffffff813704c5>] blk_rq_map_sg+0x35/0x170
> [ 158.118792] [<ffffffff814f410d>] virtio_queue_rq+0x9d/0x260
> [ 158.119268] [<ffffffff8137426f>] __blk_mq_run_hw_queue+0x1bf/0x320
> [ 158.119792] [<ffffffff813748e5>] blk_mq_run_hw_queue+0x65/0x80
> [ 158.120290] [<ffffffff8137562f>] blk_mq_insert_requests+0xcf/0x130
> [ 158.120818] [<ffffffff81376189>] blk_mq_flush_plug_list+0x129/0x140
> [ 158.121351] [<ffffffff8136bdb1>] blk_flush_plug_list+0xd1/0x230
> [ 158.121857] [<ffffffff8136c2d4>] blk_finish_plug+0x14/0x50
> [ 158.122325] [<ffffffff81267359>] ext4_writepages+0x3e9/0xcf0
> [ 158.122809] [<ffffffff81174810>] ? global_dirtyable_memory+0x50/0x50
> [ 158.123349] [<ffffffff81176fee>] do_writepages+0x1e/0x30
> [ 158.123807] [<ffffffff8120a520>] __writeback_single_inode+0x40/0x210
> [ 158.124344] [<ffffffff810b91a5>] ? wake_up_bit+0x25/0x30
> [ 158.124798] [<ffffffff8120b457>] writeback_sb_inodes+0x247/0x3b0
> [ 158.125311] [<ffffffff8120b65f>] __writeback_inodes_wb+0x9f/0xd0
> [ 158.125823] [<ffffffff8120b8b3>] wb_writeback+0x223/0x2c0
> [ 158.126286] [<ffffffff8120dc59>] bdi_writeback_workfn+0x1b9/0x430
> [ 158.126809] [<ffffffff8108d8e2>] process_one_work+0x182/0x4e0
> [ 158.127298] [<ffffffff8108dcab>] worker_thread+0x6b/0x6a0
> [ 158.127762] [<ffffffff8108dc40>] ? process_one_work+0x4e0/0x4e0
> [ 158.128266] [<ffffffff81094aeb>] kthread+0xdb/0x100
> [ 158.128689] [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
> [ 158.129240] [<ffffffff81787c3c>] ret_from_fork+0x7c/0xb0
> [ 158.129699] [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
> [ 158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 6=
6
> 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e=
5
> <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
> [ 158.132684] RIP [<ffffffff810952a0>] kthread_data+0x10/0x20
> [ 158.133174] RSP <ffff88007a603470>
> [ 158.133473] CR2: ffffffffffffffd8
> [ 158.133758] ---[ end trace 86aa70b9ee9da8bf ]---
> [ 158.134147] Fixing recursive fault but reboot is needed!
>
>
> Anyone seen this before ? Any solutions ?
>
> -Alex
>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAP9WUUHAtoaAd0EhxSYdEDjjRqvjrqZSHzw%2BurexE_qXF4TDow>