Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 23 Dec 2015 13:48:41 +0800
From:      Alex Torres <torres.g.alex@gmail.com>
To:        freebsd-virtualization@freebsd.org
Subject:   10.2-RELEASE-p7 - bhyve crash ...
Message-ID:  <CAP9WUUHhu0s21GdswaJ%2BcN_wnRhr9bbdg9AM%2BdO6q=1X8r2LBQ@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
Hi all,

I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon
installation on either of these guest installs bhyve crashes.

     OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel)
GUEST: ubuntu-14.10-server-amd64.iso
GUEST: debian-8.2.0-amd64-CD-1.iso

Hardware:

IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions:
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID.

Load + installation bootstrap:

#grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server
#bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s
3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso
-l com1,stdio -c 4 -m 2048M ubuntu-14.10-server

The Crash Upon installation:

Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=
=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=
=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=
=E2=94=80=E2=94=80=E2=94=90
  =E2=94=82
=E2=94=82
  =E2=94=82                                   50%
=E2=94=82
  =E2=94=82
=E2=94=82
  =E2=94=82 [  158.064496] BUG: unable to handle kernel paging request at
0000000010000000
[  158.065128] IP: [<ffffffff81370281>] __blk_bios_map_sg+0x1b1/0x3c0
=E2=94=82
[  158.065668] PGD 7065b067 PUD 79126067 PMD 0
=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=
=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=
=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=
=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98
[  158.066071] Oops: 0000 [#1] SMP
[  158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10
raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor
raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel
aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E)
usb_storage(E) ahci(E) libahci(E)
[  158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G            E
3.16.0-23-generic #31-Ubuntu
[  158.069905] Hardware name:   BHYVE, BIOS 1.00 03/14/2014
[  158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0)
[  158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti:
ffff88007a600000
[  158.071532] RIP: 0010:[<ffffffff81370281>]  [<ffffffff81370281>]
__blk_bios_map_sg+0x1b1/0x3c0
[  158.072265] RSP: 0018:ffff88007a603820  EFLAGS: 00010206
[  158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX:
ffff88007a6038a8
[  158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI:
ffff88007bb1ea20
[  158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09:
0000160000000000
[  158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12:
0000000000000000
[  158.075091] R13: 0000000000001000 R14: 000000000000001d R15:
ffff88007a7ef420
[  158.075688] FS:  0000000000000000(0000) GS:ffff88007fc00000(0000)
knlGS:0000000000000000
[  158.076360] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4:
00000000000406f0
[  158.077439] Stack:
[  158.077617]  ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00
000000000000001d
[  158.078290]  ffff88007a6038a8 0100000000000025 ffffea0001cf2c40
0000000000001000
[  158.078962]  ffffea0001cf2c80 0000000000001000 ffff88007bb1e400
ffff880000093e00
[  158.079632] Call Trace:
[  158.079852]  [<ffffffff813704c5>] blk_rq_map_sg+0x35/0x170
[  158.080316]  [<ffffffff814f410d>] virtio_queue_rq+0x9d/0x260
[  158.080795]  [<ffffffff8137426f>] __blk_mq_run_hw_queue+0x1bf/0x320
[  158.081321]  [<ffffffff813748e5>] blk_mq_run_hw_queue+0x65/0x80
[  158.081821]  [<ffffffff8137562f>] blk_mq_insert_requests+0xcf/0x130
[  158.082346]  [<ffffffff81376189>] blk_mq_flush_plug_list+0x129/0x140
[  158.082882]  [<ffffffff8136bdb1>] blk_flush_plug_list+0xd1/0x230
[  158.083387]  [<ffffffff8136c2d4>] blk_finish_plug+0x14/0x50
[  158.083859]  [<ffffffff81267359>] ext4_writepages+0x3e9/0xcf0
[  158.084343]  [<ffffffff81174810>] ? global_dirtyable_memory+0x50/0x50
[  158.084885]  [<ffffffff81176fee>] do_writepages+0x1e/0x30
[  158.085341]  [<ffffffff8120a520>] __writeback_single_inode+0x40/0x210
[  158.085883]  [<ffffffff810b91a5>] ? wake_up_bit+0x25/0x30
[  158.086338]  [<ffffffff8120b457>] writeback_sb_inodes+0x247/0x3b0
[  158.086849]  [<ffffffff8120b65f>] __writeback_inodes_wb+0x9f/0xd0
[  158.087356]  [<ffffffff8120b8b3>] wb_writeback+0x223/0x2c0
[  158.087820]  [<ffffffff8120dc59>] bdi_writeback_workfn+0x1b9/0x430
[  158.088337]  [<ffffffff8108d8e2>] process_one_work+0x182/0x4e0
[  158.088829]  [<ffffffff8108dcab>] worker_thread+0x6b/0x6a0
[  158.089290]  [<ffffffff8108dc40>] ? process_one_work+0x4e0/0x4e0
[  158.089796]  [<ffffffff81094aeb>] kthread+0xdb/0x100
[  158.090215]  [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
[  158.090764]  [<ffffffff81787c3c>] ret_from_fork+0x7c/0xb0
[  158.091218]  [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
[  158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 48
8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 01
<48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07
[  158.094199] RIP  [<ffffffff81370281>] __blk_bios_map_sg+0x1b1/0x3c0
[  158.094736]  RSP <ffff88007a603820>
[  158.095035] CR2: 0000000010000000
[  158.095320] ---[ end trace 86aa70b9ee9da8be ]---
[  158.095900] BUG: unable to handle kernel paging request at
ffffffffffffffd8
[  158.096532] IP: [<ffffffff810952a0>] kthread_data+0x10/0x20
[  158.097041] PGD 1c16067 PUD 1c18067 PMD 0
[  158.097447] Oops: 0000 [#2] SMP
[  158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10
raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor
raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel
aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(E)
usb_storage(E) ahci(E) libahci(E)
[  158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G      D     E
3.16.0-23-generic #31-Ubuntu
[  158.101278] Hardware name:   BHYVE, BIOS 1.00 03/14/2014
[  158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti:
ffff88007a600000
[  158.102350] RIP: 0010:[<ffffffff810952a0>]  [<ffffffff810952a0>]
kthread_data+0x10/0x20
[  158.103032] RSP: 0018:ffff88007a603470  EFLAGS: 00010002
[  158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX:
0000000000000001
[  158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI:
ffff88007ba532f0
[  158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09:
0000000000000001
[  158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12:
ffff88007fc14800
[  158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15:
0000000000000000
[  158.106457] FS:  0000000000000000(0000) GS:ffff88007fc00000(0000)
knlGS:0000000000000000
[  158.107132] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4:
00000000000406f0
[  158.108212] Stack:
[  158.108390]  ffff88007a603488 ffffffff8108e761 0000000000000000
ffff88007a6034e8
[  158.109064]  ffffffff81782c9d ffff88007ba532f0 0000000000014800
ffff88007a603fd8
[  158.109737]  0000000000014800 ffff88007ba532f0 ffff88007ba53a48
ffff88007ba532e0
[  158.110410] Call Trace:
[  158.110624]  [<ffffffff8108e761>] wq_worker_sleeping+0x11/0x90
[  158.111116]  [<ffffffff81782c9d>] __schedule+0x6ed/0x890
[  158.111578]  [<ffffffff81782e69>] schedule+0x29/0x70
[  158.112001]  [<ffffffff81072a90>] do_exit+0x840/0xab0
[  158.112430]  [<ffffffff81016c3d>] oops_end+0xad/0x150
[  158.112859]  [<ffffffff8105c5bc>] no_context+0x12c/0x310
[  158.113308]  [<ffffffff81169fe0>] ?
__add_to_page_cache_locked+0x140/0x2b0
[  158.113886]  [<ffffffff8105c81d>] __bad_area_nosemaphore+0x7d/0x210
[  158.114412]  [<ffffffff8105c9c3>] bad_area_nosemaphore+0x13/0x20
[  158.114918]  [<ffffffff8105cd4e>] __do_page_fault+0xce/0x580
[  158.115394]  [<ffffffff81213800>] ? __find_get_block_slow+0xd0/0x170
[  158.115930]  [<ffffffff8129449f>] ? ext4_mb_generate_buddy+0x28f/0x330
[  158.116479]  [<ffffffff813767ff>] ? __bt_get+0x10f/0x1c0
[  158.116926]  [<ffffffff8105d231>] do_page_fault+0x31/0x70
[  158.117382]  [<ffffffff81789d88>] page_fault+0x28/0x30
[  158.117816]  [<ffffffff81370281>] ? __blk_bios_map_sg+0x1b1/0x3c0
[  158.118329]  [<ffffffff813704c5>] blk_rq_map_sg+0x35/0x170
[  158.118792]  [<ffffffff814f410d>] virtio_queue_rq+0x9d/0x260
[  158.119268]  [<ffffffff8137426f>] __blk_mq_run_hw_queue+0x1bf/0x320
[  158.119792]  [<ffffffff813748e5>] blk_mq_run_hw_queue+0x65/0x80
[  158.120290]  [<ffffffff8137562f>] blk_mq_insert_requests+0xcf/0x130
[  158.120818]  [<ffffffff81376189>] blk_mq_flush_plug_list+0x129/0x140
[  158.121351]  [<ffffffff8136bdb1>] blk_flush_plug_list+0xd1/0x230
[  158.121857]  [<ffffffff8136c2d4>] blk_finish_plug+0x14/0x50
[  158.122325]  [<ffffffff81267359>] ext4_writepages+0x3e9/0xcf0
[  158.122809]  [<ffffffff81174810>] ? global_dirtyable_memory+0x50/0x50
[  158.123349]  [<ffffffff81176fee>] do_writepages+0x1e/0x30
[  158.123807]  [<ffffffff8120a520>] __writeback_single_inode+0x40/0x210
[  158.124344]  [<ffffffff810b91a5>] ? wake_up_bit+0x25/0x30
[  158.124798]  [<ffffffff8120b457>] writeback_sb_inodes+0x247/0x3b0
[  158.125311]  [<ffffffff8120b65f>] __writeback_inodes_wb+0x9f/0xd0
[  158.125823]  [<ffffffff8120b8b3>] wb_writeback+0x223/0x2c0
[  158.126286]  [<ffffffff8120dc59>] bdi_writeback_workfn+0x1b9/0x430
[  158.126809]  [<ffffffff8108d8e2>] process_one_work+0x182/0x4e0
[  158.127298]  [<ffffffff8108dcab>] worker_thread+0x6b/0x6a0
[  158.127762]  [<ffffffff8108dc40>] ? process_one_work+0x4e0/0x4e0
[  158.128266]  [<ffffffff81094aeb>] kthread+0xdb/0x100
[  158.128689]  [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
[  158.129240]  [<ffffffff81787c3c>] ret_from_fork+0x7c/0xb0
[  158.129699]  [<ffffffff81094a10>] ? kthread_create_on_node+0x1c0/0x1c0
[  158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 66
2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e5
<48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
[  158.132684] RIP  [<ffffffff810952a0>] kthread_data+0x10/0x20
[  158.133174]  RSP <ffff88007a603470>
[  158.133473] CR2: ffffffffffffffd8
[  158.133758] ---[ end trace 86aa70b9ee9da8bf ]---
[  158.134147] Fixing recursive fault but reboot is needed!


Anyone seen this before ?  Any solutions ?

   -Alex



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAP9WUUHhu0s21GdswaJ%2BcN_wnRhr9bbdg9AM%2BdO6q=1X8r2LBQ>