From owner-freebsd-bugs@freebsd.org Wed Sep 28 22:40:18 2016 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1119AC01EEB for ; Wed, 28 Sep 2016 22:40:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EB7391CCD for ; Wed, 28 Sep 2016 22:40:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u8SMeHMk021649 for ; Wed, 28 Sep 2016 22:40:17 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 213055] bhyve guest crashes when second disk is added Date: Wed, 28 Sep 2016 22:40:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: girgen@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Sep 2016 22:40:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D213055 Bug ID: 213055 Summary: bhyve guest crashes when second disk is added Product: Base System Version: 11.0-STABLE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bin Assignee: freebsd-bugs@FreeBSD.org Reporter: girgen@FreeBSD.org Hi, I'm trying to get bhyve running with Debian jessie (esp Github Enterprise virtual appliance) on 11.0-RELEASE. When running with one disk only, converted with qemu-img convert... it works fine.=20 But this appliance need a second disk, and with that it crashes. Oddly, I h= ad it running for a day, but now it is imppossible to get it working again. # cat device.map=20 (hd0) /dev/zvol/tank/githubroot (hd1) /dev/zvol/tank/githubdata # cat grub.in=20 set root=3D(hd0,msdos1) linux /vmlinuz root=3D/dev/vda1 initrd /initrd.img boot starting with=20 # grub-bhyve -m device.map -r hd0 -M 18000 github < grub.in=20=20 # bhyve -A -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 = -s 3:0,virtio-blk,/home/girgen/github.img -s 4:0,virtio-blk,/dev/zvol/tank/githubdata -l com1,/dev/nmdm0A -c 1 -m 18= 000 github ... host's dmesg: FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(vga): text 80x25 CPU: Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz (2297.39-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306f2 Family=3D0x6 Model=3D0x3f Steppi= ng=3D2 =20 Features=3D0xbfebfbff =20 Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x21 Structured Extended Features=3D0x37ab XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 103079215104 (98304 MB) avail memory =3D 99955458048 (95324 MB) and here's some typical output: it lives for some brief seconds... [ OK ] Started GitHub Enterprise Preflight Checks. [ 7.644335] BUG: unable to handle kernel paging request at 0000000010020= 000 [ 7.645210] IP: [] __blk_bios_map_sg+0x1de/0x400 [ 7.645959] PGD b9440067 PUD b945e067 PMD 0=20 [ 7.646526] Oops: 0000 [#1] SMP=20 [ 7.646944] Modules linked in: nfnetlink_queue nfnetlink_log nfnetlink bluetooth 6lowpan_iphc rfkill tcp_diag inet_diag binfmt_misc ip6t_REJECT xt= _hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 xt_comment xt_LOG xt_limit ipt_REJ= ECT xt_tcpudp xt_addrtype xt_owner nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables thermal_sys crc32_pclmul aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd pcspkr serio_raw evdev button autofs4 ext4 c= rc16 mbcache jbd2 dm_mod virtio_net virtio_blk crct10dif_pclmul crct10dif_common crc32c_intel psmouse virtio_pci virtio_ring virtio [ 7.655837] CPU: 3 PID: 349 Comm: kworker/3:1H Not tainted 3.16.0-4-amd6= 4 #1 Debian 3.16.36-1+deb8u1 [ 7.656903] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 7.657563] Workqueue: kblockd blk_mq_run_work_fn [ 7.658131] task: ffff880490af6290 ti: ffff88048df94000 task.ti: ffff88048df94000 [ 7.659012] RIP: 0010:[] [] __blk_bios_map_sg+0x1de/0x400 [ 7.660049] RSP: 0000:ffff88048df97cd8 EFLAGS: 00010206 [ 7.660680] RAX: 0000000010020000 RBX: 000000000001d000 RCX: 0000000000000004 [ 7.661521] RDX: 0000000010020001 RSI: ffffea000005b738 RDI: 0000000000000000 [ 7.662360] RBP: ffff88048df97d58 R08: ffff880481f73620 R09: 0000000000000025 [ 7.663202] R10: 0000000000000000 R11: 0000000001a22000 R12: 0000000000000000 [ 7.664065] R13: 0000000000001000 R14: 0000000000000004 R15: ffff88048df97d68 [ 7.664902] FS: 0000000000000000(0000) GS:ffff8804a4d80000(0000) knlGS:0000000000000000 [ 7.665871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7.666549] CR2: 0000000010020000 CR3: 00000000b9be8000 CR4: 00000000000406e0 [ 7.667395] Stack: [ 7.667649] ffff88048df97c50 ffff88048db067a0 ffff88048d8fe008 0100000000000004 [ 7.668591] ffff880481f73620 ffff880400000025 0000000000000004 ffffea000005b738 [ 7.669542] 0000000000001000 ffffea000005b738 0000000000001000 ffff88048db06600 [ 7.670507] Call Trace: [ 7.670802] [] ? blk_rq_map_sg+0x2f/0x170 [ 7.671488] [] ? virtio_queue_rq+0x9b/0x240 [virtio_b= lk] [ 7.672309] [] ? __blk_mq_run_hw_queue+0x1c2/0x320 [ 7.673079] [] ? process_one_work+0x143/0x430 [ 7.673791] [] ? worker_thread+0x113/0x4f0 [ 7.674465] [] ? __schedule+0x2b1/0x6f0 [ 7.675136] [] ? rescuer_thread+0x2d0/0x2d0 [ 7.675828] [] ? kthread+0xbd/0xe0 [ 7.676429] [] ? kthread_create_on_node+0x180/0x180 [ 7.677205] [] ? ret_from_fork+0x58/0x90 [ 7.677880] [] ? kthread_create_on_node+0x180/0x180 [ 7.678661] Code: 3f 44 89 4c 24 28 48 89 4c 24 30 e8 5d 5a 03 00 8b 7c = 24 44 48 8b 74 24 38 4c 8b 44 24 20 44 8b 4c 24 28 48 8b 4c 24 30 49 89 07 <48= > 8b 10 83 e2 03 40 f6 c6 03 0f 85 b2 01 00 00 48 09 f2 89 78=20 [ 7.682068] RIP [] __blk_bios_map_sg+0x1de/0x400 [ 7.682840] RSP [ 7.683269] CR2: 0000000010020000 [ 7.683684] ---[ end trace 94aad109fa174203 ]--- [ 7.688265] BUG: unable to handle kernel paging request at fffffffffffff= fd8 [ 7.689152] IP: [] kthread_data+0xc/0x20 [ 7.689815] PGD 1816067 PUD 1818067 PMD 0=20 [ 7.690340] Oops: 0000 [#2] SMP=20 [ 7.690755] Modules linked in: nfnetlink_queue nfnetlink_log nfnetlink bluetooth 6lowpan_iphc rfkill tcp_diag inet_diag binfmt_misc ip6t_REJECT xt= _hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 xt_comment xt_LOG xt_limit ipt_REJ= ECT xt_tcpudp xt_addrtype xt_owner nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables thermal_sys crc32_pclmul aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd pcspkr serio_raw evdev button autofs4 ext4 c= rc16 mbcache jbd2 dm_mod virtio_net virtio_blk crct10dif_pclmul crct10dif_common crc32c_intel psmouse virtio_pci virtio_ring virtio [ 7.699044] CPU: 3 PID: 349 Comm: kworker/3:1H Tainted: G D=20=20= =20=20=20=20 3.16.0-4-amd64 #1 Debian 3.16.36-1+deb8u1 [ 7.700196] Hardware name: BHYVE, BIOS 1.00 03/14/2014 [ 7.700815] task: ffff880490af6290 ti: ffff88048df94000 task.ti: ffff88048df94000 [ 7.701668] RIP: 0010:[] [] kthread_data+0xc/0x20 [ 7.702596] RSP: 0018:ffff88048df979f0 EFLAGS: 00010002 [ 7.703206] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 000000000000000f [ 7.704017] RDX: 000000000000000e RSI: 0000000000000003 RDI: ffff880490af6290 [ 7.704830] RBP: ffff880490af6290 R08: 0000000000000001 R09: 000000000000b8e1 [ 7.705643] R10: ffffffff81ae045c R11: 0000000000000000 R12: ffff8804a4d92f40 [ 7.706452] R13: 0000000000000003 R14: 0000000000000000 R15: ffff880490af6290 [ 7.707284] FS: 0000000000000000(0000) GS:ffff8804a4d80000(0000) knlGS:0000000000000000 [ 7.708201] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7.708854] CR2: 0000000000000028 CR3: 000000048d8a4000 CR4: 00000000000406e0 [ 7.709670] Stack: [ 7.709908] ffffffff8108373d ffff880490af66f0 ffffffff81514abd 0000000000012f40 [ 7.710829] ffff88048df97fd8 0000000000012f40 ffff880490af6290 ffff880490af6910 [ 7.711736] ffff880490af65e8 ffff880490af6280 ffff8804915d72b0 ffff880490af6280 [ 7.712656] Call Trace: [ 7.712952] [] ? wq_worker_sleeping+0xd/0x80 [ 7.713632] [] ? __schedule+0x43d/0x6f0 [ 7.714266] [] ? do_exit+0x6df/0xa70 [ 7.714882] [] ? oops_end+0x97/0xe0 [ 7.715485] [] ? no_context+0x2b2/0x2be [ 7.716120] [] ? __do_page_fault+0x80/0x4f0 [ 7.716786] [] ? virtqueue_add_sgs+0x350/0x5f7 [virtio_ring] [ 7.717605] [] ? cpumask_next_and+0x30/0x40 [ 7.718281] [] ? virtqueue_add_sgs+0x4ac/0x5f7 [virtio_ring] [ 7.719125] [] ? page_fault+0x28/0x30 [ 7.719734] [] ? __blk_bios_map_sg+0x1de/0x400 [ 7.720432] [] ? __blk_bios_map_sg+0x1c3/0x400 [ 7.721140] [] ? blk_rq_map_sg+0x2f/0x170 [ 7.721814] [] ? virtio_queue_rq+0x9b/0x240 [virtio_b= lk] [ 7.722620] [] ? __blk_mq_run_hw_queue+0x1c2/0x320 [ 7.723361] [] ? process_one_work+0x143/0x430 [ 7.724059] [] ? worker_thread+0x113/0x4f0 [ 7.724729] [] ? __schedule+0x2b1/0x6f0 [ 7.725370] [] ? rescuer_thread+0x2d0/0x2d0 [ 7.726060] [] ? kthread+0xbd/0xe0 [ 7.726648] [] ? kthread_create_on_node+0x180/0x180 [ 7.727406] [] ? ret_from_fork+0x58/0x90 [ 7.728055] [] ? kthread_create_on_node+0x180/0x180 [ 7.728799] Code: 08 04 00 00 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 66 66 = 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 8b 87 08 04 00 00 <48= > 8b 40 d8 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f=20 [ 7.732132] RIP [] kthread_data+0xc/0x20 [ 7.732788] RSP [ 7.733202] CR2: ffffffffffffffd8 [ 7.733591] ---[ end trace 94aad109fa174204 ]--- [ 7.734133] Fixing recursive fault but reboot is needed! --=20 You are receiving this mail because: You are the assignee for the bug.=