From owner-freebsd-virtualization@freebsd.org Thu Dec 24 04:12:18 2015 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D158A5044A for ; Thu, 24 Dec 2015 04:12:18 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: from mail-vk0-x232.google.com (mail-vk0-x232.google.com [IPv6:2607:f8b0:400c:c05::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25CA41A05 for ; Thu, 24 Dec 2015 04:12:18 +0000 (UTC) (envelope-from torres.g.alex@gmail.com) Received: by mail-vk0-x232.google.com with SMTP id j66so142821597vkg.1 for ; Wed, 23 Dec 2015 20:12:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=OdXM+9z6+r9zMT4Q1Ka78QrVFqDJZzc1WPCDRsm8yGo=; b=g1Edbg4sl86VX1bLzkCyD8TFi1qjkgMwmB0CyqGyFv8kWsRgGMRdrIdB+P0qwr3DGj 4phmzykZWEnE2MZeAHhDyWOlalmAXGravB1jSfhG1rU1jMe05J7rJPcLm27qmmVlVxMD 3Uqd8GtH5BL3ZOi9slAe/SDANkf++Pp67ZwJwC3/qWA/bUGZarI/lH8iusdJmW4iZ4s0 LMB5ElnmLuDIw7+73QC1yKemBmYriR+8V1ZpFeEzbZHf4PO2tNFOgPIAZWDya2dPLkue hkOPtCbBKMkHXn777fhCZKxdIkEwB5Hqns2MWcPOmzNFMYpgIE1Xh0rF1nb6yF5byPKE 1vfg== MIME-Version: 1.0 X-Received: by 10.31.47.197 with SMTP id v188mr21993417vkv.6.1450930337051; Wed, 23 Dec 2015 20:12:17 -0800 (PST) Received: by 10.31.149.197 with HTTP; Wed, 23 Dec 2015 20:12:17 -0800 (PST) In-Reply-To: References: Date: Thu, 24 Dec 2015 12:12:17 +0800 Message-ID: Subject: Re: 10.2-RELEASE-p7 - bhyve crash ... From: Alex Torres To: freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Dec 2015 04:12:18 -0000 After further testing this does not happen on -CURRENT but DOES happen on -STABLE. -Alex On Wed, Dec 23, 2015 at 1:48 PM, Alex Torres wrote: > Hi all, > > I'm trying to install a Linux guest (debian and ubuntu) using bhyve. Upon > installation on either of these guest installs bhyve crashes. > > OS: 10.2-RELEASE-p7 FreeBSD 10.2-RELEASE-p7 amd64 (GENERIC kernel) > GUEST: ubuntu-14.10-server-amd64.iso > GUEST: debian-8.2.0-amd64-CD-1.iso > > Hardware: > > IBM System x3550 M4 Server -[7914L2M] with the following VT-x extensions: > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID. > > Load + installation bootstrap: > > #grub-bhyve -r cd0 -m device.map -M 2048 ubuntu-14.10-server > #bhyve -AI -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-net,tap0 -s > 3:0,virtio-blk,./linux.img -s 4:0,ahci-cd,./ubuntu-14.10-server-amd64.iso > -l com1,stdio -c 4 -m 2048M ubuntu-14.10-server > > The Crash Upon installation: > > Installing the system... =E2=94=9C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=90 > > =E2=94=82 = =E2=94=82 > =E2=94=82 > 50% =E2=94=82 > > =E2=94=82 = =E2=94=82 > =E2=94=82 [ 158.064496] BUG: unable to handle kernel paging request at > 0000000010000000 > [ 158.065128] IP: [] > __blk_bios_map_sg+0x1b1/0x3c0 =E2=94=82 > [ 158.065668] PGD 7065b067 PUD 79126067 PMD 0 > =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 > [ 158.066071] Oops: 0000 [#1] SMP > [ 158.066375] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 > raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor > raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel > aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(= E) > usb_storage(E) ahci(E) libahci(E) > [ 158.069152] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G E > 3.16.0-23-generic #31-Ubuntu > [ 158.069905] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > [ 158.070353] Workqueue: writeback bdi_writeback_workfn (flush-252:0) > [ 158.070907] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: > ffff88007a600000 > [ 158.071532] RIP: 0010:[] [] > __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.072265] RSP: 0018:ffff88007a603820 EFLAGS: 00010206 > [ 158.072712] RAX: 0000000010000000 RBX: 0000000000004000 RCX: > ffff88007a6038a8 > [ 158.073306] RDX: 0000000010000001 RSI: 0000000073cb1000 RDI: > ffff88007bb1ea20 > [ 158.073902] RBP: ffff88007a603898 R08: 0000000000000000 R09: > 0000160000000000 > [ 158.074496] R10: 000000000000001d R11: 0000000073cb3000 R12: > 0000000000000000 > [ 158.075091] R13: 0000000000001000 R14: 000000000000001d R15: > ffff88007a7ef420 > [ 158.075688] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) > knlGS:0000000000000000 > [ 158.076360] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 158.076843] CR2: 0000000010000000 CR3: 000000007065a000 CR4: > 00000000000406f0 > [ 158.077439] Stack: > [ 158.077617] ffff88007d001700 ffff88007bb1e5a0 ffff880000093e00 > 000000000000001d > [ 158.078290] ffff88007a6038a8 0100000000000025 ffffea0001cf2c40 > 0000000000001000 > [ 158.078962] ffffea0001cf2c80 0000000000001000 ffff88007bb1e400 > ffff880000093e00 > [ 158.079632] Call Trace: > [ 158.079852] [] blk_rq_map_sg+0x35/0x170 > [ 158.080316] [] virtio_queue_rq+0x9d/0x260 > [ 158.080795] [] __blk_mq_run_hw_queue+0x1bf/0x320 > [ 158.081321] [] blk_mq_run_hw_queue+0x65/0x80 > [ 158.081821] [] blk_mq_insert_requests+0xcf/0x130 > [ 158.082346] [] blk_mq_flush_plug_list+0x129/0x140 > [ 158.082882] [] blk_flush_plug_list+0xd1/0x230 > [ 158.083387] [] blk_finish_plug+0x14/0x50 > [ 158.083859] [] ext4_writepages+0x3e9/0xcf0 > [ 158.084343] [] ? global_dirtyable_memory+0x50/0x50 > [ 158.084885] [] do_writepages+0x1e/0x30 > [ 158.085341] [] __writeback_single_inode+0x40/0x210 > [ 158.085883] [] ? wake_up_bit+0x25/0x30 > [ 158.086338] [] writeback_sb_inodes+0x247/0x3b0 > [ 158.086849] [] __writeback_inodes_wb+0x9f/0xd0 > [ 158.087356] [] wb_writeback+0x223/0x2c0 > [ 158.087820] [] bdi_writeback_workfn+0x1b9/0x430 > [ 158.088337] [] process_one_work+0x182/0x4e0 > [ 158.088829] [] worker_thread+0x6b/0x6a0 > [ 158.089290] [] ? process_one_work+0x4e0/0x4e0 > [ 158.089796] [] kthread+0xdb/0x100 > [ 158.090215] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.090764] [] ret_from_fork+0x7c/0xb0 > [ 158.091218] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.091765] Code: 39 f3 0f 84 4a 01 00 00 48 83 20 fd 4c 89 54 24 18 4= 8 > 8b 39 48 89 4c 24 20 e8 5c a6 03 00 48 8b 4c 24 20 4c 8b 54 24 18 48 89 0= 1 > <48> 8b 30 48 8b 54 24 30 8b 7c 24 3c 83 e6 03 f6 c2 03 0f 85 07 > [ 158.094199] RIP [] __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.094736] RSP > [ 158.095035] CR2: 0000000010000000 > [ 158.095320] ---[ end trace 86aa70b9ee9da8be ]--- > [ 158.095900] BUG: unable to handle kernel paging request at > ffffffffffffffd8 > [ 158.096532] IP: [] kthread_data+0x10/0x20 > [ 158.097041] PGD 1c16067 PUD 1c18067 PMD 0 > [ 158.097447] Oops: 0000 [#2] SMP > [ 158.097753] Modules linked in: squashfs xfs libcrc32c jfs btrfs raid10 > raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor > raid6_pq raid1 raid0 multipath linear ghash_clmulni_intel aesni_intel > aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper nls_utf8(E) isofs(= E) > usb_storage(E) ahci(E) libahci(E) > [ 158.100528] CPU: 0 PID: 136 Comm: kworker/u8:5 Tainted: G D E > 3.16.0-23-generic #31-Ubuntu > [ 158.101278] Hardware name: BHYVE, BIOS 1.00 03/14/2014 > [ 158.101730] task: ffff88007ba532f0 ti: ffff88007a600000 task.ti: > ffff88007a600000 > [ 158.102350] RIP: 0010:[] [] > kthread_data+0x10/0x20 > [ 158.103032] RSP: 0018:ffff88007a603470 EFLAGS: 00010002 > [ 158.103483] RAX: 0000000000000000 RBX: 0000000000000000 RCX: > 0000000000000001 > [ 158.104076] RDX: 0000000000000009 RSI: 0000000000000000 RDI: > ffff88007ba532f0 > [ 158.104671] RBP: ffff88007a603470 R08: 0000000000000000 R09: > 0000000000000001 > [ 158.105267] R10: 00000000000055f8 R11: ffff88007a5a0548 R12: > ffff88007fc14800 > [ 158.105862] R13: ffff88007fc14800 R14: ffff88007ba532f0 R15: > 0000000000000000 > [ 158.106457] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) > knlGS:0000000000000000 > [ 158.107132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 158.107616] CR2: 0000000000000028 CR3: 000000007065a000 CR4: > 00000000000406f0 > [ 158.108212] Stack: > [ 158.108390] ffff88007a603488 ffffffff8108e761 0000000000000000 > ffff88007a6034e8 > [ 158.109064] ffffffff81782c9d ffff88007ba532f0 0000000000014800 > ffff88007a603fd8 > [ 158.109737] 0000000000014800 ffff88007ba532f0 ffff88007ba53a48 > ffff88007ba532e0 > [ 158.110410] Call Trace: > [ 158.110624] [] wq_worker_sleeping+0x11/0x90 > [ 158.111116] [] __schedule+0x6ed/0x890 > [ 158.111578] [] schedule+0x29/0x70 > [ 158.112001] [] do_exit+0x840/0xab0 > [ 158.112430] [] oops_end+0xad/0x150 > [ 158.112859] [] no_context+0x12c/0x310 > [ 158.113308] [] ? > __add_to_page_cache_locked+0x140/0x2b0 > [ 158.113886] [] __bad_area_nosemaphore+0x7d/0x210 > [ 158.114412] [] bad_area_nosemaphore+0x13/0x20 > [ 158.114918] [] __do_page_fault+0xce/0x580 > [ 158.115394] [] ? __find_get_block_slow+0xd0/0x170 > [ 158.115930] [] ? ext4_mb_generate_buddy+0x28f/0x330 > [ 158.116479] [] ? __bt_get+0x10f/0x1c0 > [ 158.116926] [] do_page_fault+0x31/0x70 > [ 158.117382] [] page_fault+0x28/0x30 > [ 158.117816] [] ? __blk_bios_map_sg+0x1b1/0x3c0 > [ 158.118329] [] blk_rq_map_sg+0x35/0x170 > [ 158.118792] [] virtio_queue_rq+0x9d/0x260 > [ 158.119268] [] __blk_mq_run_hw_queue+0x1bf/0x320 > [ 158.119792] [] blk_mq_run_hw_queue+0x65/0x80 > [ 158.120290] [] blk_mq_insert_requests+0xcf/0x130 > [ 158.120818] [] blk_mq_flush_plug_list+0x129/0x140 > [ 158.121351] [] blk_flush_plug_list+0xd1/0x230 > [ 158.121857] [] blk_finish_plug+0x14/0x50 > [ 158.122325] [] ext4_writepages+0x3e9/0xcf0 > [ 158.122809] [] ? global_dirtyable_memory+0x50/0x50 > [ 158.123349] [] do_writepages+0x1e/0x30 > [ 158.123807] [] __writeback_single_inode+0x40/0x210 > [ 158.124344] [] ? wake_up_bit+0x25/0x30 > [ 158.124798] [] writeback_sb_inodes+0x247/0x3b0 > [ 158.125311] [] __writeback_inodes_wb+0x9f/0xd0 > [ 158.125823] [] wb_writeback+0x223/0x2c0 > [ 158.126286] [] bdi_writeback_workfn+0x1b9/0x430 > [ 158.126809] [] process_one_work+0x182/0x4e0 > [ 158.127298] [] worker_thread+0x6b/0x6a0 > [ 158.127762] [] ? process_one_work+0x4e0/0x4e0 > [ 158.128266] [] kthread+0xdb/0x100 > [ 158.128689] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.129240] [] ret_from_fork+0x7c/0xb0 > [ 158.129699] [] ? kthread_create_on_node+0x1c0/0x1c0 > [ 158.130246] Code: 00 48 89 e5 5d 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 6= 6 > 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 c8 04 00 00 55 48 89 e= 5 > <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 > [ 158.132684] RIP [] kthread_data+0x10/0x20 > [ 158.133174] RSP > [ 158.133473] CR2: ffffffffffffffd8 > [ 158.133758] ---[ end trace 86aa70b9ee9da8bf ]--- > [ 158.134147] Fixing recursive fault but reboot is needed! > > > Anyone seen this before ? Any solutions ? > > -Alex >