From owner-freebsd-current@freebsd.org Tue May 29 14:18:08 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 641F0F7FE1C for ; Tue, 29 May 2018 14:18:08 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-wr0-f170.google.com (mail-wr0-f170.google.com [209.85.128.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C89726D1F8 for ; Tue, 29 May 2018 14:18:07 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-wr0-f170.google.com with SMTP id a15-v6so25843245wrm.0 for ; Tue, 29 May 2018 07:18:07 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=SfxlJib+4VquC20ZFnCej0Dglh8nhZN/hXtR8teCJcg=; b=TK45G/6eYcwigCqz1CMbb7x6ET+D73iF9ymnSVorYqDbxZjlyYJM8njom3zuFRznP0 auuK0o3iAcX6NCyelsm24jz3fPT8cQrHlYRYyi7aT0HZBZn73Q+q/HGcWr6z2Ckect7i mny5CfzAmfucJDdrXx8kGO50h8DpQBEuJENCyO9vItq7EXlrvAHP90M4XFUnlVkdOG3I RtC8aAEG7/QQGq53/6EbjQJf5V4s39yziOnp22WAwcuDbESQdpSrG3SBXdRr53eFEDFt +6qHkM5+LauXjW8GIOZ99cae1F10U2Nf1GJ2BVbdhROms8XedI9sCE7s6qC/cvvO7Cv5 QRgg== X-Gm-Message-State: ALKqPwdx3Asp1nNmKUaHR8dc+zpWAlEtXz8ELtNEuPFMXBSDctZIa+0W ZkdoV7O4Ze1aUYbjSH36jw/pcKJd X-Google-Smtp-Source: ADUXVKIN1+4JhWdiqbrmrvtyUAtMBKdrUuCA0YO9h1zZf9c2ZSLV7D7MPzKjlnZun0iIofeqPJo5BQ== X-Received: by 2002:a19:5ad4:: with SMTP id y81-v6mr9254718lfk.82.1527603486091; Tue, 29 May 2018 07:18:06 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id k5-v6sm6521756lji.39.2018.05.29.07.18.04 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 29 May 2018 07:18:05 -0700 (PDT) Subject: Re: panic: vm_phys_free_pages: page 0x... has unexpected order 0 From: Andriy Gapon To: FreeBSD Current References: <932853d2-16f9-67c0-fcf8-745bb5e358d4@FreeBSD.org> Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABzR5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz7CwZQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryM7BTQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAcLBfAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: Date: Tue, 29 May 2018 17:18:03 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <932853d2-16f9-67c0-fcf8-745bb5e358d4@FreeBSD.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 May 2018 14:18:08 -0000 [ping] On 21/05/2018 11:44, Andriy Gapon wrote: > > FreeBSD 12.0-CURRENT amd64 r332472 > Does this panic ring a bell to anyone? > Has it already been fixed? > Thank you! > > panic: vm_phys_free_pages: page 0xfffff80cbfb71958 has unexpected order 0 > cpuid = 3 > time = 1526822662 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe017547c340 > vpanic() at vpanic+0x18d/frame 0xfffffe017547c3a0 > doadump() at doadump/frame 0xfffffe017547c420 > vm_phys_free_pages() at vm_phys_free_pages+0x253/frame 0xfffffe017547c450 > vm_page_free_phys_pglist() at vm_page_free_phys_pglist+0x37/frame 0xfffffe017547c470 > vm_object_terminate() at vm_object_terminate+0x405/frame 0xfffffe017547c4d0 > vm_object_deallocate() at vm_object_deallocate+0x45c/frame 0xfffffe017547c530 > vm_map_process_deferred() at vm_map_process_deferred+0x99/frame 0xfffffe017547c560 > vm_map_remove() at vm_map_remove+0xc6/frame 0xfffffe017547c590 > exec_new_vmspace() at exec_new_vmspace+0x185/frame 0xfffffe017547c5f0 > exec_elf64_imgact() at exec_elf64_imgact+0x907/frame 0xfffffe017547c6e0 > kern_execve() at kern_execve+0x82c/frame 0xfffffe017547ca40 > sys_execve() at sys_execve+0x4c/frame 0xfffffe017547cac0 > amd64_syscall() at amd64_syscall+0x79b/frame 0xfffffe017547cbf0 > fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe017547cbf0 > I am adding some more details. There is certain similarity between this crash and the one reported in https://lists.freebsd.org/pipermail/freebsd-current/2018-April/069246.html For example, they have vm_object_terminate_pages() in common. (kgdb) bt #0 __curthread () at ./machine/pcpu.h:230 #1 doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:361 #2 0xffffffff80b67942 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:441 #3 0xffffffff80b67ead in vpanic (fmt=, ap=0xfffffe017547c3e0) at /usr/src/sys/kern/kern_shutdown.c:837 #4 0xffffffff80b67c30 in kassert_panic (fmt=0xffffffff812d06bd "vm_phys_free_pages: page %p has unexpected order %d") at /usr/src/sys/kern/kern_shutdown.c:723 #5 0xffffffff80eae4e3 in vm_phys_free_pages (m=0xfffff80cbfb71958, order=0) at /usr/src/sys/vm/vm_phys.c:922 #6 0xffffffff80ea6687 in vm_page_free_phys_pglist (tq=) at /usr/src/sys/vm/vm_page.c:3286 #7 0xffffffff80e9e185 in vm_object_terminate_pages (object=) at /usr/src/sys/vm/vm_object.c:792 #8 vm_object_terminate (object=0xfffff8036a7cc700) at /usr/src/sys/vm/vm_object.c:861 #9 0xffffffff80e9d1dc in vm_object_deallocate (object=0xfffff8036a7cc700) at /usr/src/sys/vm/vm_object.c:684 #10 0xffffffff80e923d9 in vm_map_entry_deallocate (system_map=, entry=) at /usr/src/sys/vm/vm_map.c:2997 #11 vm_map_process_deferred () at /usr/src/sys/vm/vm_map.c:541 #12 0xffffffff80e974b6 in _vm_map_unlock (map=, file=, line=3189) at /usr/src/sys/vm/vm_map.c:554 #13 vm_map_remove (map=, start=4096, end=140737488355328) at /usr/src/sys/vm/vm_map.c:3189 #14 0xffffffff80b215a5 in exec_new_vmspace (imgp=0xfffffe017547c8b0, sv=) at /usr/src/sys/kern/kern_exec.c:1099 #15 0xffffffff80af7d37 in exec_elf64_imgact (imgp=) at /usr/src/sys/kern/imgact_elf.c:922 #16 0xffffffff80b2018c in do_execve (td=, args=, mac_p=) at /usr/src/sys/kern/kern_exec.c:606 #17 kern_execve (td=, args=, mac_p=) at /usr/src/sys/kern/kern_exec.c:351 #18 0xffffffff80b1f61c in sys_execve (td=0xfffff803e08cf000, uap=0xfffff803e08cf3c0) at /usr/src/sys/kern/kern_exec.c:225 #19 0xffffffff810270ab in syscallenter (td=0xfffff803e08cf000) at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:134 #20 amd64_syscall (td=0xfffff803e08cf000, traced=0) at /usr/src/sys/amd64/amd64/trap.c:936 #21 #22 0x00000008003ddd9a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe6c8 (kgdb) fr 8 #8 vm_object_terminate (object=0xfffff8036a7cc700) at /usr/src/sys/vm/vm_object.c:861 861 vm_object_terminate_pages(object); (kgdb) p *object $1 = { lock = { lock_object = { lo_name = 0xffffffff81202c27 "vm object", lo_flags = 627245056, lo_data = 0, lo_witness = 0xfffff80cffd6a700 }, rw_lock = 18446735294268764160 }, object_list = { tqe_next = 0xfffff8036a7cc800, tqe_prev = 0xfffff8036a7cc620 }, shadow_head = { lh_first = 0x0 }, shadow_list = { le_next = 0xfffff803705a7a00, le_prev = 0xfffff805b994d830 }, memq = { tqh_first = 0xfffff80cbfb71958, tqh_last = 0xfffff80cbfb71900 }, rtree = { rt_root = 18446735295662474800 }, size = 1561, domain = { dr_policy = 0x0, dr_iterator = 0 }, generation = 1, ref_count = 0, shadow_count = 0, memattr = 6 '\006', type = 0 '\000', flags = 12296, pg_color = 1809, paging_in_progress = 0, resident_page_count = 5, backing_object = 0x0, backing_object_offset = 0, pager_object_list = { tqe_next = 0x0, tqe_prev = 0x0 }, rvq = { lh_first = 0xfffff80cad51cc40 }, handle = 0x0, un_pager = { vnp = { vnp_size = 5, writemappings = 0 }, devp = { devp_pglist = { tqh_first = 0x5, tqh_last = 0x0 }, ops = 0x0, dev = 0x0 }, sgp = { sgp_pglist = { tqh_first = 0x5, tqh_last = 0x0 } }, swp = { swp_tmpfs = 0x5, swp_blks = { pt_root = 0 } } }, cred = 0xfffff80c131d0500, charge = 6393856, umtx_data = 0x0 } (kgdb) fr 5 #5 0xffffffff80eae4e3 in vm_phys_free_pages (m=0xfffff80cbfb71958, order=0) at /usr/src/sys/vm/vm_phys.c:922 922 KASSERT(m->order == VM_NFREEORDER, (kgdb) p *m $2 = { plinks = { q = { tqe_next = 0xfffff80cfa917ae8, tqe_prev = 0xfffff80cfa816fb8 }, s = { ss = { sle_next = 0xfffff80cfa917ae8 }, pv = 0xfffff80cfa816fb8 }, memguard = { p = 18446735333359975144, v = 18446735333358923704 } }, listq = { tqe_next = 0xfffff80cbfb71820, tqe_prev = 0xfffff80cfa816fc8 }, object = 0x0, pindex = 1548, phys_addr = 12144705536, md = { pv_list = { tqh_first = 0x0, tqh_last = 0xfffff80cbfb71990 }, pv_gen = 65204, pat_mode = 6 }, wire_count = 0, busy_lock = 1, hold_count = 0, flags = 0, aflags = 0 '\000', oflags = 0 '\000', queue = 255 '\377', psind = 0 '\000', segind = 5 '\005', order = 0 '\000', pool = 0 '\000', act_count = 5 '\005', valid = 0 '\000', dirty = 0 '\000' } -- Andriy Gapon