From owner-freebsd-hackers@freebsd.org Sat Jan 30 11:26:35 2016 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3B4CEA7374E for ; Sat, 30 Jan 2016 11:26:35 +0000 (UTC) (envelope-from amutu@amutu.com) Received: from mail-yk0-x230.google.com (mail-yk0-x230.google.com [IPv6:2607:f8b0:4002:c07::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F1BA81166 for ; Sat, 30 Jan 2016 11:26:34 +0000 (UTC) (envelope-from amutu@amutu.com) Received: by mail-yk0-x230.google.com with SMTP id r207so54326886ykd.2 for ; Sat, 30 Jan 2016 03:26:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amutu-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=sGtvMH6hkjgVWl7jqJkxyZgBF620QcXHbkObgXtA5Ms=; b=1kup+uyI46RSKhe2IU2wM2g0vuRTWkyM0GaKv/gLrCe2yGD5nZwdxepV82BEqV9wKj VGKBlLDdAvrAcwGMZn61xq/KeLbzf707dzMr36Gu+GFL9mkP3ghzBbMVRfTuMqOiqYcG Mzpq27R3o+cbbBOjaLEzetdJd/DH/iOTZrDqJDYB165GtFQHu75a8NV1iDMsDmxKnqiw KdlpVUHQES5Clag9l/LhRYg1nY/sJQHZvyLkyWNzhlsg0wDv03FFNkQtV0pdlRsU2uAy XFEWSr4494i+4VVjVjL1yHsckCIv6q9FrK+F42Tf9ICHru2mkdICav74CQE4C6x7+lZP Op0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=sGtvMH6hkjgVWl7jqJkxyZgBF620QcXHbkObgXtA5Ms=; b=c+n+gHfktwWRGEQS+6arsOr+mzX2OgRPZHM9cwT0S9jedBl/4u/bN7nR+0mj/DPXVi cuHLjqBMRpuwfDlDSJCTw7dTuitBTcYvtnBYydi3KVj++g5lJH6kNbANtu4FV1RXPppz 0zQpERwD31UAtRT5z0MkxstdMhC36AGXU/xJOtJBOrdEDsaLT+ceVkWbQaki+NZkDdAX gUbdevlOCN1CgNQLiu6W23lR2pYUq3wsPkO6F3HY1CX5L1+RKwDVGMhT52aPs251aMBN FUlLjwnih1pOeJVK684Z654Z0X1l+64hKu22Hs2gptYjbO7j4ApKNVtqed2SMiyA0lcR qprQ== X-Gm-Message-State: AG10YOQ5Y5IfAOOvZ9Qqsu5NHX7MfuMHDtMU0HQek5fbFLt73agjgKmyxspUbLGcua6pMA== X-Received: by 10.129.38.10 with SMTP id m10mr7771649ywm.183.1454153193844; Sat, 30 Jan 2016 03:26:33 -0800 (PST) Received: from mail-yk0-f173.google.com (mail-yk0-f173.google.com. [209.85.160.173]) by smtp.gmail.com with ESMTPSA id t64sm15511932ywa.45.2016.01.30.03.26.32 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 30 Jan 2016 03:26:33 -0800 (PST) Received: by mail-yk0-f173.google.com with SMTP id a85so97735500ykb.1 for ; Sat, 30 Jan 2016 03:26:32 -0800 (PST) MIME-Version: 1.0 X-Received: by 10.37.41.66 with SMTP id p63mr6741865ybp.183.1454153192659; Sat, 30 Jan 2016 03:26:32 -0800 (PST) Received: by 10.37.79.6 with HTTP; Sat, 30 Jan 2016 03:26:32 -0800 (PST) Received: by 10.37.79.6 with HTTP; Sat, 30 Jan 2016 03:26:32 -0800 (PST) In-Reply-To: <20160130071346.31022.37189@wrigleys.postgresql.org> References: <20160130071346.31022.37189@wrigleys.postgresql.org> Date: Sat, 30 Jan 2016 19:26:32 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Fwd: [BUGS] BUG #13900: stop standby failed with writer process hang(happen 3 times in 2 days) From: Jov To: freebsd-hackers@freebsd.org X-Mailman-Approved-At: Sat, 30 Jan 2016 12:21:20 +0000 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jan 2016 11:26:35 -0000 is there any clue that I can debug the problem? The hang process is still there. ---------- =E8=BD=AC=E5=8F=91=E7=9A=84=E9=82=AE=E4=BB=B6 ---------- =E5=8F=91=E4=BB=B6=E4=BA=BA=EF=BC=9A =E6=97=A5=E6=9C=9F=EF=BC=9A2016=E5=B9=B41=E6=9C=8830=E6=97=A5 3:14 PM =E4=B8=BB=E9=A2=98=EF=BC=9A[BUGS] BUG #13900: stop standby failed with writ= er process hang(happen 3 times in 2 days) =E6=94=B6=E4=BB=B6=E4=BA=BA=EF=BC=9A =E6=8A=84=E9=80=81=EF=BC=9A The following bug has been logged on the website: Bug reference: 13900 Logged by: Jov Email address: amutu@amutu.com PostgreSQL version: 9.3.7 Operating system: FreeBSD 10.2 amd64 Description: I am updating my 3 database from pg9.3 to pg9.5,but may find a bug for the bgwriter of pg9.3.I can't stop all the stand by process,even for immediate stop mode and kill -9,the writer process still there,with ps state "Ds" (D Marks a process in disk (or other short term, uninterruptible) wait) .googl= e say the only method to clean the "Ds" process is rebooting the system. truss say no info for the process,and procstat say the process is calling the poll system call in the kernel. These is the detail info: pg_ctl -D ./slave stop -m fast waiting for server to shut down............................................................... failed pg_ctl: server does not shut down psql postgres psql: FATAL: the database system is shutting down pg_ctl -D ./slave stop -m immediate waiting for server to shut down.... done server stopped ps auxwww | grep postgres jovz 976 0.0 0.3 28840 5232 - Is 17 116 0:00.04 postgres: logger process (postgres) jovz 979 0.0 0.7 196940 13552 - Ds 17 116 0:06.03 postgres: writer process (postgres) log: 2016-01-30 14:23:22.350 CST,,,947,,569b1bc2.3b3,3,,2016-01-17 12:42:42 CST,,0,LOG,00000,"received fast shutdown request",,,,,,,,,"" 2016-01-30 14:23:22.350 CST,,,947,,569b1bc2.3b3,4,,2016-01-17 12:42:42 CST,,0,LOG,00000,"aborting any active transactions",,,,,,,,,"" 2016-01-30 14:25:35.271 CST,,,64815,"",56ac575f.fd2f,1,"",2016-01-30 14:25:35 CST,,0,LOG,00000,"connection received: host=3D[local]",,,,,,,,,"" 2016-01-30 14:25:35.274 CST,"jovz","f",64815,"[local]",56ac575f.fd2f,2,"",2016-01-30 14:25:35 CST,,0,FATAL,57P03,"the database system is shutting down",,,,,,,,,"" 2016-01-30 14:25:38.324 CST,,,64817,"",56ac5762.fd31,1,"",2016-01-30 14:25:38 CST,,0,LOG,00000,"connection received: host=3D[local]",,,,,,,,,"" 2016-01-30 14:25:38.324 CST,"jovz","f",64817,"[local]",56ac5762.fd31,2,"",2016-01-30 14:25:38 CST,,0,FATAL,57P03,"the database system is shutting down",,,,,,,,,"" 2016-01-30 14:47:36.727 CST,,,65457,"",56ac5c88.ffb1,1,"",2016-01-30 14:47:36 CST,,0,LOG,00000,"connection received: host=3D[local]",,,,,,,,,"" 2016-01-30 14:47:36.727 CST,"jovz","postgres",65457,"[local]",56ac5c88.ffb1,2,"",2016-01-30 14:47:3= 6 CST,,0,FATAL,57P03,"the database system is shutting down",,,,,,,,,"" 2016-01-30 14:50:04.564 CST,,,947,,569b1bc2.3b3,5,,2016-01-17 12:42:42 CST,,0,LOG,00000,"received immediate shutdown request",,,,,,,,,"" truss -p 979 ^Ctruss: Unexpect stop in waitpid: Interrupted system call root@fblax:~ # procstat -kk 979 PID TID COMM TDNAME KSTACK 979 100688 postgres - mi_switch+0xe1 sleepq_timedwait_sig+0x8b _cv_timedwait_sig_sbt+0x18b seltdwait+0xa4 kern_poll+0x464 sys_poll+0x61 amd64_syscall+0x357 Xfast_syscall+0xfb root@fb:~ # kill -9 979 root@fb:~ # procstat -kk 979 PID TID COMM TDNAME KSTACK 979 100688 postgres - mi_switch+0xe1 sleepq_timedwait_sig+0x8b _cv_timedwait_sig_sbt+0x18b seltdwait+0xa4 kern_poll+0x464 sys_poll+0x61 amd64_syscall+0x357 Xfast_syscall+0xfb -- Sent via pgsql-bugs mailing list (pgsql-bugs@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-bugs