From owner-svn-src-head@freebsd.org Mon May 4 18:16:24 2020 Return-Path: Delivered-To: svn-src-head@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 533232D6485 for ; Mon, 4 May 2020 18:16:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic302-22.consmr.mail.gq1.yahoo.com (sonic302-22.consmr.mail.gq1.yahoo.com [98.137.68.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49G9zC3kdTz4XP3 for ; Mon, 4 May 2020 18:16:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: LIeyrEgVM1li9ooYhqzhtSDUrWGsBQaCd98bLHYPxzr1tWDaTQiFgQsVdy3sLYQ DuY7YJWnuvRsz8wt20s_q1gEXLVVWUJh4J7L8XXZfRdqA2QEDbPuojhsTo2VCZbDj3ZF.7eI0lfz o9c7ALvAJ6spb7M13DWi.WLosHHwcCt04GW6O8TjA2mlM_1bsBxCcfNWdqTo..lAnYHjPEDBx7HV _2Tx1qIzQ0cOI6GRFvSIsXRo5_nYDcyP4awQVt17mJBdAdz6Yk0vj82E5_JvCI0leB62JA3tm78h 1XD5wQwUZlerLBCGKHqLs7qcDxNr9pv3ZV8LLDFFT.tFMFBhVGs6Rs3O4IpXpFEr1cMiOnFHAhte Da.EZXxSbmsUFkHC0su6tanKGYhKy42h7GJ5OqkojE.nD7H78Vn0GLA93fU7dMt4_RlHcKBG0lxX vz3tNV4s0kGeIQEz53hRxg5yqWEeTuzc6mbNmjjN0.UVqbg3TjZzyLIuXvHvH2xBQgfdsz3VfrqZ vfA26Zu6oKgZ8Ez66yktajslvTCiZNlCGBnDitZ_ZitHlKk5_zk4KzX2BOe1dRzuyLyrkyw6FAeY LGllG7Pcf5JChIynJj6g6ghPqlCEY0JsByIIzUhzRP15Bh51CAgFN41VfGV2XAitDX5YVpBCdIZy Td8B.fb2u0R6Fmwh9b_5JFLJJMZs.gsTKEAx8HwjLQjNHpQodaUV4eEoFq6fqBdsNJaLg8KZ1acV 7yHmFiZiHKItADe.WNn3cFhzQn7gRXafkxT0J75Br5IEJWHBOEqjYCh1HHhqmGg4YAplI9nRFnzc WGIwg69XgJ86bPT6I_kpA4mTgUUa5lcHOGsVwEtKBGkoJXUXVTl9agBtFFtV6uHGuYJsGvCV8bWQ imQUDp3YhDa0AZ2OO3XCkOSGtGJFwOnEnqZnsowIrQRC7PTldWSC9Mh6cKxsLAQktEBdaqf84vX3 DpS6UUYwVDWQWgNJtDyFUiFx1KxQ.7_ZAoSEkO2zk7WahJ6aq_R5QA55BRyhAYOnTMezWiEQINqe X7BU8mdf2zwRz4wP0wew6kBTKybCFZP95mAQQXhlqMUbZkuA9PVCnTQe7z4h8RQ2Pn3KJNgopgR1 IUmbIHXyAgT4r.t3wNabY8D.Bdh7aT99AMohI_UcQplI8D0fDqyDIf8ZAdMKlAQ3sey.uUzqokMw wRQsSJ4FyGIPWpc.7WYefhujclI_4uqWnDhGhlowYfWeMVYP6PaePQZ0q_rOvAAvpvToWbVPcvO_ pL3eiTH.l.HOZk3MvqnPmtNOjJ7lSvxkLpNpI0mhpR3s4xKJ58eeMgODzqBAk2KLkOyWyKpozc6d Uu68LoHo4fJZEtTpZPLGb57.PJZ_nNAKDfvgLeFoXGEQCfGqQ9pEV066Ro2m.tdyKUvItA_N7.pH fbUbXHzl7f9mOfQYNyX1hQt7mvs8Xwcw- Received: from sonic.gate.mail.ne1.yahoo.com by sonic302.consmr.mail.gq1.yahoo.com with HTTP; Mon, 4 May 2020 18:16:22 +0000 Received: by smtp412.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID a91220a105656127b80ed8ef3721be0e; Mon, 04 May 2020 18:16:17 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: svn commit: r360233 - in head: contrib/jemalloc . . . : This partially breaks a 2-socket 32-bit powerpc (old PowerMac G4) based on head -r360311 From: Mark Millard In-Reply-To: <695E6836-F860-4557-B7DE-CC1EDB347F18@yahoo.com> Date: Mon, 4 May 2020 11:16:14 -0700 Cc: Brandon Bergren Content-Transfer-Encoding: quoted-printable Message-Id: References: <8479DD58-44F6-446A-9CA5-D01F0F7C1B38@yahoo.com> <17ACDA02-D7EF-4F26-874A-BB3E935CD072@yahoo.com> <695E6836-F860-4557-B7DE-CC1EDB347F18@yahoo.com> To: "vangyzen@freebsd.org" , svn-src-head@freebsd.org, FreeBSD Current , FreeBSD Hackers , FreeBSD PowerPC ML X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 49G9zC3kdTz4XP3 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.43 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; RCPT_COUNT_FIVE(0.00)[6]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.94)[-0.940,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.994,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.00)[ip: (3.26), ipnet: 98.137.64.0/21(0.83), asn: 36647(0.66), country: US(-0.05)]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.68.137.98.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[148.68.137.98.rep.mailspike.net : 127.0.0.17]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 May 2020 18:16:24 -0000 [This report just shows some material for the sendmail SIGSEGV's, based on truss output.] I've returned to using the modern jemalloc because it seems to show problems more, after having caught the earlier reported dhclient example under the older jemalloc context. (Again: jemalloc may be exposing a problem elsewhere.) I had truss monitor sendmail, including following child processes. A child process start and end normally looks like: 963: 3092.707439595 0.000033895 sigprocmask(SIG_SETMASK,{ SIGCHLD = },0x0) =3D 0 (0x0) 2432: 3092.708024959 0.000000000 963: 3092.708136462 0.000470115 fork() =3D 2432 (0x980) 2432: 3092.708441039 0.000033319 thr_self(0x50120000) =3D 0 (0x0) . . . 2432: 3092.717283761 0.000036008 sigaction(SIGQUIT,{ SIG_IGN SA_RESTART = ss_t },{ SIG_IGN SA_RESTART ss_t }) =3D 0 (0x0) 2432: 3092.717544288 0.000034352 sigprocmask(SIG_SETMASK,{ },0x0) =3D 0 = (0x0) 2432: 3092.717799894 0.000035768 close(0) =3D 0 (0x0) 2432: 3092.718174733 0.000103726 = openat(AT_FDCWD,"/dev/null",O_RDONLY,00) =3D 0 (0x0) 2432: 3092.718480437 0.000052091 = openat(AT_FDCWD,"/dev/null",O_WRONLY,00) =3D 4 (0x4) 2432: 3092.718778028 0.000037856 dup2(4,1) =3D 1 (0x1) 2432: 3092.719003051 0.000034255 dup2(4,2) =3D 2 (0x2) 2432: 3092.719225122 0.000033655 close(4) =3D 0 (0x0) 2432: 3092.719437735 0.000047626 fstat(0,{ mode=3Dcrw-rw-rw- = ,inode=3D22,size=3D0,blksize=3D4096 }) =3D 0 (0x0) 2432: 3092.719679274 0.000037400 fstat(1,{ mode=3Dcrw-rw-rw- = ,inode=3D22,size=3D0,blksize=3D4096 }) =3D 0 (0x0) 2432: 3092.719908859 0.000035816 fstat(2,{ mode=3Dcrw-rw-rw- = ,inode=3D22,size=3D0,blksize=3D4096 }) =3D 0 (0x0) 2432: 3092.720138299 0.000033727 clock_gettime(13,{ = 1588570204.000000000 }) =3D 0 (0x0) 2432: 3092.720658945 0.000035360 getpid() =3D 2432 (0x980) 2432: 3092.720931594 0.000048730 = __sysctl("kern.proc.args.2432",4,0x0,0x0,0x508ae000,49) =3D 0 (0x0) 2432: 3092.721572338 0.000062318 = open(".",O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC,00) =3D 4 (0x4) 2432: 3092.721962132 0.000037808 fcntl(4,F_ISUNIONSTACK,0x0) =3D 0 = (0x0) 2432: 3092.722323792 0.000098613 = getdirentries(4,"\0\0\0\0\0\t\M-I\M^Q\0\0\0\0\0\0"...,4096,{ 0x0 }) =3D = 144 (0x90) 2432: 3092.722944875 0.000036944 getdirentries(4,0x50859000,4096,{ = 0x200 }) =3D 0 (0x0) 2432: 3092.723294461 0.000045250 close(4) =3D 0 (0x0) 2432: 3092.723576400 0.000041144 clock_gettime(13,{ = 1588570204.000000000 }) =3D 0 (0x0) 2432: 3092.723828718 0.000037928 setitimer(0,{ 0.000000, 0.000000 = },0x0) =3D 0 (0x0) 2432: 3092.724092245 0.000035815 sigprocmask(SIG_UNBLOCK,{ SIGALRM },{ = }) =3D 0 (0x0) 2432: 3092.724591527 0.000038024 getpid() =3D 2432 (0x980) 2432: 3092.724952323 0.000052955 setuid(0x0) ERR#1 'Operation not = permitted' 2432: 3092.727852159 0.000042969 clock_gettime(4,{ 21633.960374942 }) =3D= 0 (0x0) 2432: 3092.728508193 0.000034327 clock_gettime(4,{ 21633.961033929 }) =3D= 0 (0x0) 2432: 3092.729146608 0.000036872 clock_gettime(4,{ 21633.961670903 }) =3D= 0 (0x0) 2432: 3092.729824967 0.000038360 clock_gettime(4,{ 21633.962349071 }) =3D= 0 (0x0) 2432: 3092.732435446 0.001634793 exit(0x0) =20 2432: 3092.732555855 0.001755202 process exit, rval =3D 0 963: 3092.732638865 0.018571063 SIGNAL 20 (SIGCHLD) code=3DCLD_EXITED = pid=3D2432 uid=3D25 status=3D0 963: 3092.732822864 0.018755062 sigsuspend({ }) ERR#4 'Interrupted = system call' 963: 3092.733076525 0.000039968 sigprocmask(SIG_SETMASK,{ SIGCHLD = },0x0) =3D 0 (0x0) 963: 3092.733447788 0.000076601 wait4(-1,{ EXITED,val=3D0 = },WNOHANG,0x0) =3D 2432 (0x980) 963: 3092.733781410 0.000034783 wait4(-1,0xffffbe60,WNOHANG,0x0) = ERR#10 'No child processes' 963: 3092.734065366 0.000037328 sigreturn(0xffffbe90) EJUSTRETURN 963: 3092.734263408 0.000033295 sigprocmask(SIG_BLOCK,0x0,{ }) =3D 0 = (0x0) (No activity in 963 for about 1800 seconds.) But once it starts failing, the SIGSEGV happens just after the: setuid(0x0) ERR#1 'Operation not permitted' For example: . . . 4745: 37293.335510778 0.000035023 clock_gettime(13,{ = 1588604405.000000000 }) =3D 0 (0x0) 4745: 37293.335754863 0.000037593 setitimer(0,{ 0.000000, 0.000000 = },0x0) =3D 0 (0x0) 4745: 37293.336010253 0.000036200 sigprocmask(SIG_UNBLOCK,{ SIGALRM },{ = }) =3D 0 (0x0) 4745: 37293.336488027 0.000033823 getpid() =3D 4745 (0x1289) 4745: 37293.336836797 0.000051995 setuid(0x0) ERR#1 'Operation not = permitted' 4745: 37293.338022675 0.001237873 SIGNAL 11 (SIGSEGV) code=3DSEGV_MAPERR = trapno=3D768 addr=3D0x506a11f0 4745: 37293.339546520 0.002761718 process killed, signal =3D 11 963: 37293.339627249 0.050797919 SIGNAL 20 (SIGCHLD) code=3DCLD_KILLED = pid=3D4745 uid=3D25 status=3D11 963: 37293.339794781 0.050965451 sigsuspend({ }) ERR#4 'Interrupted = system call' 963: 37293.340038313 0.000037544 sigprocmask(SIG_SETMASK,{ SIGCHLD = },0x0) =3D 0 (0x0) 963: 37293.340329951 0.000070215 wait4(-1,{ SIGNALED,sig=3DSIGSEGV = },WNOHANG,0x0) =3D 4745 (0x1289) 963: 37293.340634048 0.000034903 wait4(-1,0xffffbe60,WNOHANG,0x0) = ERR#10 'No child processes' 963: 37293.340901417 0.000037615 sigreturn(0xffffbe90) EJUSTRETURN 963: 37293.341090122 0.000033319 sigprocmask(SIG_BLOCK,0x0,{ }) =3D 0 = (0x0) (Another about 1800 seconds.) So it seems that sendmail's SIGSEGV always happens during the winding down of the child process: getting ready to exit. So far, it seems that once it starts happening, it happens for each child process created after that. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)