From owner-freebsd-bugs@freebsd.org Fri Sep 21 10:03:02 2018 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53A341094D72 for ; Fri, 21 Sep 2018 10:03:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E3BA977302 for ; Fri, 21 Sep 2018 10:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id A59EE1094D71; Fri, 21 Sep 2018 10:03:01 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 81DBA1094D70 for ; Fri, 21 Sep 2018 10:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1A9EF772FB for ; Fri, 21 Sep 2018 10:03:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 6955E1FDFD for ; Fri, 21 Sep 2018 10:03:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w8LA305N057233 for ; Fri, 21 Sep 2018 10:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w8LA30Sh057232 for bugs@FreeBSD.org; Fri, 21 Sep 2018 10:03:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 225692] iswprint() wrong for some FULL WIDTH characters in UTF-8 locale Date: Fri, 21 Sep 2018 10:02:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: freebsd@niamodnikufesin.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2018 10:03:02 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225692 Hank Hampel changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |freebsd@niamodnikufesin.de --- Comment #11 from Hank Hampel --- I quickly wanted to add that this problem probably affects everybody using = mosh (https://mosh.org/) - or any other remote shell that relies on the server interpreting characters - and powerline-status (https://github.com/powerline/powerline) or other programs using Unicode characters. SSH notably doesn't rely on the server interpreting the characters otherwise the outcry for this regression would have probably been much greater. Please note well that the above worked flawlessly for FreeBSD 10.x-RELEASE - which= is especially frustrating. The thing that makes this bug even worse is that there are obviously "holes= " in the Unicode coverage of the UTF-8 locales so that some Unicode characters w= ork fine while others are impossible to use - which makes this problem only har= der to debug for users. As a quick test you can put the following lines (taken from powerline-statu= s) into a file and copy it onto a FreeBSD 11.x-RELEASE machine and log onto it= via mosh and you'll see empty strings instead of the Unicode chars which in turn runs havoc on your input line if used as a shell prompt (PS1) as the length= is calculated wrongly. "dividers": { "left": { "hard": "=EE=82=B0 ", "soft": "=EE=82=B1 " }, "right": { "hard": " =EE=82=B2", "soft": " =EE=82=B3" } }, Thanks everybody for looking into this problem and fixing the associated regression! --=20 You are receiving this mail because: You are the assignee for the bug.=