Date: Fri, 9 Jul 2004 02:08:07 +0000 (UTC) From: "Tim J. Robbins" <tjr@FreeBSD.org> To: src-committers@FreeBSD.org, cvs-src@FreeBSD.org, cvs-all@FreeBSD.org Subject: cvs commit: src/usr.bin/tr Makefile cmap.c cmap.h cset.c cset.h extern.h str.c tr.c Message-ID: <200407090208.i69287du035795@repoman.freebsd.org>
next in thread | raw e-mail | index | archive | help
tjr 2004-07-09 02:08:07 UTC
FreeBSD src repository
Modified files:
usr.bin/tr Makefile extern.h str.c tr.c
Added files:
usr.bin/tr cmap.c cmap.h cset.c cset.h
Log:
Add support for multibyte characters. The challenge here was to use
data structures that scale better with large character sets, instead of
arrays indexed by character value:
- Sets of characters to delete/squeeze are stored in a new "cset" structure,
which is implemented as a splay tree of extents. This structure has the
ability to store character classes (ala wctype(3)), but this is not
currently fully utilized.
- Mappings between characters are stored in a new "cmap" structure, which
is also a splay tree.
- The parser no longer builds arrays containing all the characters in a
particular class; instead, next() determines them on-the-fly using
nextwctype(3).
Revision Changes Path
1.2 +2 -1 src/usr.bin/tr/Makefile
1.1 +212 -0 src/usr.bin/tr/cmap.c (new)
1.1 +83 -0 src/usr.bin/tr/cmap.h (new)
1.1 +303 -0 src/usr.bin/tr/cset.c (new)
1.1 +75 -0 src/usr.bin/tr/cset.h (new)
1.9 +11 -10 src/usr.bin/tr/extern.h
1.23 +78 -87 src/usr.bin/tr/str.c
1.22 +116 -102 src/usr.bin/tr/tr.c
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200407090208.i69287du035795>