Provided by: tcl8.4-doc_8.4.20-7_all bug

NAME

       Tcl_UniChar,     Tcl_UniCharCaseMatch,     Tcl_UniCharNcasecmp,    Tcl_UniCharToUtf,    Tcl_UtfToUniChar,
       Tcl_UniCharToUtfDString, Tcl_UtfToUniCharDString, Tcl_UniCharLen,  Tcl_UniCharNcmp,  Tcl_UtfCharComplete,
       Tcl_NumUtfChars,   Tcl_UtfFindFirst,   Tcl_UtfFindLast,   Tcl_UtfNext,  Tcl_UtfPrev,  Tcl_UniCharAtIndex,
       Tcl_UtfAtIndex, Tcl_UtfBackslash - routines for manipulating UTF-8 strings.

SYNOPSIS

       #include <tcl.h>

       typedef ... Tcl_UniChar;

       int
       Tcl_UniCharToUtf(ch, buf)

       int
       Tcl_UtfToUniChar(src, chPtr)

       char *                                                                                                    2
       Tcl_UniCharToUtfDString(uniStr, numChars, dstPtr)                                                         2

       Tcl_UniChar *                                                                                             2
       Tcl_UtfToUniCharDString(src, len, dstPtr)                                                                 2

       int
       Tcl_UniCharLen(uniStr)

       int
       Tcl_UniCharNcmp(uniStr, uniStr, num)

       int                                                                                                       2
       Tcl_UniCharNcasecmp(uniStr, uniStr, num)                                                                  2

       int                                                                                                       2
       Tcl_UniCharCaseMatch(uniStr, uniPattern, nocase)                                                          2

       int
       Tcl_UtfNcmp(src, src, num)

       int
       Tcl_UtfNcasecmp(src, src, num)

       int
       Tcl_UtfCharComplete(src, len)

       int
       Tcl_NumUtfChars(src, len)

       CONST char *                                                                                              2
       Tcl_UtfFindFirst(src, ch)                                                                                 2

       CONST char *                                                                                              2
       Tcl_UtfFindLast(src, ch)                                                                                  2

       CONST char *                                                                                              2
       Tcl_UtfNext(src)                                                                                          2

       CONST char *                                                                                              2
       Tcl_UtfPrev(src, start)                                                                                   2

       Tcl_UniChar
       Tcl_UniCharAtIndex(src, index)

       CONST char *                                                                                              2
       Tcl_UtfAtIndex(src, index)                                                                                2

       int
       Tcl_UtfBackslash(src, readPtr, dst)

ARGUMENTS

       char                *buf       (out)     Buffer in which the UTF-8 representation of the  Tcl_UniChar  is
                                                stored.  At most TCL_UTF_MAX bytes are stored in the buffer.

       int                 ch         (in)      The Tcl_UniChar to be converted or examined.

       Tcl_UniChar         *chPtr     (out)     Filled with the Tcl_UniChar represented by the head of the UTF-8
                                                string.

       CONST char          *src       (in)      Pointer to a UTF-8 string.

       CONST Tcl_UniChar   *uniStr    (in)      A null-terminated Unicode string.

       CONST Tcl_UniChar   *uniPattern(in)      A null-terminated Unicode string.

       int                 len        (in)      The  length of the UTF-8 string in bytes (not UTF-8 characters).
                                                If negative, all bytes up to the first null byte are used.

       int                 numChars   (in)      The length of the Unicode string in characters.  Must be greater
                                                than or equal to 0.

       Tcl_DString         *dstPtr    (in/out)  A pointer to a previously-initialized Tcl_DString.

       unsigned long       num        (in)      The number of characters to compare.

       CONST char          *start     (in)      Pointer to the beginning of a UTF-8 string.

       int                 index      (in)      The index of a character (not byte) in the UTF-8 string.

       int                 *readPtr   (out)     If non-NULL, filled with the number of bytes  in  the  backslash
                                                sequence, including the backslash character.

       char                *dst       (out)     Buffer  in which the bytes represented by the backslash sequence
                                                are stored.  At most TCL_UTF_MAX bytes are stored in the buffer. 2

       int                 nocase     (in)                                                                       2
                                                Specifies whether the match should be done case-sensitive (0) or 2
                                                case-insensitive (1).
_________________________________________________________________

DESCRIPTION

       These routines convert between UTF-8 strings and Tcl_UniChars.  A  Tcl_UniChar  is  a  Unicode  character
       represented as an unsigned, fixed-size quantity.  A UTF-8 character is a Unicode character represented as
       a varying-length sequence of up to TCL_UTF_MAX bytes.  A multibyte UTF-8 sequence consists of a lead byte
       followed by some number of trail bytes.

       TCL_UTF_MAX  is the maximum number of bytes that it takes to represent one Unicode character in the UTF-8
       representation.

       Tcl_UniCharToUtf stores the Tcl_UniChar ch as a UTF-8 string in starting at buf.  The return value is the
       number of bytes stored in buf.

       Tcl_UtfToUniChar reads one UTF-8 character starting at src and stores it as a Tcl_UniChar in *chPtr.  The
       return value is the number of bytes read from src..  The caller must ensure that  the  source  buffer  is
       long  enough  such  that  this  routine  does  not run off the end and dereference non-existent or random
       memory; if the source buffer is known to be null-terminated, this will not happen.  If the input  is  not
       in  proper  UTF-8  format,  Tcl_UtfToUniChar  will store the first byte of src in *chPtr as a Tcl_UniChar
       between 0x0000 and 0x00ff and return 1.

       Tcl_UniCharToUtfDString converts the given Unicode string to UTF-8, storing the result in  a  previously-
       initialized Tcl_DString.  You must specify the length of the given Unicode string.  The return value is a
       pointer  to  the UTF-8 representation of the Unicode string.  Storage for the return value is appended to
       the end of the Tcl_DString.

       Tcl_UtfToUniCharDString converts the given UTF-8 string to Unicode, storing the result in the previously-
       initialized Tcl_DString.  you may either specify the length of the given UTF-8 string or "-1",  in  which
       case  Tcl_UtfToUniCharDString  uses strlen to calculate the length.  The return value is a pointer to the
       Unicode representation of the UTF-8 string.  Storage for the return value is appended to the end  of  the
       Tcl_DString.  The Unicode string is terminated with a Unicode null character.

       Tcl_UniCharLen corresponds to strlen for Unicode characters.  It accepts a null-terminated Unicode string
       and returns the number of Unicode characters (not bytes) in that string.

       Tcl_UniCharNcmp  and Tcl_UniCharNcasecmp correspond to strncmp and strncasecmp, respectively, for Unicode
       characters.  They accepts two null-terminated Unicode strings and the number of  characters  to  compare.
       Both  strings  are  assumed to be at least len characters long. Tcl_UniCharNcmp  compares the two strings
       character-by-character according to the Unicode character ordering.  It returns an integer greater  than,
       equal  to,  or  less than 0 if the first string is greater than, equal to, or less than the second string
       respectively.  Tcl_UniCharNcasecmp is the Unicode case insensitive version.

       Tcl_UniCharCaseMatch is the Unicode equivalent to  Tcl_StringCaseMatch.   It  accepts  a  null-terminated 2
       Unicode  string,  a  Unicode  pattern,  and  a  boolean value specifying whether the match should be case 2
       sensitive and returns whether the string matches the pattern.

       Tcl_UtfNcmp corresponds to strncmp for UTF-8 strings. It accepts two null-terminated  UTF-8  strings  and
       the  number  of  characters  to  compare.  (Both strings are assumed to be at least len characters long.)
       Tcl_UtfNcmp compares the two strings character-by-character according to the Unicode character  ordering.
       It  returns  an integer greater than, equal to, or less than 0 if the first string is greater than, equal
       to, or less than the second string respectively.

       Tcl_UtfNcasecmp corresponds to strncasecmp for UTF-8  strings.   It  is  similar  to  Tcl_UtfNcmp  except
       comparisons ignore differences in case when comparing upper, lower or title case characters.

       Tcl_UtfCharComplete  returns  1  if  the source UTF-8 string src of length len bytes is long enough to be
       decoded by Tcl_UtfToUniChar, or 0 otherwise.  This function does not guarantee that the UTF-8  string  is
       properly  formed.   This routine is used by procedures that are operating on a byte at a time and need to
       know if a full Tcl_UniChar has been seen.

       Tcl_NumUtfChars corresponds to strlen for UTF-8 strings.  It returns the number of Tcl_UniChars that  are
       represented  by  the  UTF-8  string src.  The length of the source string is len bytes.  If the length is
       negative, all bytes up to the first null byte are used.

       Tcl_UtfFindFirst corresponds to strchr for UTF-8 strings.  It returns a pointer to the  first  occurrence
       of the Tcl_UniChar ch in the null-terminated UTF-8 string src.  The null terminator is considered part of
       the UTF-8 string.

       Tcl_UtfFindLast corresponds to strrchr for UTF-8 strings.  It returns a pointer to the last occurrence of
       the  Tcl_UniChar  ch  in the null-terminated UTF-8 string src.  The null terminator is considered part of
       the UTF-8 string.

       Given src, a pointer to some location in a UTF-8 string, Tcl_UtfNext returns a pointer to the next  UTF-8
       character  in the string.  The caller must not ask for the next character after the last character in the
       string if the string is not terminated by a null character.

       Given src, a pointer to some location in a UTF-8 string (or to a null byte immediately following  such  a
       string), Tcl_UtfPrev returns a pointer to the closest preceding byte that starts a UTF-8 character.  This
       function  will not back up to a position before start, the start of the UTF-8 string.  If src was already
       at start, the return value will be start.

       Tcl_UniCharAtIndex corresponds to a C string array dereference or the Pascal Ord() function.  It  returns
       the  Tcl_UniChar  represented  at  the specified character (not byte) index in the UTF-8 string src.  The
       source string must contain at least index characters.  Behavior is  undefined  if  a  negative  index  is
       given.

       Tcl_UtfAtIndex  returns  a  pointer  to the specified character (not byte) index in the UTF-8 string src.
       The source string must contain at least index characters.  This  is  equivalent  to  calling  Tcl_UtfNext
       index  times.   If  a  negative  index  is given, the return pointer points to the first character in the
       source string.

       Tcl_UtfBackslash is a utility procedure used by several of the  Tcl  commands.   It  parses  a  backslash
       sequence  and  stores  the  properly  formed UTF-8 character represented by the backslash sequence in the
       output buffer dst.  At most TCL_UTF_MAX bytes  are  stored  in  the  buffer.   Tcl_UtfBackslash  modifies
       *readPtr  to  contain  the  number of bytes in the backslash sequence, including the backslash character.
       The return value is the number of bytes stored in the output buffer.

       See the Tcl manual entry for information  on  the  valid  backslash  sequences.   All  of  the  sequences
       described in the Tcl manual entry are supported by Tcl_UtfBackslash.

KEYWORDS

       utf, unicode, backslash

Tcl                                                    8.1                                             Utf(3tcl)