Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
History of ext/fts3/fts3_unicode2.c
|
2019-01-02
| ||
| 23:49 | Fix harmless compiler warnings in the unicode2 logic of FTS3 and FTS5. file: [416eb7e1] check-in: [703029ac] user: drh branch: trunk, size: 17907 | |
|
2018-12-28
| ||
| 07:37 | Fix problems in fts5 found by ASAN. file: [faf0c750] check-in: [c564bf87] user: dan branch: trunk, size: 17890 | |
|
2018-12-14
| ||
| 18:11 | Fix harmless compiler warnings. file: [e49f9e01] check-in: [27221c69] user: drh branch: trunk, size: 17857 | |
|
2018-12-03
| ||
| 16:14 | Add the "remove_diacritics=2" option to the unicode61 tokenizer in both FTS5 and FTS3/4. file: [90e65f42] check-in: [06177f3f] user: dan branch: trunk, size: 17835 | |
|
2017-03-20
| ||
| 18:53 | Fix some problems in fts3 found by address-sanitizer. file: [cc04fc67] check-in: [16a8e84f] user: dan branch: trunk, size: 16696 | |
|
2014-08-06
| ||
| 18:50 | A couple more harmless compiler warnings eliminated. file: [c3d01968] check-in: [bcf6d775] user: drh branch: trunk, size: 16666 | |
| 17:49 | Fix two more harmless compiler warnings. Make sure the fts3_unicode2.c file is in sync with mkunicode.tcl. file: [b81e5f0f] check-in: [a2a60307] user: drh branch: trunk, size: 16663 | |
|
2014-07-03
| ||
| 12:18 | Change fts3/4 so that the "unicode61" is included in builds by default. It may now be excluded by defining SQLITE_DISABLE_FTS3_UNICODE. file: [c8adda75] check-in: [0cc0230a] user: dan branch: trunk, size: 16663 | |
|
2013-06-05
| ||
| 16:17 | Up until now the fts4 "unicode61" tokenizer has treated all private use codepoints except the first and last of each of the three ranges as alphanumeric (eligible to be part of tokens). This commit fixes this so that all private use codepoints are considered alphanumeric. In other words, it fixes the handling of codepoints 0xE000, 0xF8FF, 0xF0000, 0xFFFFD, 0x100000 and 0x10FFFD. file: [0113d3ac] check-in: [6cfd9af5] user: dan branch: trunk, size: 16670 | |
|
2012-06-18
| ||
| 08:00 | Fix a few compilation issues that can occur with certain compilers (e.g. GCC 2.95.3, MSVC). file: [a863f05f] check-in: [f970a3de] user: mistachkin branch: compiler-compat, size: 16734 | |
|
2012-06-06
| ||
| 19:51 | Disable FTS unicode61 by default. It is enabled by specifying compile time option SQLITE_ENABLE_FTS4_UNICODE61. file: [2965d217] check-in: [eccd6b65] user: dan branch: trunk, size: 16718 | |
| 19:30 | Have the FTS unicode61 strip out diacritics when tokenizing text. This can be disabled by specifying the tokenizer option "remove_diacritics=0". file: [6381bcfd] check-in: [790f76a5] user: dan branch: trunk, size: 16717 | |
|
2012-05-28
| ||
| 12:22 | Omit the fts3 unicode character class routines from the build if fts3/4 is disabled. file: [3ddf1728] check-in: [c00bb5d4] user: drh branch: trunk, size: 13984 | |
|
2012-05-26
| ||
| 18:28 | If SQLITE_DISABLE_FTS3_UNICODE is defined, do not build the "unicode61" tokenizer. file: [46ff2289] check-in: [e71495a8] user: dan branch: fts4-unicode, size: 13840 | |
| 17:57 | Change the format of the tables used by sqlite3FtsUnicodeTolower() to make them a little smaller. file: [e43024fe] check-in: [b89d3834] user: dan branch: fts4-unicode, size: 13755 | |
|
2012-05-25
| ||
| 19:50 | Add special fast paths to sqlite3FtsUnicodeTolower() and Isalnum() for codepoints in the ASCII range. file: [75fa8f24] check-in: [cf7b25d4] user: dan branch: fts4-unicode, size: 13179 | |
| 18:48 | Fix comments in generated file fts3_unicode2.c. file: [6989db92] check-in: [3dc567ef] user: dan branch: fts4-unicode, size: 12930 | |
| 17:50 | Add an experimental tokenizer to fts4 - "unicode". This tokenizer works in the same way except that it understands unicode "simple case folding" and recognizes all characters not classified as "Letters" or "Numbers" by unicode as token separators. file: [83ad4e6a] check-in: [0c13570e] user: dan branch: fts4-unicode, size: 11358 Added | |