SQLite

All files named ”ext/fts3/README.tokenizers”
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History for ext/fts3/README.tokenizers

2019-03-01
21:33
[b92bdeb8b4] part of check-in [f5732f4caf] The fts3_tokenizer() function returns NULL if the SQLITE_DBCONFIG_ENABLE_FTS_TOKENIZER setting is disabled, which is is by default. (check-in: [f5732f4caf] user: drh branch: trunk, size: 5333)
2012-05-26
14:54
[e0a8b81383] part of check-in [8f3e60aa22] Change the name of the "unicode" tokenizer to "unicode61" to emphasize that the case folding and separator-character identification routines are based on unicode version 6.1. (check-in: [8f3e60aa22] user: dan branch: fts4-unicode, size: 5199)
2012-05-04
02:58
[060abb298f] part of check-in [930115693a] Add an experimental tokenizer to FTS3/4: one that transliterates latin, greek, cyrillic, and hebrew characters into pure ascii. (check-in: [930115693a] user: drh branch: translit-tokenizer, size: 5215)
2008-12-30
06:36
[9987566966] part of check-in [b8898d132e] Fix a bug in README.tokenizers. Ticket #3559. (CVS 6075) (check-in: [b8898d132e] user: danielk1977 branch: trunk, size: 5188)
2007-12-13
21:54
[226644a0ea] part of check-in [4e91a267fe] Change all instances of "it's" in comments to either "its" or "it is", as appropriate, in case the comments are ever again read by a pedantic grammarian. Ticket #2840. (CVS 4629) (check-in: [4e91a267fe] user: drh branch: trunk, size: 5190)
2007-08-20
17:37
Added: [a97c9a55b3] part of check-in [216c91d2fc] Copy fts2 to fts3, renaming, and replacing references to fts2 with fts3, including capitalization variants. (CVS 4249) (check-in: [216c91d2fc] user: shess branch: trunk, size: 5192)