Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
History for ext/fts5/fts5Int.h
2025-05-30
| ||
15:43 | [cc1e6ed28e] part of check-in [22441955e0] Use a more robust backup definition for offsetof(). (check-in: [22441955e0] user: drh branch: trunk, size: 31515) | |
11:14 | [4c7380ce83] part of check-in [838deb7f34] Add "include <stddef.h>" to fts5 and rtree to ensure that they use the system version of the offsetof() macro when it is available, as the built-in version triggers ubsan errors with clang. (check-in: [838deb7f34] user: dan branch: trunk, size: 31526) | |
2025-03-14
| ||
23:57 | [bffbd0acdc] part of check-in [0c4d9c7474] Turn Fts5Colset.aiCol into a flexible array. (check-in: [0c4d9c7474] user: drh branch: flex-array, size: 31506) | |
2024-11-02
| ||
19:10 | [6abff7dd77] part of check-in [46929ae92b] Allow an fts5 table or query to be configured to collect xInstToken data for any prefix terms as part of the first parse of the main index, if any. (check-in: [46929ae92b] user: dan branch: fts5-tokendata-prefix, size: 31092) | |
2024-10-27
| ||
14:41 | [a282f33a26] part of check-in [740a37c5d5] Merge latest trunk into this branch. (check-in: [740a37c5d5] user: dan branch: fts5-tokendata-prefix, size: 31029) | |
2024-09-27
| ||
10:57 | [bf0d3efa14] part of check-in [cd36d66c88] Allow UPDATEs of unindexed columns in fts5 contentless_unindexed=1 tables. Testing to come. (check-in: [cd36d66c88] user: dan branch: fts5-contentless-unindexed, size: 30940) | |
2024-09-25
| ||
18:55 | [83a7af3fee] part of check-in [204ddf4e72] Change the way tokendata indexes are collected for prefix queries. (check-in: [204ddf4e72] user: dan branch: fts5-tokendata-prefix, size: 30907) | |
2024-09-13
| ||
16:30 | [927772e795] part of check-in [c51dc2a5e7] Require that the contentless_unindexed=1 option be specified before storing the values of fts5 UNINDEXED column belonging to contentless tables. (check-in: [c51dc2a5e7] user: dan branch: fts5-contentless-unindexed, size: 30935) | |
15:37 | [6ec0c8a494] part of check-in [d2f0d19936] Merge latest trunk changes, including the changes to the fts5 locale=1 feature, into this branch. (check-in: [d2f0d19936] user: dan branch: fts5-contentless-unindexed, size: 30854) | |
2024-09-10
| ||
16:19 | [93aba03ca4] part of check-in [55c5c119a0] Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. (check-in: [55c5c119a0] user: dan branch: fts5-locale-alternate, size: 30818) | |
2024-09-07
| ||
16:22 | [7ab1d838ad] part of check-in [70e42f941c] Fix a problem with fts5 locale=1 tables and UPDATE statements that may affect more than one row. (check-in: [70e42f941c] user: dan branch: trunk, size: 31019) | |
2024-09-03
| ||
18:55 | [d0c9bee4ed] part of check-in [dcacb1a8ef] Store the values of any UNINDEXED columns of a contentless fts5 table persistently in the database. Warning: This currently creates a (technically) incompatible file-format for contentless fts5 tables that have UNINDEXED columns. (check-in: [dcacb1a8ef] user: dan branch: fts5-contentless-unindexed, size: 30982) | |
2024-08-15
| ||
20:33 | [26a71a09ce] part of check-in [fb257540d3] Extra tests. (check-in: [fb257540d3] user: dan branch: fts5-locale, size: 30946) | |
2024-08-12
| ||
17:03 | [776b21159e] part of check-in [e626123580] Fix further issues to do with fts5 locale support. (check-in: [e626123580] user: dan branch: fts5-locale, size: 30931) | |
2024-08-10
| ||
18:59 | [b40bb0bd54] part of check-in [03e63ed24e] Update the fts5_tokenizer_v2 API so that the locale is passed as parameter to xTokenize(), instead of via a separate call to xSetLocale(). (check-in: [03e63ed24e] user: dan branch: fts5-locale, size: 30881) | |
2024-08-02
| ||
21:06 | [64ccc862cb] part of check-in [c98ccc1216] Change things so that locale=1 is required to write fts5_locale() values to an fts5 table, and so that blobs may not be stored in indexed (i.e. not UNINDEXED) columns of these tables. (check-in: [c98ccc1216] user: dan branch: fts5-locale, size: 30781) | |
2024-07-31
| ||
20:49 | [2eab38c52d] part of check-in [8bd4ae7e95] Fix various problems with the code on this branch. (check-in: [8bd4ae7e95] user: dan branch: fts5-locale, size: 31206) | |
2024-07-30
| ||
20:39 | [833a2fe729] part of check-in [ae435aff17] Fix cases surrounding blob values being stored in locale=1 fts5 tables. (check-in: [ae435aff17] user: dan branch: fts5-locale, size: 30771) | |
2024-07-27
| ||
19:46 | [330b1e2dad] part of check-in [69205264de] Ensure that an fts5 UPDATE does not strip the locale from columns that it does not write to. (check-in: [69205264de] user: dan branch: fts5-locale, size: 30698) | |
2024-07-26
| ||
20:50 | [b4a5ed934c] part of check-in [8839ef7cfb] Add the fts5_locale() function, and begin adding the related functionality to fts5. (check-in: [8839ef7cfb] user: dan branch: fts5-locale, size: 30574) | |
2024-07-17
| ||
16:27 | [41fb3a2dd4] part of check-in [81b6360050] Add extra assert() statements to the fixes on this branch. (check-in: [81b6360050] user: dan branch: alignment-fixes, size: 29965) | |
2024-05-14
| ||
17:16 | [407ee36add] part of check-in [ca4fdcb8ae] Have fts5 tables delay initializing the tokenizer until it is first used in all cases where the tokenizer is not "trigram". (check-in: [ca4fdcb8ae] user: dan branch: fts5-delay-tokenizer, size: 29578) | |
2024-05-13
| ||
20:06 | [965ded9eed] part of check-in [69ef47eeee] Allow existing fts5 tables to be dropped even if the associated tokenizer is not available. (check-in: [69ef47eeee] user: dan branch: fts5-delay-tokenizer, size: 29523) | |
2024-04-17
| ||
19:48 | [098b3fd928] part of check-in [6a640ea4d8] Prevent tokenize-blobs from being used with non-contentless tables. Fix some other issues with the new code on this branch. (check-in: [6a640ea4d8] user: dan branch: fts5-tokenize-blob, size: 30402) | |
2024-04-16
| ||
14:23 | [655147fa7e] part of check-in [c2f9d1259c] Add some tests for the fts5 tokenize-blob functionality on this branch. (check-in: [c2f9d1259c] user: dan branch: fts5-tokenize-blob, size: 30233) | |
2024-04-15
| ||
20:24 | [5fdd75e46c] part of check-in [6c51c9c6a8] Add experimental way to specify an alternative tokenizer when writing to or querying an fts5 table. (check-in: [6c51c9c6a8] user: dan branch: fts5-tokenize-blob, size: 30211) | |
2023-12-04
| ||
17:45 | [defa43c093] part of check-in [317a50563d] Fix a problem with the xInstCount() API and "ORDER BY rank" queries. (check-in: [317a50563d] user: dan branch: fts5-token-data, size: 29363) | |
2023-12-02
| ||
20:35 | [1fdbf3d16b] part of check-in [3a623cfa17] Fix various compiler warnings and other problems with the new code on this branch. (check-in: [3a623cfa17] user: dan branch: fts5-token-data, size: 29358) | |
17:32 | [285118aa6d] part of check-in [7bda09ab40] Ensure that tokendata=1 queries avoid loading large doclists for queries like "common AND uncommon", just as tokendata=0 queries do. (check-in: [7bda09ab40] user: dan branch: fts5-token-data, size: 29376) | |
2023-12-01
| ||
20:09 | [2dc7339346] part of check-in [c523f40895] Different approach to querying a tokendata=1 table. Saves cpu and memory. (check-in: [c523f40895] user: dan branch: fts5-token-data, size: 29289) | |
2023-11-22
| ||
20:02 | [782151060d] part of check-in [9b005085ff] Defer building xInstToken() hash-table until it is to be used. (check-in: [9b005085ff] user: dan branch: fts5-token-data, size: 29226) | |
19:02 | [d330c2e200] part of check-in [37b271c19d] Fix tokendata=1 and xInstToken() APIs for detail=none and detail=column tables. (check-in: [37b271c19d] user: dan branch: fts5-token-data, size: 29284) | |
2023-11-15
| ||
11:45 | [88ab1ee1ee] part of check-in [a34b26fe7f] Add implementation of xInstToken() API. (check-in: [a34b26fe7f] user: dan branch: fts5-token-data, size: 28990) | |
2023-11-13
| ||
14:29 | [19b198459a] part of check-in [828566392b] Add new fts5 API xQueryToken(). (check-in: [828566392b] user: dan branch: fts5-token-data, size: 28787) | |
2023-10-11
| ||
21:08 | [a21eb1cf03] part of check-in [122935182a] Add the tokendata=1 option to ignore trailing token-data when querying an fts5 table. (check-in: [122935182a] user: dan branch: fts5-token-data, size: 28714) | |
2023-09-30
| ||
18:13 | [66a38b285e] part of check-in [c027c092c4] Changes so that fts5 can handle tokens with embedded '\0' bytes. (check-in: [c027c092c4] user: dan branch: fts5-token-data, size: 28638) | |
2023-07-25
| ||
15:48 | [78a63cc079] part of check-in [1079300db2] Change the name of the fts5 'delete-automerge' option to 'deletemerge'. And add tests for it. (check-in: [1079300db2] user: dan branch: fts5-contentless-delete, size: 28571) | |
2023-07-24
| ||
19:13 | [7decc30640] part of check-in [b314be66b9] Add the fts5 'delete-automerge' integer option. A level is eligible for auto-merging if it has a greater than or equal percentage of its entries deleted by tombstones than the 'delete-automerge' option. Default value is 10. (check-in: [b314be66b9] user: dan branch: fts5-contentless-delete, size: 28580) | |
2023-07-22
| ||
19:47 | [f59c14f725] part of check-in [85c1589ab1] Integrate contentless delete with auto-merge. (check-in: [85c1589ab1] user: dan branch: fts5-contentless-delete, size: 28521) | |
2023-07-17
| ||
17:59 | [fa9dd8ecbd] part of check-in [cc694b8340] Do not allow the 'delete' command to be used on contentless_delete=1 fts5 tables. (check-in: [cc694b8340] user: dan branch: fts5-contentless-delete, size: 28420) | |
2023-07-10
| ||
20:44 | [40a234875f] part of check-in [e513bea84d] Begin adding support for deleting rows from contentless fts5 tables. (check-in: [e513bea84d] user: dan branch: fts5-contentless-delete, size: 28416) | |
2023-05-03
| ||
13:48 | [ed48a09641] part of check-in [bc07fe51fe] Protect a macro argument with parentheses in FTS5. (check-in: [bc07fe51fe] user: drh branch: trunk, size: 28076) | |
2023-04-12
| ||
17:40 | [f473de2bda] part of check-in [4240fd09b7] Add the 'secure-delete' option to fts5. Used to configure fts5 to aggressively remove old full-text-index entries belonging to deleted or updated rows. (check-in: [4240fd09b7] user: dan branch: fts5-secure-delete, size: 28074) | |
2022-08-08
| ||
19:29 | [c0d46e399e] part of check-in [46a78c8c0e] Avoid some cases of signed integer overflow in fts5 by casting to unsigned values. (check-in: [46a78c8c0e] user: dan branch: trunk, size: 27756) | |
2021-10-16
| ||
19:50 | [36fd4a05e6] part of check-in [0bf42bb561] Fix a harmless scan-build warning in FTS5. (check-in: [0bf42bb561] user: drh branch: trunk, size: 27751) | |
2021-10-04
| ||
18:57 | [a453bdbc57] part of check-in [15bbdf9ac8] Some #defines somehow failed to get set correctly in the previous check-in. Fixed here. (check-in: [15bbdf9ac8] user: drh branch: fix-warnings, size: 27751) | |
18:21 | [ff24689b6e] part of check-in [1c67f957fc] Fix harmless static analyzer warnings in sessions, rtree, fts3 and fts5. Add the -DSQLITE_OMIT_AUXILIARY_SAFETY_CHECKS compile-time option to cause ALWAYS() and NEVER() macros to be omitted from the build. (check-in: [1c67f957fc] user: drh branch: fix-warnings, size: 27649) | |
2021-07-07
| ||
11:51 | [49c1ef3aa6] part of check-in [9dbdc9001e] Instead of disallowing writes to fts5 tables if there are fts5vocab cursors open on them (commit [c49a6ed7]), abort any fts5vocab queries if the on-disk structure of the fts5 table changes. (check-in: [9dbdc9001e] user: dan branch: trunk, size: 27379) | |
2021-07-05
| ||
19:01 | [cc824fe126] part of check-in [c49a6ed78a] Do not allow writes to an fts5 table if there are any open fts5vocab cursors. (check-in: [c49a6ed78a] user: dan branch: trunk, size: 27290) | |
2020-10-05
| ||
16:41 | [26c74dd577] part of check-in [64782463be] Allow fts5 trigram tables created with detail=column or detail=none to optimize LIKE and GLOB queries. Allow case-insensitive tables to optimize GLOB as well as LIKE. (check-in: [64782463be] user: dan branch: trunk, size: 27246) | |
2020-09-30
| ||
20:35 | [928aed51db] part of check-in [0d7810c1ae] Add experimental unicode-aware trigram tokenizer to fts5. And support for LIKE and GLOB optimizations for fts5 tables that use said tokenizer. (check-in: [0d7810c1ae] user: dan branch: fts5-trigram, size: 27106) | |
2020-09-21
| ||
14:53 | [ba835c165b] part of check-in [782163693f] In fts5 integrity checks, do not compare the contents of the index against an external content table unless specifically requested. (check-in: [782163693f] user: dan branch: trunk, size: 26750) | |
2020-07-29
| ||
16:18 | [8d3f1f319a] part of check-in [a80ae2c98b] Dozens and dozens of typo fixes in comments. This change adds no value to the end product and is disruptive, so it is questionable whether or not it will ever land on trunk. (check-in: [a80ae2c98b] user: drh branch: typos, size: 26726) | |
2019-10-20
| ||
08:26 | [d7cbc214ee] part of check-in [b528bdcd45] Fix a resource leak in fts5 that could occur if an auxiliary function is called from within a query that does not use the full-text index. (check-in: [b528bdcd45] user: dan branch: trunk, size: 26725) | |
2019-10-09
| ||
18:36 | [3966afab06] part of check-in [86e4972092] Do not allow users to effectively disable fts5 crisismerge operations by setting the crisismerge threshold to higher than the maximum allowable segment b-trees on a single level. Fix for [d392017c]. (check-in: [86e4972092] user: dan branch: trunk, size: 26624) | |
2019-09-12
| ||
19:38 | [0ec19a906a] part of check-in [9d418a7a49] Allow fts5 to filter on multiple MATCH clauses in a single scan. (check-in: [9d418a7a49] user: dan branch: trunk, size: 26538) | |
2019-08-05
| ||
12:55 | [d87fb17d12] part of check-in [b6d52c9364] Prevent an fts5 table from being its own content table, or part of a view that is the content table. (check-in: [b6d52c9364] user: dan branch: trunk, size: 26484) | |
2019-03-18
| ||
15:23 | [5c26dce0ec] part of check-in [45c73deb44] Fix an fts5 problem with interleaving reads and writes in a single transaction. (check-in: [45c73deb44] user: dan branch: trunk, size: 26405) | |
2019-01-25
| ||
16:54 | [0b002fc71e] part of check-in [93f8ec146d] Fix asan warnings in fts5 triggered by corrupt databases - passing NULL to memcmp, out-of-range left-shift values and signed integer overflow. (check-in: [93f8ec146d] user: dan branch: trunk, size: 26393) | |
2019-01-22
| ||
21:17 | [9db5f02e2b] part of check-in [1abc441564] Fix a buffer overrun that could occur in fts5 if a prefix query is made on a corrupt database. (check-in: [1abc441564] user: dan branch: trunk, size: 26172) | |
2019-01-17
| ||
17:39 | [28a9978658] part of check-in [49956395e1] Fix problems with joining two or more fts5_vocab tables that access the same underlying fts5 table. (check-in: [49956395e1] user: dan branch: trunk, size: 26172) | |
2019-01-08
| ||
20:02 | [545ae89fca] part of check-in [ca67f2ec0e] Use 64-bit math to compute the sizes of memory allocations in extensions. (check-in: [ca67f2ec0e] user: drh branch: trunk, size: 25856) | |
2018-12-28
| ||
07:37 | [8590e08a48] part of check-in [c564bf8701] Fix problems in fts5 found by ASAN. (check-in: [c564bf8701] user: dan branch: trunk, size: 25846) | |
2018-07-13
| ||
20:28 | [39f12034b5] part of check-in [148d9b6147] Remove an unused function declaration from fts5. (check-in: [148d9b6147] user: dan branch: trunk, size: 25846) | |
19:52 | [6354c8f830] part of check-in [80d2b9e635] Add the "categories" option to the unicode61 tokenizer in fts5. (check-in: [80d2b9e635] user: dan branch: trunk, size: 25884) | |
2017-11-24
| ||
19:24 | [eda28e3a0a] part of check-in [24d7058e27] Add the "^" syntax from fts3/4 to fts5. (check-in: [24d7058e27] user: dan branch: trunk, size: 25750) | |
2017-04-13
| ||
09:45 | [15e7514b46] part of check-in [6f54ffd151] Allow a user column name to be used on the LHS of a MATCH operator in FTS5. (check-in: [6f54ffd151] user: dan branch: trunk, size: 25701) | |
2017-04-12
| ||
17:50 | [d514c81997] part of check-in [c847543f8b] Update fts5 to support "<colset> : ( <expr> )" for column filtering, as well as "<colset> : NEAR(...)" and "<colset> : <phrase>". (check-in: [c847543f8b] user: dan branch: trunk, size: 25629) | |
2017-04-08
| ||
09:12 | [88c1a9a01c] part of check-in [a921ada890] Have fts5 close any open blob-handle when a new savepoint is opened. This ensures that fts5 does not prevent DROP TABLE statements (which always open a savepoint) from succeeding. (check-in: [a921ada890] user: dan branch: trunk, size: 25632) | |
2017-02-13
| ||
13:20 | [c629b24d2b] part of check-in [c447441cff] Avoid a duplication #define in FTS5 (check-in: [c447441cff] user: drh branch: trunk, size: 25687) | |
2016-08-09
| ||
21:01 | [b2eda36e0f] part of check-in [9a5a4f6e3b] Fix harmless compiler warning. (check-in: [9a5a4f6e3b] user: drh branch: trunk, size: 25661) | |
19:48 | [17d72c55d6] part of check-in [14864f2b84] Minor update to the way fts5 column filters are parsed. (check-in: [14864f2b84] user: dan branch: trunk, size: 25715) | |
19:26 | [51eb867d9a] part of check-in [e517545650] Have fts5 interpret column lists that begin with a "-" character as "match any column except" lists. (check-in: [e517545650] user: dan branch: trunk, size: 25648) | |
2016-05-30
| ||
08:28 | [9bd0c7c642] part of check-in [64ca1a835a] Fix an FTS5 problem (segfault or incorrect query results) with "... MATCH 'x OR y' ORDER BY rank" queries when either token 'x' or 'y' is completely absent from the dataset. (check-in: [64ca1a835a] user: dan branch: trunk, size: 25594) | |
2016-03-28
| ||
20:13 | [31b6cbbd9f] part of check-in [a805c6f7ea] Add further tests for savepoint rollback. Fix various code issues and add missing comments in fts5_index.c. (check-in: [a805c6f7ea] user: dan branch: fts5, size: 25607) | |
2016-03-26
| ||
20:11 | [dde3c47b9f] part of check-in [53b80a6d05] Fix a problem with OOM handling when setting an fts5 configuration option. (check-in: [53b80a6d05] user: dan branch: fts5, size: 25681) | |
2016-03-23
| ||
15:04 | [3677076aec] part of check-in [70fc69eed9] Explicitly limit the size of fts5 tokens to 32768 bytes. (check-in: [70fc69eed9] user: dan branch: trunk, size: 25635) | |
2016-03-16
| ||
19:48 | [4e507abeba] part of check-in [33ef2210ef] Have fts5 cache the decoded structure of fts5 indexes in memory. Use "PRAGMA data_version" to detect stale caches. (check-in: [33ef2210ef] user: dan branch: fts5-data-version, size: 25388) | |
2016-03-12
| ||
16:32 | [4060504b79] part of check-in [72b3ff0f0d] Fix handling of strings that contain zero tokens in fts5. And other problems found by fuzzing. (check-in: [72b3ff0f0d] user: dan branch: trunk, size: 25302) | |
2016-03-09
| ||
20:54 | [59e1342337] part of check-in [556671444c] Add an incremental optimize capability to fts5. Make the 'merge' command independent of the 'automerge' settings. (check-in: [556671444c] user: dan branch: trunk, size: 25188) | |
2016-02-12
| ||
17:56 | [fa7c17e5c3] part of check-in [130580207a] Fix a fairly obscure buffer overread in fts5. (check-in: [130580207a] user: dan branch: trunk, size: 25128) | |
2016-02-11
| ||
17:01 | [f9e7772d3a] part of check-in [bc3f7900d5] Handle parser stack overflow when parsing fts5 query expressions. Fix some compiler warnings in fts5 code. (check-in: [bc3f7900d5] user: dan branch: trunk, size: 25109) | |
15:37 | [cb495e7cb2] part of check-in [cfe2eb88b5] Add JSON1 and FTS5 to the set of extensions subject to close compiler warning analysis. Fix some warnings in each. More (harmless) warnings still exist in FTS5. (check-in: [cfe2eb88b5] user: drh branch: trunk, size: 25041) | |
2016-02-05
| ||
19:18 | [efb02807db] part of check-in [ca91bd8ac7] Further streamlining of fts5 prefix query code. (check-in: [ca91bd8ac7] user: dan branch: trunk, size: 25129) | |
2016-02-03
| ||
20:04 | [2095cc38e7] part of check-in [ca11f46db0] Improve performance of fts5 prefix queries on detail=col tables. (check-in: [ca11f46db0] user: dan branch: trunk, size: 25070) | |
2016-02-02
| ||
17:40 | [9505f3bc8d] part of check-in [62ea9e5ab8] Enhance the performance of fts5 AND and OR queries. (check-in: [62ea9e5ab8] user: dan branch: trunk, size: 24827) | |
2016-01-23
| ||
18:51 | [6e0f90eb48] part of check-in [72d53699bf] Fix an fts5 problem with using both xPhraseFirst() and xPhraseFirstColumn() within a single statement in detail=col mode. (check-in: [72d53699bf] user: dan branch: fts5-perf, size: 24813) | |
16:20 | [a810589cf2] part of check-in [ceccc9ad78] Merge trunk changes (including fixes for warnings in fts5) with this branch. (check-in: [ceccc9ad78] user: dan branch: fts5-perf, size: 25024) | |
15:57 | [e4c7ca41a7] part of check-in [3be336aa89] Fix some signed/unsigned comparison compiler warnings in fts5. (check-in: [3be336aa89] user: dan branch: trunk, size: 24951) | |
2016-01-22
| ||
19:48 | [f93aed3d05] part of check-in [b5a57b812f] Experimental performance enhancements for fts5. (check-in: [b5a57b812f] user: dan branch: fts5-perf, size: 25005) | |
2016-01-18
| ||
17:48 | [5599703af9] part of check-in [acaf426449] Add tests for fts5. Fix a crash that can occur in fts5 if the database content is corrupted. (check-in: [acaf426449] user: dan branch: trunk, size: 24932) | |
2016-01-15
| ||
19:54 | [313e3276ac] part of check-in [3b72df405a] Rationalize some code in fts5_storage.c. Add tests to cover recently added branches in fts5. (check-in: [3b72df405a] user: dan branch: trunk, size: 24932) | |
2016-01-14
| ||
14:29 | [6c5a332e6a] part of check-in [f791fc7009] Fix more compiler warnings in FTS5. (check-in: [f791fc7009] user: drh branch: trunk, size: 24996) | |
14:15 | [3a09b2eaea] part of check-in [5a343cc033] Fix compiler warnings in fts5. (check-in: [5a343cc033] user: dan branch: trunk, size: 24504) | |
2016-01-05
| ||
21:04 | [3918045ebc] part of check-in [fd217fdb39] Rationalize and extend some fts5 test code. Fix bugs revealed by the same. (check-in: [fd217fdb39] user: dan branch: fts5-offsets, size: 24572) | |
2016-01-04
| ||
19:12 | [10608c346c] part of check-in [ee38f9dff5] Fix an OOM handling problem in fts5 detail=none and detail=col modes. Also a bug in the xInst() API when used with detail=col and column filtering expressions. Update the matchinfo() test function so that 'b' is fast with detail=col tables. (check-in: [ee38f9dff5] user: dan branch: fts5-offsets, size: 24526) | |
2016-01-02
| ||
19:01 | [cff7dd3131] part of check-in [6322a1d984] Changes to run many fts5 tests with detail=none and detail=col tables as well as the default detail=full. Also fixes for the bugs uncovered by running said tests. (check-in: [6322a1d984] user: dan branch: fts5-offsets, size: 24462) | |
2015-12-29
| ||
19:35 | [ab5f6f1f65] part of check-in [8c30605bcd] Add the xPhraseFirstColumn() and xPhraseNextColumn() API functions to fts5. For iterating through the set of columns that contain intances of a phrase. (check-in: [8c30605bcd] user: dan branch: fts5-offsets, size: 24411) | |
2015-12-28
| ||
19:55 | [7328cfa7b0] part of check-in [228b4d10e3] Change the name of the offsets=0 option to "detail=column". Have the xInst, xPhraseFirst and other API functions work by parsing the original text for detail=column tables. (check-in: [228b4d10e3] user: dan branch: fts5-offsets, size: 24275) | |
2015-12-21
| ||
18:45 | [e71739ed0b] part of check-in [609a0bc7f3] Fix an fts5 integrity-check problem that affects offsets=0 tables with prefix indexes. (check-in: [609a0bc7f3] user: dan branch: fts5-offsets, size: 24026) | |
2015-12-17
| ||
20:36 | [4e1bb66d8e] part of check-in [40b5bbf02a] Add the "offsets=0" option to fts5, to create a smaller index without term offset information. A few things are currently broken on this branch. (check-in: [40b5bbf02a] user: dan branch: fts5-offsets, size: 24021) | |
2015-11-05
| ||
18:09 | [acf968e43d] part of check-in [445480095e] Add the 'hashsize' configuration option to fts5, for configuring the amount of memory allocated to the in-memory hash table while writing. (check-in: [445480095e] user: dan branch: trunk, size: 23656) | |
2015-10-21
| ||
22:08 | [06594fd3e5] part of check-in [aa4e01ea1a] Fix harmless compiler warnings in FTS5. (check-in: [aa4e01ea1a] user: mistachkin branch: trunk, size: 23581) | |
20:56 | [dfe8390b65] part of check-in [ae350bfbfd] Remove some branches made unreachable by recent changes from fts5. (check-in: [ae350bfbfd] user: dan branch: trunk, size: 23632) | |
2015-10-19
| ||
20:49 | [db1d5a18ba] part of check-in [60a8bde055] Another optimization for fts5 prefix (and other) queries. (check-in: [60a8bde055] user: dan branch: trunk, size: 23759) | |
2015-10-17
| ||
19:49 | [0332d12fdc] part of check-in [6020d96ab4] Handle equality and range constraints on the "term" column of fts5vocab tables. Also have the same module report columns using names instead of indexes. (check-in: [6020d96ab4] user: dan branch: trunk, size: 23630) | |
2015-10-12
| ||
19:12 | [38667e3985] part of check-in [1c20c1c28b] Further tweaks to improve fts5 prefix query performance. (check-in: [1c20c1c28b] user: dan branch: trunk, size: 23621) | |
2015-10-09
| ||
01:42 | [3e682a711f] part of check-in [206174f9b1] Trying to get FTS5 tests to build and run using main.mk. Not yet working. (check-in: [206174f9b1] user: drh branch: amalg-json1-fts5, size: 23822) | |
2015-10-07
| ||
13:24 | [ed6c05b803] part of check-in [f20f9f813f] Add tests for fts5 phrase queries with column filters. (check-in: [f20f9f813f] user: dan branch: trunk, size: 23760) | |
09:02 | [93ff3f2ae0] part of check-in [accdc98b12] Add further tests for fts5 prefix queries. (check-in: [accdc98b12] user: dan branch: trunk, size: 23444) | |
2015-10-06
| ||
20:53 | [eba5b20f10] part of check-in [bf1607ac15] Optimizations for fts5 expressions that filter on column. More still to come. (check-in: [bf1607ac15] user: dan branch: trunk, size: 23468) | |
2015-10-02
| ||
20:04 | [ff78a77d81] part of check-in [5c83b9db46] Update fts5 to avoid using a statement journal for UPDATE and DELETE operations that affect at most a single row. (check-in: [5c83b9db46] user: dan branch: trunk, size: 23020) | |
2015-09-11
| ||
14:15 | [666aba8432] part of check-in [0dc436116e] Fix some compiler warnings in fts5 code. (check-in: [0dc436116e] user: dan branch: trunk, size: 22873) | |
2015-09-10
| ||
16:39 | [81ba5e4749] part of check-in [99de5e3613] Increment the fts5 version value to indicate that the on-disk format has changed. (check-in: [99de5e3613] user: dan branch: fts5-incompatible, size: 23366) | |
2015-09-08
| ||
19:55 | [7e60025821] part of check-in [00d990061d] Remove the 0x00 terminators from the end of fts5 doclists stored on disk. (check-in: [00d990061d] user: dan branch: fts5-incompatible, size: 23366) | |
2015-09-03
| ||
14:22 | [f65d41f66a] part of check-in [59ae30b97b] Remove some more code from fts5_index.c by consolidating similar functions. (check-in: [59ae30b97b] user: dan branch: fts5-incompatible, size: 23049) | |
2015-09-02
| ||
08:22 | [c6f035091f] part of check-in [cf3e45e76d] Fix a problem with fts5 synonyms and the xQueryPhrase() auxiliary function API. (check-in: [cf3e45e76d] user: dan branch: fts5-incompatible, size: 23042) | |
2015-09-01
| ||
18:08 | [d46f89aeb3] part of check-in [dbcb73802b] Add tests for fts5 synonyms implemented by adding extra terms to queries. And fixes for the same. (check-in: [dbcb73802b] user: dan branch: fts5-incompatible, size: 23041) | |
2015-08-31
| ||
20:06 | [9c538f0fcc] part of check-in [ad7feaed4c] Begin changes to allow synonym support by adding multiple terms to a query (an alternative to adding multiple terms to the FTS index). (check-in: [ad7feaed4c] user: dan branch: fts5-incompatible, size: 22964) | |
2015-08-29
| ||
15:44 | [9fd31e682a] part of check-in [fc71868496] Another change to the fts5 tokenizer API. (check-in: [fc71868496] user: dan branch: fts5-incompatible, size: 22964) | |
2015-08-28
| ||
19:56 | [b0cfe44ec9] part of check-in [90b85b42f2] Change the fts5 tokenizer API to allow more than one token to occupy a single position within a document. (check-in: [90b85b42f2] user: dan branch: fts5-incompatible, size: 22964) | |
2015-08-05
| ||
07:43 | [45f2ceb3c0] part of check-in [dffd358f6c] Remove all references to "docid" within fts5 source code and comments. Replace with "rowid". (check-in: [dffd358f6c] user: dan branch: trunk, size: 22897) | |
2015-07-27
| ||
11:49 | [4d669e2ef0] part of check-in [92c9178933] Bump the "version" field in the fts5 config table. (check-in: [92c9178933] user: dan branch: fts5-btree-index, size: 22897) | |
2015-07-09
| ||
20:46 | [8d9bce1847] part of check-in [b2de77a01c] Improve the performance of docid merges in fts5. (check-in: [b2de77a01c] user: dan branch: trunk, size: 22897) | |
19:02 | [582eb73064] part of check-in [898618ccf6] Reduce the number of calls to malloc() made by fts5. (check-in: [898618ccf6] user: dan branch: trunk, size: 22702) | |
2015-07-02
| ||
15:52 | [c917739206] part of check-in [7819002ed8] Remove "#ifdef SQLITE_ENABLE_FTS5" from individual fts5 source files. Add a single "#if !defined(SQLITE_CORE) || defined(SQLITE_ENABLE_FTS5)" to fts5.c. (check-in: [7819002ed8] user: dan branch: trunk, size: 22659) | |
2015-06-26
| ||
04:34 | [918e947c0c] part of check-in [ef2052f81e] Initial changes to get FTS5 working with MSVC. (check-in: [ef2052f81e] user: mistachkin branch: fts5Msvc, size: 22693) | |
2015-06-25
| ||
20:10 | [41e9ed1f07] part of check-in [46e86b0637] Add a script to combine all fts5 code into a single file - fts5.c - that can be used to build an SQLite loadable extension. (check-in: [46e86b0637] user: dan branch: fts5, size: 22687) | |
2015-06-10
| ||
10:45 | [21eb91e02a] part of check-in [0f7fd51325] Fix the fts5 xRename() method. (check-in: [0f7fd51325] user: dan branch: fts5, size: 22606) | |
2015-06-09
| ||
20:58 | [a6d1c30e16] part of check-in [aa12f9d9b7] Add the "columnsize=" option to fts5, similar to fts4's "matchinfo=fts3". (check-in: [aa12f9d9b7] user: dan branch: fts5, size: 22543) | |
2015-06-05
| ||
19:05 | [3de83c9639] part of check-in [32cbc0ed36] Make use of range constraints on the rowid field of an fts5 table in full-text queries. (check-in: [32cbc0ed36] user: dan branch: fts5, size: 22348) | |
2015-05-30
| ||
11:49 | [4c677f3b79] part of check-in [e008c3c8e2] Remove the "#include sqlite3Int.h" from fts5Int.h. (check-in: [e008c3c8e2] user: dan branch: fts5, size: 22328) | |
2015-05-29
| ||
15:55 | [3bcecc469f] part of check-in [0fc0ea2092] Add syntax to fts5 used to specify that a phrase or NEAR group should match a subset of columns. For example "[col1 col2 ...] : <phrase>". (check-in: [0fc0ea2092] user: dan branch: fts5, size: 21585) | |
2015-05-25
| ||
11:46 | [2ce5c5e688] part of check-in [02069782f8] Avoid redundant loads from the %_data table in the fts5 code. (check-in: [02069782f8] user: dan branch: fts5, size: 21441) | |
2015-05-23
| ||
15:43 | [271d2197ac] part of check-in [5165de548b] Avoid making redundant copies of position-lists within the fts5 code. (check-in: [5165de548b] user: dan branch: fts5, size: 21432) | |
2015-05-22
| ||
06:08 | [ba0fd64be0] part of check-in [fea8a4db9d] Improve test coverage of fts5_unicode2.c. (check-in: [fea8a4db9d] user: dan branch: fts5, size: 21358) | |
2015-05-18
| ||
17:50 | [9e581dc077] part of check-in [47dbfadb99] Improve test coverage of fts5_config.c. (check-in: [47dbfadb99] user: dan branch: fts5, size: 20947) | |
2015-05-13
| ||
17:15 | [e01aec94c0] part of check-in [aa34bf666c] Change fts5 doclist-index structures to be trees instead of flat lists. This only makes a difference for databases that contain millions of instances of the same token. (check-in: [aa34bf666c] user: dan branch: fts5, size: 20852) | |
2015-05-09
| ||
18:28 | [5b9e4afe80] part of check-in [3922276135] Allow the fts5vocab table to optionally provide data on a per-column basis. (check-in: [3922276135] user: dan branch: fts5, size: 20851) | |
2015-05-08
| ||
20:21 | [fc3edf2538] part of check-in [6bf93e3b56] Add the fts5vocab module, for direct access to the fts5 index. (check-in: [6bf93e3b56] user: dan branch: fts5, size: 20845) | |
09:21 | [be8ac04ce4] part of check-in [f369caec14] Improve the error message returned by FTS5 if it encounters an unknown file format. (check-in: [f369caec14] user: dan branch: fts5, size: 20261) | |
2015-05-07
| ||
19:29 | [94b1800ea5] part of check-in [a684b5e2d9] Change to storing all keys in a single merge-tree structure instead of one main structure and a separate one for each prefix index. This is a file-format change. Also introduce a mechanism for managing file-format changes. (check-in: [a684b5e2d9] user: dan branch: fts5, size: 19989) | |
2015-05-02
| ||
20:35 | [05e97ffb29] part of check-in [c4456dc5f5] Reorganize some of the fts5 expression parsing code. Improve test coverage of the same. (check-in: [c4456dc5f5] user: dan branch: fts5, size: 19868) | |
2015-04-29
| ||
20:54 | [2e0a1a6b77] part of check-in [c1f07a3aa9] Improve fts5 tests. (check-in: [c1f07a3aa9] user: dan branch: fts5, size: 19806) | |
2015-04-28
| ||
18:35 | [f573fe6c50] part of check-in [8e8136f2dc] Improve coverage of fts5 tests. (check-in: [8e8136f2dc] user: dan branch: fts5, size: 19790) | |
2015-04-27
| ||
16:21 | [d148c951de] part of check-in [e38e2bb637] Change the fts5 content= option so that it matches fts5 columns with the underlying table columns by name, not by their position within the CREATE TABLE statement. (check-in: [e38e2bb637] user: dan branch: fts5, size: 20210) | |
11:31 | [7dc902e195] part of check-in [ffeb3ef3cf] Further tests for fts5. (check-in: [ffeb3ef3cf] user: dan branch: fts5, size: 19904) | |
2015-04-24
| ||
19:41 | [803fd2fc03] part of check-in [8630996134] Add the "unindexed" column option to fts5. (check-in: [8630996134] user: dan branch: fts5, size: 19794) | |
15:56 | [1309320cb2] part of check-in [41449f7a0b] Add extra tests for corrupt database handling in fts5. (check-in: [41449f7a0b] user: dan branch: fts5, size: 19727) | |
2015-04-11
| ||
18:25 | [1b537736f8] part of check-in [bdb8e82ab6] Have fts5 integrity check verify that prefix indexes contain the same values as returned by prefix queries on the main terms index. (check-in: [bdb8e82ab6] user: dan branch: fts5, size: 19362) | |
16:23 | [d6fd1eb0b2] part of check-in [49c1e74522] Improve fts5 integrity-check so that it checks that DESC queries return the same as ASC. Change the poslist format slightly to make room for a delete-flag. (check-in: [49c1e74522] user: dan branch: fts5, size: 19288) | |
2015-03-21
| ||
15:37 | [8d09f7894e] part of check-in [ce972f6aab] When scanning the full-text index as part of the fts5 integrity-check, also run a point query for every term and verify that these results are consistent with those found by the linear scan. (check-in: [ce972f6aab] user: dan branch: fts5, size: 19516) | |
2015-03-07
| ||
15:46 | [1dcb02943f] part of check-in [cccee7b5b1] Fix some compiler warnings caused by signed/unsigned pointer conversions. (check-in: [cccee7b5b1] user: dan branch: fts5, size: 19517) | |
2015-02-27
| ||
07:23 | [5c8efea3d0] part of check-in [bb104b3646] Fix suffix and prefix compression of terms in top-level fts5 segments. And a crash that could follow an OOM condition. (check-in: [bb104b3646] user: dan branch: fts5, size: 19517) | |
2015-02-25
| ||
19:24 | [7c2af49317] part of check-in [7eb022d7e5] Instead of the 4-byte fields, use regular varints for the poslist-size field in fts5_hash.c. (check-in: [7eb022d7e5] user: dan branch: fts5, size: 19518) | |
2015-02-02
| ||
11:32 | [34040674eb] part of check-in [fb10bbb9f9] Fix some problems with building fts5 and fts3 together using the amalgamation. (check-in: [fb10bbb9f9] user: dan branch: fts5, size: 19478) | |
2015-01-29
| ||
20:59 | [f7cf9331f3] part of check-in [0e225b1535] Fix some problems with transactions that both read and write an fts5 table. (check-in: [0e225b1535] user: dan branch: fts5, size: 19506) | |
2015-01-24
| ||
19:57 | [e3b9344d82] part of check-in [5206ca6005] Have fts5 store rowids in ascending order. Query speed is virtually the same regardless of rowid order, and ascending order makes some insert optimizations easier. (check-in: [5206ca6005] user: dan branch: fts5, size: 19188) | |
2015-01-23
| ||
17:43 | [1d8f968b8f] part of check-in [51444f67c0] Fix compression of keys stored on internal segment b-tree nodes by fts5. (check-in: [51444f67c0] user: dan branch: fts5, size: 18741) | |
06:50 | [da4ad7558c] part of check-in [939b7a5de2] Remove some redundant code from fts5. (check-in: [939b7a5de2] user: dan branch: fts5, size: 18592) | |
2015-01-22
| ||
19:13 | [99da855109] part of check-in [5b29589715] Add further tests and fixes for fts5. (check-in: [5b29589715] user: dan branch: fts5, size: 18517) | |
2015-01-17
| ||
20:01 | [b593d5ff5f] part of check-in [f30afd209a] Ensure an up to date copy of the fts5 configuration has been loaded into memory before attempting to modify the same configuration. (check-in: [f30afd209a] user: dan branch: fts5, size: 18392) | |
2015-01-07
| ||
19:33 | [0142ba4c3c] part of check-in [e749be563d] Add the fts5 'optimize' command. (check-in: [e749be563d] user: dan branch: fts5, size: 18345) | |
17:11 | [00a8770e34] part of check-in [0cb2fed525] Add the 'rebuild' and 'delete-all' commands. (check-in: [0cb2fed525] user: dan branch: fts5, size: 18253) | |
2015-01-06
| ||
19:08 | [8b338037a9] part of check-in [65f0262fb8] Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. (check-in: [65f0262fb8] user: dan branch: fts5, size: 18113) | |
2015-01-05
| ||
20:41 | [9aafe97064] part of check-in [047aaf830d] Tests and fixes for fts5 external content tables. (check-in: [047aaf830d] user: dan branch: fts5, size: 18118) | |
2015-01-03
| ||
20:44 | [8062dc2363] part of check-in [17ef5b59f7] Add support for external content tables to fts5. (check-in: [17ef5b59f7] user: dan branch: fts5, size: 18040) | |
2015-01-02
| ||
14:55 | [b5d7970b85] part of check-in [1cd15a1759] Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause. (check-in: [1cd15a1759] user: dan branch: fts5, size: 17743) | |
2014-12-29
| ||
11:24 | [b5dfed6a1b] part of check-in [b33fe0dd89] Fixes to built-in tokenizers. (check-in: [b33fe0dd89] user: dan branch: fts5, size: 17681) | |
2014-12-03
| ||
17:27 | [36054b1dfc] part of check-in [2037dba62f] Begin testing fts5 OOM and IO error handling. (check-in: [2037dba62f] user: dan branch: fts5, size: 17534) | |
2014-12-02
| ||
20:18 | [9dbf415de0] part of check-in [b5f5971283] Add a configuration option to remap the "rank" column to an auxiliary fts5 function. (check-in: [b5f5971283] user: dan branch: fts5, size: 17517) | |
2014-12-01
| ||
20:05 | [e16cf2213a] part of check-in [9c1697a2aa] Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5. (check-in: [9c1697a2aa] user: dan branch: fts5, size: 17480) | |
2014-11-28
| ||
20:01 | [a466dd67c9] part of check-in [bb4a37b53d] Add a cookie mechanism to ensure that the %_config table is re-read as required. (check-in: [bb4a37b53d] user: dan branch: fts5, size: 17351) | |
2014-11-27
| ||
20:03 | [63daceb6e4] part of check-in [83491c5666] Add a %_config table to fts5. (check-in: [83491c5666] user: dan branch: fts5, size: 16819) | |
2014-11-24
| ||
16:24 | [fd81197929] part of check-in [059092379f] Add the auxiliary highlight() function to fts5. (check-in: [059092379f] user: dan branch: fts5, size: 16476) | |
2014-11-15
| ||
20:07 | [a3c46f9dae] part of check-in [fba0b5fc7e] Fix the customization interfaces so that they match the documentation. (check-in: [fba0b5fc7e] user: dan branch: fts5, size: 16404) | |
2014-08-18
| ||
19:30 | [bc6fa374a4] part of check-in [2397404e15] Add an "automerge=0" mode that disables auto-merging and falls back to fts4-style crisis merges. (check-in: [2397404e15] user: dan branch: fts5, size: 16109) | |
2014-08-12
| ||
16:07 | [b0eb5cd422] part of check-in [05dfdad445] Cache the value of the "totals" record in memory during transactions. (check-in: [05dfdad445] user: dan branch: fts5, size: 16050) | |
2014-08-11
| ||
19:44 | [f17a25546d] part of check-in [617e2fac1c] Replace the hash table borrowed from fts3. (check-in: [617e2fac1c] user: dan branch: fts5, size: 15945) | |
2014-08-06
| ||
16:30 | [410001da21] part of check-in [3b19eba042] Add support for savepoints to fts5. (check-in: [3b19eba042] user: dan branch: fts5, size: 14879) | |
2014-08-02
| ||
20:49 | [aef50f3078] part of check-in [b8864da95d] Start changing things to use doclist indexes as required. code is not activated yet. (check-in: [b8864da95d] user: dan branch: fts5, size: 14900) | |
2014-07-31
| ||
17:47 | [2adf0ca39d] part of check-in [bc14e64bdf] Try to reuse sorter statements in fts5. Does not work due to circular references on VTable object. (check-in: [bc14e64bdf] user: dan branch: save_sorter_stmt, size: 14950) | |
2014-07-30
| ||
19:41 | [9a195c1706] part of check-in [4cc048c365] Add hidden column "rank". Currently this always returns the same value as the bm25() function. (check-in: [4cc048c365] user: dan branch: fts5, size: 14812) | |
2014-07-25
| ||
20:30 | [92fb9c4f75] part of check-in [c4d50428ab] Add extension apis xRowCount, xQueryPhrase, xSetAuxdata and xGetAuxdata. And a ranking function that uses all of the above. (check-in: [c4d50428ab] user: dan branch: fts5, size: 14412) | |
2014-07-21
| ||
11:44 | [12d0349615] part of check-in [19504c4108] Fix the xColumnSize() extension API. (check-in: [19504c4108] user: dan branch: fts5, size: 14282) | |
2014-07-19
| ||
20:27 | [5105506a18] part of check-in [1e9053abda] Add simple tests for the xColumnText() extension api. (check-in: [1e9053abda] user: dan branch: fts5, size: 14142) | |
15:35 | [cca221a5cf] part of check-in [43fcb84472] Fixes for the xColumnSize() fts5 extension API. (check-in: [43fcb84472] user: dan branch: fts5, size: 14067) | |
2014-07-18
| ||
19:59 | [6cf315d399] part of check-in [16352d3654] Fix issues with position lists and NEAR constraints. (check-in: [16352d3654] user: dan branch: fts5, size: 13938) | |
2014-07-16
| ||
19:15 | [2d4c1e1ebd] part of check-in [1e2a7ba088] Begin adding interface for auxiliary functions. (check-in: [1e2a7ba088] user: dan branch: fts5, size: 13720) | |
2014-07-08
| ||
16:27 | [bb716a6e6a] part of check-in [75ebd3cd59] Add support for prefix queries to fts5. (check-in: [75ebd3cd59] user: dan branch: fts5, size: 12575) | |
2014-07-02
| ||
20:18 | [b7a684ff35] part of check-in [2e5652e652] Add support for phrase queries to fts5. (check-in: [2e5652e652] user: dan branch: fts5, size: 11514) | |
2014-07-01
| ||
20:45 | [80f3d38a69] part of check-in [62f2ff2041] Change the position list format so that its size in bytes is stored at the start of the list itself. (check-in: [62f2ff2041] user: dan branch: fts5, size: 10267) | |
2014-06-25
| ||
20:28 | [3fd1ebeb58] part of check-in [47a9f3cc92] Begin adding query support to fts5. (check-in: [47a9f3cc92] user: dan branch: fts5, size: 10490) | |
2014-06-24
| ||
16:59 | [6f11697324] part of check-in [3515da85d0] Add simple full-table-scan and rowid lookup support to fts5. (check-in: [3515da85d0] user: dan branch: fts5, size: 10325) | |
2014-06-23
| ||
11:33 | Added: [cc41cf776a] part of check-in [1e0648dcf2] Add some code for an experimental fts5 module. Does not work yet. (check-in: [1e0648dcf2] user: dan branch: fts5, size: 9931) | |