/ File History
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of ext/fts5/fts5_expr.c

2019-03-20
05:45
Fix various harmless compiler warnings seen with MSVC. file: [840c88d5] check-in: [1c0fe5b5] user: mistachkin branch: noWarnings, size: 81784
2019-01-08
20:02
Use 64-bit math to compute the sizes of memory allocations in extensions. file: [188d1dca] check-in: [ca67f2ec] user: drh branch: trunk, size: 81752
2018-12-28
07:37
Fix problems in fts5 found by ASAN. file: [0eff5bad] check-in: [c564bf87] user: dan branch: trunk, size: 81566
2018-07-13
19:52
Add the "categories" option to the unicode61 tokenizer in fts5. file: [5aef080b] check-in: [80d2b9e6] user: dan branch: trunk, size: 81561
2018-06-30
20:26
Avoid a warning in fts5.c due to not using generated routine sqlite3Fts5ParserFallback(). file: [4ff82037] check-in: [65ff5144] user: dan branch: trunk, size: 81380
2018-03-07
14:49
Fix harmless compiler warning in FTS5. file: [c23a2e4c] check-in: [2d544711] user: mistachkin branch: msvcFixes, size: 81272
2017-11-24
19:24
Add the "^" syntax from fts3/4 to fts5. file: [01048018] check-in: [24d7058e] user: dan branch: trunk, size: 81268
2017-04-13
09:45
Allow a user column name to be used on the LHS of a MATCH operator in FTS5. file: [f2825f71] check-in: [6f54ffd1] user: dan branch: trunk, size: 80420
2017-04-12
17:50
Update fts5 to support "<colset> : ( <expr> )" for column filtering, as well as "<colset> : NEAR(...)" and "<colset> : <phrase>". file: [e5522f89] check-in: [c847543f] user: dan branch: trunk, size: 79962
2017-02-21
17:52
Fix an FTS5 problem that could cause a crash when certain queries were interrupted using sqlite3_interrupt(). file: [c6ecc228] check-in: [e400909f] user: dan branch: trunk, size: 77252
2017-01-23
07:06
Fix a problem preventing FTS5 from correctly passing the FTS5_TOKENIZE_PREFIX flag to custom tokenizer implementations. file: [33f0e806] check-in: [03c60134] user: dan branch: trunk, size: 77063
2016-12-09
16:12
Fix an fts5 bug that could cause a crash following an OOM error or sqlite3_interrupt() interrupt. file: [dc2cee9f] check-in: [0ea3ece9] user: dan branch: trunk, size: 77062
2016-11-28
14:52
Simplify some code in fts5_expr.c. Add some extra test cases for the same. file: [34ece379] check-in: [7cc2d60d] user: dan branch: trunk, size: 77034
2016-11-14
08:19
Fix an fts5 problem causing a crash in phrase queries where the first token of the phrase matches one or more rows but some other token within the phrase matches zero. file: [e1242194] check-in: [e78f6f3b] user: dan branch: trunk, size: 76687
2016-09-21
19:43
Fix a problem with the fts5 auxiliary function API causing a crash when a query contained a phrase of zero terms. file: [c65c5629] check-in: [0741812d] user: dan branch: trunk, size: 76672
2016-08-13
06:38
Fix a buffer overread in fts5. file: [1ee97156] check-in: [fcfbee6c] user: dan branch: trunk, size: 76412
2016-08-09
19:48
Minor update to the way fts5 column filters are parsed. file: [df0004b5] check-in: [14864f2b] user: dan branch: trunk, size: 76408
19:26
Have fts5 interpret column lists that begin with a "-" character as "match any column except" lists. file: [8e975ae0] check-in: [e5175456] user: dan branch: trunk, size: 77734
2016-05-30
08:28
Fix an FTS5 problem (segfault or incorrect query results) with "... MATCH 'x OR y' ORDER BY rank" queries when either token 'x' or 'y' is completely absent from the dataset. file: [bcb238ee] check-in: [64ca1a83] user: dan branch: trunk, size: 75698
2016-05-09
18:05
Fix the FTS5 xQueryPhrase() API function so that it recognizes column filters. file: [da2b33c2] check-in: [48505cde] user: dan branch: trunk, size: 75942
2016-03-23
15:04
Explicitly limit the size of fts5 tokens to 32768 bytes. file: [5ca4bafe] check-in: [70fc69ee] user: dan branch: trunk, size: 75558
2016-03-16
19:53
Add a cast to an implict (size_t -> int) conversion in fts5_expr.c. file: [35e9d92c] check-in: [d9b5ff7a] user: dan branch: trunk, size: 75428
2016-03-14
12:16
Fix a memory leak in fts5 that could occur following a syntax error in a query expression. file: [be309fb2] check-in: [54b8968e] user: dan branch: trunk, size: 75423
2016-03-12
19:33
Fix a problem handling 'NEAR("" token)' in fts5 found by fuzzing. file: [f11757a2] check-in: [10a827ae] user: dan branch: trunk, size: 75370
16:32
Fix handling of strings that contain zero tokens in fts5. And other problems found by fuzzing. file: [c4166ba0] check-in: [72b3ff0f] user: dan branch: trunk, size: 74884
2016-02-11
17:01
Handle parser stack overflow when parsing fts5 query expressions. Fix some compiler warnings in fts5 code. file: [8e8e4635] check-in: [bc3f7900] user: dan branch: trunk, size: 72679
2016-02-02
21:19
Add tests to restore full coverage of fts5 code. file: [ff5c451a] check-in: [063755c8] user: dan branch: trunk, size: 72796
17:40
Enhance the performance of fts5 AND and OR queries. file: [304b2244] check-in: [62ea9e5a] user: dan branch: trunk, size: 72782
2016-02-01
20:12
Improve performance of fts5 queries. file: [768d221e] check-in: [2334e882] user: dan branch: trunk, size: 73720
2016-01-23
18:51
Fix an fts5 problem with using both xPhraseFirst() and xPhraseFirstColumn() within a single statement in detail=col mode. file: [a66b9694] check-in: [72d53699] user: dan branch: fts5-perf, size: 72156
2016-01-22
19:48
Experimental performance enhancements for fts5. file: [48b9131b] check-in: [b5a57b81] user: dan branch: fts5-perf, size: 72636
2016-01-18
17:48
Add tests for fts5. Fix a crash that can occur in fts5 if the database content is corrupted. file: [4ab4504c] check-in: [acaf4264] user: dan branch: trunk, size: 72149
2016-01-16
18:58
Add further tests for fts5. Fix some problems with detail=col mode and auxiliary functions. file: [3ba4c958] check-in: [de77d602] user: dan branch: trunk, size: 72143
2016-01-14
14:15
Fix compiler warnings in fts5. file: [510db459] check-in: [5a343cc0] user: dan branch: trunk, size: 72299
2016-01-11
17:30
Fix bugs in fts5 synonym processing for detail=col and other modes. file: [6eba2220] check-in: [0e3c5454] user: dan branch: fts5-offsets, size: 72293
2016-01-06
19:35
Merge latest trunk changes into this branch. file: [913ab9f9] check-in: [e7dcd013] user: dan branch: fts5-offsets, size: 70943
10:17
Fix a problem with the xPhraseFirstColumn() API in detail=col mode. Remove some unused test code from fts5ac.test. file: [5d5dd304] check-in: [a4e55f73] user: dan branch: fts5-offsets, size: 70986
2016-01-05
21:04
Rationalize and extend some fts5 test code. Fix bugs revealed by the same. file: [1aa0f5d5] check-in: [fd217fdb] user: dan branch: fts5-offsets, size: 70952
2016-01-04
19:12
Fix an OOM handling problem in fts5 detail=none and detail=col modes. Also a bug in the xInst() API when used with detail=col and column filtering expressions. Update the matchinfo() test function so that 'b' is fast with detail=col tables. file: [3fe37251] check-in: [ee38f9df] user: dan branch: fts5-offsets, size: 70327
2016-01-02
19:01
Changes to run many fts5 tests with detail=none and detail=col tables as well as the default detail=full. Also fixes for the bugs uncovered by running said tests. file: [898e0bb5] check-in: [6322a1d9] user: dan branch: fts5-offsets, size: 69641
2015-12-29
19:35
Add the xPhraseFirstColumn() and xPhraseNextColumn() API functions to fts5. For iterating through the set of columns that contain intances of a phrase. file: [08ee4f34] check-in: [8c30605b] user: dan branch: fts5-offsets, size: 68105
2015-12-28
19:55
Change the name of the offsets=0 option to "detail=column". Have the xInst, xPhraseFirst and other API functions work by parsing the original text for detail=column tables. file: [c9522ae9] check-in: [228b4d10] user: dan branch: fts5-offsets, size: 67561
2015-12-23
16:42
Fix some harmless gcc compiler warnings. Mostly in fts5, but also two in the core code. file: [8228aca3] check-in: [5d44d4a6] user: dan branch: trunk, size: 64744
2015-12-18
19:07
Fix a problem with prefix queries on fts5 offsets=0 tables. file: [3b2c7ac5] check-in: [ad0987d8] user: dan branch: fts5-offsets, size: 65175
2015-12-16
23:30
Fix even more harmless compiler warnings. file: [80075fa4] check-in: [1d0e6aa1] user: mistachkin branch: msvcWarn, size: 64787
2015-10-14
20:34
Fix harmless compiler warnings. file: [28b15c9a] check-in: [1c46c194] user: mistachkin branch: trunk, size: 64783
2015-10-12
22:31
Remove the unused fts5ExprColsetTest() routine. file: [bc31478f] check-in: [9ecafc0c] user: drh branch: trunk, size: 64753
19:12
Further tweaks to improve fts5 prefix query performance. file: [17a94521] check-in: [1c20c1c2] user: dan branch: trunk, size: 64922
2015-10-08
21:00
Further tweaks to main.mk so that fts5 builds as part of testfixture. file: [1df899af] check-in: [97e11b79] user: dan branch: amalg-json1-fts5, size: 67502
20:40
Fix further fts5 compilation issues. file: [d3a56928] check-in: [0d7f301f] user: dan branch: amalg-json1-fts5, size: 67483
2015-10-07
09:02
Add further tests for fts5 prefix queries. file: [2054e550] check-in: [accdc98b] user: dan branch: trunk, size: 67287
2015-10-06
20:53
Optimizations for fts5 expressions that filter on column. More still to come. file: [bd2618ce] check-in: [bf1607ac] user: dan branch: trunk, size: 67319
2015-09-11
14:15
Fix some compiler warnings in fts5 code. file: [667faaf1] check-in: [0dc43611] user: dan branch: trunk, size: 67526
2015-09-09
23:54
Fix harmless compiler warning in FTS5. file: [a7726fe7] check-in: [86146a73] user: mistachkin branch: trunk, size: 67550
17:17
Fix harmless compiler warnings in FTS5. file: [3f10e630] check-in: [2cdb1877] user: mistachkin branch: trunk, size: 67584
2015-09-03
19:48
Rearrange code in fts5_expr.c so that synonym support does not slow down the common case. file: [1c24e1a2] check-in: [80188281] user: dan branch: fts5-incompatible, size: 67819
10:27
Fix a memory leak in fts5_expr.c. file: [0c36c1db] check-in: [399932a1] user: dan branch: fts5-incompatible, size: 67596
2015-09-02
19:48
Further tests to raise coverage of fts5 synonym code to 100%. Fix a dropped error code in the same. file: [45a1d186] check-in: [bdedd838] user: dan branch: fts5-incompatible, size: 67546
18:56
Fix an issue with fts5 synonyms and NEAR(...) queries. file: [1a6dbdab] check-in: [f2e59070] user: dan branch: fts5-incompatible, size: 67548
17:34
Fix a problem with fts5 synonyms and phrase queries. Also fix an OOM handling bug in fts5. file: [408384b2] check-in: [a4c35fa2] user: dan branch: fts5-incompatible, size: 67564
14:17
Fix a problem handling OOM conditions within fts5 queries that feature synonyms. file: [5ae9bae1] check-in: [11fa9808] user: dan branch: fts5-incompatible, size: 66903
08:22
Fix a problem with fts5 synonyms and the xQueryPhrase() auxiliary function API. file: [d92beea3] check-in: [cf3e45e7] user: dan branch: fts5-incompatible, size: 66650
2015-09-01
18:44
Fix a problem that occurs when more than 4 synonyms for a term appear within a single row. file: [44caa0cc] check-in: [cd359550] user: dan branch: fts5-incompatible, size: 66525
18:08
Add tests for fts5 synonyms implemented by adding extra terms to queries. And fixes for the same. file: [99560f28] check-in: [dbcb7380] user: dan branch: fts5-incompatible, size: 66043
2015-08-31
20:06
Begin changes to allow synonym support by adding multiple terms to a query (an alternative to adding multiple terms to the FTS index). file: [1458c3e3] check-in: [ad7feaed] user: dan branch: fts5-incompatible, size: 64280
2015-08-29
15:44
Another change to the fts5 tokenizer API. file: [7ea46f67] check-in: [fc718684] user: dan branch: fts5-incompatible, size: 59938
2015-08-28
19:56
Change the fts5 tokenizer API to allow more than one token to occupy a single position within a document. file: [f53917b6] check-in: [90b85b42] user: dan branch: fts5-incompatible, size: 59832
2015-08-18
16:32
Fix harmless compiler warning in FTS5. file: [d075d36c] check-in: [02448a9f] user: mistachkin branch: trunk, size: 59717
2015-08-05
19:35
Add tests for the matchinfo-like test function. Fix problems found in test and fts5 code by doing so. file: [495b24f4] check-in: [9e3aafe4] user: dan branch: trunk, size: 59723
07:43
Remove all references to "docid" within fts5 source code and comments. Replace with "rowid". file: [31c17560] check-in: [dffd358f] user: dan branch: trunk, size: 59709
2015-07-30
11:26
Return an error message (instead of segfaulting) if test function fts5_expr() is invoked with no arguments. file: [59bea726] check-in: [8e818b89] user: dan branch: trunk, size: 59709
2015-07-24
20:34
Fix warnings in fts5 code. file: [56dcbcbd] check-in: [bd4f156d] user: dan branch: trunk, size: 59481
2015-07-16
20:17
Fix compiler warnings in fts5 code. file: [ac0614f8] check-in: [e9bf275c] user: dan branch: trunk, size: 59477
2015-07-02
15:52
Remove "#ifdef SQLITE_ENABLE_FTS5" from individual fts5 source files. Add a single "#if !defined(SQLITE_CORE) || defined(SQLITE_ENABLE_FTS5)" to fts5.c. file: [d2e14834] check-in: [7819002e] user: dan branch: trunk, size: 59477
2015-06-26
04:34
Initial changes to get FTS5 working with MSVC. file: [3386ab0a] check-in: [ef2052f8] user: mistachkin branch: fts5Msvc, size: 59535
2015-06-05
19:05
Make use of range constraints on the rowid field of an fts5 table in full-text queries. file: [549bda1f] check-in: [32cbc0ed] user: dan branch: fts5, size: 59527
2015-06-03
11:23
Fix an fts5 problem in extracting columns from position lists containing large varints. file: [78a498ba] check-in: [4ea015ab] user: dan branch: fts5, size: 58779
2015-06-02
19:38
Change the fts5 multi-column syntax to use parenthesis instead of square brackets. file: [b28917bc] check-in: [ab85a6fc] user: dan branch: fts5, size: 60471
18:07
Merge latest trunk changes with this branch. file: [aa5683ce] check-in: [c9ffda4a] user: dan branch: fts5, size: 60471
17:57
Reimplement [ec69e09a] so that each call to the xNext() method does not involve two iterations of the match expression tree (only one). file: [ae3cff45] check-in: [80fe305b] user: dan branch: fts5, size: 60471
2015-06-01
19:17
Improve performance of the fts5 AND operator. file: [e68f969e] check-in: [b43e9a5b] user: dan branch: fts5, size: 60673
09:15
Change fts5 expression processing to avoid linear scans of long doclists caused by phrases that match specific columns only. file: [e58c9dec] check-in: [ec69e09a] user: dan branch: fts5, size: 58567
2015-05-30
11:49
Remove the "#include sqlite3Int.h" from fts5Int.h. file: [6a683326] check-in: [e008c3c8] user: dan branch: fts5, size: 56168
2015-05-29
19:00
Add extra tests and fixes for multi-column matches. file: [1685b331] check-in: [ae6794ff] user: dan branch: fts5, size: 56164
15:55
Add syntax to fts5 used to specify that a phrase or NEAR group should match a subset of columns. For example "[col1 col2 ...] : <phrase>". file: [c6072825] check-in: [0fc0ea20] user: dan branch: fts5, size: 55920
2015-05-28
19:57
Optimizations for fts5 queries that match against a specific column. file: [c94983ea] check-in: [b29ac50a] user: dan branch: fts5, size: 52652
2015-05-25
11:46
Avoid redundant loads from the %_data table in the fts5 code. file: [a8b31d36] check-in: [02069782] user: dan branch: fts5, size: 50817
2015-05-23
15:43
Avoid making redundant copies of position-lists within the fts5 code. file: [638df496] check-in: [5165de54] user: dan branch: fts5, size: 50827
2015-05-22
06:08
Improve test coverage of fts5_unicode2.c. file: [f9a2ef4e] check-in: [fea8a4db] user: dan branch: fts5, size: 50092
2015-05-18
17:50
Improve test coverage of fts5_config.c. file: [0c4b50bb] check-in: [47dbfadb] user: dan branch: fts5, size: 48762
2015-05-16
20:04
Further test coverage improvements for fts5. file: [a88af159] check-in: [927d9a64] user: dan branch: fts5, size: 48912
2015-05-07
19:29
Change to storing all keys in a single merge-tree structure instead of one main structure and a separate one for each prefix index. This is a file-format change. Also introduce a mechanism for managing file-format changes. file: [3fe11704] check-in: [a684b5e2] user: dan branch: fts5, size: 48866
2015-05-02
20:35
Reorganize some of the fts5 expression parsing code. Improve test coverage of the same. file: [f49d6841] check-in: [c4456dc5] user: dan branch: fts5, size: 48797
2015-05-01
20:38
Further improvements to test coverage of fts5 code. file: [e2005ba7] check-in: [d4331943] user: dan branch: fts5, size: 49434
2015-04-29
20:54
Improve fts5 tests. file: [663c75df] check-in: [c1f07a3a] user: dan branch: fts5, size: 49368
2015-04-28
20:24
Fix an fts5 bug in handling writes while there are active cursors. file: [e647a262] check-in: [07f70955] user: dan branch: fts5, size: 49368
2015-04-22
20:58
Add extra OOM tests for fts5. file: [05da381a] check-in: [2dd59b57] user: dan branch: fts5, size: 49264
2015-03-04
08:29
Fix a couple of build problems. file: [5215137e] check-in: [a5d5468c] user: dan branch: fts5, size: 49232
2015-02-02
11:32
Fix some problems with building fts5 and fts3 together using the amalgamation. file: [eee52c9d] check-in: [fb10bbb9] user: dan branch: fts5, size: 49172
2015-01-24
19:57
Have fts5 store rowids in ascending order. Query speed is virtually the same regardless of rowid order, and ascending order makes some insert optimizations easier. file: [473e3428] check-in: [5206ca60] user: dan branch: fts5, size: 49178
2015-01-19
11:15
Handle the case where a tokenizer determines that there are zero tokens in an fts5 query term. file: [8a0e6437] check-in: [75f3d17f] user: dan branch: fts5, size: 49042
2015-01-10
20:34
Fix some documentation issues in fts5. file: [6ba7a2e3] check-in: [512e1bdb] user: dan branch: fts5, size: 48694
2015-01-06
19:08
Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. file: [0320ae94] check-in: [65f0262f] user: dan branch: fts5, size: 48444
2015-01-03
20:44
Add support for external content tables to fts5. file: [317093f0] check-in: [17ef5b59] user: dan branch: fts5, size: 48496
2014-12-18
18:25
Fix various problems in fts5 revealed by fault-injection tests. file: [27d3d2de] check-in: [e358c3de] user: dan branch: fts5, size: 48423
2014-12-03
17:27
Begin testing fts5 OOM and IO error handling. file: [5db50cd4] check-in: [2037dba6] user: dan branch: fts5, size: 48235
2014-11-15
20:07
Fix the customization interfaces so that they match the documentation. file: [d317be07] check-in: [fba0b5fc] user: dan branch: fts5, size: 48154
2014-08-05
19:35
Use doclist indexes for AND queries as well as phrases. file: [7b8e3802] check-in: [5d38e6ed] user: dan branch: fts5, size: 47526
2014-08-02
20:49
Start changing things to use doclist indexes as required. code is not activated yet. file: [94024744] check-in: [b8864da9] user: dan branch: fts5, size: 46359
2014-07-30
19:41
Add hidden column "rank". Currently this always returns the same value as the bm25() function. file: [e764d75c] check-in: [4cc048c3] user: dan branch: fts5, size: 46367
2014-07-28
20:14
Add the "loadfts" program, for performance testing the loading of data into fts3/fts4/fts5 tables. file: [e426baa5] check-in: [770b9540] user: dan branch: fts5, size: 46339
2014-07-25
20:30
Add extension apis xRowCount, xQueryPhrase, xSetAuxdata and xGetAuxdata. And a ranking function that uses all of the above. file: [65c19180] check-in: [c4d50428] user: dan branch: fts5, size: 46336
2014-07-23
19:31
Add a snippet() function to fts5. file: [2911813d] check-in: [bdc58fd2] user: dan branch: fts5, size: 43752
2014-07-18
19:59
Fix issues with position lists and NEAR constraints. file: [288b3e01] check-in: [16352d36] user: dan branch: fts5, size: 43764
2014-07-17
15:14
Fix a problem with position list processing for OR queries. file: [52a1b47c] check-in: [5808f30f] user: dan branch: fts5, size: 40296
2014-07-16
19:15
Begin adding interface for auxiliary functions. file: [e4e4e6d3] check-in: [1e2a7ba0] user: dan branch: fts5, size: 40220
2014-07-10
20:21
Support "ORDER BY rowid ASC". file: [0dc31b06] check-in: [b96b5e16] user: dan branch: fts5, size: 38672
2014-07-08
16:27
Add support for prefix queries to fts5. file: [21351cdd] check-in: [75ebd3cd] user: dan branch: fts5, size: 37510
2014-07-05
15:15
Add support for AND, OR and NOT to fts5. file: [a341fe4f] check-in: [8682b87e] user: dan branch: fts5, size: 39619
07:54
Add support for the "colname : <nearset>" syntax to fts5. file: [618e6641] check-in: [00466710] user: dan branch: fts5, size: 36911
2014-07-03
20:39
Add support for NEAR expressions to fts5. file: [84dd8c1f] check-in: [250ae8d4] user: dan branch: fts5, size: 32744
2014-07-02
20:18
Add support for phrase queries to fts5. file: [aacfcf6b] check-in: [2e5652e6] user: dan branch: fts5, size: 30193
2014-06-26
12:31
Fix minor problems in term matching. file: [1874b17f] check-in: [94eeb077] user: dan branch: fts5, size: 21248
2014-06-25
20:28
Begin adding query support to fts5. file: [9666362f] check-in: [47a9f3cc] user: dan branch: fts5, size: 21230
2014-06-23
11:33
Add some code for an experimental fts5 module. Does not work yet. file: [bdfb98da] check-in: [1e0648dc] user: dan branch: fts5, size: 17884 Added