Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
100 descendants of 90b82d3ef613b291
|
2015-05-13
| ||
| 17:15 | Change fts5 doclist-index structures to be trees instead of flat lists. This only makes a difference for databases that contain millions of instances of the same token. (check-in: aa34bf66 user: dan tags: fts5) | |
|
2015-05-09
| ||
| 18:28 | Allow the fts5vocab table to optionally provide data on a per-column basis. (check-in: 39222761 user: dan tags: fts5) | |
|
2015-05-08
| ||
| 20:21 | Add the fts5vocab module, for direct access to the fts5 index. (check-in: 6bf93e3b user: dan tags: fts5) | |
| 09:21 | Improve the error message returned by FTS5 if it encounters an unknown file format. (check-in: f369caec user: dan tags: fts5) | |
|
2015-05-07
| ||
| 19:29 | Change to storing all keys in a single merge-tree structure instead of one main structure and a separate one for each prefix index. This is a file-format change. Also introduce a mechanism for managing file-format changes. (check-in: a684b5e2 user: dan tags: fts5) | |
|
2015-05-02
| ||
| 20:35 | Reorganize some of the fts5 expression parsing code. Improve test coverage of the same. (check-in: c4456dc5 user: dan tags: fts5) | |
|
2015-05-01
| ||
| 20:38 | Further improvements to test coverage of fts5 code. (check-in: d4331943 user: dan tags: fts5) | |
| 12:14 | Improve test coverage of fts5.c. (check-in: add4f468 user: dan tags: fts5) | |
|
2015-04-29
| ||
| 20:54 | Improve fts5 tests. (check-in: c1f07a3a user: dan tags: fts5) | |
|
2015-04-28
| ||
| 20:24 | Fix an fts5 bug in handling writes while there are active cursors. (check-in: 07f70955 user: dan tags: fts5) | |
| 18:35 | Improve coverage of fts5 tests. (check-in: 8e8136f2 user: dan tags: fts5) | |
|
2015-04-27
| ||
| 16:21 | Change the fts5 content= option so that it matches fts5 columns with the underlying table columns by name, not by their position within the CREATE TABLE statement. (check-in: e38e2bb6 user: dan tags: fts5) | |
| 11:31 | Further tests for fts5. (check-in: ffeb3ef3 user: dan tags: fts5) | |
|
2015-04-25
| ||
| 20:29 | Improve coverage of fts5_index.c slightly. (check-in: e5aaa013 user: dan tags: fts5) | |
| 18:56 | Add tests for fts5. (check-in: e748651c user: dan tags: fts5) | |
|
2015-04-24
| ||
| 20:18 | Merge latest trunk changes with this branch. (check-in: 1c78d892 user: dan tags: fts5) | |
| 19:41 | Add the "unindexed" column option to fts5. (check-in: 86309961 user: dan tags: fts5) | |
| 15:56 | Add extra tests for corrupt database handling in fts5. (check-in: 41449f7a user: dan tags: fts5) | |
| 06:02 | Fix an fts5 build problem in main.mk. (check-in: 60045ced user: dan tags: fts5) | |
|
2015-04-22
| ||
| 20:58 | Add extra OOM tests for fts5. (check-in: 2dd59b57 user: dan tags: fts5) | |
| 20:14 | Fix problems with doclist-indexes involving very large rowids. (check-in: 1e599409 user: dan tags: fts5) | |
| 09:40 | Update this branch with latest trunk changes. (check-in: 9797482d user: dan tags: fts5) | |
|
2015-04-21
| ||
| 20:13 | Fix a problem in fts5fault1.test. (check-in: a21d60cb user: dan tags: fts5) | |
| 19:07 | Fix an fts5 problem with large deletes. (check-in: e50e8031 user: dan tags: fts5) | |
|
2015-04-20
| ||
| 18:48 | Fix some fts5 problems with very large position lists. (check-in: 2ea8f9cb user: dan tags: fts5) | |
|
2015-04-15
| ||
| 18:49 | Logically store updates as (insert+delete) within the FTS tree. This allows keys to be annihilated more quickly under some circumstances. (check-in: 50fae1f0 user: dan tags: fts5) | |
| 16:01 | Fix a problem preventing doclist indexes from being loaded. (check-in: b29109a0 user: dan tags: fts5) | |
|
2015-04-14
| ||
| 20:15 | Begin changing fts5 to use a delete flag so that delete markers may be annihilated more quickly. (check-in: 9341c070 user: dan tags: fts5) | |
|
2015-04-11
| ||
| 18:25 | Have fts5 integrity check verify that prefix indexes contain the same values as returned by prefix queries on the main terms index. (check-in: bdb8e82a user: dan tags: fts5) | |
| 16:23 | Improve fts5 integrity-check so that it checks that DESC queries return the same as ASC. Change the poslist format slightly to make room for a delete-flag. (check-in: 49c1e745 user: dan tags: fts5) | |
|
2015-03-21
| ||
| 15:45 | Merge trunk changes with this branch. (check-in: 14274391 user: dan tags: fts5) | |
| 15:37 | When scanning the full-text index as part of the fts5 integrity-check, also run a point query for every term and verify that these results are consistent with those found by the linear scan. (check-in: ce972f6a user: dan tags: fts5) | |
|
2015-03-11
| ||
| 14:51 | Add an optimization to the fts5 unicode tokenizer code. (check-in: f5db4892 user: dan tags: fts5) | |
|
2015-03-10
| ||
| 19:24 | Avoid redundant string comparisons while merging fts5 segment b-trees. (check-in: 5c46820d user: dan tags: fts5) | |
|
2015-03-07
| ||
| 15:46 | Fix some compiler warnings caused by signed/unsigned pointer conversions. (check-in: cccee7b5 user: dan tags: fts5) | |
| 11:50 | Fix the bm25() function so that it multiplies scores by -1 before returning them. This means better matches have a lower numerical score, so "ORDER BY rank" (not "ORDER BY rank DESC") does what you want. (check-in: 3ee7b5a9 user: dan tags: fts5) | |
|
2015-03-04
| ||
| 08:29 | Fix a couple of build problems. (check-in: a5d5468c user: dan tags: fts5) | |
|
2015-02-27
| ||
| 09:41 | Further minor optimizations to flushing fts5 data to disk. (check-in: a07dcca9 user: dan tags: fts5) | |
| 07:23 | Fix suffix and prefix compression of terms in top-level fts5 segments. And a crash that could follow an OOM condition. (check-in: bb104b36 user: dan tags: fts5) | |
|
2015-02-26
| ||
| 20:49 | Optimize copying data from fts5 in-memory hash tables to top level segments. (check-in: 8e3ca632 user: dan tags: fts5) | |
| 14:54 | Fix an fts5 bug in large incremental merges. (check-in: 208e3cb6 user: dan tags: fts5) | |
|
2015-02-25
| ||
| 19:24 | Instead of the 4-byte fields, use regular varints for the poslist-size field in fts5_hash.c. (check-in: 7eb022d7 user: dan tags: fts5) | |
|
2015-02-02
| ||
| 11:58 | Ensure generated header file fts5parse.h is included in sqlite3.c. (check-in: bc7be2fc user: dan tags: fts5) | |
| 11:32 | Fix some problems with building fts5 and fts3 together using the amalgamation. (check-in: fb10bbb9 user: dan tags: fts5) | |
| 09:40 | Merge latest trunk changes with this branch. (check-in: 76212f2c user: dan tags: fts5) | |
|
2015-01-31
| ||
| 15:23 | Minor optimizations to fts5 writes. (check-in: 1fffe51f user: dan tags: fts5) | |
|
2015-01-29
| ||
| 20:59 | Fix some problems with transactions that both read and write an fts5 table. (check-in: 0e225b15 user: dan tags: fts5) | |
|
2015-01-27
| ||
| 20:41 | Fix a problem with fts5 doclist-indexes that occured if the first rowid of the first non-term page of a doclist is zero. (check-in: f704bc05 user: dan tags: fts5) | |
|
2015-01-24
| ||
| 19:57 | Have fts5 store rowids in ascending order. Query speed is virtually the same regardless of rowid order, and ascending order makes some insert optimizations easier. (check-in: 5206ca60 user: dan tags: fts5) | |
|
2015-01-23
| ||
| 17:43 | Fix compression of keys stored on internal segment b-tree nodes by fts5. (check-in: 51444f67 user: dan tags: fts5) | |
| 06:50 | Remove some redundant code from fts5. (check-in: 939b7a5d user: dan tags: fts5) | |
|
2015-01-22
| ||
| 19:13 | Add further tests and fixes for fts5. (check-in: 5b295897 user: dan tags: fts5) | |
|
2015-01-21
| ||
| 20:30 | Further tests and fixes for fts5. (check-in: c020a291 user: dan tags: fts5) | |
| 18:23 | Fix an fts5 issue with loading doclist-indexes for a term that is the last thing on its leaf page. (check-in: e0d61442 user: dan tags: fts5) | |
| 17:20 | Merge trunk changes with this branch. (check-in: f8699a1a user: dan tags: fts5) | |
| 16:10 | Add further tests for fts5 backend. (check-in: 09dabb3b user: dan tags: fts5) | |
| 06:36 | Merge latest trunk changes with this branch. (check-in: b3348b1e user: dan tags: fts5) | |
|
2015-01-20
| ||
| 20:34 | Add extra fault injection tests to fts5. (check-in: f45a0dc0 user: dan tags: fts5) | |
|
2015-01-19
| ||
| 11:15 | Handle the case where a tokenizer determines that there are zero tokens in an fts5 query term. (check-in: 75f3d17f user: dan tags: fts5) | |
|
2015-01-17
| ||
| 20:01 | Ensure an up to date copy of the fts5 configuration has been loaded into memory before attempting to modify the same configuration. (check-in: f30afd20 user: dan tags: fts5) | |
| 17:48 | Improve the performance of the fts5 porter tokenizer implementation. (check-in: 96ea6004 user: dan tags: fts5) | |
|
2015-01-13
| ||
| 17:25 | Fix prefix indexes so that they work in characters, not bytes. (check-in: af8d43a4 user: dan tags: fts5) | |
|
2015-01-12
| ||
| 17:58 | Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the default tokenizer. Change the name of the simple tokenizer to "ascii". (check-in: f22dbcca user: dan tags: fts5) | |
|
2015-01-10
| ||
| 20:34 | Fix some documentation issues in fts5. (check-in: 512e1bdb user: dan tags: fts5) | |
|
2015-01-07
| ||
| 19:33 | Add the fts5 'optimize' command. (check-in: e749be56 user: dan tags: fts5) | |
| 17:11 | Add the 'rebuild' and 'delete-all' commands. (check-in: 0cb2fed5 user: dan tags: fts5) | |
|
2015-01-06
| ||
| 19:08 | Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. (check-in: 65f0262f user: dan tags: fts5) | |
| 14:38 | Further fixes and test cases related to external content tables. (check-in: ce6a899b user: dan tags: fts5) | |
|
2015-01-05
| ||
| 20:41 | Tests and fixes for fts5 external content tables. (check-in: 047aaf83 user: dan tags: fts5) | |
|
2015-01-03
| ||
| 20:44 | Add support for external content tables to fts5. (check-in: 17ef5b59 user: dan tags: fts5) | |
|
2015-01-02
| ||
| 14:55 | Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause. (check-in: 1cd15a17 user: dan tags: fts5) | |
|
2015-01-01
| ||
| 18:03 | Merge latest trunk changes with this branch. (check-in: 4b365167 user: dan tags: fts5) | |
| 16:46 | Add a version of the unicode61 tokenizer to fts5. (check-in: d09f7800 user: dan tags: fts5) | |
|
2014-12-29
| ||
| 15:59 | Move all fts5 test files to new directory "ext/fts5/test". (check-in: 7f148edb user: dan tags: fts5) | |
| 11:24 | Fixes to built-in tokenizers. (check-in: b33fe0dd user: dan tags: fts5) | |
|
2014-12-23
| ||
| 19:18 | Fix the fts5 bm25() function so that it matches the documentation. (check-in: 1ac7a8d0 user: dan tags: fts5) | |
|
2014-12-22
| ||
| 21:01 | Fixes and simplifications for the snippet() and highlight() functions. (check-in: ca5d4404 user: dan tags: fts5) | |
|
2014-12-19
| ||
| 20:53 | Remove the fts5_test() aux function. Test aux functions using the tcl interface instead. (check-in: 67e3ffd9 user: dan tags: fts5) | |
|
2014-12-18
| ||
| 20:01 | Fix a problem with prefix queries and the AND operator. (check-in: 38b3c65e user: dan tags: fts5) | |
| 18:25 | Fix various problems in fts5 revealed by fault-injection tests. (check-in: e358c3de user: dan tags: fts5) | |
|
2014-12-03
| ||
| 17:27 | Begin testing fts5 OOM and IO error handling. (check-in: 2037dba6 user: dan tags: fts5) | |
|
2014-12-02
| ||
| 20:18 | Add a configuration option to remap the "rank" column to an auxiliary fts5 function. (check-in: b5f59712 user: dan tags: fts5) | |
|
2014-12-01
| ||
| 20:05 | Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5. (check-in: 9c1697a2 user: dan tags: fts5) | |
|
2014-11-28
| ||
| 20:01 | Add a cookie mechanism to ensure that the %_config table is re-read as required. (check-in: bb4a37b5 user: dan tags: fts5) | |
|
2014-11-27
| ||
| 20:03 | Add a %_config table to fts5. (check-in: 83491c56 user: dan tags: fts5) | |
|
2014-11-24
| ||
| 16:24 | Add the auxiliary highlight() function to fts5. (check-in: 05909237 user: dan tags: fts5) | |
|
2014-11-15
| ||
| 20:07 | Fix the customization interfaces so that they match the documentation. (check-in: fba0b5fc user: dan tags: fts5) | |
|
2014-08-25
| ||
| 19:58 | Add documentation for tokenizer api to fts5.h. Also add a script to extract extension API docs and format them as html. (check-in: e240d467 user: dan tags: fts5) | |
|
2014-08-18
| ||
| 19:30 | Add an "automerge=0" mode that disables auto-merging and falls back to fts4-style crisis merges. (check-in: 2397404e user: dan tags: fts5) | |
|
2014-08-12
| ||
| 16:07 | Cache the value of the "totals" record in memory during transactions. (check-in: 05dfdad4 user: dan tags: fts5) | |
| 08:36 | Automatically resize the hash table used by fts5. (check-in: f1cb48f4 user: dan tags: fts5) | |
|
2014-08-11
| ||
| 20:26 | Simplify the way position lists are copied when merging data. (check-in: 9f8d678a user: dan tags: fts5) | |
| 19:44 | Replace the hash table borrowed from fts3. (check-in: 617e2fac user: dan tags: fts5) | |
|
2014-08-09
| ||
| 18:22 | Fix an uninitialized variable causing a problem during fts5 table initialization. (check-in: a14fa876 user: dan tags: fts5) | |
| 18:02 | Use multiple memory allocations for a single Fts5Structure object. This is probably less efficient but much easier to get right. (check-in: 2821825f user: dan tags: fts5) | |
|
2014-08-07
| ||
| 18:47 | Add "segment promotion" to fts5. This prevents the FTS index from growing indefinitely as data is added and deleted. (check-in: ba359d78 user: dan tags: fts5) | |
|
2014-08-06
| ||
| 20:04 | Avoid writing delete markers to the oldest segment in an FTS index. (check-in: 1baeb1ce user: dan tags: fts5) | |
| 16:30 | Add support for savepoints to fts5. (check-in: 3b19eba0 user: dan tags: fts5) | |
|
2014-08-05
| ||
| 19:35 | Use doclist indexes for AND queries as well as phrases. (check-in: 5d38e6ed user: dan tags: fts5) | |
| 19:00 | Use doclist-indexes with "ORDER BY rowid ASC" fts5 queries as well. (check-in: d028ba65 user: dan tags: fts5) | |
|
2014-08-04
| ||
| 20:07 | Fix fts5_index.c to use doclist-indexes when possible. Only some cases work so far. (check-in: 90b82d3e user: dan tags: fts5) | |