/ File History
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History of ext/fts3/fts3_snippet.c

2019-11-18
14:04
Improvements to detection of corruption in the %_stat shadow table of FTS4. file: [d62e40ba] check-in: [6b67eba5] user: drh branch: trunk, size: 57872
10:37
Improved detection of corruption in the %_stat table of FTS4. Chromium ticket 1025467. file: [bc9b1236] check-in: [10f8a3b7] user: drh branch: trunk, size: 57915
2019-11-17
02:41
Better detection of corruption in the %_stat and %_docsize shadow tables of FTS3. file: [70e8aa4a] check-in: [1e449687] user: drh branch: trunk, size: 57920
2019-08-21
11:31
Fix a broken assert() in the fts3 snippet code that was failing for queries containging more than 64 phrases. file: [7963dd25] check-in: [4c01e017] user: dan branch: trunk, size: 57279
2019-04-13
14:17
Fix additional compiler warnings introduced by the previous check-in and found by MSVC. file: [2f3a78b9] check-in: [6fc0deff] user: drh branch: trunk, size: 57283
14:07
Fixes for harmless compiler warnings. file: [09b38ba5] check-in: [c28c973a] user: drh branch: trunk, size: 57232
04:38
Use the 64-bit memory allocator interfaces in extensions, whenever possible. file: [7d3c7076] check-in: [07ee06fd] user: drh branch: trunk, size: 57224
2019-02-28
13:41
Avoid an assert() failure and an undefined left-shift operation in the fts3 snippet() function that could occur if the database was corrupt. file: [0d8362ef] check-in: [d5250db6] user: dan branch: trunk, size: 57165
2019-02-23
20:48
Fix a couple of assert() statements in fts3 that can be false if the database is corrupt. file: [d002c29d] check-in: [84162af5] user: dan branch: trunk, size: 57149
2019-02-03
07:46
Fix an assertion failure in fts3 triggered by a corrupt database. file: [ac1f8945] check-in: [560ebd42] user: dan branch: trunk, size: 57133
2019-01-18
19:26
Fix problems causing undefined left-shift operations in the fts3 snippet() function. file: [54ac8f46] check-in: [b90dbaed] user: dan branch: trunk, size: 57084
2019-01-16
19:44
Fix a problem in the fts3 matchinfo() function with corrupt database handling. file: [17af214e] check-in: [24ed5fb6] user: dan branch: trunk, size: 56849
2019-01-12
14:58
Fix a problem with corrupt database handling in the fts3 matchinfo() function. file: [bea80381] check-in: [703646b1] user: dan branch: trunk, size: 56715
2019-01-08
20:02
Use 64-bit math to compute the sizes of memory allocations in extensions. file: [3c4654a5] check-in: [ca67f2ec] user: drh branch: trunk, size: 56573
2015-05-26
17:29
Avoid using a zero-sized array within a struct in fts3 code. file: [68ae118b] check-in: [b05cae36] user: dan branch: trunk, size: 56538
2015-05-25
10:57
Fix an fts4 matchinf() problem triggered by deferred tokens that are part of phrases that are part of AND expressions. file: [39a018b7] check-in: [f1e942a1] user: dan branch: trunk, size: 56538
2015-05-19
22:56
Fix the MSVC makefile so that it works with OTA. Fix a harmless compiler warning in FTS3. file: [97a16ea2] check-in: [c7b16645] user: drh branch: trunk, size: 56488
2015-05-06
17:51
Remove some dead code from fts3_snippet.c. file: [b7aaa869] check-in: [46b2d3ce] user: dan branch: fts3-matchinfo-y, size: 56483
17:41
More optimization for the 'y' and 'b' matchinfo directives. file: [aa922977] check-in: [8c5b9fed] user: dan branch: fts3-matchinfo-y, size: 58035
08:43
Further optimizations for the 'y' and 'b' matchinfo operators. file: [e03db2f3] check-in: [fbd038bb] user: dan branch: fts3-matchinfo-y, size: 56681
2015-05-05
20:39
Add the fts3 matchinfo 'b' flag. file: [2224cdfd] check-in: [b9b77972] user: dan branch: fts3-matchinfo-y, size: 56797
19:37
Optimizations for the matchinfo() function, particularly the 'y' flag. file: [a1c62f1b] check-in: [dddd7e18] user: dan branch: fts3-matchinfo-y, size: 56074
2015-05-02
09:44
Add the experimental matchinfo 'y' flag to fts3/4. file: [40a96ba7] check-in: [92941609] user: dan branch: fts3-matchinfo-y, size: 53503
2015-05-01
14:07
Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, and to ensure that error messages are not overwritten and thus leaked. file: [0ce4ee24] check-in: [605347e0] user: drh branch: trunk, size: 51801
2015-03-04
20:18
Fix harmless compiler warning. file: [52c2dcf4] check-in: [580dae46] user: mistachkin branch: trunk, size: 51801
2015-01-27
19:01
Fix a bug in the fts3 snippet() function causing it to omit leading separator characters from snippets that begin with the first token in a column. file: [f16ef642] check-in: [adc9283d] user: dan branch: trunk, size: 51797
18:43
Improve the performance of fts3/4 queries that use the OR operator and at least one auxiliary fts function. file: [55c126e0] check-in: [245e8730] user: dan branch: trunk, size: 51694
2013-11-12
17:46
When possible, have FTS use 32-bit operations to read varints from the database. file: [51beb5c1] check-in: [aa7ba302] user: dan branch: trunk, size: 51627
2013-08-19
18:17
Add some extra assert() statements to silence a few clang warnings. file: [e8ee8c10] check-in: [1c63e951] user: dan branch: trunk, size: 51634
2013-03-21
21:20
Many spelling fixes in comments. No changes to code. file: [5fcfcaff] check-in: [6f6e2d50] user: mistachkin branch: trunk, size: 51571
2012-10-17
20:28
Add a comment to fts3_snippet.c. file: [f6ebb353] check-in: [b5f5ba31] user: dan branch: trunk, size: 51569
20:15
Initialize variables used as outputs of custom tokenizer method calls in fts4. file: [776facfe] check-in: [514505a8] user: dan branch: trunk, size: 50869
2012-05-10
17:43
Have the FTS auxiliary functions correctly handle terms that appear in non-matching branches of the FTS expression. Fix for [bdc6bbbb38]. file: [bf67520a] check-in: [4d3e1673] user: dan branch: trunk, size: 50845
2012-03-27
15:00
Remove the fts3merge.test script in favour of changing the fts4merge.test script so that it runs tests using both fts4 and fts3. Fix some problems with incr-merge and FTS3 tables. file: [51a3a34c] check-in: [5c447e22] user: dan branch: fts4-incr-merge, size: 50667
2012-03-03
18:46
Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. file: [c9e126c2] check-in: [f8e9c445] user: dan branch: fts4-languageid, size: 50673
2011-10-19
16:20
Merge the fts4-content branch with the trunk. file: [1f9ee6a8] check-in: [8a407705] user: dan branch: trunk, size: 50595
09:40
Fix a problem in FTS to do with ^ tokens and the snippet() function. file: [e1f3ed04] check-in: [2c03b24f] user: dan branch: fts4-content, size: 50601
2011-10-13
17:16
Handle updating the only row of an FTS table correctly. Fix for [9fd058691]. file: [19a906f8] check-in: [7e24645b] user: dan branch: trunk, size: 50535
2011-10-04
11:22
Add experimental 'content' option to FTS4. file: [8838a1de] check-in: [1d27ea74] user: dan branch: fts4-content, size: 50576
2011-06-20
17:24
Fix various harmless compiler warnings in FTS3 and RTREE. file: [58b2ba2b] check-in: [fe62179e] user: drh branch: trunk, size: 50541
2011-06-16
00:54
Changes to #ifdefs so that the build goes correctly if the only FTS macro defined is SQLITE_ENABLE_FTS4. file: [a44b38a0] check-in: [a0b43a32] user: drh branch: trunk, size: 50537
2011-06-08
18:39
Fix various issues to do with deferred tokens, NEAR expressions and matchinfo(). file: [82e2c1e4] check-in: [3972a787] user: dan branch: fts3-prefix-search, size: 50537
2011-06-03
18:00
FTS changes: Remove unreachable code. Fix bugs. When processing a large doclist incrementally, read from disk incrementally too. file: [0485969c] check-in: [a4c7e282] user: dan branch: fts3-prefix-search, size: 51550
2011-06-02
19:57
Changes to improve performance and support LIMIT clauses on fts3 tables. This branch is unstable for now. file: [10e0b099] check-in: [28149a78] user: dan branch: fts3-prefix-search, size: 53335
2011-05-28
15:57
Minor changes made while planning a larger change. file: [6ee62601] check-in: [84097a4c] user: dan branch: fts3-prefix-search, size: 54437
2011-05-17
15:56
Add extended return code SQLITE_CORRUPT_VTAB. Returned when the tcontents of the sqlite tables used internally by a virtual table module are invalid or inconsistent. file: [92b40397] check-in: [8844e8bf] user: dan branch: trunk, size: 54427
2011-05-04
12:52
Optimize "ORDER BY rowid/docid DESC/ASC" clauses on FTS tables. file: [a4a3c7d2] check-in: [13395121] user: dan branch: vtab-conflict, size: 54417
2011-03-23
17:10
Fix a bug in fts4 to do with matchinfo and deferred tokens. file: [e857c6a8] check-in: [30d42dc6] user: dan branch: trunk, size: 54344
2011-02-01
17:55
Fix a case in fts4 where a corrupt %_stat table could lead to a crash. file: [bfefb42b] check-in: [4ade96ce] user: dan branch: fts4aux, size: 54350
2011-01-13
10:58
Fix a segfault that can occur in matchinfo if an fts4 table contains mostly zero-length documents. Specifically, if the table contains more rows than it does bytes of text. file: [196c5e6c] check-in: [fe904766] user: dan branch: trunk, size: 54260
2010-12-10
17:06
Fix a performance regression in matchinfo(). file: [3a26a835] check-in: [fa37d8eb] user: dan branch: trunk, size: 54218
2010-12-01
15:36
Fix some warnings under MSVC in fts3 module. file: [6c87b559] check-in: [c7771c0b] user: shaneh branch: trunk, size: 54811
2010-11-26
16:49
Fix various compiler warnings. file: [1d827175] check-in: [c412f612] user: drh branch: trunk, size: 54789
15:13
Add a couple of comments to fts3_snippet.c. file: [e8a952d5] check-in: [ad8df6c5] user: dan branch: fts3-experimental, size: 54718
2010-11-25
17:49
Add coverage tests (and associated fixes) for new matchinfo() code. file: [8dc1fe91] check-in: [70495cec] user: dan branch: fts3-experimental, size: 52035
10:33
Fix bugs in fts3 function matchinfo() when used with deferred tokens. file: [d765bda6] check-in: [ddc2b7ec] user: dan branch: fts3-experimental, size: 51810
2010-11-24
19:26
Add code for the matchinfo 'longest common substring' feature. file: [be2648ff] check-in: [71011a4f] user: dan branch: fts3-experimental, size: 51622
11:51
Remove some unused code from fts3. Add tests to fts3matchinfo.test. file: [967ca2d3] check-in: [ae40b34c] user: dan branch: fts3-experimental, size: 48383
2010-11-23
19:16
Experimental changes to fts3 function matchinfo(). file: [aa0a7608] check-in: [9cf0f2b7] user: dan branch: fts3-experimental, size: 48011
2010-10-23
19:07
Fixes for the matchinfo() function related to FTS4 common token handling. file: [300c12b7] check-in: [deb80eac] user: dan branch: experimental, size: 41897
2010-10-20
18:56
Updates to FTS4 to improve performance and make more accurate cost estimates for prefix terms. file: [ca60a2a4] check-in: [d0a450ce] user: dan branch: experimental, size: 41060
2010-10-19
14:08
Experimental changes to fts4 to try to selectively avoid loading very large doclists. file: [474c11e7] check-in: [5ae0ba44] user: dan branch: experimental, size: 41001
2010-08-06
19:00
Remove all vestiges of ctype.h from FTS3. This addresses ticket [991789d9f3136a] among other bug reports. file: [2c4c9211] check-in: [b8b465ed] user: drh branch: trunk, size: 41025
2010-03-26
17:40
Correctly handle strings with zero-length tokens in the FTS3 offsets() function. This is a cherrypick of [d37034f7fc]. file: [538bd27a] check-in: [ff6ae4f0] user: drh branch: branch-3.6.23, size: 41037
2010-03-24
15:57
Fix for [9861b74ab9]. Correctly handle strings with zero tokens in the fts3 offsets() function. file: [bc582c38] check-in: [d37034f7] user: dan branch: trunk, size: 41044
2010-03-18
16:34
Mark internal routines as "static" in FTS3. Ticket [b1552d0fa7]. file: [ec53bd8a] check-in: [39b34ac4] user: drh branch: trunk, size: 40981
2010-02-26
01:46
Minor changes to silence some compiler warnings with MSVC. file: [9cb2e78f] check-in: [4927c62d] user: shaneh branch: trunk, size: 40974
2010-02-10
05:33
Fix a segfault in fts3 that may occur if the snippet, offsets or matchinfo functions are used in a query that does not contain a MATCH clause. file: [9cba9a32] check-in: [14ab536a] user: dan branch: trunk, size: 40856
2010-02-03
19:55
Add a new full-text search variant that tracks the total number of documents and document sizes, to make ranking search results easier. Currently called FTS4. file: [67ef70f0] check-in: [1b6e6094] user: drh branch: trunk, size: 40571
2010-01-15
17:25
Add coverage tests for fts3_snippet.c. Also fixes related to the same. file: [e5bce65a] check-in: [5e9d8cca] user: dan branch: trunk, size: 39984
2010-01-12
17:57
Update comments in fts3_snippet.c. file: [fdc2c12e] check-in: [dd9689b7] user: dan branch: trunk, size: 39830
2010-01-11
12:00
Modify snippets code to run more efficiently. And to avoid a bug relating to snippets based on full-text queries that contain duplicate terms. file: [99bc7e73] check-in: [a2b1183d] user: dan branch: trunk, size: 31121
2010-01-09
07:33
Fix handling of an OOM error in the fts3 offsets() function. Fix a couple of snippet related test cases in e_fts3.test. file: [a521f904] check-in: [14dc46a7] user: dan branch: trunk, size: 30303
2010-01-07
10:54
Fixes to problems in FTS3 snippet() function found by th3 tests. file: [210bd2a9] check-in: [3b5ccd26] user: dan branch: trunk, size: 29800
2010-01-06
18:36
Fix a segfault that can occur following an OOM in the FTS3 snippet() function file: [f3d4bc93] check-in: [c7e5966e] user: dan branch: trunk, size: 29493
17:19
Change the fts3 snippet function to return (hopefully) more relevant snippets in less time. file: [612b3ad6] check-in: [8a208223] user: dan branch: trunk, size: 29439
2010-01-05
14:18
Removed compiler warnings in MSVC. file: [0e38f76c] check-in: [4ecb4725] user: shaneh branch: trunk, size: 41114
2010-01-02
19:02
Add experimental implementation of FTS3 functions matchinfo() and snippet() (not enabled by default). file: [a11d9f29] check-in: [51f7ee84] user: dan branch: trunk, size: 41103
2009-12-03
06:26
Updates to FTS3 to correct compiler warnings under MSVC. file: [6c2eb6d8] check-in: [37495b55] user: shaneh branch: trunk, size: 23247
2009-12-01
13:57
Changes to the TCL interface header to allow it to be compiled independently from the amalgamation. file: [84ba2fad] check-in: [58113932] user: drh branch: trunk, size: 23221
2009-11-30
19:48
Test coverage improvements in the FTS3 porter stemmer. file: [39cf30a7] check-in: [6d112bfd] user: drh branch: trunk, size: 22975
2009-11-28
21:33
Updates to snippet() and offsets() functions of FTS3 so that they work sanely following an OOM fault. file: [b62144ea] check-in: [b939a37a] user: drh branch: trunk, size: 22967
2009-11-19
15:25
Fix some fts3 related issues with the autoconf and amalgamation build systems. file: [082f2906] check-in: [3b179247] user: dan branch: fts3-refactor, size: 24456
2009-11-13
17:36
Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). file: [8ea96192] check-in: [30a92f11] user: dan branch: fts3-refactor, size: 24391 Added