/ History for ext/fts3/fts3_snippet.c
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History for ext/fts3/fts3_snippet.c

2020-05-14
23:59
[86e7e947] part of check-in [a4dd1489] Fix a null pointer deference that can occur on a strange matchinfo() query. (check-in: [a4dd1489] user: drh branch: trunk, size: 57889)
2020-01-07
09:06
[052b35ad] part of check-in [e1f12978] Fix an instance of an undefined behaviour (a left-shift of a 64-bit unsigned integer by a value greater than 64) that could occur in fts3. (check-in: [e1f12978] user: dan branch: trunk, size: 57877)
2019-11-18
14:04
[d62e40ba] part of check-in [6b67eba5] Improvements to detection of corruption in the %_stat shadow table of FTS4. (check-in: [6b67eba5] user: drh branch: trunk, size: 57872)
10:37
[bc9b1236] part of check-in [10f8a3b7] Improved detection of corruption in the %_stat table of FTS4. Chromium ticket 1025467. (check-in: [10f8a3b7] user: drh branch: trunk, size: 57915)
2019-11-17
02:41
[70e8aa4a] part of check-in [1e449687] Better detection of corruption in the %_stat and %_docsize shadow tables of FTS3. (check-in: [1e449687] user: drh branch: trunk, size: 57920)
2019-08-21
11:31
[7963dd25] part of check-in [4c01e017] Fix a broken assert() in the fts3 snippet code that was failing for queries containging more than 64 phrases. (check-in: [4c01e017] user: dan branch: trunk, size: 57279)
2019-04-13
14:17
[2f3a78b9] part of check-in [6fc0deff] Fix additional compiler warnings introduced by the previous check-in and found by MSVC. (check-in: [6fc0deff] user: drh branch: trunk, size: 57283)
14:07
[09b38ba5] part of check-in [c28c973a] Fixes for harmless compiler warnings. (check-in: [c28c973a] user: drh branch: trunk, size: 57232)
04:38
[7d3c7076] part of check-in [07ee06fd] Use the 64-bit memory allocator interfaces in extensions, whenever possible. (check-in: [07ee06fd] user: drh branch: trunk, size: 57224)
2019-02-28
13:41
[0d8362ef] part of check-in [d5250db6] Avoid an assert() failure and an undefined left-shift operation in the fts3 snippet() function that could occur if the database was corrupt. (check-in: [d5250db6] user: dan branch: trunk, size: 57165)
2019-02-23
20:48
[d002c29d] part of check-in [84162af5] Fix a couple of assert() statements in fts3 that can be false if the database is corrupt. (check-in: [84162af5] user: dan branch: trunk, size: 57149)
2019-02-03
07:46
[ac1f8945] part of check-in [560ebd42] Fix an assertion failure in fts3 triggered by a corrupt database. (check-in: [560ebd42] user: dan branch: trunk, size: 57133)
2019-01-18
19:26
[54ac8f46] part of check-in [b90dbaed] Fix problems causing undefined left-shift operations in the fts3 snippet() function. (check-in: [b90dbaed] user: dan branch: trunk, size: 57084)
2019-01-16
19:44
[17af214e] part of check-in [24ed5fb6] Fix a problem in the fts3 matchinfo() function with corrupt database handling. (check-in: [24ed5fb6] user: dan branch: trunk, size: 56849)
2019-01-12
14:58
[bea80381] part of check-in [703646b1] Fix a problem with corrupt database handling in the fts3 matchinfo() function. (check-in: [703646b1] user: dan branch: trunk, size: 56715)
2019-01-08
20:02
[3c4654a5] part of check-in [ca67f2ec] Use 64-bit math to compute the sizes of memory allocations in extensions. (check-in: [ca67f2ec] user: drh branch: trunk, size: 56573)
2015-05-26
17:29
[68ae118b] part of check-in [b05cae36] Avoid using a zero-sized array within a struct in fts3 code. (check-in: [b05cae36] user: dan branch: trunk, size: 56538)
2015-05-25
10:57
[39a018b7] part of check-in [f1e942a1] Fix an fts4 matchinf() problem triggered by deferred tokens that are part of phrases that are part of AND expressions. (check-in: [f1e942a1] user: dan branch: trunk, size: 56538)
2015-05-19
22:56
[97a16ea2] part of check-in [c7b16645] Fix the MSVC makefile so that it works with OTA. Fix a harmless compiler warning in FTS3. (check-in: [c7b16645] user: drh branch: trunk, size: 56488)
2015-05-06
17:51
[b7aaa869] part of check-in [46b2d3ce] Remove some dead code from fts3_snippet.c. (check-in: [46b2d3ce] user: dan branch: fts3-matchinfo-y, size: 56483)
17:41
[aa922977] part of check-in [8c5b9fed] More optimization for the 'y' and 'b' matchinfo directives. (check-in: [8c5b9fed] user: dan branch: fts3-matchinfo-y, size: 58035)
08:43
[e03db2f3] part of check-in [fbd038bb] Further optimizations for the 'y' and 'b' matchinfo operators. (check-in: [fbd038bb] user: dan branch: fts3-matchinfo-y, size: 56681)
2015-05-05
20:39
[2224cdfd] part of check-in [b9b77972] Add the fts3 matchinfo 'b' flag. (check-in: [b9b77972] user: dan branch: fts3-matchinfo-y, size: 56797)
19:37
[a1c62f1b] part of check-in [dddd7e18] Optimizations for the matchinfo() function, particularly the 'y' flag. (check-in: [dddd7e18] user: dan branch: fts3-matchinfo-y, size: 56074)
2015-05-02
09:44
[40a96ba7] part of check-in [92941609] Add the experimental matchinfo 'y' flag to fts3/4. (check-in: [92941609] user: dan branch: fts3-matchinfo-y, size: 53503)
2015-05-01
14:07
[0ce4ee24] part of check-in [605347e0] Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, and to ensure that error messages are not overwritten and thus leaked. (check-in: [605347e0] user: drh branch: trunk, size: 51801)
2015-03-04
20:18
[52c2dcf4] part of check-in [580dae46] Fix harmless compiler warning. (check-in: [580dae46] user: mistachkin branch: trunk, size: 51801)
2015-01-27
19:01
[f16ef642] part of check-in [adc9283d] Fix a bug in the fts3 snippet() function causing it to omit leading separator characters from snippets that begin with the first token in a column. (check-in: [adc9283d] user: dan branch: trunk, size: 51797)
18:43
[55c126e0] part of check-in [245e8730] Improve the performance of fts3/4 queries that use the OR operator and at least one auxiliary fts function. (check-in: [245e8730] user: dan branch: trunk, size: 51694)
2013-11-12
17:46
[51beb5c1] part of check-in [aa7ba302] When possible, have FTS use 32-bit operations to read varints from the database. (check-in: [aa7ba302] user: dan branch: trunk, size: 51627)
2013-08-19
18:17
[e8ee8c10] part of check-in [1c63e951] Add some extra assert() statements to silence a few clang warnings. (check-in: [1c63e951] user: dan branch: trunk, size: 51634)
2013-03-21
21:20
[5fcfcaff] part of check-in [6f6e2d50] Many spelling fixes in comments. No changes to code. (check-in: [6f6e2d50] user: mistachkin branch: trunk, size: 51571)
2012-10-17
20:28
[f6ebb353] part of check-in [b5f5ba31] Add a comment to fts3_snippet.c. (check-in: [b5f5ba31] user: dan branch: trunk, size: 51569)
20:15
[776facfe] part of check-in [514505a8] Initialize variables used as outputs of custom tokenizer method calls in fts4. (check-in: [514505a8] user: dan branch: trunk, size: 50869)
2012-05-10
17:43
[bf67520a] part of check-in [4d3e1673] Have the FTS auxiliary functions correctly handle terms that appear in non-matching branches of the FTS expression. Fix for [bdc6bbbb38]. (check-in: [4d3e1673] user: dan branch: trunk, size: 50845)
2012-03-27
15:00
[51a3a34c] part of check-in [5c447e22] Remove the fts3merge.test script in favour of changing the fts4merge.test script so that it runs tests using both fts4 and fts3. Fix some problems with incr-merge and FTS3 tables. (check-in: [5c447e22] user: dan branch: fts4-incr-merge, size: 50667)
2012-03-03
18:46
[c9e126c2] part of check-in [f8e9c445] Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. (check-in: [f8e9c445] user: dan branch: fts4-languageid, size: 50673)
2011-10-19
16:20
[1f9ee6a8] part of check-in [8a407705] Merge the fts4-content branch with the trunk. (check-in: [8a407705] user: dan branch: trunk, size: 50595)
09:40
[e1f3ed04] part of check-in [2c03b24f] Fix a problem in FTS to do with ^ tokens and the snippet() function. (check-in: [2c03b24f] user: dan branch: fts4-content, size: 50601)
2011-10-13
17:16
[19a906f8] part of check-in [7e24645b] Handle updating the only row of an FTS table correctly. Fix for [9fd058691]. (check-in: [7e24645b] user: dan branch: trunk, size: 50535)
2011-10-04
11:22
[8838a1de] part of check-in [1d27ea74] Add experimental 'content' option to FTS4. (check-in: [1d27ea74] user: dan branch: fts4-content, size: 50576)
2011-06-20
17:24
[58b2ba2b] part of check-in [fe62179e] Fix various harmless compiler warnings in FTS3 and RTREE. (check-in: [fe62179e] user: drh branch: trunk, size: 50541)
2011-06-16
00:54
[a44b38a0] part of check-in [a0b43a32] Changes to #ifdefs so that the build goes correctly if the only FTS macro defined is SQLITE_ENABLE_FTS4. (check-in: [a0b43a32] user: drh branch: trunk, size: 50537)
2011-06-08
18:39
[82e2c1e4] part of check-in [3972a787] Fix various issues to do with deferred tokens, NEAR expressions and matchinfo(). (check-in: [3972a787] user: dan branch: fts3-prefix-search, size: 50537)
2011-06-03
18:00
[0485969c] part of check-in [a4c7e282] FTS changes: Remove unreachable code. Fix bugs. When processing a large doclist incrementally, read from disk incrementally too. (check-in: [a4c7e282] user: dan branch: fts3-prefix-search, size: 51550)
2011-06-02
19:57
[10e0b099] part of check-in [28149a78] Changes to improve performance and support LIMIT clauses on fts3 tables. This branch is unstable for now. (check-in: [28149a78] user: dan branch: fts3-prefix-search, size: 53335)
2011-05-28
15:57
[6ee62601] part of check-in [84097a4c] Minor changes made while planning a larger change. (check-in: [84097a4c] user: dan branch: fts3-prefix-search, size: 54437)
2011-05-17
15:56
[92b40397] part of check-in [8844e8bf] Add extended return code SQLITE_CORRUPT_VTAB. Returned when the tcontents of the sqlite tables used internally by a virtual table module are invalid or inconsistent. (check-in: [8844e8bf] user: dan branch: trunk, size: 54427)
2011-05-04
12:52
[a4a3c7d2] part of check-in [13395121] Optimize "ORDER BY rowid/docid DESC/ASC" clauses on FTS tables. (check-in: [13395121] user: dan branch: vtab-conflict, size: 54417)
2011-03-23
17:10
[e857c6a8] part of check-in [30d42dc6] Fix a bug in fts4 to do with matchinfo and deferred tokens. (check-in: [30d42dc6] user: dan branch: trunk, size: 54344)
2011-02-01
17:55
[bfefb42b] part of check-in [4ade96ce] Fix a case in fts4 where a corrupt %_stat table could lead to a crash. (check-in: [4ade96ce] user: dan branch: fts4aux, size: 54350)
2011-01-13
10:58
[196c5e6c] part of check-in [fe904766] Fix a segfault that can occur in matchinfo if an fts4 table contains mostly zero-length documents. Specifically, if the table contains more rows than it does bytes of text. (check-in: [fe904766] user: dan branch: trunk, size: 54260)
2010-12-10
17:06
[3a26a835] part of check-in [fa37d8eb] Fix a performance regression in matchinfo(). (check-in: [fa37d8eb] user: dan branch: trunk, size: 54218)
2010-12-01
15:36
[6c87b559] part of check-in [c7771c0b] Fix some warnings under MSVC in fts3 module. (check-in: [c7771c0b] user: shaneh branch: trunk, size: 54811)
2010-11-26
16:49
[1d827175] part of check-in [c412f612] Fix various compiler warnings. (check-in: [c412f612] user: drh branch: trunk, size: 54789)
15:13
[e8a952d5] part of check-in [ad8df6c5] Add a couple of comments to fts3_snippet.c. (check-in: [ad8df6c5] user: dan branch: fts3-experimental, size: 54718)
2010-11-25
17:49
[8dc1fe91] part of check-in [70495cec] Add coverage tests (and associated fixes) for new matchinfo() code. (check-in: [70495cec] user: dan branch: fts3-experimental, size: 52035)
10:33
[d765bda6] part of check-in [ddc2b7ec] Fix bugs in fts3 function matchinfo() when used with deferred tokens. (check-in: [ddc2b7ec] user: dan branch: fts3-experimental, size: 51810)
2010-11-24
19:26
[be2648ff] part of check-in [71011a4f] Add code for the matchinfo 'longest common substring' feature. (check-in: [71011a4f] user: dan branch: fts3-experimental, size: 51622)
11:51
[967ca2d3] part of check-in [ae40b34c] Remove some unused code from fts3. Add tests to fts3matchinfo.test. (check-in: [ae40b34c] user: dan branch: fts3-experimental, size: 48383)
2010-11-23
19:16
[aa0a7608] part of check-in [9cf0f2b7] Experimental changes to fts3 function matchinfo(). (check-in: [9cf0f2b7] user: dan branch: fts3-experimental, size: 48011)
2010-10-23
19:07
[300c12b7] part of check-in [deb80eac] Fixes for the matchinfo() function related to FTS4 common token handling. (check-in: [deb80eac] user: dan branch: experimental, size: 41897)
2010-10-20
18:56
[ca60a2a4] part of check-in [d0a450ce] Updates to FTS4 to improve performance and make more accurate cost estimates for prefix terms. (check-in: [d0a450ce] user: dan branch: experimental, size: 41060)
2010-10-19
14:08
[474c11e7] part of check-in [5ae0ba44] Experimental changes to fts4 to try to selectively avoid loading very large doclists. (check-in: [5ae0ba44] user: dan branch: experimental, size: 41001)
2010-08-06
19:00
[2c4c9211] part of check-in [b8b465ed] Remove all vestiges of ctype.h from FTS3. This addresses ticket [991789d9f3136a] among other bug reports. (check-in: [b8b465ed] user: drh branch: trunk, size: 41025)
2010-03-26
17:40
[538bd27a] part of check-in [ff6ae4f0] Correctly handle strings with zero-length tokens in the FTS3 offsets() function. This is a cherrypick of [d37034f7fc]. (check-in: [ff6ae4f0] user: drh branch: branch-3.6.23, size: 41037)
2010-03-24
15:57
[bc582c38] part of check-in [d37034f7] Fix for [9861b74ab9]. Correctly handle strings with zero tokens in the fts3 offsets() function. (check-in: [d37034f7] user: dan branch: trunk, size: 41044)
2010-03-18
16:34
[ec53bd8a] part of check-in [39b34ac4] Mark internal routines as "static" in FTS3. Ticket [b1552d0fa7]. (check-in: [39b34ac4] user: drh branch: trunk, size: 40981)
2010-02-26
01:46
[9cb2e78f] part of check-in [4927c62d] Minor changes to silence some compiler warnings with MSVC. (check-in: [4927c62d] user: shaneh branch: trunk, size: 40974)
2010-02-10
05:33
[9cba9a32] part of check-in [14ab536a] Fix a segfault in fts3 that may occur if the snippet, offsets or matchinfo functions are used in a query that does not contain a MATCH clause. (check-in: [14ab536a] user: dan branch: trunk, size: 40856)
2010-02-03
19:55
[67ef70f0] part of check-in [1b6e6094] Add a new full-text search variant that tracks the total number of documents and document sizes, to make ranking search results easier. Currently called FTS4. (check-in: [1b6e6094] user: drh branch: trunk, size: 40571)
2010-01-15
17:25
[e5bce65a] part of check-in [5e9d8cca] Add coverage tests for fts3_snippet.c. Also fixes related to the same. (check-in: [5e9d8cca] user: dan branch: trunk, size: 39984)
2010-01-12
17:57
[fdc2c12e] part of check-in [dd9689b7] Update comments in fts3_snippet.c. (check-in: [dd9689b7] user: dan branch: trunk, size: 39830)
2010-01-11
12:00
[99bc7e73] part of check-in [a2b1183d] Modify snippets code to run more efficiently. And to avoid a bug relating to snippets based on full-text queries that contain duplicate terms. (check-in: [a2b1183d] user: dan branch: trunk, size: 31121)
2010-01-09
07:33
[a521f904] part of check-in [14dc46a7] Fix handling of an OOM error in the fts3 offsets() function. Fix a couple of snippet related test cases in e_fts3.test. (check-in: [14dc46a7] user: dan branch: trunk, size: 30303)
2010-01-07
10:54
[210bd2a9] part of check-in [3b5ccd26] Fixes to problems in FTS3 snippet() function found by th3 tests. (check-in: [3b5ccd26] user: dan branch: trunk, size: 29800)
2010-01-06
18:36
[f3d4bc93] part of check-in [c7e5966e] Fix a segfault that can occur following an OOM in the FTS3 snippet() function (check-in: [c7e5966e] user: dan branch: trunk, size: 29493)
17:19
[612b3ad6] part of check-in [8a208223] Change the fts3 snippet function to return (hopefully) more relevant snippets in less time. (check-in: [8a208223] user: dan branch: trunk, size: 29439)
2010-01-05
14:18
[0e38f76c] part of check-in [4ecb4725] Removed compiler warnings in MSVC. (check-in: [4ecb4725] user: shaneh branch: trunk, size: 41114)
2010-01-02
19:02
[a11d9f29] part of check-in [51f7ee84] Add experimental implementation of FTS3 functions matchinfo() and snippet() (not enabled by default). (check-in: [51f7ee84] user: dan branch: trunk, size: 41103)
2009-12-03
06:26
[6c2eb6d8] part of check-in [37495b55] Updates to FTS3 to correct compiler warnings under MSVC. (check-in: [37495b55] user: shaneh branch: trunk, size: 23247)
2009-12-01
13:57
[84ba2fad] part of check-in [58113932] Changes to the TCL interface header to allow it to be compiled independently from the amalgamation. (check-in: [58113932] user: drh branch: trunk, size: 23221)
2009-11-30
19:48
[39cf30a7] part of check-in [6d112bfd] Test coverage improvements in the FTS3 porter stemmer. (check-in: [6d112bfd] user: drh branch: trunk, size: 22975)
2009-11-28
21:33
[b62144ea] part of check-in [b939a37a] Updates to snippet() and offsets() functions of FTS3 so that they work sanely following an OOM fault. (check-in: [b939a37a] user: drh branch: trunk, size: 22967)
2009-11-19
15:25
[082f2906] part of check-in [3b179247] Fix some fts3 related issues with the autoconf and amalgamation build systems. (check-in: [3b179247] user: dan branch: fts3-refactor, size: 24456)
2009-11-13
17:36
[8ea96192] part of check-in [30a92f11] Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). (check-in: [30a92f11] user: dan branch: fts3-refactor, size: 24391) Added