/ History for ext/fts3/fts3_snippet.c
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History for ext/fts3/fts3_snippet.c

2020-07-29
16:18
[cf7eed27] part of check-in [a80ae2c9] Dozens and dozens of typo fixes in comments. This change adds no value to the end product and is disruptive, so it is questionable whether or not it will ever land on trunk. (check-in: [a80ae2c9] user: drh branch: typos, size: 57890)
2020-05-14
23:59
[86e7e947] part of check-in [a4dd1489] Fix a null pointer deference that can occur on a strange matchinfo() query. (check-in: [a4dd1489] user: drh branch: trunk, size: 57889)
2020-01-07
09:06
[052b35ad] part of check-in [e1f12978] Fix an instance of an undefined behaviour (a left-shift of a 64-bit unsigned integer by a value greater than 64) that could occur in fts3. (check-in: [e1f12978] user: dan branch: trunk, size: 57877)
2019-11-18
14:04
[d62e40ba] part of check-in [6b67eba5] Improvements to detection of corruption in the %_stat shadow table of FTS4. (check-in: [6b67eba5] user: drh branch: trunk, size: 57872)
10:37
[bc9b1236] part of check-in [10f8a3b7] Improved detection of corruption in the %_stat table of FTS4. Chromium ticket 1025467. (check-in: [10f8a3b7] user: drh branch: trunk, size: 57915)
2019-11-17
02:41
[70e8aa4a] part of check-in [1e449687] Better detection of corruption in the %_stat and %_docsize shadow tables of FTS3. (check-in: [1e449687] user: drh branch: trunk, size: 57920)
2019-08-21
11:31
[7963dd25] part of check-in [4c01e017] Fix a broken assert() in the fts3 snippet code that was failing for queries containging more than 64 phrases. (check-in: [4c01e017] user: dan branch: trunk, size: 57279)
2019-04-13
14:17
[2f3a78b9] part of check-in [6fc0deff] Fix additional compiler warnings introduced by the previous check-in and found by MSVC. (check-in: [6fc0deff] user: drh branch: trunk, size: 57283)
14:07
[09b38ba5] part of check-in [c28c973a] Fixes for harmless compiler warnings. (check-in: [c28c973a] user: drh branch: trunk, size: 57232)
04:38
[7d3c7076] part of check-in [07ee06fd] Use the 64-bit memory allocator interfaces in extensions, whenever possible. (check-in: [07ee06fd] user: drh branch: trunk, size: 57224)
2019-02-28
13:41
[0d8362ef] part of check-in [d5250db6] Avoid an assert() failure and an undefined left-shift operation in the fts3 snippet() function that could occur if the database was corrupt. (check-in: [d5250db6] user: dan branch: trunk, size: 57165)
2019-02-23
20:48
[d002c29d] part of check-in [84162af5] Fix a couple of assert() statements in fts3 that can be false if the database is corrupt. (check-in: [84162af5] user: dan branch: trunk, size: 57149)
2019-02-03
07:46
[ac1f8945] part of check-in [560ebd42] Fix an assertion failure in fts3 triggered by a corrupt database. (check-in: [560ebd42] user: dan branch: trunk, size: 57133)
2019-01-18
19:26
[54ac8f46] part of check-in [b90dbaed] Fix problems causing undefined left-shift operations in the fts3 snippet() function. (check-in: [b90dbaed] user: dan branch: trunk, size: 57084)
2019-01-16
19:44
[17af214e] part of check-in [24ed5fb6] Fix a problem in the fts3 matchinfo() function with corrupt database handling. (check-in: [24ed5fb6] user: dan branch: trunk, size: 56849)
2019-01-12
14:58
[bea80381] part of check-in [703646b1] Fix a problem with corrupt database handling in the fts3 matchinfo() function. (check-in: [703646b1] user: dan branch: trunk, size: 56715)
2019-01-08
20:02
[3c4654a5] part of check-in [ca67f2ec] Use 64-bit math to compute the sizes of memory allocations in extensions. (check-in: [ca67f2ec] user: drh branch: trunk, size: 56573)
2015-05-26
17:29
[68ae118b] part of check-in [b05cae36] Avoid using a zero-sized array within a struct in fts3 code. (check-in: [b05cae36] user: dan branch: trunk, size: 56538)
2015-05-25
10:57
[39a018b7] part of check-in [f1e942a1] Fix an fts4 matchinf() problem triggered by deferred tokens that are part of phrases that are part of AND expressions. (check-in: [f1e942a1] user: dan branch: trunk, size: 56538)
2015-05-19
22:56
[97a16ea2] part of check-in [c7b16645] Fix the MSVC makefile so that it works with OTA. Fix a harmless compiler warning in FTS3. (check-in: [c7b16645] user: drh branch: trunk, size: 56488)
2015-05-06
17:51
[b7aaa869] part of check-in [46b2d3ce] Remove some dead code from fts3_snippet.c. (check-in: [46b2d3ce] user: dan branch: fts3-matchinfo-y, size: 56483)
17:41
[aa922977] part of check-in [8c5b9fed] More optimization for the 'y' and 'b' matchinfo directives. (check-in: [8c5b9fed] user: dan branch: fts3-matchinfo-y, size: 58035)
08:43
[e03db2f3] part of check-in [fbd038bb] Further optimizations for the 'y' and 'b' matchinfo operators. (check-in: [fbd038bb] user: dan branch: fts3-matchinfo-y, size: 56681)
2015-05-05
20:39
[2224cdfd] part of check-in [b9b77972] Add the fts3 matchinfo 'b' flag. (check-in: [b9b77972] user: dan branch: fts3-matchinfo-y, size: 56797)
19:37
[a1c62f1b] part of check-in [dddd7e18] Optimizations for the matchinfo() function, particularly the 'y' flag. (check-in: [dddd7e18] user: dan branch: fts3-matchinfo-y, size: 56074)
2015-05-02
09:44
[40a96ba7] part of check-in [92941609] Add the experimental matchinfo 'y' flag to fts3/4. (check-in: [92941609] user: dan branch: fts3-matchinfo-y, size: 53503)
2015-05-01
14:07
[0ce4ee24] part of check-in [605347e0] Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, and to ensure that error messages are not overwritten and thus leaked. (check-in: [605347e0] user: drh branch: trunk, size: 51801)
2015-03-04
20:18
[52c2dcf4] part of check-in [580dae46] Fix harmless compiler warning. (check-in: [580dae46] user: mistachkin branch: trunk, size: 51801)
2015-01-27
19:01
[f16ef642] part of check-in [adc9283d] Fix a bug in the fts3 snippet() function causing it to omit leading separator characters from snippets that begin with the first token in a column. (check-in: [adc9283d] user: dan branch: trunk, size: 51797)
18:43
[55c126e0] part of check-in [245e8730] Improve the performance of fts3/4 queries that use the OR operator and at least one auxiliary fts function. (check-in: [245e8730] user: dan branch: trunk, size: 51694)
2013-11-12
17:46
[51beb5c1] part of check-in [aa7ba302] When possible, have FTS use 32-bit operations to read varints from the database. (check-in: [aa7ba302] user: dan branch: trunk, size: 51627)
2013-08-19
18:17
[e8ee8c10] part of check-in [1c63e951] Add some extra assert() statements to silence a few clang warnings. (check-in: [1c63e951] user: dan branch: trunk, size: 51634)
2013-03-21
21:20
[5fcfcaff] part of check-in [6f6e2d50] Many spelling fixes in comments. No changes to code. (check-in: [6f6e2d50] user: mistachkin branch: trunk, size: 51571)
2012-10-17
20:28
[f6ebb353] part of check-in [b5f5ba31] Add a comment to fts3_snippet.c. (check-in: [b5f5ba31] user: dan branch: trunk, size: 51569)
20:15
[776facfe] part of check-in [514505a8] Initialize variables used as outputs of custom tokenizer method calls in fts4. (check-in: [514505a8] user: dan branch: trunk, size: 50869)
2012-05-10
17:43
[bf67520a] part of check-in [4d3e1673] Have the FTS auxiliary functions correctly handle terms that appear in non-matching branches of the FTS expression. Fix for [bdc6bbbb38]. (check-in: [4d3e1673] user: dan branch: trunk, size: 50845)
2012-03-27
15:00
[51a3a34c] part of check-in [5c447e22] Remove the fts3merge.test script in favour of changing the fts4merge.test script so that it runs tests using both fts4 and fts3. Fix some problems with incr-merge and FTS3 tables. (check-in: [5c447e22] user: dan branch: fts4-incr-merge, size: 50667)
2012-03-03
18:46
[c9e126c2] part of check-in [f8e9c445] Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. (check-in: [f8e9c445] user: dan branch: fts4-languageid, size: 50673)
2011-10-19
16:20
[1f9ee6a8] part of check-in [8a407705] Merge the fts4-content branch with the trunk. (check-in: [8a407705] user: dan branch: trunk, size: 50595)
09:40
[e1f3ed04] part of check-in [2c03b24f] Fix a problem in FTS to do with ^ tokens and the snippet() function. (check-in: [2c03b24f] user: dan branch: fts4-content, size: 50601)
2011-10-13
17:16
[19a906f8] part of check-in [7e24645b] Handle updating the only row of an FTS table correctly. Fix for [9fd058691]. (check-in: [7e24645b] user: dan branch: trunk, size: 50535)
2011-10-04
11:22
[8838a1de] part of check-in [1d27ea74] Add experimental 'content' option to FTS4. (check-in: [1d27ea74] user: dan branch: fts4-content, size: 50576)
2011-06-20
17:24
[58b2ba2b] part of check-in [fe62179e] Fix various harmless compiler warnings in FTS3 and RTREE. (check-in: [fe62179e] user: drh branch: trunk, size: 50541)
2011-06-16
00:54
[a44b38a0] part of check-in [a0b43a32] Changes to #ifdefs so that the build goes correctly if the only FTS macro defined is SQLITE_ENABLE_FTS4. (check-in: [a0b43a32] user: drh branch: trunk, size: 50537)
2011-06-08
18:39
[82e2c1e4] part of check-in [3972a787] Fix various issues to do with deferred tokens, NEAR expressions and matchinfo(). (check-in: [3972a787] user: dan branch: fts3-prefix-search, size: 50537)
2011-06-03
18:00
[0485969c] part of check-in [a4c7e282] FTS changes: Remove unreachable code. Fix bugs. When processing a large doclist incrementally, read from disk incrementally too. (check-in: [a4c7e282] user: dan branch: fts3-prefix-search, size: 51550)
2011-06-02
19:57
[10e0b099] part of check-in [28149a78] Changes to improve performance and support LIMIT clauses on fts3 tables. This branch is unstable for now. (check-in: [28149a78] user: dan branch: fts3-prefix-search, size: 53335)
2011-05-28
15:57
[6ee62601] part of check-in [84097a4c] Minor changes made while planning a larger change. (check-in: [84097a4c] user: dan branch: fts3-prefix-search, size: 54437)
2011-05-17
15:56
[92b40397] part of check-in [8844e8bf] Add extended return code SQLITE_CORRUPT_VTAB. Returned when the tcontents of the sqlite tables used internally by a virtual table module are invalid or inconsistent. (check-in: [8844e8bf] user: dan branch: trunk, size: 54427)
2011-05-04
12:52
[a4a3c7d2] part of check-in [13395121] Optimize "ORDER BY rowid/docid DESC/ASC" clauses on FTS tables. (check-in: [13395121] user: dan branch: vtab-conflict, size: 54417)
2011-03-23
17:10
[e857c6a8] part of check-in [30d42dc6] Fix a bug in fts4 to do with matchinfo and deferred tokens. (check-in: [30d42dc6] user: dan branch: trunk, size: 54344)
2011-02-01
17:55
[bfefb42b] part of check-in [4ade96ce] Fix a case in fts4 where a corrupt %_stat table could lead to a crash. (check-in: [4ade96ce] user: dan branch: fts4aux, size: 54350)
2011-01-13
10:58
[196c5e6c] part of check-in [fe904766] Fix a segfault that can occur in matchinfo if an fts4 table contains mostly zero-length documents. Specifically, if the table contains more rows than it does bytes of text. (check-in: [fe904766] user: dan branch: trunk, size: 54260)
2010-12-10
17:06
[3a26a835] part of check-in [fa37d8eb] Fix a performance regression in matchinfo(). (check-in: [fa37d8eb] user: dan branch: trunk, size: 54218)
2010-12-01
15:36
[6c87b559] part of check-in [c7771c0b] Fix some warnings under MSVC in fts3 module. (check-in: [c7771c0b] user: shaneh branch: trunk, size: 54811)
2010-11-26
16:49
[1d827175] part of check-in [c412f612] Fix various compiler warnings. (check-in: [c412f612] user: drh branch: trunk, size: 54789)
15:13
[e8a952d5] part of check-in [ad8df6c5] Add a couple of comments to fts3_snippet.c. (check-in: [ad8df6c5] user: dan branch: fts3-experimental, size: 54718)
2010-11-25
17:49
[8dc1fe91] part of check-in [70495cec] Add coverage tests (and associated fixes) for new matchinfo() code. (check-in: [70495cec] user: dan branch: fts3-experimental, size: 52035)
10:33
[d765bda6] part of check-in [ddc2b7ec] Fix bugs in fts3 function matchinfo() when used with deferred tokens. (check-in: [ddc2b7ec] user: dan branch: fts3-experimental, size: 51810)
2010-11-24
19:26
[be2648ff] part of check-in [71011a4f] Add code for the matchinfo 'longest common substring' feature. (check-in: [71011a4f] user: dan branch: fts3-experimental, size: 51622)
11:51
[967ca2d3] part of check-in [ae40b34c] Remove some unused code from fts3. Add tests to fts3matchinfo.test. (check-in: [ae40b34c] user: dan branch: fts3-experimental, size: 48383)
2010-11-23
19:16
[aa0a7608] part of check-in [9cf0f2b7] Experimental changes to fts3 function matchinfo(). (check-in: [9cf0f2b7] user: dan branch: fts3-experimental, size: 48011)
2010-10-23
19:07
[300c12b7] part of check-in [deb80eac] Fixes for the matchinfo() function related to FTS4 common token handling. (check-in: [deb80eac] user: dan branch: experimental, size: 41897)
2010-10-20
18:56
[ca60a2a4] part of check-in [d0a450ce] Updates to FTS4 to improve performance and make more accurate cost estimates for prefix terms. (check-in: [d0a450ce] user: dan branch: experimental, size: 41060)
2010-10-19
14:08
[474c11e7] part of check-in [5ae0ba44] Experimental changes to fts4 to try to selectively avoid loading very large doclists. (check-in: [5ae0ba44] user: dan branch: experimental, size: 41001)
2010-08-06
19:00
[2c4c9211] part of check-in [b8b465ed] Remove all vestiges of ctype.h from FTS3. This addresses ticket [991789d9f3136a] among other bug reports. (check-in: [b8b465ed] user: drh branch: trunk, size: 41025)
2010-03-26
17:40
[538bd27a] part of check-in [ff6ae4f0] Correctly handle strings with zero-length tokens in the FTS3 offsets() function. This is a cherrypick of [d37034f7fc]. (check-in: [ff6ae4f0] user: drh branch: branch-3.6.23, size: 41037)
2010-03-24
15:57
[bc582c38] part of check-in [d37034f7] Fix for [9861b74ab9]. Correctly handle strings with zero tokens in the fts3 offsets() function. (check-in: [d37034f7] user: dan branch: trunk, size: 41044)
2010-03-18
16:34
[ec53bd8a] part of check-in [39b34ac4] Mark internal routines as "static" in FTS3. Ticket [b1552d0fa7]. (check-in: [39b34ac4] user: drh branch: trunk, size: 40981)
2010-02-26
01:46
[9cb2e78f] part of check-in [4927c62d] Minor changes to silence some compiler warnings with MSVC. (check-in: [4927c62d] user: shaneh branch: trunk, size: 40974)
2010-02-10
05:33
[9cba9a32] part of check-in [14ab536a] Fix a segfault in fts3 that may occur if the snippet, offsets or matchinfo functions are used in a query that does not contain a MATCH clause. (check-in: [14ab536a] user: dan branch: trunk, size: 40856)
2010-02-03
19:55
[67ef70f0] part of check-in [1b6e6094] Add a new full-text search variant that tracks the total number of documents and document sizes, to make ranking search results easier. Currently called FTS4. (check-in: [1b6e6094] user: drh branch: trunk, size: 40571)
2010-01-15
17:25
[e5bce65a] part of check-in [5e9d8cca] Add coverage tests for fts3_snippet.c. Also fixes related to the same. (check-in: [5e9d8cca] user: dan branch: trunk, size: 39984)
2010-01-12
17:57
[fdc2c12e] part of check-in [dd9689b7] Update comments in fts3_snippet.c. (check-in: [dd9689b7] user: dan branch: trunk, size: 39830)
2010-01-11
12:00
[99bc7e73] part of check-in [a2b1183d] Modify snippets code to run more efficiently. And to avoid a bug relating to snippets based on full-text queries that contain duplicate terms. (check-in: [a2b1183d] user: dan branch: trunk, size: 31121)
2010-01-09
07:33
[a521f904] part of check-in [14dc46a7] Fix handling of an OOM error in the fts3 offsets() function. Fix a couple of snippet related test cases in e_fts3.test. (check-in: [14dc46a7] user: dan branch: trunk, size: 30303)
2010-01-07
10:54
[210bd2a9] part of check-in [3b5ccd26] Fixes to problems in FTS3 snippet() function found by th3 tests. (check-in: [3b5ccd26] user: dan branch: trunk, size: 29800)
2010-01-06
18:36
[f3d4bc93] part of check-in [c7e5966e] Fix a segfault that can occur following an OOM in the FTS3 snippet() function (check-in: [c7e5966e] user: dan branch: trunk, size: 29493)
17:19
[612b3ad6] part of check-in [8a208223] Change the fts3 snippet function to return (hopefully) more relevant snippets in less time. (check-in: [8a208223] user: dan branch: trunk, size: 29439)
2010-01-05
14:18
[0e38f76c] part of check-in [4ecb4725] Removed compiler warnings in MSVC. (check-in: [4ecb4725] user: shaneh branch: trunk, size: 41114)
2010-01-02
19:02
[a11d9f29] part of check-in [51f7ee84] Add experimental implementation of FTS3 functions matchinfo() and snippet() (not enabled by default). (check-in: [51f7ee84] user: dan branch: trunk, size: 41103)
2009-12-03
06:26
[6c2eb6d8] part of check-in [37495b55] Updates to FTS3 to correct compiler warnings under MSVC. (check-in: [37495b55] user: shaneh branch: trunk, size: 23247)
2009-12-01
13:57
[84ba2fad] part of check-in [58113932] Changes to the TCL interface header to allow it to be compiled independently from the amalgamation. (check-in: [58113932] user: drh branch: trunk, size: 23221)
2009-11-30
19:48
[39cf30a7] part of check-in [6d112bfd] Test coverage improvements in the FTS3 porter stemmer. (check-in: [6d112bfd] user: drh branch: trunk, size: 22975)
2009-11-28
21:33
[b62144ea] part of check-in [b939a37a] Updates to snippet() and offsets() functions of FTS3 so that they work sanely following an OOM fault. (check-in: [b939a37a] user: drh branch: trunk, size: 22967)
2009-11-19
15:25
[082f2906] part of check-in [3b179247] Fix some fts3 related issues with the autoconf and amalgamation build systems. (check-in: [3b179247] user: dan branch: fts3-refactor, size: 24456)
2009-11-13
17:36
[8ea96192] part of check-in [30a92f11] Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). (check-in: [30a92f11] user: dan branch: fts3-refactor, size: 24391) Added