SQLite

All files named ”ext/fts5/fts5_aux.c”
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

History for ext/fts5/fts5_aux.c

2025-02-27
21:17
[da4a7a9a11] part of check-in [f50c21484d] Approximately 100 typo corrections spanning the whole tree, submitted via forum post 0db9827f0464bc33 and individually audited and verified. Affects only code comments, innocuous test strings, error message text in tool (not library) code, and configure-level help text. (check-in: [f50c21484d] user: stephan branch: trunk, size: 27053)
2024-08-23
15:18
[65a0468dd1] part of check-in [396f720f36] Add fts5 auxiliary function fts5_get_locale(). For querying the locale of a stored value. (check-in: [396f720f36] user: dan branch: trunk, size: 27053)
2024-08-12
17:03
[12cd2512f8] part of check-in [e626123580] Fix further issues to do with fts5 locale support. (check-in: [e626123580] user: dan branch: fts5-locale, size: 25605)
11:13
[0d0ee62dfe] part of check-in [f7d56a1f21] Update the auxiliary function API to include xTokenize_x2() instead of xSetLocale(). (check-in: [f7d56a1f21] user: dan branch: fts5-locale, size: 25445)
2024-07-31
20:49
[598c80fc0f] part of check-in [8bd4ae7e95] Fix various problems with the code on this branch. (check-in: [8bd4ae7e95] user: dan branch: fts5-locale, size: 25678)
2024-07-30
15:55
[652f839dc0] part of check-in [569ae56a67] Update the highlight() and snippet() functions to use locales when available. (check-in: [569ae56a67] user: dan branch: fts5-locale, size: 25601)
2023-12-26
15:52
[4584e88878] part of check-in [1a8a9b1c89] Ensure that the xColumnText(), xQueryPhrase() and xPhraseFirstColumn() APIs all return SQLITE_RANGE if they are passed a bad column or phrase number. (check-in: [1a8a9b1c89] user: dan branch: trunk, size: 24882)
2023-11-03
17:20
[ee770eec0a] part of check-in [8f5e9c192f] Fix a case where adjacent tokens are handled incorrectly by the fts5 snippet() function. (check-in: [8f5e9c192f] user: dan branch: trunk, size: 24777)
2023-10-24
15:53
[35c4101613] part of check-in [d570aa02f7] Fix a problem with the fts5 highlight() and snippet() functions when used with tokenizers like "trigram" that output overlapping tokens. Forum post 63735293ec. (check-in: [d570aa02f7] user: dan branch: fts5-trigram-snippet-fix, size: 24517)
2023-03-10
13:36
[572d5ec92b] part of check-in [96d5116d17] Fix a problem with the fts5 snippet() function that shows up when snippets just 1 token in length are requested. (check-in: [96d5116d17] user: dan branch: trunk, size: 23708)
2020-11-27
19:40
[f558e1fb9f] part of check-in [8edb983bc8] Fix a compiler warning in fts5_aux.c. (check-in: [8edb983bc8] user: dan branch: trunk, size: 23659)
16:15
[7dc0cda24b] part of check-in [6ff9673847] Add missing cast to fts5 bm25() code. (check-in: [6ff9673847] user: dan branch: trunk, size: 23659)
16:08
[e6dbf53bfe] part of check-in [d85f4f27f5] Remove a redundant "if( rc==SQLITE_OK )" from the fts5 bm25() code. (check-in: [d85f4f27f5] user: dan branch: trunk, size: 23644)
16:05
[90483e4020] part of check-in [14a4dcf347] Move an "if( rc==SQLITE_OK )" to outside a loop body in the fts5 bm25() code. (check-in: [14a4dcf347] user: dan branch: trunk, size: 23712)
2020-07-29
16:18
[e71a8731ad] part of check-in [a80ae2c98b] Dozens and dozens of typo fixes in comments. This change adds no value to the end product and is disruptive, so it is questionable whether or not it will ever land on trunk. (check-in: [a80ae2c98b] user: drh branch: typos, size: 23686)
2019-03-20
05:45
[dcc627d8b6] part of check-in [1c0fe5b576] Fix various harmless compiler warnings seen with MSVC. (check-in: [1c0fe5b576] user: mistachkin branch: noWarnings, size: 23686)
2019-01-29
16:34
[afe8c2394c] part of check-in [7c862c4655] Avoid an integer overflow in the fts5 snippet() function triggered by a corrupt database record. (check-in: [7c862c4655] user: dan branch: trunk, size: 23673)
2019-01-25
16:54
[8284d25ca8] part of check-in [93f8ec146d] Fix asan warnings in fts5 triggered by corrupt databases - passing NULL to memcmp, out-of-range left-shift values and signed integer overflow. (check-in: [93f8ec146d] user: dan branch: trunk, size: 23607)
2019-01-19
15:55
[c93e943a17] part of check-in [928e622178] Avoid a division-by-zero error in fts5 caused by a corrupt database. (check-in: [928e622178] user: dan branch: trunk, size: 23553)
2019-01-15
18:14
[4353df5d71] part of check-in [a5e9cc794f] Handle SQL NULL values without crashing in the fts5 snippet() and highlight() functions. (check-in: [a5e9cc794f] user: dan branch: trunk, size: 23514)
2019-01-08
20:02
[859b63b248] part of check-in [ca67f2ec0e] Use 64-bit math to compute the sizes of memory allocations in extensions. (check-in: [ca67f2ec0e] user: drh branch: trunk, size: 23509)
2017-12-26
14:32
[ca666a3bbe] part of check-in [6a790b67a0] Fix crashes that could occur if SQL NULL values were passed to the built-in FTS5 snippet function. Edit: breaks amalgamation builds. (check-in: [6a790b67a0] user: dan branch: trunk, size: 23507)
14:11
[9a6d07db9a] part of check-in [553a3ad324] Fix crashes that could occur if SQL NULL values were passed to the built-in FTS5 snippet function. Edit: breaks amalgamation builds. (check-in: [553a3ad324] user: dan branch: mistake, size: 23491)
2016-10-05
20:14
[67acf8d517] part of check-in [b066637bb7] Fix some compiler warnings in fts5. (check-in: [b066637bb7] user: dan branch: trunk, size: 23217)
2016-08-24
18:50
[2f20784a34] part of check-in [b174ed2bde] Fix a bug in the fts5 snippet function causing it to return text containing zero phrase instances. (check-in: [b174ed2bde] user: dan branch: fts5-snippet-bias, size: 23182)
2016-08-20
17:23
[13246759ce] part of check-in [b56b2a85cf] Fix other minor problems with the fts5 snippet() function. (check-in: [b56b2a85cf] user: dan branch: fts5-snippet-bias, size: 23168)
2016-08-19
14:25
[26a2b7e5f0] part of check-in [d8180af2ad] Have the fts5 snippet() function avoid favouring snippets that begin with sentences that do not contain search terms. Add an extra bias in favour of the first sentence in the document. (check-in: [d8180af2ad] user: dan branch: fts5-snippet-bias, size: 23052)
2016-08-17
19:05
[5921bbef4c] part of check-in [60de159476] Bias the fts5 snippet() function to return snippets that look like they start at the start of sentences. (check-in: [60de159476] user: dan branch: fts5-snippet-bias, size: 22869)
11:14
[e4bec077c5] part of check-in [a861713cc6] Fix a problem in the fts5 snippet() auxiliary function. (check-in: [a861713cc6] user: dan branch: trunk, size: 18961)
2016-02-11
17:01
[daa57fb452] part of check-in [bc3f7900d5] Handle parser stack overflow when parsing fts5 query expressions. Fix some compiler warnings in fts5 code. (check-in: [bc3f7900d5] user: dan branch: trunk, size: 18671)
2016-01-23
18:51
[b9bcce753e] part of check-in [72d53699bf] Fix an fts5 problem with using both xPhraseFirst() and xPhraseFirstColumn() within a single statement in detail=col mode. (check-in: [72d53699bf] user: dan branch: fts5-perf, size: 18608)
2015-12-23
16:42
[2dafc3aee0] part of check-in [5d44d4a6cf] Fix some harmless gcc compiler warnings. Mostly in fts5, but also two in the core code. (check-in: [5d44d4a6cf] user: dan branch: trunk, size: 18613)
2015-10-14
20:34
[1f384972d6] part of check-in [1c46c194a2] Fix harmless compiler warnings. (check-in: [1c46c194a2] user: mistachkin branch: trunk, size: 18625)
2015-10-08
20:28
[b09aa27dcd] part of check-in [5343e601fb] Fix two more warnings in fts5 code. (check-in: [5343e601fb] user: dan branch: amalg-json1-fts5, size: 18620)
2015-08-29
15:44
[7a307760a9] part of check-in [fc71868496] Another change to the fts5 tokenizer API. (check-in: [fc71868496] user: dan branch: fts5-incompatible, size: 18580)
2015-08-28
19:56
[7d0e275ee9] part of check-in [90b85b42f2] Change the fts5 tokenizer API to allow more than one token to occupy a single position within a document. (check-in: [90b85b42f2] user: dan branch: fts5-incompatible, size: 18495)
2015-07-14
17:18
[044cb176a8] part of check-in [3de030c904] Fix some harmless compiler warnings. (check-in: [3de030c904] user: mistachkin branch: trunk, size: 18448)
2015-07-02
15:52
[7cd0e28581] part of check-in [7819002ed8] Remove "#ifdef SQLITE_ENABLE_FTS5" from individual fts5 source files. Add a single "#if !defined(SQLITE_CORE) || defined(SQLITE_ENABLE_FTS5)" to fts5.c. (check-in: [7819002ed8] user: dan branch: trunk, size: 18448)
2015-04-29
20:54
[d53f00f31a] part of check-in [c1f07a3aa9] Improve fts5 tests. (check-in: [c1f07a3aa9] user: dan branch: fts5, size: 18506)
2015-03-07
11:50
[fcea18b1a2] part of check-in [3ee7b5a9f9] Fix the bm25() function so that it multiplies scores by -1 before returning them. This means better matches have a lower numerical score, so "ORDER BY rank" (not "ORDER BY rank DESC") does what you want. (check-in: [3ee7b5a9f9] user: dan branch: fts5, size: 18492)
2015-03-04
08:29
[c64e56b08c] part of check-in [a5d5468c05] Fix a couple of build problems. (check-in: [a5d5468c05] user: dan branch: fts5, size: 18485)
2015-01-06
19:08
[549aef152b] part of check-in [65f0262fb8] Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer. (check-in: [65f0262fb8] user: dan branch: fts5, size: 18426)
2015-01-05
20:41
[a74523025a] part of check-in [047aaf830d] Tests and fixes for fts5 external content tables. (check-in: [047aaf830d] user: dan branch: fts5, size: 18548)
2014-12-23
19:18
[445e54031f] part of check-in [1ac7a8d0af] Fix the fts5 bm25() function so that it matches the documentation. (check-in: [1ac7a8d0af] user: dan branch: fts5, size: 18482)
2014-12-22
21:01
[6200a3f6d1] part of check-in [ca5d44042a] Fixes and simplifications for the snippet() and highlight() functions. (check-in: [ca5d44042a] user: dan branch: fts5, size: 21422)
2014-12-19
20:53
[b8e5660a05] part of check-in [67e3ffd950] Remove the fts5_test() aux function. Test aux functions using the tcl interface instead. (check-in: [67e3ffd950] user: dan branch: fts5, size: 26925)
2014-11-27
20:03
[0e3e5fea6b] part of check-in [83491c5666] Add a %_config table to fts5. (check-in: [83491c5666] user: dan branch: fts5, size: 35448)
2014-11-24
16:24
[2e467bdd93] part of check-in [059092379f] Add the auxiliary highlight() function to fts5. (check-in: [059092379f] user: dan branch: fts5, size: 35170)
2014-11-15
20:07
[6b0612e431] part of check-in [fba0b5fc7e] Fix the customization interfaces so that they match the documentation. (check-in: [fba0b5fc7e] user: dan branch: fts5, size: 30271)
2014-08-06
16:30
[31e581413e] part of check-in [3b19eba042] Add support for savepoints to fts5. (check-in: [3b19eba042] user: dan branch: fts5, size: 30279)
2014-07-31
11:57
[366057c718] part of check-in [37a417d27e] Add further tests for the extension APIs with "ORDER BY rank" queries. (check-in: [37a417d27e] user: dan branch: fts5, size: 30099)
2014-07-30
19:41
[3cae4225d4] part of check-in [4cc048c365] Add hidden column "rank". Currently this always returns the same value as the bm25() function. (check-in: [4cc048c365] user: dan branch: fts5, size: 30096)
2014-07-28
20:14
[243156c197] part of check-in [770b9540c1] Add the "loadfts" program, for performance testing the loading of data into fts3/fts4/fts5 tables. (check-in: [770b9540c1] user: dan branch: fts5, size: 30096)
2014-07-26
18:38
[78adc5db0f] part of check-in [71d32f53e8] Add tests and fixes for bm25() function. (check-in: [71d32f53e8] user: dan branch: fts5, size: 30210)
2014-07-25
20:30
[f8bed7a86b] part of check-in [c4d50428ab] Add extension apis xRowCount, xQueryPhrase, xSetAuxdata and xGetAuxdata. And a ranking function that uses all of the above. (check-in: [c4d50428ab] user: dan branch: fts5, size: 26342)
2014-07-23
19:31
[cba929fb13] part of check-in [bdc58fd28a] Add a snippet() function to fts5. (check-in: [bdc58fd28a] user: dan branch: fts5, size: 20455)
2014-07-21
14:22
[1496113523] part of check-in [8c6b0aff34] Add the xTokenize extension API. (check-in: [8c6b0aff34] user: dan branch: fts5, size: 8017)
11:44
[9f0487715c] part of check-in [19504c4108] Fix the xColumnSize() extension API. (check-in: [19504c4108] user: dan branch: fts5, size: 6497)
2014-07-19
20:27
[75f9abf7a7] part of check-in [1e9053abda] Add simple tests for the xColumnText() extension api. (check-in: [1e9053abda] user: dan branch: fts5, size: 6006)
15:35
[978a90fe90] part of check-in [43fcb84472] Fixes for the xColumnSize() fts5 extension API. (check-in: [43fcb84472] user: dan branch: fts5, size: 5615)
2014-07-16
20:07
[27b082732f] part of check-in [c1f9a4b76c] Fixes for tcl list generation in fts5_test(). (check-in: [c1f9a4b76c] user: dan branch: fts5, size: 5135)
19:15
Added: [53ab338c6a] part of check-in [1e2a7ba088] Begin adding interface for auxiliary functions. (check-in: [1e2a7ba088] user: dan branch: fts5, size: 4590)