Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
119 check-ins using file ext/fts5/fts5_tokenize.c version 30f97a8c74
|
2015-08-21
| ||
| 14:21 | Add extra tests and a fix for rollbacks of UNLOCKED transactions. (check-in: 82cd837e72 user: dan tags: begin-concurrent) | |
|
2015-08-20
| ||
| 20:25 | Fix a problem causing corruption when an UNLOCKED transaction is rolled back. (check-in: 7c36147846 user: dan tags: begin-concurrent) | |
|
2015-08-19
| ||
| 20:27 | When committing an unlocked transaction, relocate newly allocated database pages within the file to avoid conflicting with committed transactions. There are lots of things still to fix in this code. (check-in: 3bbc31d515 user: dan tags: begin-concurrent) | |
|
2015-08-15
| ||
| 18:16 | Handle writes to auto-vacuum databases within UNLOCKED transactions in the same way as for non-UNLOCKED transactions. (check-in: de1ea450db user: dan tags: begin-concurrent) | |
|
2015-07-30
| ||
| 20:26 | Add the --rbu switch to the "sqldiff" utility. (check-in: 098bea26da user: dan tags: trunk) | |
| 11:38 | Allow RBU tables to be named "data[0-9]*_<target>" instead of strictly "data_<target>". Also update RBU so that it always processes data tables in order sorted by name. (check-in: 287aa30601 user: dan tags: trunk) | |
| 11:26 | Return an error message (instead of segfaulting) if test function fts5_expr() is invoked with no arguments. (check-in: 8e818b8985 user: dan tags: trunk) | |
|
2015-07-29
| ||
| 22:38 | Support building VSIX packages for UAP using Visual Studio 2015 and the Windows 10 SDK. (check-in: 96559adbf1 user: mistachkin tags: trunk) | |
| 22:37 | Update Windows 10 SDK version for RTM. (Closed-Leaf check-in: 80ab338cc6 user: mistachkin tags: msvc2015) | |
| 21:47 | Add SQLITE_DISABLE_INTRINSIC define to disable use of intrinsic functions (e.g. for certain older compilers and/or platforms). (check-in: f0075d735a user: mistachkin tags: trunk) | |
| 20:24 | Fix the releasetest.tcl script so that it ignore cast overflow errors that recent versions of clang generate but which are unavoidable given the test input. (check-in: a0020c5785 user: drh tags: trunk) | |
| 20:00 | Version 3.8.11.1 (check-in: cf538e2783 user: drh tags: trunk, release, version-3.8.11.1) | |
| 15:22 | Restore an undocumented side-effect of PRAGMA cache_size: it forces the database schema to be parsed. Also increase the version number to 3.8.11.1. (check-in: e4628de3ce user: drh tags: trunk) | |
| 14:58 | Update comments in fts5.h describing the xColumnCount() API function. (check-in: a623eb55d1 user: dan tags: trunk) | |
| 14:46 | Increase the version number to 3.8.11.1 (Closed-Leaf check-in: 326d746dee user: drh tags: branch-3.8.11) | |
| 14:10 | The "PRAGMA cache_size" reads the database schema, as it has done in all prior versions of SQLite. This side-effect of cache_size is undocumented, but apparently it does get used and its absence from 3.8.11 was causing problems. (check-in: 4489722a6b user: drh tags: branch-3.8.11) | |
| 12:14 | Only allow UNLOCKED transactions to commit if none of the pages read by the transaction have been modified since it was opened. (check-in: 0b9718426e user: dan tags: begin-concurrent) | |
|
2015-07-28
| ||
| 19:35 | Update batch build tool library paths for MSVC 2015. (check-in: d431d4e11a user: mistachkin tags: msvc2015) | |
| 18:53 | Fix the xfer optimization for WITHOUT ROWID tables so that it correctly updates the change count returned by sqlite3_changes(). (check-in: eff43715d1 user: drh tags: trunk) | |
| 16:46 | Add some test cases and fix some small problems with BEGIN UNLOCKED transactions. (check-in: 6da0e962ad user: dan tags: begin-concurrent) | |
|
2015-07-27
| ||
| 19:57 | Clarification to the documentation for sqlite3_result_zeroblob64(). No changes to code. (check-in: c98175e900 user: drh tags: trunk) | |
| 19:31 | Add an experimental "BEGIN UNLOCKED" command. (check-in: 8079421604 user: dan tags: begin-concurrent) | |
| 13:49 | Version 3.8.11 (check-in: b8e92227a4 user: drh tags: trunk, release, version-3.8.11) | |
| 12:19 | Merge the fts5-btree-index branch with this one. FTS5 changes only. (check-in: 9f1dcdc3e1 user: dan tags: trunk) | |
| 11:49 | Bump the "version" field in the fts5 config table. (Closed-Leaf check-in: 92c9178933 user: dan tags: fts5-btree-index) | |
| 11:43 | Minor tweak to the SQL schema used by fts5. (check-in: 427bf09ba4 user: dan tags: fts5-btree-index) | |
| 11:01 | Remove a potentially undefined behaviour involving signed integers and bitshift operations from fts5_hash.c. (check-in: ad6286ab1f user: dan tags: fts5-btree-index) | |
| 10:46 | Merge latest trunk changes with this branch. (check-in: 5ec933c257 user: dan tags: fts5-btree-index) | |
|
2015-07-25
| ||
| 19:26 | Remove a duplicated "if" condition from fts3.c. (check-in: ee348b1275 user: dan tags: trunk) | |
| 14:26 | Fix the rowallock.test script so that it works with builds that do not support mmap mode. (check-in: 7efed5786b user: dan tags: trunk) | |
| 14:12 | Fix the wal3.test module so that it works with the memsubsys1 permutation. (check-in: af85b01d93 user: drh tags: trunk) | |
| 12:03 | Fix a test script problem in memsubsys2.test. (check-in: 70885729b7 user: dan tags: trunk) | |
| 03:10 | Disable the page cache bulk allocation for the shrink.test and wal.test modules. (check-in: 3418f1f165 user: drh tags: trunk) | |
|
2015-07-24
| ||
| 23:28 | Fix the zeroblob.test script so that it works even on builds where the SQLITE_MAX_LENGTH has been raised to 2147483645. (check-in: db12914981 user: drh tags: trunk) | |
| 22:21 | Merge test improvements and minor fixes from trunk. (check-in: 0298a9a780 user: drh tags: sessions) | |
| 21:19 | Enable the RBU extension to compile cleanly on Windows using MSVC. (check-in: cca79fdc3d user: mistachkin tags: trunk) | |
| 20:43 | For Windows CE, a different header is required for the byteswap intrinsics. (check-in: 2d572b8cdc user: mistachkin tags: trunk) | |
| 20:34 | Fix warnings in fts5 code. (check-in: bd4f156d07 user: dan tags: trunk) | |
| 19:56 | Fix the pragma2.test module so that it works with SQLITE_ENABLE_MEMORY_MANAGEMENT. (check-in: de281a4fac user: drh tags: trunk) | |
| 18:58 | Allow the RBU module to read data from appropriately named SQL views created within the RBU database. (check-in: 45c6a760ca user: dan tags: trunk) | |
| 18:22 | Fix a test script bug introduced by [562687d9]. (check-in: a343745d99 user: dan tags: trunk) | |
| 17:36 | Add the sqlite3_bind_zeroblob64() API. (check-in: 1997ee548b user: dan tags: trunk) | |
| 17:26 | New makefile target "fastfuzztest" runs the same tests as "fuzztest" but with a 100M memory size limit. This more than doubles the speed. The original unlimited "fuzztest" is still run on a "fulltest". (check-in: cfeb1b1c29 user: drh tags: trunk) | |
| 17:14 | Fix compiler warnings. Get the new sqlite3_result_zeroblob64() working on loadable extensions. (check-in: f8991e6f72 user: drh tags: trunk) | |
| 16:24 | Add the sqlite3_result_zeroblob64() API. Use it in the SQL zeroblob() function. (check-in: c6445b9fb4 user: dan tags: trunk) | |
| 15:49 | More robust handling of zeroblob() with oversized arguments. Fix fuzzcheck so that it can be run with limited heap memory. (check-in: 4e3e516a42 user: drh tags: trunk) | |
| 14:17 | Modify a few test scripts to avoid leaving the sqlite3Config structure in a non-default state. (check-in: 562687d9f5 user: dan tags: trunk) | |
| 00:02 | Update RBU description comment in the header file. No changes to code. (check-in: 119883a21b user: mistachkin tags: trunk) | |
|
2015-07-23
| ||
| 21:59 | Merge all changes in the latest 3.8.11 beta into the sessions branch. Changes include the rename of OTA to RBU, the WITHOUT-ROWID-OR-Skipscan fix, and improvements to pcache1. (check-in: 7f0ee77062 user: drh tags: sessions) | |
| 20:44 | Change the name of the OTA extension to RBU: Resumable Bulk Update. (check-in: 017c5019e1 user: drh tags: trunk) | |
| 17:16 | When SQLITE_OMIT_LOOKASIDE is set, do not allocate any lookaside memory since it will never be used. (check-in: 0ffd499f23 user: drh tags: trunk) | |
| 16:39 | The sqlite3ExprCodeGetColumn() is not guaranteed to put the result in the register requested. Fix the skip-scan code generator for WITHOUT ROWID tables so that it always checks the register and copies the result if it lands in the wrong register. Fix for ticket [8fd39115d8f46ece70e7d4b3]. (check-in: 793e206f90 user: drh tags: trunk) | |
|
2015-07-21
| ||
| 19:22 | Fix harmless compiler warning in MSVC 2015. (check-in: 01c8b9ccfa user: mistachkin tags: trunk) | |
|
2015-07-19
| ||
| 19:53 | Cleanup the 'config.h' file in the appropriate distclean targets. (check-in: e0a9978077 user: mistachkin tags: trunk) | |
|
2015-07-17
| ||
| 12:42 | More adjustments to the malloc5.test module so that it works correctly with the new pcache1 bulk allocation. (check-in: 2a7b3a440f user: drh tags: trunk) | |
| 01:16 | Avoid a harmless compiler warning. (check-in: 2288842b8f user: drh tags: trunk) | |
|
2015-07-16
| ||
| 20:24 | Merge trunk changes, including fixes for compiler warnings in fts5 code, with this branch. (check-in: 7190d79ba4 user: dan tags: fts5-btree-index) | |
| 20:17 | Fix compiler warnings in fts5 code. (check-in: e9bf275cd9 user: dan tags: trunk) | |
| 18:37 | Fix harmless compiler warnings. (check-in: 9a592cf91c user: drh tags: trunk) | |
| 18:18 | Defer the bulk pcache1 memory allocation until the first page allocation request. Limit the size of the pcache1 bulk allocation to the cache_size setting. Deallocate the bulk allocation on a sqlite3_db_release_memory() request, if the bulk allocation is completely unused. (check-in: b79a4affe4 user: drh tags: trunk) | |
| 17:29 | Fix compilation issues with SQLITE_OMIT_COMPOUND_SELECT defined. (check-in: 9c39d46445 user: mistachkin tags: trunk) | |
|
2015-07-15
| ||
| 23:15 | Enable memory-mapped I/O on FreeBSD and DragonFly. (check-in: 2cdd647951 user: drh tags: trunk) | |
| 21:00 | Make the debugging line numbers in the amalgamation more accurate. (check-in: 3b34e95ca8 user: mistachkin tags: trunk) | |
| 19:46 | Use a WITHOUT ROWID table to index fts5 btree leaves. This is faster to query and only slightly larger than storing btree nodes within an intkey table. (check-in: 862418e350 user: dan tags: fts5-btree-index) | |
| 18:35 | Fix some harmless compiler warnings. (check-in: 110cd84f5e user: drh tags: trunk) | |
| 18:04 | Attempt to fix harmless warnings generated by GCC and Clang runtime analyzers. (check-in: b522c95ddc user: drh tags: trunk) | |
| 13:56 | Fix the fuzz3.test script so that it works with the new bulk pagecache allocation feature. (check-in: 829a2dbaf1 user: drh tags: trunk) | |
|
2015-07-14
| ||
| 22:43 | Amplify the comment on renderLogMsg() that explains the problems associated with calling sqlite3_log() from deep within the memory allocator. (check-in: a73d7128fb user: drh tags: trunk) | |
| 21:56 | Further refine FTS5 cleanup in Makefiles. (check-in: b53a95063c user: mistachkin tags: trunk) | |
| 21:56 | Skip trying to include 'intrin.h' when compiling for WinCE with MSVC. (check-in: 6db90ca2b4 user: mistachkin tags: trunk) | |
| 17:18 | Fix some harmless compiler warnings. (check-in: 3de030c904 user: mistachkin tags: trunk) | |
| 15:39 | Merge trunk changes, including the addition of FTS5 and pcache1 performance enhancements. (check-in: db4cbefb86 user: drh tags: sessions) | |
| 14:48 | Always invoke the profile callback even if the statement does not run to completion. (check-in: 202479aa0a user: drh tags: trunk) | |
| 00:36 | Refine cleaning of FTS5 files by Makefile targets. (check-in: e548d77b3c user: mistachkin tags: trunk) | |
|
2015-07-13
| ||
| 23:55 | Fix the origination date on the loadfts.c utility program. (check-in: 5c76c062c0 user: drh tags: trunk) | |
| 18:01 | Fix the header comment on the loadfts.c utility program. (check-in: 955ad4ae19 user: drh tags: trunk) | |
|
2015-07-10
| ||
| 17:55 | Fix inconsistencies in formatting of fts5 docs. (check-in: 5fb4c77163 user: dan tags: trunk) | |
|
2015-07-09
| ||
| 20:46 | Improve the performance of docid merges in fts5. (check-in: b2de77a01c user: dan tags: trunk) | |
| 19:02 | Reduce the number of calls to malloc() made by fts5. (check-in: 898618ccf6 user: dan tags: trunk) | |
|
2015-07-08
| ||
| 17:59 | Fix two problems that could cause fts3 auxiliary functions to occasionally misbehave if used with match expressions that contain both OR and NEAR. (check-in: 372c1db247 user: dan tags: trunk) | |
| 16:22 | Enhance the pcache1 page cache so that it tries to allocate a block of SQLITE_DEFAULT_PCACHE_INITSZ pages from malloc() on startup, and uses those preallocated pages when possible rather than going to malloc() for each individual page. About a 5% performance increase for some workloads. (check-in: 5348ffc3fd user: drh tags: trunk) | |
| 14:13 | Comment fix. No changes to code. (Closed-Leaf check-in: c1e2ed0ef4 user: drh tags: pcache-bulk-local) | |
| 13:40 | Do not do the bulk pcache1 allocations if SQLITE_CONFIG_PAGECACHE specifies a global page cache buffer. (check-in: 75d98dae67 user: drh tags: pcache-bulk-local) | |
| 12:25 | Early detection of file corruption in a debugging routine, before the invalid data can cause problems. (check-in: b27a47fef9 user: drh tags: trunk) | |
| 01:22 | Avoid left-shifting bits into the sign of a signed integer, as such behavior is technically undefined. (check-in: 9417b4021b user: drh tags: pcache-bulk-local) | |
|
2015-07-07
| ||
| 21:14 | Add a compile-time constant for configuring the default pagecache setup. (check-in: ad5fdfbac8 user: drh tags: pcache-bulk-local) | |
| 19:35 | Merge the Fts5MultiSegIter and Fts5IndexIter objects. (check-in: 6ace73541a user: dan tags: trunk) | |
| 19:07 | Add a test case to verify that "PRAGMA data_version" works as expected when an OTA client writes to the database. (check-in: 6441f2dc9e user: dan tags: trunk) | |
| 15:14 | No need to test sqlite3GlobalConfig.bCoreMutex when SQLITE_THREADSAFE==0. (check-in: 26db0fee06 user: drh tags: pcache-bulk-local) | |
| 14:06 | Simplify the page recycling condition in pcache1. Fix test cases to work with the latest changes. (check-in: 5b60df5503 user: drh tags: pcache-bulk-local) | |
| 08:29 | Further optimizations for fts5 b-tree seeks. (check-in: f37899686c user: dan tags: trunk) | |
|
2015-07-06
| ||
| 20:57 | A unified cache is now only used for SQLITE_ENABLE_MEMORY_MANAGEMENT, or if SQLITE_CONFIG_PAGECACHE defines a shared start-time page cache buffer and the application is single-threaded. (check-in: d5ff1d6905 user: drh tags: pcache-bulk-local) | |
| 20:27 | Speed up seek operations on fts5 b-tree structures. (check-in: 7b7da1eb43 user: dan tags: trunk) | |
| 18:54 | Enhance separate pcache1 to allocate a block of pages from heap on startup, if possible, for a 5.2% performance improvement. (check-in: aa7341c873 user: drh tags: pcache-bulk-local) | |
|
2015-07-05
| ||
| 22:15 | Do not allow recursive CTEs that use aggregate queries in the recursive part. (check-in: 6d2999afbc user: drh tags: trunk) | |
|
2015-07-04
| ||
| 18:44 | Optimize seek operations on fts5 b-trees. (check-in: 8cf02090ce user: dan tags: trunk) | |
| 18:15 | Preserve the number of requested PAGECACHE pages even if the memory pointer or size is zero. Enhance the pcache1.c header comment to explain the memory layout of a page cache line. (check-in: dacb2a615c user: drh tags: trunk) | |
| 15:35 | Fix a problem in the fts5 integrity-check. (check-in: 4e473559c9 user: dan tags: trunk) | |
| 11:14 | Do not preserve the btreeInitPage() results in PRAGMA integrity_check if there were cell sizing errors because PRAGMA cell_size_check was turned off during the btreeInitPage() call. (check-in: 743bf1f184 user: drh tags: trunk) | |
| 00:04 | Sync up Makefile clean targets for FTS5. (check-in: 43ead44ef6 user: mistachkin tags: trunk) | |
|
2015-07-03
| ||
| 23:29 | Correction to check-in [1025873fdf], tighten up the number of static test mutexes. (check-in: 4e515897af user: mistachkin tags: trunk) | |
| 23:12 | Update clean target in MSVC makefile. (check-in: e6c03e7201 user: mistachkin tags: trunk) | |
| 23:11 | Enhance mutex testing to include APP and VFS static mutexes. (check-in: 1025873fdf user: mistachkin tags: trunk) | |
| 21:38 | Add static mutexes for use by the built-in / third-party VFSs and use the built-in VFS mutex where appropriate. (check-in: b202e2a1d7 user: mistachkin tags: trunk) | |
| 20:47 | Rework the Fts5MultiSegIter structure a bit to make it more efficient. (check-in: 0778825d0e user: dan tags: trunk) | |
| 19:13 | Speed up eof checks on fts5 cursors. (check-in: 3df4af5d8c user: dan tags: trunk) | |
| 17:54 | Enable use of the __builtin_bswap32() only with GCC 4.3 and higher. (check-in: 030f60a7ba user: mistachkin tags: trunk) | |
| 17:14 | Avoid freeing the array of instance matches each time the fts5 xNext() method is called. (check-in: b9b0c1e50d user: dan tags: trunk) | |
| 14:34 | New command-line options for speedtest1: --multithread, --nomemstat, --serialized, and --singlethread (check-in: 2b7567229e user: drh tags: trunk) | |
|
2015-07-02
| ||
| 20:12 | Copy fts5.h into the build directory as part of building fts5.c. Also remove code to edit fts5parse.c from various Makefiles and add it to mkfts5c.tcl. (check-in: 4d8f03dc7b user: dan tags: trunk) | |
| 19:47 | When doing coverage analysis of a btree page for pragma integrity_check, make the first entry (that covers the header, cell index, and gap) implied, for a performance boost and size reduction. (check-in: e53d497c2d user: drh tags: trunk) | |
| 18:52 | Minor change to mkfts5c.tcl so that fts5.c can be used according to the instructions in loadext.html. (check-in: edbcccd349 user: dan tags: trunk) | |
| 18:47 | Merge in the latest enhancements from trunks, especially the use of _byteswap_ulong() and similar intrinsics on MSVC. (check-in: 85ca4409bd user: drh tags: sessions) | |
| 18:16 | Add fts5_source_id() SQL function, similar to sqlite_source_id(). (check-in: ec2573487c user: dan tags: trunk) | |
| 16:52 | Fix harmless compiler warnings and one macro VVA_ONLY macro usage issue. (check-in: bcc8a75509 user: mistachkin tags: trunk) | |
| 16:50 | Simplify FTS5 handling in the MSVC makefile. (check-in: f022e04343 user: mistachkin tags: trunk) | |
| 16:29 | Fix a (harmless) shadowed local variable definition in the integrity_check logic. (check-in: 3a26a919fd user: drh tags: trunk) | |
| 16:17 | Smaller and faster PRAGMA integrity_check that also does a better job of detecting errors. Some output text describing discovered file corruption has changed for clarity. (check-in: 251a7590ff user: drh tags: trunk) | |
| 15:52 | Remove "#ifdef SQLITE_ENABLE_FTS5" from individual fts5 source files. Add a single "#if !defined(SQLITE_CORE) || defined(SQLITE_ENABLE_FTS5)" to fts5.c. (check-in: 7819002ed8 user: dan tags: trunk) | |