SQLite

Release Checklist for SQLite 3.40.0
Login
2022-12-23 12:31:02 drhok
3. Documentation review:
2022-12-23 12:31:00 drhok
3c. Release accouncement in "news.html".
2022-11-15 23:27:25 drhok
28. Run make wordcount and do tests on current and prior versions:
2022-11-15 23:27:23 drhok
28b. rm -f wc.db && ./wordcount wc.db $BIGTEXT --all --cachesize 5 --nosync
2022-11-15 23:27:21 drhok
28a. rm -f wc.db && ./wordcount wc.db $BIGTEXT --all
2022-11-15 23:27:18 drhok
27. Performance tests using speedtest1 --testset rtree
2022-11-15 23:27:16 drhok
27a. Linux
2022-11-15 23:27:13 drhok
26b. Mac
2022-11-15 23:27:10 drhok
26a. Linux
2022-11-15 23:27:08 drhok
26. Performance tests using speedtest1 compared against the previous release and a release from about one year ago.
2022-11-15 23:26:54 drhok
13. WASM
2022-11-15 23:26:52 drhok
13d. Click on the test links - confirm correct results.
2022-11-15 23:26:50 drhok
13c. althttpd --enable-sab --page index.html
2022-11-15 23:26:47 drhok
13b. (On Linux) ./configure --enable-all && cd ext/wasm && make
2022-11-15 23:22:05 drhok
13a. Build and install Fiddle according to website maintenance instructions. Run simple tests.
2022-11-15 23:18:07 drhok
31. Verify that the performance and size measurement spreadsheet in the documentation (misc/speed-size-graph.ods) is up-to-date.
2022-11-15 23:13:04 drhok
39. Website built procedures
2022-11-15 23:13:01 drhok
39b. tools/mkmsvcmin.tcl has been run to update the MSVC makefiles in autoconf
2022-11-15 23:12:20 drhok
36. Build the "atrc" test program and run "./atrc $DB | ./sqlite3 $DB" against multiple databases, visually verify the result
2022-11-15 23:06:15 drhok
2. Source code change review. fossil diff --from release --to trunk
2022-11-15 23:06:13 drhok
2l. Compare sqlite3.c and sqlite3.h against the previous release.
2022-11-15 23:06:10 drhok
2k. Significant compile-time options are recognized by the sqlite3_compileoption_used() interface.
2022-11-15 23:05:36 drhok
2j. Verify that the list of APIs exposed via the extension header is up-to-date (sqlite3ext.h).
2022-11-15 23:05:31 drhok
2i. Verify that source code contains no tabs and that surplus whitespace has been removed.
2022-11-15 23:05:27 drhok
2g. Check all calls to sqlite3OsRead() and sqlite3OsWrite() to ensure that offset computations are 64-bit clean.
2022-11-15 23:05:25 drhok
2f. Variables and functions have been renamed to reflect changes in their use.
2022-11-15 23:05:22 drhok
2e. Comments have been updated to reflect code changes.
2022-11-15 23:05:20 drhok
2d. New code complies with design rules.
2022-11-15 23:05:17 drhok
2c. New code complies with style guidelines.
2022-11-15 23:05:15 drhok
2b. All significant changes are mentioned in the "changes" log of the documentation.
2022-11-15 23:05:12 drhok
2a. No stray changes.
2022-11-15 22:58:07 drhok
2h. Check all calls to memory allocation routines to ensure that size computations are 64-bit clean. Suggested regular expression for search: /(Re|M)alloc[FORZa-z]*(/
2022-11-15 22:46:49 drhok
3i. Check new/changed documentation for spelling and gramatical mistakes.
2022-11-15 22:41:56 drhok
3h. Test metrics are up-to-date (testing.html).
2022-11-15 22:41:54 drhok
3g. Database footprint is up-to-date (features.html).
2022-11-15 22:41:47 drhok
3f. The compile-time options are all up-to-date (compile.html).
2022-11-15 22:41:41 drhok
3e. Requirements marks are up-to-date in both documentation and source code. Do this early so that necessary code changes are well validated by subsequent checklist items.
2022-11-15 22:41:37 drhok
3d. No unresolved hyperlinks in the documentation build.
2022-11-15 22:41:33 drhok
3b. Release announcement in "changes.in".
2022-11-15 22:41:31 drhok
3a. Latest release on the "index.html" page.
2022-11-15 18:44:58 drhok
29. Compare performance to the previous release using kvtest.
2022-11-15 18:44:56 drhok
29a. Linux
2022-11-15 18:43:22 drhok
29b. Mac
2022-11-15 18:24:21 drhok
21. SEE tests using TH3:
2022-11-15 18:24:17 drhok
21c. see-aes256-ofb.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make see.rc min.rc -O2 th3: mkth3.tcl -DSQLITE_HAS_CODEC cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2130072 tests. 152.345 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 18:10:05 drhok
21e. see-aes128-ccm.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make see.rc fast.rc th3: mkth3.tcl -DSQLITE_HAS_CODEC -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DBPAGE_VTAB -DSQLITE_ENABLE_DBSTAT_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE cfg/?*.cfg extra1/?*.cfg bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test th3: 0 errors in 11064640 tests. 1260.341 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 17:43:30 drhok
21g. see-aes256-openssl.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make see.rc quick.rc -lcrypto th3: mkth3.tcl -DSQLITE_HAS_CODEC -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2421266 tests. 324.171 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 16:24:33 drhok
21k. At least one of the above using "memdebug.rc".
2022-11-15 16:24:30 drhok
21d. see-rc4.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make see.rc memdebug.rc quick.rc th3: mkth3.tcl -DSQLITE_HAS_CODEC -DSQLITE_DEBUG -DSQLITE_MEMDEBUG -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE cfg/?*.cfg extra1/?*.cfg cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test th3: 0 errors in 11054460 tests. 2588.913 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 15:50:47 drhok
27b. Windows
2022-11-15 15:47:01 drhok
29c. Windows
2022-11-15 15:46:57 drhok
26c. Windows
2022-11-15 15:17:15 drhok
23. NDS-Devkit testing
2022-11-15 15:17:12 drhok
23c. Verify the "NDS DevKit" version number shown at the end of the test
2022-11-15 15:17:02 drhok
23b. Test using: tclsh th3make test.rc nds_devkit.rc
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: th3make test.rc nds_devkit.rc th3: mkth3.tcl -DSQLITE_DEBUG -DSQLITE_ENABLE_EXPENSIVE_ASSERT -DSQLITE_ENABLE_WHERETRACE -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DBPAGE_VTAB -DSQLITE_ENABLE_DBSTAT_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DNDS_ENABLE_EXTENSIONS -DNDS_ENABLE_COMPRESS -DSQLITE_ENABLE_SHARED_SCHEMA -DSQLITE_SECURE_DELETE nx_compress.c cfg/?*.cfg extra1/?*.cfg bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test demo/?*.test th3: 0 errors in 10151214 tests. 4237.998 seconds on bella 64-bit little-endian th3: NDS DevKit 3.40.0 2022-11-15 13:58:59 8fa9c3feb3f62a16 th3: SQLite 3.40.0 2022-11-15 13:42:11 97a95928917dcbc6298aac81ae1f4982f9f6997d41955c7b3dc9b8d8e4ca7216
2022-11-15 14:03:00 drhpending
23b. Test using: tclsh th3make test.rc nds_devkit.rc
2022-11-15 14:01:37 drhok
23a. Merge all trunk enhancements into the reuse-schema branch and use that branch to update the devkit.
2022-11-15 12:58:26 drhok
30. Use the ".selftest" command of the shell to verify that legacy database files are readable and cross-platform
2022-11-15 12:58:22 drhok
30d. Windows
2022-11-15 12:57:34 drhok
24. Amalgamation autoconf tarball.
2022-11-15 12:50:57 drhok
24d. Works on Windows MinGW
2022-11-15 12:46:19 drhok
25. TEA archive builds correctly and runs:
2022-11-15 12:46:15 drhok
25d. Windows MSVC
2022-11-15 12:43:57 drhok
24e. Works on Windows MSVC
2022-11-15 12:39:59 drhok
21h. see-aes256-cryptoapi.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: th3make msvc.rc see.rc quick.rc th3: mkth3.tcl -D_CRT_SECURE_NO_DEPRECATE -D_CRT_SECURE_NO_WARNINGS -D_CRT_NONSTDC_NO_DEPRECATE -D_CRT_NONSTDC_NO_WARNINGS -DSQLITE_HAS_CODEC -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2428700 tests. 989.867 seconds on SQLiteWin10 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 02:49:43 drhok
5b. tclsh tool/omittest-msvc.tcl ← on Windows
2022-11-15 02:49:35 drhok
5. OMIT, ENABLE, and DISABLE options:
2022-11-15 02:49:31 drhok
5b. tclsh tool/omittest-msvc.tcl ← on Windows
2022-11-15 01:59:56 drhok
21o. At least one of the above on Windows.
2022-11-15 01:59:45 drhok
21a. see.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: th3make msvc.rc see.rc quick.rc th3: mkth3.tcl -D_CRT_SECURE_NO_DEPRECATE -D_CRT_SECURE_NO_WARNINGS -D_CRT_NONSTDC_NO_DEPRECATE -D_CRT_NONSTDC_NO_WARNINGS -DSQLITE_HAS_CODEC -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2428780 tests. 1065.191 seconds on SQLiteWin10 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-15 01:36:55 drhok
22. ZIPVFS tests:
2022-11-15 01:36:52 drhok
22h. At least one of the above on Windows.
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: th3make msvc.rc zipvfs.rc quick.rc th3: mkth3.tcl -D_CRT_SECURE_NO_DEPRECATE -D_CRT_SECURE_NO_WARNINGS -D_CRT_NONSTDC_NO_DEPRECATE -D_CRT_NONSTDC_NO_WARNINGS -DSQLITE_ENABLE_ZIPVFS -DZIPVFS_OMIT_DEPRECATED -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE zipvfs/?*.cfg cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan zipvfs/?*.test cov1/?*.test th3: 0 errors in 3781495 tests. 2059.835 seconds on SQLiteWin10 64-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-15 00:59:38 drhok
17. Sqllogictest:
2022-11-15 00:59:34 drhok
17d. tclsh run-all.tcl - on windows
0 errors out of 11879758 tests and 1244 invocations in 2073 seconds
2022-11-15 00:16:01 drhok
16. Dbsqlfuzz tests
2022-11-15 00:15:57 drhok
16i. Win10/MSVC: fuzzcheck $CORPUS -spinner
2022-11-15 00:11:40 drhok
11. Tests for platform Windows:
2022-11-15 00:11:38 drhok
11g. Verify that EXEs and DLLs generated using MSVC contain the correct version number, product name, description, and copyright as resources.
2022-11-15 00:09:55 drhok
11f. sh tool/symbols-mingw.sh - no incorrect exports or dependencies
2022-11-15 00:08:19 drhok
22b. th3make zipvfs.rc test.rc
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make zipvfs.rc test.rc th3: mkth3.tcl -DSQLITE_ENABLE_ZIPVFS -DZIPVFS_OMIT_DEPRECATED -DSQLITE_DEBUG -DSQLITE_ENABLE_EXPENSIVE_ASSERT -DSQLITE_ENABLE_WHERETRACE -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DBPAGE_VTAB -DSQLITE_ENABLE_DBSTAT_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB zipvfs/?*.cfg cfg/?*.cfg extra1/?*.cfg zipvfs/?*.test bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test demo/?*.test th3: 0 errors in 14050336 tests. 3777.101 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-15 00:06:46 drhok
11e. tclsh test/wapptest.tcl --msvc --platform Failure-Detection -noui - all failures detected
2022-11-14 22:52:47 drhok
11d. tclsh test/wapptest.tcl --msvc -noui --debug
0 errors from 3411703 tests in 12 configurations. SQLite version 3.40.0 2022-11-14 19:42:01 6ee57a2e4e3399481100c40da0229d2d33cbe3290016185c8a60839d14b209f6
2022-11-14 21:27:18 drhok
6e. tclsh test/wapptest.tcl -noui --debug
0 errors from 17167979 tests in 50 configurations. SQLite version 3.40.0 2022-11-14 17:48:26 fa68dd8928c76888d535e649794743eeefd3abe0f909792a128955710bfc948a 0 errors from 17167968 tests in 50 configurations. SQLite version 3.40.0 2022-11-14 19:42:01 6ee57a2e4e3399481100c40da0229d2d33cbe3290016185c8a60839d14b209f6
2022-11-14 21:17:24 drhok
21n. At least one of the above on Mac OS X.
2022-11-14 21:01:52 drhok
22d. th3make zipvfs.rc quick.rc -valgrind
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make zipvfs.rc quick.rc --valgrind th3: mkth3.tcl -DSQLITE_ENABLE_ZIPVFS -DZIPVFS_OMIT_DEPRECATED -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE -DTH3_OMIT_MISUSE -DTH3_LOWMEM zipvfs/?*.cfg cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan zipvfs/?*.test cov1/?*.test th3: 0 errors in 3743634 tests. 21315.107 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 20:33:24 drhok
8. Tests for platform MacOS x64:
2022-11-14 20:33:21 drhok
8c. tclsh multitest.tcl --scenario failures - all failures detected
2022-11-14 20:32:27 drhok
8b. tclsh multitest.tcl --quick
0 failures on 16 th3makes and 32532866 tests in (01:36:30) 2 cores on SQLite-iMac-2018.local SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 20:25:10 danok
39d. All build products work on their target platforms
2022-11-14 20:24:47 danok
39c. Compile-time options for build products have been updated as necessary
2022-11-14 20:19:49 danok
39a. Compile-time options in builds/products_build.sh in the supportdb repository has been updated to align with any changes to the default makefiles.
No changes required.
2022-11-14 20:19:41 danok
39a. Compile-time options in builds/products_build.sh in the supportdb repository has been updated to align with any changes to the default makefiles.
2022-11-14 20:05:02 danok
6. Tests for platform Linux x86_64:
2022-11-14 19:49:44 danok
6f. tclsh test/wapptest.tcl --platform Failure-Detection -noui - all failures detected
All tests report "failure".
2022-11-14 19:48:30 danok
6e. tclsh test/wapptest.tcl -noui --debug
0 errors from 17167979 tests in 50 configurations. SQLite version 3.40.0 2022-11-14 17:48:26 fa68dd8928c76888d535e649794743eeefd3abe0f909792a128955710bfc948a
2022-11-14 19:00:39 drhok
22g. At least one of the above on Mac OS X.
2022-11-14 19:00:34 drhok
22c. th3make zipvfs.rc memdebug.rc
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make zipvfs.rc memdebug.rc th3: mkth3.tcl -DSQLITE_ENABLE_ZIPVFS -DZIPVFS_OMIT_DEPRECATED -DSQLITE_DEBUG -DSQLITE_MEMDEBUG zipvfs/?*.cfg cfg/?*.cfg extra1/?*.cfg zipvfs/?*.test bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test th3: 0 errors in 10921078 tests. 7784.821 seconds on minimac 64-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 18:51:06 danok
37. Run the rbu/run_rbu_tests.tcl script in the test-dbs project on Linux.
All tests report "round trip test successful."
2022-11-14 18:47:30 danok
33. Verify that databases (including FTS3 and RTREE databases), rollback journals, and WAL files created by the release candidate are readable and writeable by historical versions of SQLite (as long as no unsupported features are used) and vice versa.
Tested using backcompat.test against 3.8.2 and 3.7.2 SQLite 2022-11-14 17:48:26 fa68dd8928c76888d535e649794743eeefd3abe0f909792a128955710bfc948a 0 errors out of 265 tests on ws1 Linux 64-bit little-endian
2022-11-14 18:14:48 danok
14. On an F2FS filesystem with the F2FS_FEATURE_ATOMIC_WRITE feature, test with: $(TOP)/configure && make test OPTS="-DSQLITE_ENABLE_BATCH_ATOMIC_WRITE -DSQLITE_DEBUG -DSQLITE_NO_SYNC"
SQLite 2022-11-14 17:48:26 fa68dd8928c76888d535e649794743eeefd3abe0f909792a128955710bfc948a 0 errors out of 254031 tests on ws1 Linux 64-bit little-endian
2022-11-14 17:28:44 drhok
16g. CFLAGS='-Os -g -DSQLITE_VDBE_COVERAGE' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
2022-11-14 17:28:38 danok
12. Tests for platform OpenBSD (x86):
2022-11-14 17:28:36 danok
12b. th3make quick.rc
th3: 0 errors in 2458893 tests. 815.569 seconds on openbsd.my.domain 32-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912calt1
2022-11-14 17:26:10 drhok
16f. CC=clang CFLAGS='-Os -g -fsanitize=memory' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
fuzzcheck: 0 errors out of 59372 tests in 222.463 seconds SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 17:20:59 drhok
16e. CC=clang CFLAGS='-Os -g -fsanitize=address' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
fuzzcheck: 0 errors out of 59372 tests in 210.987 seconds SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 17:17:12 drhok
25c. Mac OS X
2022-11-14 17:16:51 drhpending
16e. CC=clang CFLAGS='-Os -g -fsanitize=address' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
2022-11-14 17:15:22 drhok
16d. CC=clang CFLAGS='-Os -g -fsanitize=undefined' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
fuzzcheck: 0 errors out of 59372 tests in 115.646 seconds SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 17:15:04 danpending
12b. th3make quick.rc
2022-11-14 17:13:48 drhok
24c. Works on Mac OS X.
2022-11-14 17:12:59 drhok
25b. Linux
2022-11-14 17:10:51 drhok
25a. Verify that the SQLite version number is correct in autoconf/tea/configure.ac
2022-11-14 17:09:04 drhok
24b. Works on Linux.
2022-11-14 17:06:41 drhok
24a. Builds.
2022-11-14 17:05:31 drhok
30c. Mac
2022-11-14 17:04:12 drhok
35. Build and verify sqldiff
2022-11-14 17:04:09 drhok
35b. Mac
2022-11-14 17:04:07 drhok
34. Build and verify correct operation of sqlite3_analyzer on:
2022-11-14 17:04:04 drhok
34b. Mac OS X
2022-11-14 17:03:54 drhpending
16d. CC=clang CFLAGS='-Os -g -fsanitize=undefined' make -e clean fuzzcheck && ./fuzzcheck $CORPUS --spinner
2022-11-14 17:02:35 drhok
18. Build using the configure/make in main source tree.
2022-11-14 17:02:33 drhok
18b. Verify the correct version numbers have been installed.
2022-11-14 17:02:31 drhok
18a. Make sure that autoconf has been run to update the configure script.
2022-11-14 17:02:10 drhok
16h. Mac: fuzzcheck $CORPUS --spinner
fuzzcheck: 0 errors out of 59372 tests in 70.775 seconds SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 17:01:14 drhok
16c. valgrind fuzzcheck $CORPUS --spinner
20221107.db: 59372/59372 fuzzcheck: 0 errors out of 59372 tests in 1941.636 seconds SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 16:56:27 drhpending
16h. Mac: fuzzcheck $CORPUS --spinner
2022-11-14 16:56:20 danok
12a. make test
SQLite 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912calt1 0 errors out of 214622 tests on openbsd.my.domain OpenBSD 32-bit little-endian
2022-11-14 16:50:31 drhok
17c. tclsh run-all.tcl - on unix
0 errors out of 11879758 tests and 1244 invocations in 1189 seconds
2022-11-14 16:46:44 drhpending
22c. th3make zipvfs.rc memdebug.rc
2022-11-14 16:39:00 drhpending
17c. tclsh run-all.tcl - on unix
2022-11-14 16:38:35 drhpending
8b. tclsh multitest.tcl --quick
2022-11-14 16:37:53 drhok
8d. tclsh test/wapptest.tcl -platform Failure-Detection -noui - all failures detected
2022-11-14 16:33:11 drhok
8a. tclsh test/wapptest.tcl -noui --debug
0 errors from 6674757 tests in 12 configurations. SQLite version 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 16:32:17 drhpending
16c. valgrind fuzzcheck $CORPUS --spinner
2022-11-14 16:26:36 drhok
16b. Check-in CORPUS as an unversioned file in the dbsqlfuzz repository
2022-11-14 16:26:31 drhok
16a. Develop a new CORPUS database by running dbsqlfuzz for 10 billion iterations
2022-11-14 16:25:14 drhok
17b. No SQLite compiler warnings.
2022-11-14 16:25:10 drhok
17a. Checked in latest SQLite amalgamation.
2022-11-14 16:06:54 drhok
21l. At least one of the above with option -DSQLITE_DIRECT_OVERFLOW_READ.
2022-11-14 16:06:51 drhok
21i. Verify that builds work with -DSQLITE_ENABLE_UPDATE_DELETE_LIMIT
2022-11-14 16:06:47 drhok
21j. At least one of the above using "test.rc".
2022-11-14 16:06:34 drhok
21f. see-cccrypt.c
th3: mkth3.tcl -DSQLITE_HAS_CODEC -DSQLITE_ENABLE_UPDATE_DELETE_LIMIT -DSQLITE_DIRECT_OVERFLOW_READ -DSQLITE_DEBUG -DSQLITE_ENABLE_EXPENSIVE_ASSERT -DSQLITE_ENABLE_WHERETRACE -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DBPAGE_VTAB -DSQLITE_ENABLE_DBSTAT_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB cfg/?*.cfg extra1/?*.cfg bugs/?*.test cov1/?*.test extra1/?*.test fts/?*.test req1/?*.test demo/?*.test th3: 0 errors in 8807386 tests. 2286.097 seconds on minimac 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-14 16:03:27 drhpending
11d. tclsh test/wapptest.tcl --msvc -noui --debug
2022-11-14 16:02:01 drhok
11c. tclsh multitest.tcl --msvc --scenario failures - verify failures detected
2022-11-14 16:01:14 drhok
11b. tclsh multitest.tcl --msvc --quick on x86
0 failures on 16 th3makes and 32159558 tests in (02:30:15) 2 cores on SQLiteWin10 SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 15:03:30 drhpending
22d. th3make zipvfs.rc quick.rc -valgrind
2022-11-14 14:55:11 drhok
22f. At least one of the above on Linux.
2022-11-14 14:55:06 drhok
22e. th3make zipvfs.rc quick.rc
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make zipvfs.rc quick.rc th3: mkth3.tcl -DSQLITE_ENABLE_ZIPVFS -DZIPVFS_OMIT_DEPRECATED -DSQLITE_DEBUG -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB -DTH3_SELFCOVERAGE zipvfs/?*.cfg cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan zipvfs/?*.test cov1/?*.test th3: 0 errors in 3761082 tests. 542.317 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 14:45:57 drhok
22a. testfixture ../zipvfs/test/zipvfs.test (See test/README.md for details)
SQLite 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c 0 errors out of 70754 tests on bella Linux 64-bit little-endian
2022-11-14 14:44:51 drhpending
22e. th3make zipvfs.rc quick.rc
2022-11-14 14:44:45 drhpending
22a. testfixture ../zipvfs/test/zipvfs.test (See test/README.md for details)
2022-11-14 14:33:22 drhok
20. CEROD tests in the "test/" subdirectory.
2022-11-14 14:29:21 drhpending
21f. see-cccrypt.c
2022-11-14 14:21:48 drhok
30b. Linux
2022-11-14 14:21:44 drhok
38. Verify that the "sqlite3-all.c" build target works and that the resulting "sqlite3-all.c" file and its include files ("sqlite3-?.c") compile and run the same as the single-file amalgamation.
2022-11-14 14:19:15 drhok
35a. Linux
2022-11-14 14:19:12 drhok
34a. Linux
2022-11-14 14:17:57 drhok
21m. At least one of the above on Linux.
2022-11-14 14:17:50 drhok
21b. see-aes128-ofb.c
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: ./th3make see.rc debug.rc th3: mkth3.tcl -DSQLITE_HAS_CODEC -DSQLITE_DEBUG -DSQLITE_THREADSAFE=0 -DSQLITE_ENABLE_WHERETRACE -DSQLITE_ENABLE_BYTECODE_VTAB -DSQLITE_ENABLE_DBPAGE_VTAB -DSQLITE_ENABLE_DBSTAT_VTAB -DSQLITE_ENABLE_DESERIALIZE -DSQLITE_ENABLE_STMTVTAB cfg/c?.cfg cfg/wal1.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2463126 tests. 432.418 seconds on r20 64-bit little-endian th3: SQLite 3.40.0 2022-11-14 13:37:27 8d3fcc8fb84f463bdd10c4a8d863d95b1023f9bf2de0b747380623b9dec72556
2022-11-14 14:15:25 drhok
5a. tclsh ../tool/omittest.tcl -skip_run -target libsqlite3.a ← on Linux
2022-11-14 14:14:54 drhok
7. Tests for platform Linux ARM (BeagleBoard or RaspberryPI)
2022-11-14 14:14:51 drhok
7a. tclsh th3make min.rc -DTH3_LOWMEM --unobfuscated
th3: 97f53acb3da9ad07b15eb2e0fc6b5cea96641ae6c3098fd81ab3558a9d92bc39 th3: th3make min.rc -DTH3_LOWMEM --unobfuscated th3: mkth3.tcl -DTH3_LOWMEM cfg/c?.cfg cfg/wal1.cfg cfg/f2fs.cfg coverage.testplan cov1/?*.test th3: 0 errors in 2157354 tests. 5475.934 seconds on raspberrypi 32-bit little-endian th3: SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 13:49:22 drhok
6i. Test the reuse-schema branch with ./configure --enable-all && make "OPTS=-DSQLITE_ENABLE_SHARED_SCHEMA" test.
2022-11-14 13:46:59 drhok
15. Trunk changes merged and verified on active branches:
2022-11-14 13:46:57 drhok
15g. client-see (in the see-base repository)
2022-11-14 13:42:35 drhok
15e. reuse-schema (from trunk)
2022-11-14 13:37:54 drhok
15f. see (in the see-base repository)
2022-11-14 13:18:49 drhok
15d. begin-concurrent-pnu-wal2 (from wal2)
2022-11-14 13:17:53 drhok
10. Tests for platform MacOS (PPC):
2022-11-14 13:17:51 drhok
10c. Verify that Fossil repositories are cross-platform with x86/x64.
2022-11-14 13:16:28 drhok
10b. Recompile and test Fossil.
2022-11-14 13:15:16 drhok
19. Fossil updated to use the latest SQLite.
2022-11-14 13:15:13 drhok
19c. fossil all test-integrity -d
2022-11-14 13:12:48 drhok
19b. Used on active websites with no issues.
2022-11-14 13:12:44 drhok
19a. No SQLite compiler warnings.
2022-11-14 13:11:32 drhpending
11b. tclsh multitest.tcl --msvc --quick on x86
2022-11-14 13:11:17 drhok
15c. wal2 (from trunk)
2022-11-14 13:05:07 drhok
35c. Windows
2022-11-14 13:04:01 drhok
34c. Windows
2022-11-14 13:02:12 drhok
32. Verify that the amalgamation builds are byte-for-byte identical on all workstation platforms.
2022-11-14 13:02:08 drhok
32d. Windows using native MinGW.
36596ff878cb75ce8ba96a15987410c1623dadf667635b7ad18153f5dfa3d69d sqlite3.c 3b03544b0b46333161267cb679e109fdc9f7f86375c5a0dab235b330807b07a8 sqlite3.h
2022-11-14 13:00:28 drhok
15b. begin-concurrent-report (from begin-concurrent-pnu)
2022-11-14 12:59:03 drhok
32e. Windows using NMAKE.
36596ff878cb75ce8ba96a15987410c1623dadf667635b7ad18153f5dfa3d69d sqlite3.c 3b03544b0b46333161267cb679e109fdc9f7f86375c5a0dab235b330807b07a8 sqlite3.h
2022-11-14 12:58:07 drhok
11a. tclsh multitest.tcl --msvc --quick on x64
0 failures on 16 th3makes and 32367604 tests in (02:08:52) 2 cores on SQLiteWin10 SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 12:55:49 drhok
10a. .selftest checks (see below)
2022-11-14 12:55:39 drhok
32b. Mac OS X
36596ff878cb75ce8ba96a15987410c1623dadf667635b7ad18153f5dfa3d69d extsrc/sqlite3.c 3b03544b0b46333161267cb679e109fdc9f7f86375c5a0dab235b330807b07a8 extsrc/sqlite3.h
2022-11-14 12:55:13 drhok
32c. Mac OS X (PPC)
36596ff878cb75ce8ba96a15987410c1623dadf667635b7ad18153f5dfa3d69d extsrc/sqlite3.c 3b03544b0b46333161267cb679e109fdc9f7f86375c5a0dab235b330807b07a8 extsrc/sqlite3.h
2022-11-14 12:55:08 drhok
32a. Linux
36596ff878cb75ce8ba96a15987410c1623dadf667635b7ad18153f5dfa3d69d extsrc/sqlite3.c 3b03544b0b46333161267cb679e109fdc9f7f86375c5a0dab235b330807b07a8 extsrc/sqlite3.h
2022-11-14 12:54:25 drhok
30a. iBook PPC
2022-11-14 12:46:12 drhok
9. Tests for platform MacOS ARM:
2022-11-14 12:46:09 drhok
9b. tclsh multitest.tcl --quick
0 failures on 16 th3makes and 32533655 tests in (00:17:48) 4 cores on minimac SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 12:45:48 drhpending
7a. tclsh th3make min.rc -DTH3_LOWMEM --unobfuscated
2022-11-14 12:45:32 drhpending
15b. begin-concurrent-report (from begin-concurrent-pnu)
2022-11-14 12:45:27 drhok
15a. begin-concurrent (from trunk)
2022-11-14 12:40:09 drhpending
8a. tclsh test/wapptest.tcl -noui --debug
2022-11-14 12:31:15 drhpending
9b. tclsh multitest.tcl --quick
2022-11-14 12:26:04 drhok
9a. tclsh test/wapptest.tcl -noui --debug
0 errors from 6154704 tests in 12 configurations. SQLite version 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 12:24:38 drhok
6g. sh tool/symbols.sh - no incorrect exports or dependencies
2022-11-14 12:23:57 drhok
6b. tclsh multitest.tcl --scenario coverage
A few branches missed in STAT4 and one in os_unix.c. Full coverage in core and in rtree.
2022-11-14 11:43:44 drhok
7b. Recompile and test Fossil.
2022-11-14 11:43:19 drhok
6h. ./configure --enable-debug --enable-all && make parse.c && CC=clang CFLAGS='-fsanitize=address,undefined' make -e test
Some warnings are generated, but they are all benign.
2022-11-14 11:10:40 drhpending
7b. Recompile and test Fossil.
2022-11-14 11:10:10 drhpending
6h. ./configure --enable-debug --enable-all && make parse.c && CC=clang CFLAGS='-fsanitize=address,undefined' make -e test
2022-11-14 11:03:44 drhok
6j. CC=clang CFLAGS='-fsanitize=thread' ./configure && make threadtest5 && ./threadtest5
2022-11-14 11:02:41 drhok
6k. Run auxiliary test script in the /usr subdirectory of the TH3 repository
2022-11-14 10:59:22 drhok
6d. tclsh multitest.tcl --scenario failures - all failures detected
2022-11-14 10:57:53 drhok
6c. tclsh multitest.tcl --scenario obscure
2022-11-14 10:53:39 drhok
4. Compiler warning checks.
2022-11-14 10:53:36 drhok
4d. Clang-10.0.0: CFLAGS='-O0' ./configure --enable-debug --enable-all && scan-build make sqlite3
2022-11-14 10:53:34 drhok
4c. Clang-6.0.0: CFLAGS='-O0' ./configure --enable-debug --enable-all && scan-build make sqlite3
2022-11-14 10:46:00 drhpending
9a. tclsh test/wapptest.tcl -noui --debug
2022-11-14 10:45:53 drhok
9a. tclsh test/wapptest.tcl -noui --debug
2022-11-14 10:44:35 drhpending
11a. tclsh multitest.tcl --msvc --quick on x64
2022-11-14 10:42:13 drhok
4b. Mac OS X GCC -Wall -Wextra (the "tool/warnings.sh" script)
2022-11-14 10:42:10 drhok
4a. Linux GCC -Wall -Wextra (the "tool/warnings.sh" script)
2022-11-14 10:39:48 drhok
6a. tclsh multitest.tcl
0 failures on 52 th3makes and 250320471 tests in (02:32:12) 8 cores on r20 SQLite 3.40.0 2022-11-13 19:29:51 80ff592a9d0157bfa8bd1f9959c3aa26cab0ec16fdccf7b58a7523b8912c1a8c
2022-11-14 10:38:45 drhok
1. Test procedure review.
2022-11-14 10:38:42 drhok
1a. Review the "test/wapptest.tcl" script for completeness and accuracy.
2022-11-14 10:38:39 drhok
1b. Review "multitest.tcl" and "alignment*.rc" scripts in TH3 for completeness.
2022-11-14 10:38:37 drhok
1c. Review this checklist for completeness and accuracy.