Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
73 events for the month beginning 2022-11-01 by user stephan
Following month ↑|
2022-11-30
| ||
| 18:21 | Rename some JS files from X.js to X.c-pp.js to keep the maintainer, and downstream build customizers, aware that those files contain constructs specific to the c-pp preprocessor and will not run as-is in JS. (check-in: 2eade7c7b1 user: stephan tags: trunk) | |
| 11:50 | Install sqlite3_malloc/sqlite3_free() as the JS-side WASM allocator (as opposed to replacing C-level's malloc()/free() with them). All tests work and this eliminates the potential for allocator discrepancies when using the (de)serialize APIs. (check-in: 95c78f6b46 user: stephan tags: trunk) | |
| 10:05 | Merge trunk into wasi-patches branch. (check-in: 64cf34a855 user: stephan tags: wasi-patches) | |
| 08:37 | Simplify how the OPFS VFS async proxy copies initial state sent to it from the synchronous side of the connection. Make the lock-wait time a multiple of the wait-loop timeout interval. (check-in: eddafafffa user: stephan tags: trunk) | |
| 07:48 | OPFS VFS: remove an invalid TODO and fix a property name typo which caused xCheckReservedLock() to always report false. (check-in: 3b037caa2f user: stephan tags: trunk) | |
| 07:17 | Rename some OPFS JS files. Prevent JS bindings of sqlite3_uri_...() from performing JS-to-C-string argument conversion on their first argument, as doing so is specifically illegal. (check-in: 79832808de user: stephan tags: trunk) | |
| 05:27 | Refactor a significant chunk of the OPFS sqlite3_vfs init code into sqlite3.VfsHelper, and internal-use-only API encapsulating code relevant to creating new VFSes in JS. Intended to assist in pending experimentation with an alternative OPFS VFS. (check-in: e25d7b080a user: stephan tags: trunk) | |
| 03:08 | Doc and logging text tweaks in the OPFS async proxy and test app. (check-in: 7ce8608e22 user: stephan tags: trunk) | |
|
2022-11-29
| ||
| 18:28 | sqlite3.oo1.OpfsDb: default to journal_mode=persist, as current tests show it to be marginally faster than truncate/delete in Chrome v109. Also increase default busy_timeout from 2 seconds to 3, admittedly on a whim. (check-in: d0c8fa30a3 user: stephan tags: trunk) | |
| 18:00 | OPFS speedtest1: hide a currently-broken/to-fix WASMFS-build link. (check-in: cde95d382f user: stephan tags: trunk) | |
| 06:56 | Rename one instance of opfs.OpfsDb to oo1.OpfsDb, as per [0c5c51f4fb04]. (check-in: 75b04c9b30 user: stephan tags: trunk) | |
| 06:09 | Minor internal cleanups and docs in the OPFS sqlite3_vfs. (check-in: 61799b05ff user: stephan tags: trunk) | |
| 05:25 | Internal restructuring of the OPFS sqlite3_vfs in order to facilitate certain experimentation and improve error reporting/hints if it cannot be activated. Deprecate the name sqlite3.opfs.OpfsDb, preferring sqlite3.oo1.OpfsDb for consistency with JsStorageDb and any future DB subclasses. (check-in: 0c5c51f4fb user: stephan tags: trunk) | |
| 02:23 | Add an explicit warning about the current API-instability of the sqlite3.opfs namespace, which may need to be eliminated based on re-thinking of how the OPFS sqlite3_vfs is registered. Comment changes only - no code. (check-in: 0cb2fd1417 user: stephan tags: trunk) | |
|
2022-11-27
| ||
| 00:57 | Document an OPFS API change in Chrome v108 which does not break our code but does change several formerly async methods to synchronous. No code changes. (check-in: e9dd87e28a user: stephan tags: trunk) | |
|
2022-11-26
| ||
| 15:24 | OPFS VFS: add the opfs-unlock-asap=1 URI flag which tells the VFS to release implicit locks ASAP instead of during VFS idle time. This improves concurrency notably in the test app but brings a significant performance penalty in speedtest1 (roughly 4x slowdown). This is not the final word in OPFS concurrency, but gets us a step further. (check-in: 9542f9ce9e user: stephan tags: trunk) | |
|
2022-11-24
| ||
| 17:53 | More work on the OPFS concurrency testing app. (Closed-Leaf check-in: c0458caca3 user: stephan tags: opfs-unlock-asap) | |
| 16:03 | JS documentation cleanups. No code changes. (check-in: 18e89a436d user: stephan tags: trunk) | |
| 02:35 | Add sqlite3.oo1.DB.prototype.checkRc() and tests for both that method and its class-level counterpart. (check-in: f7eaa6ba21 user: stephan tags: trunk) | |
|
2022-11-23
| ||
| 21:09 | Minor JS doc updates. (check-in: 27efd63ad7 user: stephan tags: trunk) | |
| 21:03 | Add optional zSchema argument to sqlite3_js_db_export(). (check-in: 9c23644b1e user: stephan tags: trunk) | |
| 20:49 | OPFS concurrency test: add a URL flag to enable/disable unlock-asap mode. (check-in: 1c1bf22ead user: stephan tags: opfs-unlock-asap) | |
| 19:03 | Add an experimental OPFS VFS-specific URI flag, opfs-unlock-asap, which tells the VFS to release implicit locks ASAP. This permits higher concurrency but hurts performance considerably. This may or may not be obsoleted by other concurrency-related experimentation. (check-in: d23c917013 user: stephan tags: opfs-unlock-asap) | |
| 19:02 | • Edit [c5b7a9715a13b696|c5b7a9715a]: Move to branch opfs-unlock-asap. (artifact: 37daa39da2 user: stephan) | |
| 16:39 | Initial infrastructure for adding a mode to the OPFS VFS which causes implicit locks to be released ASAP, which increases concurrency at the cost of performance. (check-in: c5b7a9715a user: stephan tags: opfs-unlock-asap) | |
| 15:55 | • Edit [220cc4c6399b772b|220cc4c639]: Edit check-in comment. (artifact: 641de14f09 user: stephan) | |
| 15:52 | Remove a bit of over-cleverness which breaks loading of sqlite3.js in some main-thread cases. Broken by [96f76e7616]. (check-in: 220cc4c639 user: stephan tags: trunk) | |
| 15:33 | OPFS concurrency tester: ensure that the work interval timer does not overlap with the work time. (check-in: 8f2076553b user: stephan tags: trunk) | |
|
2022-11-21
| ||
| 16:03 | Merge trunk into wasi-patches branch to clean up the diff view. (check-in: 95de6742d3 user: stephan tags: wasi-patches) | |
| 16:00 | OPFS contention test: give each worker a distinct recognizable name instead of a random one. (check-in: 5f564bf7de user: stephan tags: trunk) | |
| 06:07 | Add new JS tests dir to those pushed to the test server. (check-in: 07182dca9f user: stephan tags: trunk) | |
| 05:18 | More tweaking of OPFS concurrency measures and the related test app. (check-in: a8d4da1501 user: stephan tags: trunk) | |
| 04:12 | Resolve missing SQLITE_LOCKED result code which triggered a new (since last checkin) exception in the OPFS VFS. Improve output of the OPFS contention tester app. (check-in: 2debbbca33 user: stephan tags: trunk) | |
| 03:50 | Add test app for experimenting with multi-worker OPFS concurrency. Tweak OPFS VFS to significantly improve the otherwise "unfortunate" concurrency situation. (check-in: 96f76e7616 user: stephan tags: trunk) | |
|
2022-11-20
| ||
| 15:30 | Remove check for WASM_WASI macro when detecting wasi compilation mode, as that macro is project-specific. Rely only on __wasi__ (exposed by clang) to detect wasi compilation mode. (check-in: d469ac0c44 user: stephan tags: wasi-patches) | |
| 05:47 | js dist: account for a file rename in the previous checkin. (check-in: 469f9011a8 user: stephan tags: trunk) | |
| 05:36 | Further minor cleanups in the JS build related to vanilla vs ESM. (check-in: 100a596800 user: stephan tags: trunk) | |
| 04:14 | Remove an obsolete reference to WASMFS from ext/wasm/index.html. (check-in: 51ff681864 user: stephan tags: trunk) | |
| 04:14 | Generic cleanups and doc additions in the wasm build files. (check-in: d10f385e36 user: stephan tags: trunk) | |
| 04:13 | Add 'snapshot' target to create distinctly-named snapshot builds of the wasm deliverables zip file. (check-in: f7620aa09e user: stephan tags: trunk) | |
| 01:15 | Minor cleanups in the ESM-related preprocessor filtering. (check-in: 205884a273 user: stephan tags: trunk) | |
|
2022-11-19
| ||
| 16:16 | Get tester1.js working via an ES6 worker module and add that variant to the dist zipfile. (check-in: 90480586f1 user: stephan tags: trunk) | |
| 15:03 | Elide a wasi-incompatible shell.c block in SQLITE_WASI builds. (check-in: 9b8b15a779 user: stephan tags: wasi-patches) | |
| 07:44 | Default to SQLITE_THREADSAFE=0 and SQLITE_OMIT_LOAD_EXTENSION for wasi builds. (check-in: 382ba3b284 user: stephan tags: wasi-patches) | |
| 07:39 | Account for lack of mmap(), getpid(), and shared memory APIs in wasi. (check-in: 80ff026fb4 user: stephan tags: wasi-patches) | |
| 07:17 | Preliminary patches to get sqlite3.c building as-is in WASI environments. (check-in: 19c04d71bf user: stephan tags: wasi-patches) | |
| 05:26 | Add build of sqlite3.mjs (ES6 module), add a test app for it, and include it in the dist build. (check-in: 2e783670e1 user: stephan tags: trunk) | |
| 02:58 | Integrate a custom preprocessor to the JS build process to facilitate creation of both vanilla JS and ES6 Module builds from the same source files. There is still some build-level reworking pending to make an ESM build a first-class deliverable. (check-in: 10c723d96d user: stephan tags: trunk) | |
| 02:51 | More work towards creation of a ES6 JS module. (Closed-Leaf check-in: 6b826e700f user: stephan tags: js-cpp) | |
|
2022-11-18
| ||
| 15:22 | shell.c.in: on non-Windows platforms, check for $XDG_CONFIG_HOME/sqlite3/sqliterc before ~/.sqliterc, per request in forum post 7a16582b1e403c81. (check-in: 17065d095d user: stephan tags: trunk) | |
| 02:29 | Replace use of cpp with the fit-to-purpose c-pp to avoid cpp's C-centric/JS-unfriendly quirks. (check-in: 49d70f071e user: stephan tags: js-cpp) | |
|
2022-11-17
| ||
| 15:21 | Merge trunk into js-cpp branch. (check-in: e047b33d1f user: stephan tags: js-cpp) | |
|
2022-11-16
| ||
| 21:52 | Change a self.X JS reference to X to account for a symbol resolution discrepancy between vanilla JS and ES6 modules, as explained in forum post 801d8f77e5115141. (check-in: 0590de4da1 user: stephan tags: trunk) | |
| 21:39 | wasm build: include FTS5 instead of FTS4, per /chat and HN discussions. (check-in: 85c3f2ac5a user: stephan tags: trunk) | |
|
2022-11-13
| ||
| 19:29 | Remove some outdated code comments. No code changes. (check-in: 80ff592a9d user: stephan tags: trunk) | |
|
2022-11-10
| ||
| 13:22 | Automatically relinquish implicitly-acquired OPFS file locks during VFS idle time in an attempt to help alleviate cross-tab locking contention like that described in forum post 58a377083cd24a. (check-in: 8daf24ff73 user: stephan tags: trunk) | |
| 13:14 | Rework automatically acquired OPFS locks to be released during idle time. This eliminates the performance hit reported in [46304ba057707c]. (Closed-Leaf check-in: a7fe91afca user: stephan tags: opfs-lock-without-xlock) | |
| 11:38 | • Edit [46304ba057707c3b|46304ba057]: Edit check-in comment. (artifact: d394242c2a user: stephan) | |
| 11:35 | OPFS: if an op which needs a lock is called when no lock has been obtained, automatically lock it at the start of the op and unlock it at the end of that op. This is an attempt to alleviate the cross-tab contention described in forum post 58a377083cd24a but it increases speedtest1 run time by approximately 4x. Perhaps auto-lock can be combined with the older idle-time-based auto-unlock to unlock such locks (but not those from xLock()) to improve this? (check-in: 46304ba057 user: stephan tags: opfs-lock-without-xlock) | |
|
2022-11-07
| ||
| 17:21 | Minor doc updates in speed-check.sh. No code changes. (check-in: d2ed4116fb user: stephan tags: trunk) | |
| 13:06 | Add sqlite3.wasm.alloc.impl() as a "public back door" into the low-level non-throwing allocator. Correct sqlite3.WasmAllocError constructor to behave like its usages expect it to and add tests for that. (check-in: cea8bf9a14 user: stephan tags: trunk) | |
| 12:12 | Minor wasm doc touchups. No code changes. (check-in: 2c44836891 user: stephan tags: trunk) | |
|
2022-11-06
| ||
| 13:12 | shell.c.in: on non-Windows platforms, check for $XDG_CONFIG_HOME/sqlite3/sqliterc before ~/.sqliterc, per request in forum post 7a16582b1e403c81. (Closed-Leaf check-in: 49c6e438a8 user: stephan tags: sqliterc-xdg-config) | |
|
2022-11-04
| ||
| 09:02 | Correct sqlite3-wasm.c's SQLITE_DEFAULT_CACHE_SIZE (it's measured in kb, not bytes). (check-in: 479ad980df user: stephan tags: trunk) | |
|
2022-11-03
| ||
| 22:51 | Add experimental esm target to ext/wasm/GNUmakefile to tell emcc to generate sqlite3.mjs (ES6 module) instead of sqlite3.js. Related to discussion at ed4596cf8496a39b. (check-in: e55d8eba83 user: stephan tags: trunk) | |
| 22:14 | Experimentally use clang's C preprocessor to filter #ifdef's out of the generated sqlite3-api.js, the goal being to see if we can feasibly use cpp to include ES6 module-specific code in the main code base and conditionally filter it out. (check-in: 718a6d371e user: stephan tags: js-cpp) | |
| 21:21 | Globally replace '' with "" for empty JS strings to please C preprocessor. (check-in: e92e1f42be user: stephan tags: trunk) | |
|
2022-11-02
| ||
| 14:08 | Minor build cleanups and fix a harmless race condition in the OPFS part of tester1.js. (check-in: 70ee6ee014 user: stephan tags: trunk) | |
| 11:53 | Add sqlite3_wasm_vfs_create_file() to replace Emscripten's FS.createDataFile() in a (mostly) VFS-agnostic way. Add a test for worker1's export (to bytearray) support. Re-add worker1 open-from-bytearray using sqlite3_wasm_vfs_create_file() but it's untested (requires a new interactive test app or maybe reconsideration). (check-in: b35e1225c9 user: stephan tags: trunk) | |
| 08:49 | Fix a symbol name typo which broke and exception-handling case in OPFS xOpen(). (check-in: 5bc83d5695 user: stephan tags: trunk) | |
| 08:10 | Fix a missing symbol in non-SQLITE_DEBUG builds. (check-in: 17cdcad627 user: stephan tags: trunk) | |
|
2022-11-01
| ||
| 11:09 | Minor internal cleanups in the js pieces. (check-in: 271391b4e3 user: stephan tags: trunk) | |
| 07:49 | Significant cleanups and expansion of the sqlite3.opfs utilities. Add oo1.DB.dbVfsName(). Add VFS name to worker1:open's arguments and result. (check-in: 86a341d7e0 user: stephan tags: trunk) | |