QuestDB 8.1.1

Back to school... Baaack to school...

Lunch? Check. Pants? Check (phew!) New QuestDB release? Oh yeah.

Let's go! 📚 ✏️ 🥪

Breaking changes 💥

We have changed the language in our SNAPSHOT related SQL statements. We introduce CHECKPOINT.

Apply it before taking a backup.

Instead of executing:

 SNAPSHOT PREPARE

You will now execute:

CHECKPOINT CREATE

When the backup is complete, instead of executing:

SNAPSHOT COMPLETE

You will execute:

  CHECKPOINT RELEASE

Both commands are supported for now, but we encourage you to migrate to the new system.

We have also introduced a fix for integer overflow, which now widens the type of the result.

For example, the following will be automatically widened to LONG (64bit) to avoid numeric overflow:

select 799990090 * 100000

Improvements 🚀

• General improvements to database stability
• Out-of-the-box ingress performance improved via reduced resource contention
• SQL execution performance improvements for cases like ORBER BY <long>, and GROUP BY with virtual columns such as now()
• Certain ASOF SQL queries have improved their performance by orders of magnitude
• Support for VARCHAR and STRING as deduplication keys.

Pull requests

• fix(sql): add support for filling weeks ('w') in SAMPLE BY queries by @nwoolmer in https://github.com/questdb/questdb/pull/4812
• fix(pgwire): fix insert as select statement running twice on pgwire when using prepared statements by @ideoma in https://github.com/questdb/questdb/pull/4820
• fix(sql): fix reading uint16 column as chars from parquet by @ideoma in https://github.com/questdb/questdb/pull/4814
• feat(core): configure to roll log files daily by default when QuestDB set up from binaries by @ideoma in https://github.com/questdb/questdb/pull/4810
• fix(sql): improve check to rule out keyed sample by queries with from-to by @nwoolmer in https://github.com/questdb/questdb/pull/4827
• feat(sql): add table_storage() functionality by @siddharth0815 in https://github.com/questdb/questdb/pull/4817
• fix(sql): fix edge case when using parallel sample by with fill by @nwoolmer in https://github.com/questdb/questdb/pull/4849
• fix(sql): fix file does not exist error on updates by @ideoma in https://github.com/questdb/questdb/pull/4846
• perf(sql): optimize queries with virtual columns, filter, and limit by @puzpuzpuz in https://github.com/questdb/questdb/pull/4858
• fix(sql): NullPointerException thrown on SAMPLE BY query with constant key by @puzpuzpuz in https://github.com/questdb/questdb/pull/4866
• feat(sql): replace SNAPSHOT SQL with CHECKPOINT to reduce confusion by @bluestreak01 in https://github.com/questdb/questdb/pull/4821
• fix(sql): fix error when using sample by with fill(none) by @nwoolmer in https://github.com/questdb/questdb/pull/4864
• feat(sql): checkpoint_status function for read-only checks of in-progress checkpoint by @puzpuzpuz in https://github.com/questdb/questdb/pull/4869
• fix(sql): improve query behaviour when using non-constant FROM clauses in SAMPLE BY by @nwoolmer in https://github.com/questdb/questdb/pull/4850
• fix(ilp): fix incorrect storage of non-ascii characters that can lead to incorrect SQL results by @bluestreak01 in https://github.com/questdb/questdb/pull/4876
• feat(sql): add support for weighted mid price by @alexandrebrilhante in https://github.com/questdb/questdb/pull/4801
• feat(sql): show server_version_num support by @puzpuzpuz in https://github.com/questdb/questdb/pull/4867
• perf(core): reduce default number of WAL apply threads by @puzpuzpuz in https://github.com/questdb/questdb/pull/4865
• fix(core): prevent potential double-close of File Descriptors by @ideoma in https://github.com/questdb/questdb/pull/4874
• fix(core): fix pgwire float precision for text format by @glasstiger in https://github.com/questdb/questdb/pull/4879
• perf(sql): optimize like/ilike/regexp functions on symbol column by @puzpuzpuz in https://github.com/questdb/questdb/pull/4871
• fix(core): align native library naming with JNA convention by @mtopolnik in https://github.com/questdb/questdb/pull/4882
• perf(sql): use radix sort to speed up single integer column order by by @puzpuzpuz in https://github.com/questdb/questdb/pull/4891
• perf(sql): JIT-optimise IN timestamp_literal operator by @zebs97 in https://github.com/questdb/questdb/pull/4750
• fix(core): fix query failure when high limit is used with bind variables by @glasstiger in https://github.com/questdb/questdb/pull/4896
• fix(sql): symbol cannot be set to CACHE immediately after setting it to NOCACHE by @nwoolmer in https://github.com/questdb/questdb/pull/4908
• fix(sql): better overflow behaviour when converting timezones by @jerrinot in https://github.com/questdb/questdb/pull/4824

New Contributors

• @alexandrebrilhante made their first contribution in https://github.com/questdb/questdb/pull/4801

Full Changelog: https://github.com/questdb/questdb/compare/8.1.0...8.1.1