orioledb/orioledb
Fork: 109 Star: 2880 (更新于 2024-10-25 05:20:06)
license: NOASSERTION
Language: C .
OrioleDB – building a modern cloud-native storage engine (... and solving some PostgreSQL wicked problems) 🇺🇦
最后发布版本: beta5 ( 2024-05-14 06:51:34)
OrioleDB – building a modern cloud-native storage engine
(... and solving some PostgreSQL wicked problems)
OrioleDB is a new storage engine for PostgreSQL, bringing a modern approach to database capacity, capabilities and performance to the world's most-loved database platform.
OrioleDB consists of an extension, building on the innovative table access method framework and other standard Postgres extension interfaces. By extending and enhancing the current table access methods, OrioleDB opens the door to a future of more powerful storage models that are optimized for cloud and modern hardware architectures.
OrioleDB is currently distributed under the standard PostgreSQL license.
-
Designed for modern hardware. OrioleDB design avoids legacy CPU bottlenecks on modern servers containing dozens and hundreds CPU cores, providing optimized usage of modern storage technologies such as SSD and NVRAM.
-
Reduced maintenance needs. OrioleDB implements the concepts of undo log and page-mergins, eliminating the need for dedicated garbage collection processes. Additionally, OrioleDB implements default 64-bit transaction identifiers, thus eliminating the well-known and painful wraparound problem.
-
Designed to be distributed. OrioleDB implements a row-level write-ahead log with support for parallel apply. This log architecture is optimized for raft consensus-based replication allowing the implementation of active-active multimaster.
The key technical differentiations of OrioleDB are as follows:
-
No buffer mapping and lock-less page reading. In-memory pages in OrioleDB are connected with direct links to the storage pages. This eliminates the need for in-buffer mapping along with its related bottlenecks. Additionally, in OrioleDB in-memory page reading doesn't involve atomic operations. Together, these design decisions bring vertical scalability for Postgres to the whole new level.
-
MVCC is based on the UNDO log concept. In OrioleDB, old versions of tuples do not cause bloat in the main storage system, but eviction into the undo log comprising undo chains. Page-level undo records allow the system to easily reclaim space occupied by deleted tuples as soon as possible. Together with page-mergins, these mechanisms eliminate bloat in the majority of cases. Dedicated VACUUMing of tables is not needed as well, removing a significant and common cause of system performance deterioration and database outages.
-
Copy-on-write checkpoints and row-level WAL. OrioleDB utilizes copy-on-write checkpoints, which provides a structurally consistent snapshot of data every moment of time. This is friendly for modern SSDs and allows row-level WAL logging. In turn, row-level WAL logging is easy to parallelize (done), compact and suitable for active-active multimaster (planned).
See usage, architecture, and project structure documentation as well as PostgresBuild 2021 slides. To start the development see OrioleDB development quickstart.
Status
OrioleDB now has public beta status. It is recommended for experiments, testing, benchmarking, etc., but is not recommended for production usage. If you are interested in OrioleDB's benefits in production, please contact us.
Installation
Use docker container
We provide docker images for amd64
and arm64v8
architectures under Alpine Linux.
docker pull orioledb/orioledb:latest-pg16
For example it can be started same as postgres server:
# !Don't forget to set default locale to C, POSIX or use icu-locale
docker run --name some-postgres -e POSTGRES_PASSWORD=... -e POSTGRES_INITDB_ARGS="--locale=C" -d -p5432:5432 orioledb/orioledb:latest-pg16
See our dockerhub for details.
Build from source
Before building and installing OrioleDB, one should ensure to have the following:
-
PostgreSQL with extensibility patches: 15 (tag: patches15_22) or 16 (tag: patches16_24);
- for versions before 16
./config
script should be run with--with-icu
- for versions before 16
- Development package of libzstd;
- python 3.5+ with testgres package.
Typical installation procedure may look like this:
$ git clone https://github.com/orioledb/orioledb
$ cd orioledb
# Make sure that postgres bin directory is in PATH before running
$ make USE_PGXS=1
$ make USE_PGXS=1 install
$ make USE_PGXS=1 installcheck
Before starting working with OrioleDB, adding the following line to
postgresql.conf
is required. This change requires a restart of
the PostgreSQL database server.
shared_preload_libraries = 'orioledb.so'
Collations
OrioleDB tables support only ICU, C, and POSIX collations.
So that you don't have to write COLLATE for every "text" field of tables you have options:
Create whole cluster with one of these collations:
initdb --locale=C -D..
# OR
initdb --locale=POSIX -D..
# OR
initdb --locale-provider=icu --icu-locale=en -D...
Create new database with default collation from template0
createdb --locale=C --template template0 ...
# OR
createdb --locale=POSIX --template template0 ...
# OR
createdb --locale-provider=icu --icu-locale=en --template template0 ...
Or using CREATE DATABASE
with LOCALE
or ICU_LOCALE
parameters.
Setup
Run the following SQL query on the database to enable the OrioleDB engine.
CREATE EXTENSION orioledb;
Once the above steps are complete, you can start using OrioleDB's tables. See usage documentation for details.
CREATE TABLE table_name (...) USING orioledb;
最近版本更新:(数据更新于 2024-10-04 22:01:38)
2024-05-14 06:51:34 beta5
2023-12-13 23:22:56 beta4
2023-10-30 05:04:21 beta3
2023-09-11 00:41:07 beta2
2023-06-17 23:42:38 beta1
2023-04-26 20:33:04 alpha13
2023-02-26 23:43:11 alpha12
2023-02-20 17:09:56 alpha11
2023-02-06 22:38:05 alpha10
2022-12-27 09:01:24 alpha9
主题(topics):
database, orioledb, postgres, postgresql, postgresql-extension, sql, table-access-method
orioledb/orioledb同语言 C最近更新仓库
2024-11-04 17:16:21 redis/redis
2024-11-04 10:57:34 EdgeTX/edgetx
2024-10-31 09:06:25 Spooks4576/Ghost_ESP
2024-10-21 23:21:37 pbatard/rufus
2024-10-19 07:55:53 EpicGamesExt/raddebugger
2024-10-15 20:35:06 Mbed-TLS/mbedtls