📢 Breaking change

• If you already enabled ZO_ENABLE_INVERTED_INDEX=true and you want to keep the old Inverted index data then you can add a new ENV ZO_INVERTED_INDEX_OLD_FORMAT=true. but i recommend use new Inverted index format, it will generate more efficient format. and you also can use match_all_raw(keyword) to search old data without Inverted index.

What's Changed

• feat: auto enable user-defined schema by @taimingl in https://github.com/openobserve/openobserve/pull/3873
• chore: improve message by @prabhatsharma in https://github.com/openobserve/openobserve/pull/3899
• fix: openai schema by @taimingl in https://github.com/openobserve/openobserve/pull/3900
• feat: schema check per req for all logs ingestion APIs by @taimingl in https://github.com/openobserve/openobserve/pull/3829
• feat: add metrics for query lifetime by @haohuaijin in https://github.com/openobserve/openobserve/pull/3893
• fix: include org_id in list_objects for rbac by @Subhra264 in https://github.com/openobserve/openobserve/pull/3841
• fix: error while using arrow_cast with percentile function by @haohuaijin in https://github.com/openobserve/openobserve/pull/3902
• fix: Added more meaningful error messages by @bjp232004 in https://github.com/openobserve/openobserve/pull/3903
• fix: pending query metrics by @haohuaijin in https://github.com/openobserve/openobserve/pull/3908
• fix: cancel query for super cluster by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3909
• feat: dashboard folder UI changes by @ktx-vaidehi in https://github.com/openobserve/openobserve/pull/3731
• fix: dark theme issue on role and group and logs page along with name… by @bjp232004 in https://github.com/openobserve/openobserve/pull/3914
• fix: inverted index search by @oasisk in https://github.com/openobserve/openobserve/pull/3915
• fix: extra path was added in cancel, need only org by @ansrivas in https://github.com/openobserve/openobserve/pull/3913
• fix: trace's span name by @taimingl in https://github.com/openobserve/openobserve/pull/3916
• test: inverted index testcases by @neha00290 in https://github.com/openobserve/openobserve/pull/3920
• fix: unnecessary null field during compaction by @taimingl in https://github.com/openobserve/openobserve/pull/3917
• perf: disable repartition when sort by timestamp desc by @haohuaijin in https://github.com/openobserve/openobserve/pull/3918
• perf: avoid repartition in file group by @haohuaijin in https://github.com/openobserve/openobserve/pull/3921
• feat: ugprade rust to 2024-07-07 by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3922
• fix: query result cache v2 by @oasisk in https://github.com/openobserve/openobserve/pull/3895
• perf: optimize search partition settings by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3924
• chore(deps): bump zerovec from 0.10.2 to 0.10.4 by @dependabot in https://github.com/openobserve/openobserve/pull/3927
• chore(deps): bump eifinger/setup-rye from 3 to 4 by @dependabot in https://github.com/openobserve/openobserve/pull/3925
• fix: inverted index can't get result when the min_timestamp mismatch by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3928
• fix: when adding existing user to another org, given role should be correct by @Subhra264 in https://github.com/openobserve/openobserve/pull/3911
• fix: histogram time to match partition time range by @oasisk in https://github.com/openobserve/openobserve/pull/3926
• chore: set use cache flag by @oasisk in https://github.com/openobserve/openobserve/pull/3929
• chore: set use cache flag by @oasisk in https://github.com/openobserve/openobserve/pull/3931
• fix: added plus sign for getcount call & removed duplicate call from … by @bjp232004 in https://github.com/openobserve/openobserve/pull/3933
• feat: parallelize the tests by @ansrivas in https://github.com/openobserve/openobserve/pull/3930
• fix: avoid otlp tracing being split into parts by @taimingl in https://github.com/openobserve/openobserve/pull/3937
• chore(deps): bump zerovec-derive from 0.10.2 to 0.10.3 by @dependabot in https://github.com/openobserve/openobserve/pull/3936
• feat: secondary index by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3870
• fix: query management exec dur, query range and pagination fix by @ktx-vaidehi in https://github.com/openobserve/openobserve/pull/3934
• fix: query with inverted index by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3946
• fix: enable rbac for index streams by @Subhra264 in https://github.com/openobserve/openobserve/pull/3905
• fix: use _timestamp in TriggerData for triggers usage by @Subhra264 in https://github.com/openobserve/openobserve/pull/3948
• fix: invalid peer certificate: UnknownIssuer for report traces by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3949
• chore: debug query result cache issue by @oasisk in https://github.com/openobserve/openobserve/pull/3943
• ci: remove mimalloc on windows by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3951
• fix: cancel all internal trace_ids by @taimingl in https://github.com/openobserve/openobserve/pull/3952
• fix: cache ratio issue by @oasisk in https://github.com/openobserve/openobserve/pull/3953
• perf: optimize search partition by @hengfeiyang in https://github.com/openobserve/openobserve/pull/3954

🐳 Docker Images

Available at:

• https://gallery.ecr.aws/zinclabs/openobserve
• https://hub.docker.com/r/openobserve/openobserve/tags

Version tags:

• public.ecr.aws/zinclabs/openobserve:v0.10.8-rc5
• public.ecr.aws/zinclabs/openobserve:v0.10.8-rc5-simd
• openobserve/openobserve:v0.10.8-rc5
• openobserve/openobserve:v0.10.8-rc5-simd

📒 Documentation: https://openobserve.ai/docs/

Full Changelog: https://github.com/openobserve/openobserve/compare/v0.10.8-rc4...v0.10.8-rc5