Notice! This version has a few known bugs regarding revocable access tokens. Specifically, the UI for listing access tokens does not work properly unless you have a specific platform privilege. Additionally, there is a delay in revoking access tokens of 6 hours. We recommend that you skip this version and upgrade directly to v0.8.38.

Highlights

User Experience

This release comes packed full of new features and updates.

• NEW – Create & Revoke Access Tokens via the UI - Find this under Settings > Developer. This replaces the previous stateless tokens UI.
• NEW – Create and Invite Users to DataHub via the UI - Find this under Users & Groups > Invite DataHub users. Admins can also now generate password reset links for their users.
• NEW - Manage Related Glossary Terms via the UI - Add and remove Glossary Terms Contained By and Inherited From a parent via the UI. Find this under Glossary
• UPDATE - Rename “Manage” navigation item to “Govern”
• [IMPORTANT] UPDATE - Move “Users & Groups” navigation item into Settings > Access
• [IMPORTANT] UPDATE - Move “Policies” navigation item into Settings > Access (Privileges)
• FIX - You no longer need to run a reindexing job to start using the new Business Glossary UI. This process is handled for you at boot time.
• Minor fixes & improvements to UI for adding policy users + groups.

Metadata Ingestion

• Support Snowflake ingest via Oauth
• Misc fixes and improvements to existing ingestion sources

What's Changed

• feat(docs): auto-open config section for ingestion sources by @shirshanka in https://github.com/datahub-project/datahub/pull/5075
• feat(spark-lineage): coalesce spark jobs by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5077
• refactor(ui): UI Navigation Refactoring by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5076
• Update docs to alert users to restore indices for their Glossary by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5082
• fix(restore-indices): Do not fail while working with each row by @dexter-mh-lee in https://github.com/datahub-project/datahub/pull/5084
• fix(ingestion): looker - Handling gracefully invalid json in query dynamic field by @treff7es in https://github.com/datahub-project/datahub/pull/5083
• feat(docs): ingest - add tab for config json schema by @shirshanka in https://github.com/datahub-project/datahub/pull/5086
• chore(dep): upgrade json-smart by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5081
• feat(ingest): rest_emitter - Adding option to rest emitter to disable ssl verification by @treff7es in https://github.com/datahub-project/datahub/pull/5042
• feat(cli): suggest upgrades when appropriate by @shirshanka in https://github.com/datahub-project/datahub/pull/5091
• feat(doc): Generating json schema for ingestion recipes by @treff7es in https://github.com/datahub-project/datahub/pull/5092
• feat(ingest): snowflake using oauth by @saxo-lalrishav in https://github.com/datahub-project/datahub/pull/4647
• fix(ui): do not show copy URN buttons when Clipboard API is not available by @Masterchen09 in https://github.com/datahub-project/datahub/pull/5087
• feat(kafka): use a thread pool executor for kafka for thread reuse by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5079
• Manage Access Tokens by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5067
• tests(lookml): adding tests for model deny patterns by @gabe-lyons in https://github.com/datahub-project/datahub/pull/4934
• feat(model): Add optional context field to tag/term association by @dexter-mh-lee in https://github.com/datahub-project/datahub/pull/5085
• fix(glossary) Two quick followup fixes around the new Glossary updates by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5065
• chore(deps): bump eventsource from 1.1.0 to 1.1.1 in /docs-website by @dependabot in https://github.com/datahub-project/datahub/pull/5057
• feat(oidc): add configurable read timeout by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5088
• feat(glossary) Display Incoming 'IsA' Glossary related entities by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5063
• fix(profiling): don't stop if some steps fail by @anshbansal in https://github.com/datahub-project/datahub/pull/5095
• feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5099
• fix(deps): ingest - moving packaging to framework_common by @shirshanka in https://github.com/datahub-project/datahub/pull/5096
• feat(frontend) Allow overriding akka-max-header-value-length by @karoliskascenas in https://github.com/datahub-project/datahub/pull/5094
• refactor(graphql): Migrate Visual Config into the Configuration Provider by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/4780
• chore(akka): upgrade akka http for vuln by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5100
• fix(build): reduce time taken for resolution by @anshbansal in https://github.com/datahub-project/datahub/pull/5106
• fix(build): remove dependencies added for compatibility by @anshbansal in https://github.com/datahub-project/datahub/pull/5108
• fix(ci): pin google-cloud-logging to avoid pip backtracking by @shirshanka in https://github.com/datahub-project/datahub/pull/5109
• Policies page issue by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5107
• chore(deps): Bump spring to 5.3.20 for vuln fix by @pedro93 in https://github.com/datahub-project/datahub/pull/5110
• fix(cli): Bumping avro-gen3 to 0.7.4 by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5098
• feat(docs): Updating example files with the new ingestion recipe suffix by @treff7es in https://github.com/datahub-project/datahub/pull/5103
• feat(graphql): add graphql endpoint to check whether an entity exists by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5102
• feat(looker): ensure explore name matches looker's display name by @shirshanka in https://github.com/datahub-project/datahub/pull/5111
• fix(ui): Fixing missing homescreen logo by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5112
• fix(dbt): final fix of dbt platform instance issues by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5115
• feat(ingestion): bigquery-usage - Collect stats from read event reasons by @treff7es in https://github.com/datahub-project/datahub/pull/5118
• feat(terms) Add ability to Add and Remove Related Terms to Glossary Terms by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5120
• Fixed Issue : Add Members Modal by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5117
• fix(bigquery): handling of empty partitioned tables, improve report message by @anshbansal in https://github.com/datahub-project/datahub/pull/5122
• feat(glossary) Hide self and children from select when moving a GlossaryNode by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5123
• fix(ingestion): bigquery-usage - Removing filtering at queryevents by @treff7es in https://github.com/datahub-project/datahub/pull/5124
• feat(users): add ability to add native users from the UI by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5097
• fix(ingestion): Looker original view name should be used for explore_joins by @sebkim in https://github.com/datahub-project/datahub/pull/4928
• fix(iceberg): Change how MapType are mapped to Avro to support complex Map key type by @cccs-eric in https://github.com/datahub-project/datahub/pull/5060
• fix(ingestion): bigquery-usage - Only send operational metadata for allowed tables by @treff7es in https://github.com/datahub-project/datahub/pull/5127
• fix(dbt): Validator error fix by @BoyuanZhangDE in https://github.com/datahub-project/datahub/pull/5125
• feat(settings): skip calling graphql hooks if user does not have the right permissions by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5136

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.8.36...v0.8.37