Notice: There is a known issue in this release. Listing access tokens for a user may not return the correct results to the UI due to an unreliable query to DataHub's search backend. This will be resolved in v0.8.39. Note that this does not mean that access tokens will not work or are in any way compromised - the functionality of generating and using access tokens is not impacted.

The below release notes are copied from v0.8.37 release notes.

Highlights

User Experience

This release comes packed full of new features and updates.

• NEW – Create & Revoke Access Tokens via the UI - Find this under Settings > Developer. This replaces the previous stateless tokens UI.
• NEW – Create and Invite Users to DataHub via the UI - Find this under Users & Groups > Invite DataHub users. Admins can also now generate password reset links for their users.
• NEW - Manage Related Glossary Terms via the UI - Add and remove Glossary Terms Contained By and Inherited From a parent via the UI. Find this under Glossary
• UPDATE - Rename “Manage” navigation item to “Govern”
• [IMPORTANT] UPDATE - Move “Users & Groups” navigation item into Settings > Access
• [IMPORTANT] UPDATE - Move “Policies” navigation item into Settings > Access (Privileges)
• FIX - You no longer need to run a reindexing job to start using the new Business Glossary UI. This process is handled for you at boot time.
• Minor fixes & improvements to UI for adding policy users + groups.

Metadata Ingestion

• Support Snowflake ingest via Oauth
• Misc fixes and improvements to existing ingestion sources

Disclaimers:

With this upgrade, we've added a new mechanism for authenticating users: native authentication. By default, this is enabled, which will allow new users to be created by Admin and for the user to login.

If you were previously disabling BOTH JaaS (via AUTH_JAAS_ENABLED = false) AND OIDC, and you still do not want to require a username + password to login, you'll need to add a new environment variable to datahub-frontend-react container: AUTH_NATIVE_ENABLED=false.

What's Changed

• feat(docs): auto-open config section for ingestion sources by @shirshanka in https://github.com/datahub-project/datahub/pull/5075
• feat(spark-lineage): coalesce spark jobs by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5077
• refactor(ui): UI Navigation Refactoring by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5076
• Update docs to alert users to restore indices for their Glossary by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5082
• fix(restore-indices): Do not fail while working with each row by @dexter-mh-lee in https://github.com/datahub-project/datahub/pull/5084
• fix(ingestion): looker - Handling gracefully invalid json in query dynamic field by @treff7es in https://github.com/datahub-project/datahub/pull/5083
• feat(docs): ingest - add tab for config json schema by @shirshanka in https://github.com/datahub-project/datahub/pull/5086
• chore(dep): upgrade json-smart by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5081
• feat(ingest): rest_emitter - Adding option to rest emitter to disable ssl verification by @treff7es in https://github.com/datahub-project/datahub/pull/5042
• feat(cli): suggest upgrades when appropriate by @shirshanka in https://github.com/datahub-project/datahub/pull/5091
• feat(doc): Generating json schema for ingestion recipes by @treff7es in https://github.com/datahub-project/datahub/pull/5092
• feat(ingest): snowflake using oauth by @saxo-lalrishav in https://github.com/datahub-project/datahub/pull/4647
• fix(ui): do not show copy URN buttons when Clipboard API is not available by @Masterchen09 in https://github.com/datahub-project/datahub/pull/5087
• feat(kafka): use a thread pool executor for kafka for thread reuse by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5079
• Manage Access Tokens by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5067
• tests(lookml): adding tests for model deny patterns by @gabe-lyons in https://github.com/datahub-project/datahub/pull/4934
• feat(model): Add optional context field to tag/term association by @dexter-mh-lee in https://github.com/datahub-project/datahub/pull/5085
• fix(glossary) Two quick followup fixes around the new Glossary updates by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5065
• chore(deps): bump eventsource from 1.1.0 to 1.1.1 in /docs-website by @dependabot in https://github.com/datahub-project/datahub/pull/5057
• feat(oidc): add configurable read timeout by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5088
• feat(glossary) Display Incoming 'IsA' Glossary related entities by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5063
• fix(profiling): don't stop if some steps fail by @anshbansal in https://github.com/datahub-project/datahub/pull/5095
• feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5099
• fix(deps): ingest - moving packaging to framework_common by @shirshanka in https://github.com/datahub-project/datahub/pull/5096
• feat(frontend) Allow overriding akka-max-header-value-length by @karoliskascenas in https://github.com/datahub-project/datahub/pull/5094
• refactor(graphql): Migrate Visual Config into the Configuration Provider by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/4780
• chore(akka): upgrade akka http for vuln by @RyanHolstien in https://github.com/datahub-project/datahub/pull/5100
• fix(build): reduce time taken for resolution by @anshbansal in https://github.com/datahub-project/datahub/pull/5106
• fix(build): remove dependencies added for compatibility by @anshbansal in https://github.com/datahub-project/datahub/pull/5108
• fix(ci): pin google-cloud-logging to avoid pip backtracking by @shirshanka in https://github.com/datahub-project/datahub/pull/5109
• Policies page issue by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5107
• chore(deps): Bump spring to 5.3.20 for vuln fix by @pedro93 in https://github.com/datahub-project/datahub/pull/5110
• fix(cli): Bumping avro-gen3 to 0.7.4 by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5098
• feat(docs): Updating example files with the new ingestion recipe suffix by @treff7es in https://github.com/datahub-project/datahub/pull/5103
• feat(graphql): add graphql endpoint to check whether an entity exists by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5102
• feat(looker): ensure explore name matches looker's display name by @shirshanka in https://github.com/datahub-project/datahub/pull/5111
• fix(ui): Fixing missing homescreen logo by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5112
• fix(dbt): final fix of dbt platform instance issues by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5115
• feat(ingestion): bigquery-usage - Collect stats from read event reasons by @treff7es in https://github.com/datahub-project/datahub/pull/5118
• feat(terms) Add ability to Add and Remove Related Terms to Glossary Terms by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5120
• Fixed Issue : Add Members Modal by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5117
• fix(bigquery): handling of empty partitioned tables, improve report message by @anshbansal in https://github.com/datahub-project/datahub/pull/5122
• feat(glossary) Hide self and children from select when moving a GlossaryNode by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5123
• fix(ingestion): bigquery-usage - Removing filtering at queryevents by @treff7es in https://github.com/datahub-project/datahub/pull/5124
• feat(users): add ability to add native users from the UI by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5097
• fix(ingestion): Looker original view name should be used for explore_joins by @sebkim in https://github.com/datahub-project/datahub/pull/4928
• fix(iceberg): Change how MapType are mapped to Avro to support complex Map key type by @cccs-eric in https://github.com/datahub-project/datahub/pull/5060
• fix(ingestion): bigquery-usage - Only send operational metadata for allowed tables by @treff7es in https://github.com/datahub-project/datahub/pull/5127
• fix(dbt): Validator error fix by @BoyuanZhangDE in https://github.com/datahub-project/datahub/pull/5125
• feat(settings): skip calling graphql hooks if user does not have the right permissions by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5136
• fix(ingest): fix table urn for athena connectionType by @mayurinehate in https://github.com/datahub-project/datahub/pull/5135
• Fixed the UI issue on Deprecated Pop-Up issue by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5130
• fix(ui-ingestion): show warning banner when configuring looker ui-ingestion for the first time by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5139
• fix(tokens): Fix stale cache problem, reduce cache timeout for access tokens + fix listing owner tokens by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5140

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.8.37...v0.8.38