Highlights

User Experience

• Performance improvements in the UI
• Improvements in CSV connector for easier ingestion - description, ownership, domain support added
• UI form for Snowflake Managed Ingestion so you don't have to make changes in YAML
• Viewing Siblings

Developer Experience

• Ability to stop quickstart instead of nuking
• Customizing mapped ports in quickstart
• New models for dashboard usage
• Circuit breaker and python api for Assertion and Operation

Metadata Ingestion

• Improvements in bigquery connector to only profile some tables
• Intermittent 401 errors during ingestion fixed
• New salesforce connector

What's Changed

• fix(test): add cleanup in tests, make urls configurable by @anshbansal in https://github.com/datahub-project/datahub/pull/5287
• fix(docs,quickstart): release related changes for 0.8.40 by @anshbansal in https://github.com/datahub-project/datahub/pull/5299
• [Deployment]: fix config typo on confluent cloud by @tengis in https://github.com/datahub-project/datahub/pull/5293
• fix(cli): suppress secrets in stacktraces by @anshbansal in https://github.com/datahub-project/datahub/pull/5302
• refactor(ui): Fix settings page divider by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5292
• fix(cli): timeline - category should be owner not ownership by @shirshanka in https://github.com/datahub-project/datahub/pull/5304
• perf(siblings): reduce data fetched by siblings in lineage by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5308
• fix(ingest): bigquery - Fix for bigquery error when there was no bigquery catalog specified by @treff7es in https://github.com/datahub-project/datahub/pull/5303
• fix(ui) Fix entity profile sidebar width issues by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5305
• perf(search): Improve search default performance by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5311
• perf(ui): Performance improvements and misc refactorings in the UI by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5310
• Modified the drop down of Menu Items by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5301
• fix(validation) Fail validation error silently instead of crashing by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5314
• feat(docs) Add documentation on authorization & authentication by @pedro93 in https://github.com/datahub-project/datahub/pull/5265
• fix(ui) Make profile icon clickable to expand header menu by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5317
• refactor(ui): Extract searchable page into its own component (perf + ux) by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5318
• fix(gms) Remove auto-creating status aspect if not present when ingesting by @pedro93 in https://github.com/datahub-project/datahub/pull/5315
• fix(ui): Add missing SearchRoutes component by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5321
• feat(ingest): Ingest Looker dashboard create/update/delete timestamps by @mayurinehate in https://github.com/datahub-project/datahub/pull/5312
• fix(ui): Fix pipeline tasks list loading by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5332
• feat(ingest): lookml - adding support for only emitting reachable vie… by @shirshanka in https://github.com/datahub-project/datahub/pull/5333
• fix(ingest): omit schema fields when name is absent by @mayurinehate in https://github.com/datahub-project/datahub/pull/5275
• fix(siblings) Combine siblings data but remove duplicate data by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5337
• Fix typo in metadata-ingestion.md by @dougpm in https://github.com/datahub-project/datahub/pull/5338
• fix(me) Cache the me query for performance reasons by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5316
• fix(tokens) Adds non-admin tests for access tokens by @pedro93 in https://github.com/datahub-project/datahub/pull/5174
• feat(bigquery): support size, rowcount, lastmodified based table selection for profiling by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5329
• chore: Refactor Python Codebase by @koconder in https://github.com/datahub-project/datahub/pull/5113
• docs(bigquery): profiling report enhancement by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5342
• feat(ingest): update CSV source to support description and ownership type by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5346
• Fixed UI issue: Tags list going outside the container by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5341
• feat(ingest): add salesforce connector by @mayurinehate in https://github.com/datahub-project/datahub/pull/5104
• feat(bootstrap): create abstract class UpgradeStep to abstract away upgrade logic by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5349
• fix(bigquery-usage): dataset name fix for sharded tables by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5347
• docs(features): update grammar on Features overview by @maggiehays in https://github.com/datahub-project/datahub/pull/5350
• fix(ci): fix mysql and kafka-connect ingestion test by @shirshanka in https://github.com/datahub-project/datahub/pull/5352
• feat(ui): add copy function for stats table sample value by @ngamanda in https://github.com/datahub-project/datahub/pull/5331
• fix(ui) Correct show/hide tabs in Settings based on privileges by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5355
• fix(siblings): add useMutationUrn to domain section by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5270
• feat(schema) Show last observed timestamp in the schema tab by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5348
• fix(glossary) Fixes a bug for yaml ingested terms without source_url by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5356
• feat(lineage) Add Lineage tab to Chart and Dashboard entity profiles by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5357
• fix(cassandra): fix Cassandra queries used by IngestDataPlatformInstancesStep by @justinas-marozas in https://github.com/datahub-project/datahub/pull/5199
• refactor(ui): Use createTag mutation for creating new tags from the UI by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5359
• Added recommendation on group modal by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5362
• refactor(ui): Remove unnecessary fields in GraphQL queries by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5358
• feat(ingest) - add audit actor urn to auditStamp by @neojunjie in https://github.com/datahub-project/datahub/pull/5264
• feat(ingest): Domain ingestion usability by @shirshanka in https://github.com/datahub-project/datahub/pull/5366
• fix(config): fixes config key in DataHubAuthorizerFactory by @sgomezvillamor in https://github.com/datahub-project/datahub/pull/5371
• fix(ingest): domains - check whether urn based domain exists during r… by @shirshanka in https://github.com/datahub-project/datahub/pull/5373
• feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart by @NavinSharma13 in https://github.com/datahub-project/datahub/pull/5353
• fix(build): tweak ingestion build by @anshbansal in https://github.com/datahub-project/datahub/pull/5374
• feat(query) Add get_entity_v2 to python package by @aezomz in https://github.com/datahub-project/datahub/pull/5255
• fix(airflow): Fix for failing serialisation when Param was specified + support for external task sensor by @treff7es in https://github.com/datahub-project/datahub/pull/5368
• fix(users): fix to not get invite token unless the invite token modal is visible by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5380
• fix(gms): Propagate token cache error by @pedro93 in https://github.com/datahub-project/datahub/pull/5381
• fix(bootstrap): skip ingesting data platforms that already exist by @aditya-radhakrishnan in https://github.com/datahub-project/datahub/pull/5382
• fix(cli): respect server telemetry settings correctly by @treff7es in https://github.com/datahub-project/datahub/pull/5384
• fix(ingest): bigquery - Graceful bq partition id date parsing failure by @treff7es in https://github.com/datahub-project/datahub/pull/5386
• feat(airflow): Circuit breaker and python api for Assertion and Operation by @treff7es in https://github.com/datahub-project/datahub/pull/5196
• feat(kafka-setup): add options for sasl_plaintext by @abiwill in https://github.com/datahub-project/datahub/pull/5385
• fix(bigquery): multi-project GCP setup run query through correct project by @anshbansal in https://github.com/datahub-project/datahub/pull/5393
• fix(bigquery): add storage project name by @anshbansal in https://github.com/datahub-project/datahub/pull/5395
• Add Changes to support smoke test on Datahub deployed on kubernetes Cluster by @NavinSharma13 in https://github.com/datahub-project/datahub/pull/5334
• fix(PlayCookie) PLAY_TOKEN cookie rejected because userprofile exceeds 4096 chars by @neojunjie in https://github.com/datahub-project/datahub/pull/5114
• feat(dashboards): add datasets field to DashboardInfo aspect by @Masterchen09 in https://github.com/datahub-project/datahub/pull/5188
• feat(siblings): allow viewing siblings separately by @gabe-lyons in https://github.com/datahub-project/datahub/pull/5390
• Added Cursor pointer to tags by @Ankit-Keshari-Vituity in https://github.com/datahub-project/datahub/pull/5389
• feat(GMS): Adding Dashboard Usage Models by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/5399
• fix(quickstart): use platform agnostic way to get folder by @anshbansal in https://github.com/datahub-project/datahub/pull/5400
• Adds support for Domains in CSV source by @pedro93 in https://github.com/datahub-project/datahub/pull/5372
• feat(ingestion) Build out UI form for Snowflake Managed Ingestion by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/5391
• Update application.yml by @liyuhui666 in https://github.com/datahub-project/datahub/pull/5394
• feat(model, graphql, ingest): Dashboard usage by @mayurinehate in https://github.com/datahub-project/datahub/pull/5397
• fix(datahub-client): Fix kafka config issue by @MugdhaHardikar-GSLab in https://github.com/datahub-project/datahub/pull/5403
• build: improve comprehensiveness of gradle clean by @hsheth2 in https://github.com/datahub-project/datahub/pull/5003
• fix(gms): Change MessageDigest to be thread safe by @pedro93 in https://github.com/datahub-project/datahub/pull/5405
• fix(metadata-ingestion): Fix csv enricher test by @pedro93 in https://github.com/datahub-project/datahub/pull/5406
• fix(tests): Removes duplicate policies tests & makes DataHub user configurable by @pedro93 in https://github.com/datahub-project/datahub/pull/5365

New Contributors

• @tengis made their first contribution in https://github.com/datahub-project/datahub/pull/5293
• @dougpm made their first contribution in https://github.com/datahub-project/datahub/pull/5338
• @koconder made their first contribution in https://github.com/datahub-project/datahub/pull/5113
• @NavinSharma13 made their first contribution in https://github.com/datahub-project/datahub/pull/5353
• @aezomz made their first contribution in https://github.com/datahub-project/datahub/pull/5255

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.8.40...v0.8.41