v0.13.0

datahub-project/datahub

版本发布时间: 2024-03-01 07:20:42

datahub-project/datahub最新发布版本:v0.13.3(2024-05-24 07:11:13)

Breaking Changes

Updating MySQL version for quickstarts to 8.2, may cause quickstart issues for existing instances.
Neo4j 5.x, may require migration from 4.x
Build requires JDK17 (Runtime Java 11)
Build requires Docker Compose > 2.20
#9731 - The acryl-datahub CLI now requires Python 3.8+
#9601 - The Unity Catalog(UC) ingestion source config include_metastore is now disabled by default. This change will affect the urns of all entities in the workspace.
Entity Hierarchy with include_metastore: true (Old)
```
- UC Metastore
  - Catalog
    - Schema
      - Table
```
Entity Hierarchy with include_metastore: false (New)
```
- Catalog
  - Schema
    - Table
```
We recommend using platform_instance for differentiating across metastores.

If stateful ingestion is enabled, running ingestion with latest cli version will perform all required cleanup. Otherwise, we recommend soft deleting all databricks data via the DataHub CLI: datahub delete --platform databricks --soft and then reingesting with latest cli version.
#9601 - The Unity Catalog(UC) ingestion source config include_hive_metastore is now enabled by default. This requires config warehouse_id to be set. You can disable include_hive_metastore by setting it to False to avoid ingesting legacy hive metastore catalog in Databricks.
#9904 - The default Redshift table_lineage_mode is now MIXED, instead of STL_SCAN_BASED. Improved lineage generation is also available by enabling use_lineaege_v2. This v2 implementation will become the default in a future release.

Deprecations

Spark 2.x (including previous JDK8 build requirements)

What's Changed

fix(ingest/transformer): correct registration by @anshbansal in https://github.com/datahub-project/datahub/pull/9418
docs(ingest/sql-queries): Rearrange sections by @asikowitz in https://github.com/datahub-project/datahub/pull/9426
fix: Adjusting the view of the Column Stats by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9430
feat(patch): support fine grained lineage patches by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9408
fix(CVE-2023-6378): update logback classic by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9438
feat: allow the sidebar size to be draggable by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9401
fix(json-schema): do not send invalid URLs by @anshbansal in https://github.com/datahub-project/datahub/pull/9417
fix(ingest/profiling) Fixing profile eligibility check by @treff7es in https://github.com/datahub-project/datahub/pull/9446
fix(ingest): avoid git dependency in dbt by @hsheth2 in https://github.com/datahub-project/datahub/pull/9447
feat(ingest): add retries for tableau by @hsheth2 in https://github.com/datahub-project/datahub/pull/9437
docs(updating-datahub): update docs for v0.12.1 by @david-leifker in https://github.com/datahub-project/datahub/pull/9441
feat: Allow specifying Data Product URN via UI by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9386
Add button to copy urn of an Ownership Type by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9452
docs(ingest/tableau): add token to sink config in sample recipe by @KaYunKIM in https://github.com/datahub-project/datahub/pull/9411
feat(glossary): add ability to clone glossary term(name and documentation) from term profile menu by @allizex in https://github.com/datahub-project/datahub/pull/9445
feat(ingestion): Add typeUrn handling to ownership transformers by @skrydal in https://github.com/datahub-project/datahub/pull/9370
fix(ingest): reduce GraphQL Logs to warning for circuit breaker by @arunvasudevan in https://github.com/datahub-project/datahub/pull/9436
fix: support Apollo caching for settings / Policies by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9442
refactor | PRD-785 | datahub oss: migrate use of useGetAuthenticatedU… by @sumitappt in https://github.com/datahub-project/datahub/pull/9456
refactor(ui): Minor improvements & refactoring by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9420
feat(ingest): add ingest --no-progress option by @BlueHorn07 in https://github.com/datahub-project/datahub/pull/9300
fix(powerbi): add access token refresh by @anshbansal in https://github.com/datahub-project/datahub/pull/9405
fix | PRD-463 | Stop trying to ping the track endpoint on login home … by @sumitappt in https://github.com/datahub-project/datahub/pull/9462
feat(ingest/unity): enable hive metastore ingestion by @mayurinehate in https://github.com/datahub-project/datahub/pull/9416
feat(ingestion/transformer): create tag if not exist by @siddiquebagwan-gslab in https://github.com/datahub-project/datahub/pull/9076
fix(ingest): make user_urn and group_urn generation consider user and… by @shirshanka in https://github.com/datahub-project/datahub/pull/9026
feat(ingestion): Add test_connection methods for important sources by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9334
docs: fix sample command for container logs by @nnnkkk7 in https://github.com/datahub-project/datahub/pull/9427
fix(ingest): bump source configs json schema version by @hsheth2 in https://github.com/datahub-project/datahub/pull/9424
fix(ingest/profiling): Add option to enable external table profiling by @treff7es in https://github.com/datahub-project/datahub/pull/9463
fix(operations): fix get index sizes integer wrap by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9450
feat(build): gradle 8, jdk17, neo4j 5 by @david-leifker in https://github.com/datahub-project/datahub/pull/9458
feat(ingest/redshift): drop repeated operations by @hsheth2 in https://github.com/datahub-project/datahub/pull/9440
feat: Deprecation 'Note' changed to Markdown Renderable by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9396
feat : markdown support for group description by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9455
feat(ingest): enable CLL for dbt by default by @hsheth2 in https://github.com/datahub-project/datahub/pull/9466
fix(ingest/snowflake) - Fixing snowflake url with default region by @treff7es in https://github.com/datahub-project/datahub/pull/9443
Fix downstream CI issue by @noggi in https://github.com/datahub-project/datahub/pull/9479
feat(ingest): pydantic v2 compatibility by @hsheth2 in https://github.com/datahub-project/datahub/pull/9434
feat(gms): Add support for platform-based browse by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9376
Searching for users on Users page shows incorrect roles: Issue resolved by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9474
fix(ingest/redshift: Fixing operation query to not return duplicate operations by @treff7es in https://github.com/datahub-project/datahub/pull/9481
Fade recipe section to transparent on Ingestion Run Details by @purnimagarg1 in https://github.com/datahub-project/datahub/pull/9404
Allow message_name field for protobuf ingestion by @eboneil in https://github.com/datahub-project/datahub/pull/9480
feat(docker-compose): consolidate docker-compose profiles by @david-leifker in https://github.com/datahub-project/datahub/pull/9478
Adds urnBasedPagination option to datahub-upgrade RestoreIndices by @nmbryant in https://github.com/datahub-project/datahub/pull/9232
fix(quickstart): force strings for mysql version by @david-leifker in https://github.com/datahub-project/datahub/pull/9485
fix(docker): fix frontend dev docker path by @david-leifker in https://github.com/datahub-project/datahub/pull/9488
fix: Tab doesn't represent the page you are on for non-data asset pages by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9468
Do not sync demo in downstream repos by @noggi in https://github.com/datahub-project/datahub/pull/9493
fix(ingest): update ingest_stats event with transformer types by @hsheth2 in https://github.com/datahub-project/datahub/pull/9487
feat | PRD-874 | Keep the same tab selected when browsing Glossary tr… by @sumitappt in https://github.com/datahub-project/datahub/pull/9469
style | PRD-893 | Tag overflow is missing padding by @sumitappt in https://github.com/datahub-project/datahub/pull/9497
feat(analytics): change MAU chart to be until last month by @anshbansal in https://github.com/datahub-project/datahub/pull/9499
fix(kafka): fix infinite deserialization logging by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9494
fix(ingest/fivetran): only materialize upstream lineage by @hsheth2 in https://github.com/datahub-project/datahub/pull/9490
feat(ingest): handle multiline string coercion by @hsheth2 in https://github.com/datahub-project/datahub/pull/9484
fix(ingest/databricks): Pinning databricks sdk to not fail on mypy issues by @treff7es in https://github.com/datahub-project/datahub/pull/9500
feat(ingest): remove librdkafka hacks by @hsheth2 in https://github.com/datahub-project/datahub/pull/9507
feat(ingest): rename custom package path from models to metadata by @hsheth2 in https://github.com/datahub-project/datahub/pull/9502
Prd 886 edit links by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9498
feat(ingest): support CLL for redshift materialized views with auto refresh by @hsheth2 in https://github.com/datahub-project/datahub/pull/9508
feat: Input field added for the Custom cron, and issue on search sour… by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9510
fix(ingest): update dbt type inference by @hsheth2 in https://github.com/datahub-project/datahub/pull/9512
feat(ingest/redshift): merge CLL instead of overwriting by @hsheth2 in https://github.com/datahub-project/datahub/pull/9513
Add debounce on search on ingestion listing page by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9516
fix: correct the color of edit links by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9517
fix(frontend): Add JSON list oidc group extraction logic by @ethan-cartwright in https://github.com/datahub-project/datahub/pull/9495
feat(frontend): align frontend sso code with refactors by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9506
fix(ingest/glue): glue table partition (Athena v3) profiling parameters retrieval error by @KulykDmytro in https://github.com/datahub-project/datahub/pull/9521
fix(ingest/fivetran): handle missing user_id for a connection by @ryaminal in https://github.com/datahub-project/datahub/pull/9460
feat(ui): Allow copying assertion urn from the UI by @sumitappt in https://github.com/datahub-project/datahub/pull/9523
feat(ingest/openapi): support proxies and alternate auth schemes by @fer-marino in https://github.com/datahub-project/datahub/pull/9492
build(ingest/feast): upgrade to latest feast version by @cburroughs in https://github.com/datahub-project/datahub/pull/9439
build: enable gradle caching by @hsheth2 in https://github.com/datahub-project/datahub/pull/9525
chore(build): update base-requirements + add script for regeneration by @hsheth2 in https://github.com/datahub-project/datahub/pull/9524
add automatic reset password test by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9515
feat(ingestion/bigquery): Use sqlglot_lineage for usage and add more perf timers by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9247
fix(ingest/mongodb): support disabling schemaSamplingSize by @diegoreico in https://github.com/datahub-project/datahub/pull/9295
fix(ingest): Fix mongodb ingestion when platform_instance is missing from recipe by @TonyOuyangGit in https://github.com/datahub-project/datahub/pull/9486
fix(ingest/snowflake): explicit set schema if public schema is absent by @mayurinehate in https://github.com/datahub-project/datahub/pull/9526
fix | PRD-901 | Border is too thick for sidebar by @sumitappt in https://github.com/datahub-project/datahub/pull/9528
Humanise duration shown on ingestion page by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9530
fix(cli): fix issue with upsert for data product external url by @anshbansal in https://github.com/datahub-project/datahub/pull/9534
fix posts are failing to be created as Admin user by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9533
while creating secrets via UI validate validate character~ by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9548
feat(ui): add databricks logo by @mayurinehate in https://github.com/datahub-project/datahub/pull/9473
feat(databricks): add hive metastore analyze profiling by @mayurinehate in https://github.com/datahub-project/datahub/pull/9511
Fix/PRD-906 make setting manage policy test by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9547
search user functionality added by @kushagra-apptware in https://github.com/datahub-project/datahub/pull/9532
fix(ci): make test flexible to allow sha-based cli versions by @shirshanka in https://github.com/datahub-project/datahub/pull/9551
feat/PRD-895-Navigation-test by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9545
docs(acryl cloud): release notes for 0.2.14.1 by @anshbansal in https://github.com/datahub-project/datahub/pull/9554
ci(doc): tweak build rule to avoid docker build for docs by @anshbansal in https://github.com/datahub-project/datahub/pull/9555
fix(ingest): improve kafka-connect test stability by @hsheth2 in https://github.com/datahub-project/datahub/pull/9519
fix(ingest/looker): add user stats to report by @hsheth2 in https://github.com/datahub-project/datahub/pull/9505
perf(lineage): Rewrite lineage query for Elastic graph store by @shirshanka in https://github.com/datahub-project/datahub/pull/9552
feat(ingest): improve config loading helpers by @hsheth2 in https://github.com/datahub-project/datahub/pull/9477
feat(patch): add dashboardInfo and chartInfo support for patch by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9536
feat(docker): docker compose profiles updates by @david-leifker in https://github.com/datahub-project/datahub/pull/9514
feat(ui): switch to vite and vitest by @hsheth2 in https://github.com/datahub-project/datahub/pull/9451
fix(graphql): BatchGetEntitiesResolver respects order by @shirshanka in https://github.com/datahub-project/datahub/pull/9557
ci(label): datahub-community-champion label based off usernames by @anshbansal in https://github.com/datahub-project/datahub/pull/9558
feat(quickstart): add actions to debug quickstart by @david-leifker in https://github.com/datahub-project/datahub/pull/9559
refactor: PRD-900 | Review glossary related cypress tests and extract… by @sumitappt in https://github.com/datahub-project/datahub/pull/9549
fix(compose-profiles): hostname kafka-broker -> broker by @david-leifker in https://github.com/datahub-project/datahub/pull/9563
build(spark-smoke): dump container logs for spark smoke test by @david-leifker in https://github.com/datahub-project/datahub/pull/9565
fix(ingest/looker): limit dashboard object lifetime to thread by @hsheth2 in https://github.com/datahub-project/datahub/pull/9564
feat(ingest): track thread count in ingestion report by @hsheth2 in https://github.com/datahub-project/datahub/pull/9566
build(deps): bump @adobe/css-tools from 4.3.1 to 4.3.2 in /datahub-web-react by @dependabot in https://github.com/datahub-project/datahub/pull/9561
Lower count for CSV download query from 500 to 200 to alleviate timeouts by @eboneil in https://github.com/datahub-project/datahub/pull/9568
fix(ci): ignore binaries from test results upload by @hsheth2 in https://github.com/datahub-project/datahub/pull/9560
fix(ci): fix label logic by @anshbansal in https://github.com/datahub-project/datahub/pull/9571
bump(docker-compose): migrate to v2 docker compose cli by @david-leifker in https://github.com/datahub-project/datahub/pull/9569
feat(ingestion/transformer): Add dataset dataproduct transformer by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9491
Fix - Removed AWS S3 Platform by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9581
feat(entity-registry): entity registry plugins by @david-leifker in https://github.com/datahub-project/datahub/pull/9538
Fix/glossary test by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9584
fix(owner): last modified on adding owner by @anshbansal in https://github.com/datahub-project/datahub/pull/9553
fix(frontend): restrict redirect uri domain by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9592
docs(slack): add note about private Slack channels by @hsheth2 in https://github.com/datahub-project/datahub/pull/9589
fix(ingest/snowflake): set platform instance for foreign keys by @hsheth2 in https://github.com/datahub-project/datahub/pull/9577
fix(ingest/redshift): include table type in custom properties by @hsheth2 in https://github.com/datahub-project/datahub/pull/9576
fix(graphql): fix npe in access mapper by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9593
fix(ingest/bigquery): support google-cloud-bigquery 3.15.0 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9595
Fix - updated verification steps by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9598
fix(ingestion/starburst-trino): Fix validation errors in TrinoJoinedAccessEvent by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9580
feat(ingest/snowflake): improve accuracy of computed sample-based pro… by @mayurinehate in https://github.com/datahub-project/datahub/pull/9600
feat(ingestion/fivetran): Add fivetran bigquery destination support by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9531
feat: Auto-focus on entity profile action modals by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9444
fix(ingest): support database_pattern in clickhouse and clickhouse-usage by @Gerrit-K in https://github.com/datahub-project/datahub/pull/9482
feat(ingest/tableau): include platform_instance in browse v1 path by @hsheth2 in https://github.com/datahub-project/datahub/pull/9607
Fix/nested domain test by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9609
feat(ingest/tableau): add retries on OSErrors by @hsheth2 in https://github.com/datahub-project/datahub/pull/9596
feat(spring): update spring to version 6 and spring boot to version 3 by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9567
feat(ingest): key-partitioning for rest emitter by @hsheth2 in https://github.com/datahub-project/datahub/pull/9613
fix(ingest/nifi): make s3 dataset urn consistent with s3 source by @mayurinehate in https://github.com/datahub-project/datahub/pull/9599
Fix - Changed popup text visibility and removed unnecessary code by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9611
feat(ingest/looker): add retries to API calls by @hsheth2 in https://github.com/datahub-project/datahub/pull/9606
fix(graphql): Add jsonProps to SchemaField type by @pedro93 in https://github.com/datahub-project/datahub/pull/9622
feat(ingest/looker): add backpressure-aware executor by @hsheth2 in https://github.com/datahub-project/datahub/pull/9615
fix(ingest/mongodb): Fix downsampling the collection schema output undetermined by @TonyOuyangGit in https://github.com/datahub-project/datahub/pull/9612
Unskip "type" filter tests by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9630
feat(ingest/dbt): speed up dbt CLL by @hsheth2 in https://github.com/datahub-project/datahub/pull/9617
Added Homepage Post Steps by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9620
feat(graphql): generate ToString method by @anshbansal in https://github.com/datahub-project/datahub/pull/9634
fix(internal schema): changes to make internal schema registry more compatible with other schema registries by @darnaut in https://github.com/datahub-project/datahub/pull/9636
fix(autocomplete): Filter default entity types based on those present in types map by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9625
feat: inital champions page by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9429
docs: add intro video to the docs main page by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9597
feat(search): add support for empty aggregations through searchable annotation by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9624
docs: add events link by @hsheth2 in https://github.com/datahub-project/datahub/pull/9638
feat(ingest/dbt-cloud): Add way to customize dbt cloud access endpoint by @treff7es in https://github.com/datahub-project/datahub/pull/9633
build(ingest/feast): upgrade to latest feast version (0.35.x) by @cburroughs in https://github.com/datahub-project/datahub/pull/9627
feat(classifier): Add support for excluding list of exact column names by @ethan-cartwright in https://github.com/datahub-project/datahub/pull/9472
feat(cli): add threads to sink report by @anshbansal in https://github.com/datahub-project/datahub/pull/9642
fix(extension) Fixes routing for the embed pages for chrome extension by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9648
feat: add an endpoint to edit posts by @muzzacode in https://github.com/datahub-project/datahub/pull/9629
feat(monitoring): add metrics for kafka consumers by @anshbansal in https://github.com/datahub-project/datahub/pull/9643
feat(web): update aws logos by @rinzool in https://github.com/datahub-project/datahub/pull/9660
fix(docs-website): update copy around the video on index by @hsheth2 in https://github.com/datahub-project/datahub/pull/9661
fix(protobuf): fix reseved field error in fields in nested messages by @wngus606 in https://github.com/datahub-project/datahub/pull/9318
feat(ingest/databricks): ingest hive metastore by default, more docs by @mayurinehate in https://github.com/datahub-project/datahub/pull/9601
fix(docker):The datahub-frontend service failed to start when executing dev.sh #7616 by @yangjiandan in https://github.com/datahub-project/datahub/pull/7618
feat(openapi): Implement getIndexSizes function from rest.li in openapi by @iprentic in https://github.com/datahub-project/datahub/pull/8730
feat(ingest/sql-parsing): Support file backed dict in SqlParsingBuilder for lineage by @asikowitz in https://github.com/datahub-project/datahub/pull/9654
feat(posts): add edit support for posts by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9666
feat(roles): Add support for roles in groups in GMS by @pedro93 in https://github.com/datahub-project/datahub/pull/9659
fix(frontend): Add fallback for image load error on Avatar by @ingthorb in https://github.com/datahub-project/datahub/pull/9501
fix(user-removal): resolve user removal list update issue by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9671
feat(ui) Add standardized GQL error handling function to FE by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9470
feat(kafka): add health indicator for kafka by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9662
perf(entity-service): batch exists calls by @david-leifker in https://github.com/datahub-project/datahub/pull/9663
feat(ingest/airflow): support airflow 2.8 dataset listeners by @hsheth2 in https://github.com/datahub-project/datahub/pull/9664
fix(docs): Correct Kafka Connect sink documentation by @pedro93 in https://github.com/datahub-project/datahub/pull/9672
docs(observability): add databricks as supported source by @mayurinehate in https://github.com/datahub-project/datahub/pull/9619
feat(build): conditional ci by @david-leifker in https://github.com/datahub-project/datahub/pull/9673
build(deps-dev): bump vite from 4.5.0 to 4.5.2 in /datahub-web-react by @dependabot in https://github.com/datahub-project/datahub/pull/9676
feat(superset): add some custom properties for dashboards by @rinzool in https://github.com/datahub-project/datahub/pull/9670
fix(superset): handle comma in dataset table name by @rinzool in https://github.com/datahub-project/datahub/pull/9656
feat(openapi): allow swagger 3.x by @dim-ops in https://github.com/datahub-project/datahub/pull/9646
feat(ingest/superset): add domains and platform_instance support by @rinzool in https://github.com/datahub-project/datahub/pull/9647
fix(workflow): workflow tweaks by @david-leifker in https://github.com/datahub-project/datahub/pull/9678
feat(ingest/databricks): view upstream lineage for hive metastore by @mayurinehate in https://github.com/datahub-project/datahub/pull/9657
feat(ingest/dynamodb): add domain arg by @dim-ops in https://github.com/datahub-project/datahub/pull/9658
feat(backend): structured properties and forms by @david-leifker in https://github.com/datahub-project/datahub/pull/9626
feat(ingest/lookml): support complex lookml manifests by @hsheth2 in https://github.com/datahub-project/datahub/pull/9688
docs: Add Case Studies and DataHub Basics to Resources tab by @maggiehays in https://github.com/datahub-project/datahub/pull/9687
fix(ingestion/mssql): use platform_instance for mssql dataflow/datajob by @sleeperdeep in https://github.com/datahub-project/datahub/pull/9527
Added to Verify Edit Post Steps by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9683
feat(ingest): improve sql tests + dbt reporting by @hsheth2 in https://github.com/datahub-project/datahub/pull/9649
feat(ingest/sql-parser): test redshift temp tables by @hsheth2 in https://github.com/datahub-project/datahub/pull/9653
feat(policies): Allow policies to be applied to resources based on tags by @pedro93 in https://github.com/datahub-project/datahub/pull/9684
feat(role-assignment): add role assignment dropdown in the UI for groups by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9689
feat(ingest/looker): add browse paths for charts by @hsheth2 in https://github.com/datahub-project/datahub/pull/9639
fix: Fix error message when attempting to delete home page posts with… by @Salman-Apptware in https://github.com/datahub-project/datahub/pull/9667
feat(ui) Support auto-render aspects on remaining entity types by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9696
fix(consumer): wait for internal schema registry by @darnaut in https://github.com/datahub-project/datahub/pull/9699
feat(build): support jdk8 spark lineage by @david-leifker in https://github.com/datahub-project/datahub/pull/9697
feat(ingest): add ODBC library and tools to base image by @darnaut in https://github.com/datahub-project/datahub/pull/9701
feat (resolver): Add new endpoint for editing secrets by @muzzacode in https://github.com/datahub-project/datahub/pull/9665
feat(ingest): handling for const in json schema by @anshbansal in https://github.com/datahub-project/datahub/pull/9694
refactor(ingest): simplify adding aspects to MCEs in transformers by @hsheth2 in https://github.com/datahub-project/datahub/pull/9686
docs(openapi): improve description fields by @dim-ops in https://github.com/datahub-project/datahub/pull/9690
feat(docs): Add documentation on Incident Change Event by @pedro93 in https://github.com/datahub-project/datahub/pull/9709
feat(ingest/dbt): support aws config without region by @hsheth2 in https://github.com/datahub-project/datahub/pull/9650
fix(test): improve cypress tests by @david-leifker in https://github.com/datahub-project/datahub/pull/9711
feat(ingest/tableau): map trino_jdbc platform type by @hsheth2 in https://github.com/datahub-project/datahub/pull/9708
fix(oidc settings): effective JWS algorithm setting by @darnaut in https://github.com/datahub-project/datahub/pull/9712
feat(ingest/metabase): Use new sql parser; reduce error reporting levels by @asikowitz in https://github.com/datahub-project/datahub/pull/9714
fix(ingestion/bigquery): Table-view-snapshot Lineage Bug fix by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9579
feat(ui) Add structured properties support in the UI by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9695
docs(): Updating docs for assertions to correct databricks assertions support by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9713
test(spark-lineage): minor tweaks by @david-leifker in https://github.com/datahub-project/datahub/pull/9717
feat(search): support filtering on count type searchable fields for equality by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9700
feat(ui): Supporting rendering custom assertion descriptions by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9722
infra(ui): Add a react context provider allowing sub-components to update theme conf by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9674
fix(ingestion/metabase): Fetch Dashboards through Collections by @7onn in https://github.com/datahub-project/datahub/pull/9631
fix(ingest/glue): Profiling breaks for non-partitioned tables due to absent Table.PartitionKeys by @KulykDmytro in https://github.com/datahub-project/datahub/pull/9591
fix(search): fix filters for hasX and numValues fields by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9729
fix(ingest/airflow): fix plugin support for airflow 2.5.0 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9719
fix(cli): fix example data contract yaml + update airflow codecov by @hsheth2 in https://github.com/datahub-project/datahub/pull/9707
fix(ingest/metabase): add missing sql parser dep by @hsheth2 in https://github.com/datahub-project/datahub/pull/9725
feat(glossary-term-dropdown): include parent term groups in dropdown by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9715
fix(ingest/s3): Not sorting schema fields to keep original order by @treff7es in https://github.com/datahub-project/datahub/pull/9349
fix(ingest/test): Fixing breaking change in moto 5.0 library by @treff7es in https://github.com/datahub-project/datahub/pull/9736
build(graphql): simplify gradle graphql codegen task by @shirshanka in https://github.com/datahub-project/datahub/pull/9734
feat(edit-secret): frontend support to edit secrets by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9737
chore(cli): drop support for python 3.7 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9731
docs: Add slack survey page by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9590
feat(platform): add support for via nodes by @shirshanka in https://github.com/datahub-project/datahub/pull/9733
feat(ingestion/tableau) Ingest tags from datasource by @eboneil in https://github.com/datahub-project/datahub/pull/9730
feat(ingest/okta): option to only ingest users from filtered groups by @anshbansal in https://github.com/datahub-project/datahub/pull/9738
feat(cli): add sibling helper CLI command by @anshbansal in https://github.com/datahub-project/datahub/pull/9744
chore(gms): allow adjusting the log level for gms debug log file by @darnaut in https://github.com/datahub-project/datahub/pull/9743
build(ingestion-smoke): fix smoke dockerfile by @david-leifker in https://github.com/datahub-project/datahub/pull/9724
feat(cli): option to init via username password, add lint for smoke-test by @anshbansal in https://github.com/datahub-project/datahub/pull/9675
feat(forms) Update form model to include searchable on actor assignment by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9747
feat(ingestion/dbt): multiple node owner separated by comma by @sid-acryl in https://github.com/datahub-project/datahub/pull/9740
fix(mceConsumer): prevent health endpoint authentication failure by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9748
fix(ingest/transformer): generate ownership aspect from handle_end_of_stream by @sid-acryl in https://github.com/datahub-project/datahub/pull/9720
fix(aspects): fix default aspect generation for non-restli locations by @david-leifker in https://github.com/datahub-project/datahub/pull/9746
chore(compose): mysql compose healthcheck by @david-leifker in https://github.com/datahub-project/datahub/pull/9754
chore(gradle): datahub-frontend docker dependency avoid yarnInstall by @david-leifker in https://github.com/datahub-project/datahub/pull/9758
fix(search): fix default entities for aggregation filters by @david-leifker in https://github.com/datahub-project/datahub/pull/9761
feat(ingestion/redshift): collapse lineage to permanent table by @sid-acryl in https://github.com/datahub-project/datahub/pull/9704
fix(ingest): upgrade pytest-docker by @hsheth2 in https://github.com/datahub-project/datahub/pull/9765
fix(patch): patch builder import TagUrn by @david-leifker in https://github.com/datahub-project/datahub/pull/9764
feat(forms) Add support for metadata forms on entities in the UI by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9718
chore(ingest/feast): drop redundant typeguard constraint by @cburroughs in https://github.com/datahub-project/datahub/pull/9770
feat(ingestion/feast): loosen feast dependency by @cburroughs in https://github.com/datahub-project/datahub/pull/9769
feat(ci): check for packages, change location of lint by @anshbansal in https://github.com/datahub-project/datahub/pull/9759
feat(tag-filter): Add tag as filer in policy creation page by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9756
feat(ingest/metabase): Allow to configure a different url for links by @ilpianista in https://github.com/datahub-project/datahub/pull/9727
docs(elastricsearch): add description fiels by @dim-ops in https://github.com/datahub-project/datahub/pull/9693
fix(ingest/snowflake): stop pinning transitive spacy dependency by @cburroughs in https://github.com/datahub-project/datahub/pull/9768
feat(cli): Add support for custom ownership types to dataproduct CLI by @skrydal in https://github.com/datahub-project/datahub/pull/9762
docs: update champion bio by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9773
fix(ingest/fivetran): Fixing issue when connector user is empty by @treff7es in https://github.com/datahub-project/datahub/pull/9774
feat(ingest/glossary): support pydantic v2 in business-glossary source by @hsheth2 in https://github.com/datahub-project/datahub/pull/9763
fix(datahub-flow-diagram): add missing image for onboarding tour by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9783
Update aws.md by @scalvanese452 in https://github.com/datahub-project/datahub/pull/9726
fix(gms/search):Fix missing mapping of DOUBLE searchable type by @siladitya2 in https://github.com/datahub-project/datahub/pull/9651
chore(lint): apply spotless by @david-leifker in https://github.com/datahub-project/datahub/pull/9789
docs(observe): add upsert assertion monitor graphql examples by @mayurinehate in https://github.com/datahub-project/datahub/pull/9766
fix(docs): fix the subtitle on the slack page by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9781
feat(airflow) Override datajob external_url by @gp1105739 in https://github.com/datahub-project/datahub/pull/9681
fix(browsev2): align browse and aggregate queries by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9790
misc: datahub-upgrade improvements, aspect key & default aspects fixes by @david-leifker in https://github.com/datahub-project/datahub/pull/9796
chore(pegasus): upgrade pegasus, remove gradle 8 hacks for pegasus plugin by @david-leifker in https://github.com/datahub-project/datahub/pull/9798
feat(graphql): get raw aspects for assertions, allow aspectNames filter by @mayurinehate in https://github.com/datahub-project/datahub/pull/9792
feat(ingest/slack): source to get user info from slack by @anshbansal in https://github.com/datahub-project/datahub/pull/9776
Added mutiple tests scenarios by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9750
feat(token): helper to debug owner of raw token by @anshbansal in https://github.com/datahub-project/datahub/pull/9793
fix(forms) Update styles of submit/confirm button and fix num input bug by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9797
feat(structured-props) Extend structured props support to other entity types by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9780
feat(recommendations): Correct searchable entities for top platform by @pedro93 in https://github.com/datahub-project/datahub/pull/9800
feat(ingest/dbt): speed up test result only ingestion by @hsheth2 in https://github.com/datahub-project/datahub/pull/9791
feat(access-token-list): admin being able to view all org access tokens by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9803
feat(graphql): add configuration for limiting graphql query complexity by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9802
feat(docs): embed luma calendar widget by @yoonhyejin in https://github.com/datahub-project/datahub/pull/9784
docs: fix links to metadata modeling by @rubiojr in https://github.com/datahub-project/datahub/pull/9685
feat(ingest): sql parsing aggregator by @hsheth2 in https://github.com/datahub-project/datahub/pull/9786
feat(ingest/glossary): handle ownership type in business glossary connector by @sgomezvillamor in https://github.com/datahub-project/datahub/pull/9805
test(ingest): use pytest-random-order for unit tests by @hsheth2 in https://github.com/datahub-project/datahub/pull/9753
feat(cli): make docker compose project name configurable by @hsheth2 in https://github.com/datahub-project/datahub/pull/9808
feat(ingest/oracle): support changing data dictionary (ALL_ or DBA_) by @sleeperdeep in https://github.com/datahub-project/datahub/pull/8873
feat(quickstart): remove container_name from compose files by @hsheth2 in https://github.com/datahub-project/datahub/pull/9809
fix(cli): fix quickstart command with pydantic v2 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9806
docs: update docs referencing jdk8 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9807
feat(openapi): allow Bearer token by @dim-ops in https://github.com/datahub-project/datahub/pull/9669
Upgrade shiro-core to 1.13 by @gp1105739 in https://github.com/datahub-project/datahub/pull/9818
fix(mysql-setup): specify charset and collation when creating table by @darnaut in https://github.com/datahub-project/datahub/pull/9817
feat(build): upgrade fastapi and gitdb due to vulnerablities by @gp1105739 in https://github.com/datahub-project/datahub/pull/9819
fix(ingest/profiling): ignore limit/offset when counting table row count in profiling by @treff7es in https://github.com/datahub-project/datahub/pull/9635
build(deps): bump follow-redirects from 1.15.2 to 1.15.4 in /docs-website by @dependabot in https://github.com/datahub-project/datahub/pull/9603
fix(forms) Set form prompts default not required by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9820
refactor(graphql): consolidate cache for stats by @david-leifker in https://github.com/datahub-project/datahub/pull/9826
feat(forms) Extend forms support to other entity types by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9801
doc(policies): consistent descriptions for root user policies by @anshbansal in https://github.com/datahub-project/datahub/pull/9823
doc(acryl cloud): release notes for 0.2.15.1 by @anshbansal in https://github.com/datahub-project/datahub/pull/9837
fix(forms) Prevent schema field prompts from being required by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9831
fix(ui/token): token page failing to render by @anshbansal in https://github.com/datahub-project/datahub/pull/9827
fix(ui/lineage): Do not crash on query entity by @asikowitz in https://github.com/datahub-project/datahub/pull/9836
feat(): Adding supports for data incidents for datasets, dashboards, charts, data jobs, data flows by @jjoyce0510 in https://github.com/datahub-project/datahub/pull/9710
feat(ingest): reporting logging tweaks by @hsheth2 in https://github.com/datahub-project/datahub/pull/9835
feat(operations): add explain endpoint for search by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9832
fix(search): fix inequality filters for count fields by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9858
feat(ingest): clean up reporting methods by @hsheth2 in https://github.com/datahub-project/datahub/pull/9848
feat(graphql): Miscellaneous query additions by @asikowitz in https://github.com/datahub-project/datahub/pull/9855
refactor(ui): Update eslint and rearrange imports by @asikowitz in https://github.com/datahub-project/datahub/pull/9854
feat(models,ui): Support query nodes in lineage by @asikowitz in https://github.com/datahub-project/datahub/pull/9850
feat(ui): Add and update platform logos by @asikowitz in https://github.com/datahub-project/datahub/pull/9849
feat(ingest/dynamoDB): flatten struct fields by @TonyOuyangGit in https://github.com/datahub-project/datahub/pull/9852
fix(ingest/looker): update for Looker query API breaking change by @feldjay in https://github.com/datahub-project/datahub/pull/9865
chore(graphql): bump graphql engine version by @david-leifker in https://github.com/datahub-project/datahub/pull/9864
fix(ingest/redash): Limit size of RedashSourceReport by @atjones0011 in https://github.com/datahub-project/datahub/pull/9873
feat(forms) Add batchRemoveForm graphql endpoint by @chriscollins3456 in https://github.com/datahub-project/datahub/pull/9840
fix(lineage): logging reduction and fixes by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9878
feat(ingest): add escape hatch methods to SqlParsingAggregator by @hsheth2 in https://github.com/datahub-project/datahub/pull/9860
fix(ingest): better logging line attribution by @hsheth2 in https://github.com/datahub-project/datahub/pull/9876
fix(ingest): bump sqlglot + add some debug info to tests by @hsheth2 in https://github.com/datahub-project/datahub/pull/9867
docs(ingest): document remote for ingest deploy by @gabe-lyons in https://github.com/datahub-project/datahub/pull/9897
build(workflow): test enable workflow for docs change by @david-leifker in https://github.com/datahub-project/datahub/pull/9901
feat(ingest/mongodb): improve sorting when downsampling collection schema by @TonyOuyangGit in https://github.com/datahub-project/datahub/pull/9856
feat(ingest/snowflake): speed up snowflake usage query by @hsheth2 in https://github.com/datahub-project/datahub/pull/9899
feat(structured-properties): soft delete by @david-leifker in https://github.com/datahub-project/datahub/pull/9812
feat(ingest): add timeout to sqlglot parser by @hsheth2 in https://github.com/datahub-project/datahub/pull/9868
feat(models): Add subtypes aspect to dataFlow by @asikowitz in https://github.com/datahub-project/datahub/pull/9866
fix(cli): add-sibling preserve existing siblings by @stevenayers in https://github.com/datahub-project/datahub/pull/9907
feat(ingest/redshift): redshift lineage v2 by @hsheth2 in https://github.com/datahub-project/datahub/pull/9904
build(frontend): Add tsc to lint by @asikowitz in https://github.com/datahub-project/datahub/pull/9911
fix(posts): add padding to post link card by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9883
feat(ingestion/trino): Add sibling support in ingestion by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9853
PRD-1069 | Changed secret name by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9917
feat(policies): Make policies searchable by privilege, type, status or editable fields by @pedro93 in https://github.com/datahub-project/datahub/pull/9877
feat(ci): exempt more names from being marked as community by @anshbansal in https://github.com/datahub-project/datahub/pull/9918
feat(ingest/qlik): Qlik cloud connector integration by @shubhamjagtap639 in https://github.com/datahub-project/datahub/pull/9682
feat(ingest): use uv for python package installs by @hsheth2 in https://github.com/datahub-project/datahub/pull/9885
feat(ingest/tableau): add non-embedded custom sql to project container by @hsheth2 in https://github.com/datahub-project/datahub/pull/9875
fix(ingest/patch): Adding proper json patch path quoting by @treff7es in https://github.com/datahub-project/datahub/pull/9872
feat(token-status-filter): add filter for expired and all tokens by @gaurav2733 in https://github.com/datahub-project/datahub/pull/9930
feat(ingest/slack): add option to ingest slack channels by @anshbansal in https://github.com/datahub-project/datahub/pull/9884
feat(ingest/csv-enricher): add support for ownership type urn by @anshbansal in https://github.com/datahub-project/datahub/pull/9935
feat(patch): refactor cll patch by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9922
fix(pr): make prs only pull changes from pr branch instead of head merge by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9937
feat(ingest): loosen sentry requirements by @hsheth2 in https://github.com/datahub-project/datahub/pull/9936
fix(react): include flow diagram in docs build by @hsheth2 in https://github.com/datahub-project/datahub/pull/9785
fix(ingest/mysql): Adding support for bit type by @treff7es in https://github.com/datahub-project/datahub/pull/9950
feat(ingest/patch): add helper for auto-quoting by @hsheth2 in https://github.com/datahub-project/datahub/pull/9938
feat(ingest): Support for JSONL in s3 source with max_rows support by @Adityamalik123 in https://github.com/datahub-project/datahub/pull/9921
feat(ingest): fix bugs in SqlParsingAggregator by @hsheth2 in https://github.com/datahub-project/datahub/pull/9926
fix(ui/schema): error handling add by @anshbansal in https://github.com/datahub-project/datahub/pull/9952
PRD-1067 | added owner in gen_datahub_groups and condition for maximu… by @Kunal-kankriya in https://github.com/datahub-project/datahub/pull/9888
feat(ci): skip smoke-test lint if there are no changes by @hsheth2 in https://github.com/datahub-project/datahub/pull/9945
feat(search): search access controls by @david-leifker in https://github.com/datahub-project/datahub/pull/9892
feat(ingest/sql-parser): add alias for mariadb by @hsheth2 in https://github.com/datahub-project/datahub/pull/9956
docs(ingest/lookml): update known discrepancy list by @hsheth2 in https://github.com/datahub-project/datahub/pull/9941
chore(vulnerability): Bumped up versions for vulnerability fix by @pankajmahato-visa in https://github.com/datahub-project/datahub/pull/9929
Revert "chore(vulnerability): Bumped up versions for vulnerability fi… by @RyanHolstien in https://github.com/datahub-project/datahub/pull/9961

New Contributors

@KaYunKIM made their first contribution in https://github.com/datahub-project/datahub/pull/9411
@BlueHorn07 made their first contribution in https://github.com/datahub-project/datahub/pull/9300
@nnnkkk7 made their first contribution in https://github.com/datahub-project/datahub/pull/9427
@ryaminal made their first contribution in https://github.com/datahub-project/datahub/pull/9460
@fer-marino made their first contribution in https://github.com/datahub-project/datahub/pull/9492
@diegoreico made their first contribution in https://github.com/datahub-project/datahub/pull/9295
@Kunal-kankriya made their first contribution in https://github.com/datahub-project/datahub/pull/9547
@Gerrit-K made their first contribution in https://github.com/datahub-project/datahub/pull/9482
@muzzacode made their first contribution in https://github.com/datahub-project/datahub/pull/9629
@ingthorb made their first contribution in https://github.com/datahub-project/datahub/pull/9501
@dim-ops made their first contribution in https://github.com/datahub-project/datahub/pull/9646
@sleeperdeep made their first contribution in https://github.com/datahub-project/datahub/pull/9527
@7onn made their first contribution in https://github.com/datahub-project/datahub/pull/9631
@sid-acryl made their first contribution in https://github.com/datahub-project/datahub/pull/9740
@ilpianista made their first contribution in https://github.com/datahub-project/datahub/pull/9727
@scalvanese452 made their first contribution in https://github.com/datahub-project/datahub/pull/9726
@gp1105739 made their first contribution in https://github.com/datahub-project/datahub/pull/9681
@rubiojr made their first contribution in https://github.com/datahub-project/datahub/pull/9685
@atjones0011 made their first contribution in https://github.com/datahub-project/datahub/pull/9873
@stevenayers made their first contribution in https://github.com/datahub-project/datahub/pull/9907
@Adityamalik123 made their first contribution in https://github.com/datahub-project/datahub/pull/9921
@pankajmahato-visa made their first contribution in https://github.com/datahub-project/datahub/pull/9929

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.12.1...v0.13.0

相关地址：原始地址下载(tar) 下载(zip)

查看：2024-03-01发行的版本