feat(dataplex): add MetadataFeed to CatalogService for tracking metadata changes
feat(dataplex): add LookupContext to CatalogService for LLM-generated resource context
feat(dataplex): add support for attaching aspects to EntryLinks
feat(dataplex): add UpdateEntryLink and LookupEntryLinks methods to CatalogService
feat(dataplex): support OneTime triggers for DataScan operations
feat(dataplex): add debug query support to Data Quality rules
feat(dataplex): allow selective generation scope for Data Documentation scans
feat(dataplex): add SKIPPED state to DataScan catalog publishing status
docs(dataplex): remove deprecated metadata change warnings in Dataplex Catalog
The DataProductService provides APIs to curate and manage collections of data assets as data products, enabling more organized sharing and usage for specific business cases.
MetadataFeeds allow users to monitor metadata changes (CREATE, UPDATE, DELETE) within a specified scope (organization, project, or entry group) and publish them to Pub/Sub.
CatalogService now includes a LookupContext API to provide LLM-generated context for resources, and enhanced EntryLink management, including the ability to attach aspects.
DataScan operations now support a OneTime trigger for single-run scans, and Data Quality rules support DebugQueries to help investigate rule failures by returning diagnostic values.
fix(dataplex)!: remove deprecated Explore-related methods and messages from public client libraries
Breaking Changes:
- Removed ContentService and all associated methods (CreateContent, UpdateContent, DeleteContent, GetContent, ListContent, etc.) and request/response messages.
- Removed Environment and Session management methods from DataplexService (CreateEnvironment, UpdateEnvironment, DeleteEnvironment, ListEnvironments, GetEnvironment, ListSessions) and their associated messages.
PiperOrigin-RevId: 883306841
feat: A new message `DataDocumentationResult` is added representing Data Documentation Result
feat: A new field `data_documentation_spec` is added for Data Documentation Spec to message `.google.cloud.dataplex.v1.DataScan`
feat: A new field `data_documentation_result` is added for Data Documentation Result to message `.google.cloud.dataplex.v1.DataScan`
feat: A new field `data_documentation_spec` is added for Data Documentation Spec to message `.google.cloud.dataplex.v1.DataScanJob`
feat: A new field `data_documentation_result` is added for Data Documentation Result in `.google.cloud.dataplex.v1.DataScanJob`
feat: A new data scan type Data documentation added.
docs: A comment for message `DataScan` is changed
docs: A comment for field `resource` in message `.google.cloud.dataplex.v1.DataSource` is changed
PiperOrigin-RevId: 822921010
An update to Go gRPC Protobuf generation will change service registration function signatures to use an interface instead of a concrete type in generated .pb.go service files. This change should affect very few client library users. See release notes advisories in https://github.com/googleapis/google-cloud-go/pull/11025.
PiperOrigin-RevId: 807444457
feat: A new message `Glossary` is added
feat: A new resource_definition `dataplex.googleapis.com/Glossary` is added
feat: A new message `GlossaryCategory` is added
feat: A new resource_definition `dataplex.googleapis.com/GlossaryCategory` is added
feat: A new message `GlossaryTerm` is added
feat: A new resource_definition `dataplex.googleapis.com/GlossaryTerm` is added
feat: A new message `CreateGlossaryRequest` is added
feat: A new message `UpdateGlossaryRequest` is added
feat: A new message `DeleteGlossaryRequest` is added
feat: A new message `GetGlossaryRequest` is added
feat: A new message `ListGlossariesRequest` is added
feat: A new message `ListGlossariesResponse` is added
feat: A new message `CreateGlossaryCategoryRequest` is added
feat: A new message `UpdateGlossaryCategoryRequest` is added
feat: A new message `DeleteGlossaryCategoryRequest` is added
feat: A new message `GetGlossaryCategoryRequest` is added
feat: A new message `ListGlossaryCategoriesRequest` is added
feat: A new message `ListGlossaryCategoriesResponse` is added
feat: A new message `CreateGlossaryTermRequest` is added
feat: A new message `UpdateGlossaryTermRequest` is added
feat: A new message `DeleteGlossaryTermRequest` is added
feat: A new message `GetGlossaryTermRequest` is added
feat: A new message `ListGlossaryTermsRequest` is added
feat: A new message `ListGlossaryTermsResponse` is added
feat: A new method `CreateEntryLink` is added to service `CatalogService`
feat: A new method `DeleteEntryLink` is added to service `CatalogService`
feat: A new method `GetEntryLink` is added to service `CatalogService`
feat: A new field `entry_link` is added to message `.google.cloud.dataplex.v1.ImportItem`
feat: A new field `deleted_entry_links` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `created_entry_links` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `unchanged_entry_links` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `glossaries` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `entry_link_types` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `referenced_entry_scopes` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new message `EntryLink` is added
feat: A new resource_definition `dataplex.googleapis.com/EntryLink` is added
feat: A new message `CreateEntryLinkRequest` is added
feat: A new message `DeleteEntryLinkRequest` is added
feat: A new message `GetEntryLinkRequest` is added
feat: A new field `project` is added to message `.google.cloud.dataplex.v1.DataDiscoverySpec`
feat: A new field `catalog_publishing_enabled` is added to message `.google.cloud.dataplex.v1.DataQualitySpec`
feat: A new field `catalog_publishing_status` is added to message `.google.cloud.dataplex.v1.DataQualityResult`
feat: A new field `passed` is added to message `.google.cloud.dataplex.v1.DataQualityColumnResult`
feat: A new field `dimensions` is added to message `.google.cloud.dataplex.v1.DataQualityColumnResult`
feat: A new message `DataScanCatalogPublishingStatus` is added
feat: A new field `catalog_publishing_status` is added to message `.google.cloud.dataplex.v1.DataScanEvent`
docs: A comment for field `image_version` in message `.google.cloud.dataplex.v1.Environment` is changed
docs: A comment for service `CatalogService` is changed
docs: A comment for method `CreateMetadataJob` in service `CatalogService` is changed
docs: A comment for message `AspectType` is changed
docs: A comment for field `alternate_use_permission` in message `.google.cloud.dataplex.v1.AspectType` is changed
docs: A comment for field `type` in message `.google.cloud.dataplex.v1.AspectType` is changed
docs: A comment for field `alternate_use_permission` in message `.google.cloud.dataplex.v1.EntryType` is changed
docs: A comment for field `create_time` in message `.google.cloud.dataplex.v1.Entry` is changed
docs: A comment for field `update_time` in message `.google.cloud.dataplex.v1.Entry` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.CreateEntryGroupRequest` is changed
docs: A comment for message `DeleteEntryTypeRequest` is changed
docs: A comment for message `DeleteAspectTypeRequest` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.SearchEntriesRequest` is changed
docs: A comment for field `query` in message `.google.cloud.dataplex.v1.SearchEntriesRequest` is changed
docs: A comment for field `order_by` in message `.google.cloud.dataplex.v1.SearchEntriesRequest` is changed
docs: A comment for field `update_mask` in message `.google.cloud.dataplex.v1.ImportItem` is changed
docs: A comment for field `aspect_keys` in message `.google.cloud.dataplex.v1.ImportItem` is changed
docs: A comment for enum value `FULL` in enum `SyncMode` is changed
docs: A comment for field `output_path` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for service `CmekService` is changed
docs: A comment for service `ContentService` is changed
docs: A comment for field `results_table` in message `.google.cloud.dataplex.v1.DataProfileSpec` is changed
docs: A comment for field `row_filter` in message `.google.cloud.dataplex.v1.DataProfileSpec` is changed
docs: A comment for field `min_length` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `max_length` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `average_length` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `average` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `standard_deviation` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `min` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `quartiles` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `max` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `average` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `standard_deviation` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `min` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `quartiles` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `max` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `value` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `count` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `ratio` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `null_ratio` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `distinct_ratio` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `top_n_values` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `type` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `mode` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `profile` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `fields` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `row_count` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `profile` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `scanned_data` in message `.google.cloud.dataplex.v1.DataProfileResult` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.DataQualityDimension` is changed
docs: A comment for field `dimension` in message `.google.cloud.dataplex.v1.DataQualityRule` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.ListDataTaxonomiesRequest` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.CreateDataScanRequest` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.DeleteDataScanRequest` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.GetDataScanRequest` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.ListDataScansRequest` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.RunDataScanRequest` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.GetDataScanJobRequest` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.ListDataScanJobsRequest` is changed
docs: A comment for field `rule` in message `.google.cloud.dataplex.v1.GenerateDataQualityRulesResponse` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.DataScan` is changed
docs: A comment for field `name` in message `.google.cloud.dataplex.v1.DataScanJob` is changed
docs: A comment for enum value `TASK_CONFIG` in enum `ExecutionTrigger` is changed
docs: A comment for enum value `CREATED` in enum `State` is changed
docs: A comment for field `user_managed` in message `.google.cloud.dataplex.v1.Schema` is changed
docs: A comment for field `entity` in message `.google.cloud.dataplex.v1.DataSource` is changed
docs: A comment for field `resource` in message `.google.cloud.dataplex.v1.DataSource` is changed
docs: A comment for field `field` in message `.google.cloud.dataplex.v1.ScannedData` is changed
docs: A comment for field `start` in message `.google.cloud.dataplex.v1.ScannedData` is changed
docs: A comment for field `end` in message `.google.cloud.dataplex.v1.ScannedData` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.CreateLakeRequest` is changed
docs: A comment for field `parent` in message `.google.cloud.dataplex.v1.ListLakesRequest` is changed
docs: A comment for enum value `ABORTED` in enum `State` is changed
docs: A comment for enum value `TASK_CONFIG` in enum `Trigger` is changed
PiperOrigin-RevId: 805560354
docs: A comment for message `MetadataJob` is changed
docs: A comment for message `MetadataJob` is changed
docs: A comment for field `exported_entries` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `error_message` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for enum `SyncMode` is changed
docs: A comment for field `source_storage_uri` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `organization_level` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `projects` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `entry_groups` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `entry_types` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `aspect_types` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `scope` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for field `output_path` in message `.google.cloud.dataplex.v1.MetadataJob` is changed
docs: A comment for enum value `EXPORT` in enum `Type` is changed
docs: A comment for enum value `INTERNAL_ERROR` in enum `ErrorCode` is changed
docs: A comment for field `encryption_config_id` in message `.google.cloud.dataplex.v1.CreateEncryptionConfigRequest` is changed
docs: A comment for message `DataDiscoveryResult` is changed
docs: A comment for field `scan_statistics` in message `.google.cloud.dataplex.v1.DataDiscoveryResult` is changed
PiperOrigin-RevId: 756928247
---
feat: Removing internal visibility labels for cmek public preview
---
feat: A new message `ExportJobResult` is added
feat: A new message `ExportJobSpec` is added
feat: A new value `EXPORT` is added to enum `Type`
feat: A new field `export_spec` is added to message `.google.cloud.dataplex.v1.MetadataJob`
feat: A new field `export_result` is added to message `.google.cloud.dataplex.v1.MetadataJob`
---
docs: minor formatting changes
PiperOrigin-RevId: 746484746
docs: update the Dataplex Catalog proto to remove the info about schema changes
feat: DataTaxonomyService is now deprecated
PiperOrigin-RevId: 735645981
feat: update Go Bigtable import path
feat: release MetadataJob APIs and related resources in GA
feat: expose create time in DataScanJobAPI
docs: correct API documentation
feat: release metadata export in private preview
feat: Add data_version field to AspectSource
docs: add info about schema changes for BigQuery metadata in Dataplex Catalog
docs: Add Identifier for `name` in message `.google.cloud.dataplex.v1.MetadataJob` per https://google.aip.dev/cloud/2510
docs: Add comment for field `type` in message `.google.cloud.dataplex.v1.MetadataJob` per https://linter.aip.dev/192/has-comments
docs: Add comment for field `status` in message `.google.cloud.dataplex.v1.MetadataJob` per https://linter.aip.dev/192/has-comments
docs: Add link to fully qualified names documentation
feat: add annotations in CreateMetadataJob, GetMetadataJob, ListMetaDataJobs and CancelMetadataJob for cloud audit logging
feat: Add new Data Discovery scan type in Datascan
docs: Scrub descriptions for standalone discovery scans
docs: correct the dimensions for data quality rules
feat: A new field `suspended` is added to DataScans
feat: expose create time to customers
feat: Add a TABLE_PUBLISHED field in DiscoveryEvent
feat: Add a TABLE_UPDATED field in DiscoveryEvent
feat: Add a TABLE_IGNORED field in DiscoveryEvent
feat: Add a TABLE_DELETED field in DiscoveryEvent
feat: Add a DATA_DISCOVERY enum type in DataScanEvent
feat: Add a DataDiscoveryAppliedConfigs message
docs: A comment for message `DataScanEvent` is changed
feat: Add an Issue field to DiscoveryEvent.ActionDetails to output the action message in Cloud Logs
feat: A new enum `TableType` is added
feat: A new message `TableDetails` is added
feat: A new field `datascan_id` is added to message `.google.cloud.dataplex.v1.DiscoveryEvent`
feat: A new field `table` is added to message `.google.cloud.dataplex.v1.DiscoveryEvent`
docs: Dataplex Tasks do not support Dataplex Content path as a direct input anymore
PiperOrigin-RevId: 696600248
fix!: An existing field `entry` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `display_name` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `entry_type` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `modify_time` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `fully_qualified_name` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `description` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
fix!: An existing field `relative_resource` is removed from message `.google.cloud.dataplex.v1.SearchEntriesResult`
docs: A comment for field `aspects` in message `.google.cloud.dataplex.v1.Entry` is changed
docs: A comment for field `filter` in message `.google.cloud.dataplex.v1.ListEntriesRequest` is changed
PiperOrigin-RevId: 630090353
feat: new event types GOVERNANCE_RULE_MATCHED_RESOURCES, GOVERNANCE_RULE_SEARCH_LIMIT_EXCEEDS, GOVERNANCE_RULE_ERRORS
chore: updated service and timeout settings
PiperOrigin-RevId: 583444130
