Commit graph

175 commits

Author SHA1 Message Date
Google APIs
1df255f1fe feat: Add ConfidentialInstanceType field to support selection of confidential compute technology
docs: Update comments for ConfidentialInstanceConfig and related fields

PiperOrigin-RevId: 934685865
2026-06-18 20:07:11 -07:00
Google APIs
169dd3e4b9 feat: Add vcore_seconds and memory_mb_seconds to YarnApplication in Dataproc v1
docs: A comment for field `filter` in message `.google.cloud.dataproc.v1.ListJobsRequest` is changed

PiperOrigin-RevId: 924861736
2026-06-01 12:52:29 -07:00
Google APIs
2db75e6407 feat: add support for Cloud Resource Manager tags for Dataproc Serverless workloads
docs: A comment for method `DeleteBatch` in service `BatchController` is changed
docs: A comment for field `request_id` in message `.google.cloud.dataproc.v1.CreateBatchRequest` is changed
docs: A comment for field `filter` in message `.google.cloud.dataproc.v1.ListBatchesRequest` is changed
docs: A comment for field `batches` in message `.google.cloud.dataproc.v1.ListBatchesResponse` is changed
docs: A comment for field `name` in message `.google.cloud.dataproc.v1.SessionTemplate` is changed
docs: A comment for field `spark_connect_session` in message `.google.cloud.dataproc.v1.SessionTemplate` is changed
docs: A comment for field `name` in message `.google.cloud.dataproc.v1.Session` is changed
docs: A comment for field `spark_connect_session` in message `.google.cloud.dataproc.v1.Session` is changed
docs: A comment for message `SparkConnectConfig` is changed
docs: A comment for field `cohort` in message `.google.cloud.dataproc.v1.RuntimeConfig` is changed
docs: A comment for field `milli_accelerator_seconds` in message `.google.cloud.dataproc.v1.UsageMetrics` is changed
docs: A comment for field `accelerator_type` in message `.google.cloud.dataproc.v1.UsageMetrics` is changed
docs: A comment for field `boot_disk_kms_key` in message `.google.cloud.dataproc.v1.GkeNodePoolConfig` is changed
docs: A comment for field `pypi_repository` in message `.google.cloud.dataproc.v1.PyPiRepositoryConfig` is changed

PiperOrigin-RevId: 911509116
2026-05-06 13:15:18 -07:00
Google APIs
3adc515b8b feat: add PySparkNotebookBatch message
PiperOrigin-RevId: 910808400
2026-05-05 11:30:03 -07:00
Google APIs
2da8658712 feat: Add Engine field to support LightningEngine in clusters and add support for stop ttl
PiperOrigin-RevId: 897294662
2026-04-09 14:11:22 -07:00
Google APIs
d84d3c2900 feat: Add ClusterType to support creating Zero-Scale clusters
PiperOrigin-RevId: 869501236
2026-02-12 20:01:57 -08:00
Google APIs
6e4f2a51f7 fix: upgrade gRPC service registration func
An update to Go gRPC Protobuf generation will change service registration function signatures to use an interface instead of a concrete type in generated .pb.go service files. This change should affect very few client library users. See release notes advisories in https://github.com/googleapis/google-cloud-go/pull/11025.

PiperOrigin-RevId: 823187922
2025-10-23 14:25:43 -07:00
Google APIs
d89b4d093f feat: Added support for JUPYTER_KERNEL_GATEWAY component
PiperOrigin-RevId: 810157893
2025-09-22 14:34:34 -07:00
Google APIs
b7e013ac0b chore: update preview/stable values for previously migrated libraries, and do not attempt to regenerate .OwlBot.yaml for libraries that already exist
PiperOrigin-RevId: 808815559
2025-09-18 18:10:09 -07:00
Google APIs
888ae95dd6 fix: upgrade gRPC service registration func
An update to Go gRPC Protobuf generation will change service registration function signatures to use an interface instead of a concrete type in generated .pb.go service files. This change should affect very few client library users. See release notes advisories in https://github.com/googleapis/google-cloud-go/pull/11025.

PiperOrigin-RevId: 807444457
2025-09-15 17:15:55 -07:00
Google APIs
425c9e6e70 chore: create new top-level build rule to remove the post-processor
PiperOrigin-RevId: 806562104
2025-09-12 23:37:29 -07:00
Google APIs
ea37c68239 feat: Add cluster_tier to support creating premium clusters
PiperOrigin-RevId: 776861070
2025-06-27 23:51:56 -07:00
Google APIs
cc520460fa feat: Added support for DELTA, ICEBERG, PIG components
PiperOrigin-RevId: 768948627
2025-06-08 20:30:16 -07:00
Google APIs
5e49af896d feat: add scenarios AUTO/NONE to autotuning config
PiperOrigin-RevId: 766437023
2025-06-02 19:23:18 -07:00
Google APIs
9415ba048a chore: update copyright year for auto-generated protos
PiperOrigin-RevId: 732130682
2025-02-28 07:26:00 -08:00
Google APIs
2dc21fecf8 chore: update copyright year for auto-generated protos
PiperOrigin-RevId: 731525551
2025-02-26 18:13:12 -08:00
Google APIs
d4da473c44 feat: Added support for the AuthenticationConfig field to Dataproc serverless workload configurations, allowing specification of the user workload identity as either the end user or a service account
PiperOrigin-RevId: 729645002
2025-02-21 13:47:13 -08:00
Google APIs
2f49d448f9 feat: Add ProvisioningModelMix to support mixing of spot and standard instances for secondary workers
feat: Add support for configuration of bootdisk IOPS and throughput when bootdisk is a hyperdisk

PiperOrigin-RevId: 686008645
2024-10-15 01:39:57 -07:00
Google APIs
5c181aaf78 feat: add support for Spark Connect sessions in Dataproc Serverless for Spark
docs: update docs for `filter` field in `ListSessionsRequest`

PiperOrigin-RevId: 678438691
2024-09-24 16:29:27 -07:00
Google APIs
964f6c9ab5 feat: add resource reference for KMS keys and fix comments
PiperOrigin-RevId: 674408200
2024-09-13 13:11:21 -07:00
Google APIs
02f62c8e24 feat: add support for new Dataproc features
1. Allow flink and trino job support for workflow templates API
2. Add unreachable output field for LIST workflow template API
3. Add unreachable output field for LIST batch templates API
4. Add kms key input for create cluster API
5. Add FLINK metric source for Dataproc Metric Source

PiperOrigin-RevId: 673000575
2024-09-10 09:49:43 -07:00
Google APIs
32bc036532 feat: add support for new Dataproc features
1. Allow flink job support for jobs
2. Add unreachable output field for LIST jobs API

PiperOrigin-RevId: 672705294
2024-09-09 16:00:38 -07:00
Google APIs
76ffdb2287 chore(php): Migrate some GA APIs to NEW_SURFACE_ONLY
PiperOrigin-RevId: 672632836
2024-09-09 12:26:01 -07:00
Google APIs
6a474b31c5 feat:add optional parameters (tarball-access) in DiagnoseClusterRequest
PiperOrigin-RevId: 669375999
2024-08-30 10:45:43 -07:00
Google APIs
7160b0c31e feat: add the cohort and auto tuning configuration to the batch's RuntimeConfig
PiperOrigin-RevId: 646101687
2024-06-24 08:22:57 -07:00
Google APIs
3597f7db21 chore: update copyright year for auto-generated protos
PiperOrigin-RevId: 631538781
2024-05-07 13:56:05 -07:00
Google APIs
8b83319965 feat: A new value CANCEL is added to enum ScalingDecisionType
feat: A new value `DO_NOT_CANCEL` is added to enum `ScalingDecisionType`
feat: A new value `SECONDARY_SCALEDOWN_SINGLE_REQUEST_LIMIT_REACHED` is added to enum `ConstrainingFactor`
feat: A new enum `MetricType` is added
feat: A new field `decision_metric` is added to message `.google.cloud.dataproc.logging.AutoscalerRecommendation`
feat: A new message `ReconciliationLog` is added
feat: A new message `ReconciliationClusterHealLog` is added
feat: A new enum `ReconciliationDecisionType` is added
docs: A comment for message `ClusterSize` is changed
docs: A comment for message `AutoscalerRecommendation` is changed

PiperOrigin-RevId: 620350169
2024-03-29 15:06:51 -07:00
Google APIs
738ff24cb9 feat: Update google-cloud-dataproc-v1 version to 0.24
PiperOrigin-RevId: 603832736
2024-02-02 17:49:52 -08:00
Google APIs
71ea538d92 feat: add session and session_template controllers
PiperOrigin-RevId: 602428194
2024-01-29 10:25:41 -08:00
Google APIs
667eaac011 feat: Support for universe_domain
PiperOrigin-RevId: 597849524
2024-01-12 08:40:29 -08:00
Google APIs
4795a45759 feat: migrate samples to new surface
PiperOrigin-RevId: 595432418
2024-01-03 10:04:06 -08:00
Google APIs
a70dd17d12 feat: support required_registration_fraction for secondary workers
PiperOrigin-RevId: 578743167
2023-11-01 22:36:59 -07:00
Google APIs
6b95655b94 feat: add optional parameters (tarball_gcs_dir, diagnosis_interval, jobs, yarn_application_ids) in DiagnoseClusterRequest
PiperOrigin-RevId: 565501215
2023-09-14 15:57:29 -07:00
Google APIs
4a5a6fd452 feat: support min_num_instances for primary worker and InstanceFlexibilityPolicy for secondary worker
PiperOrigin-RevId: 559135594
2023-08-22 09:31:19 -07:00
Google APIs
34a499aea7 docs: Minor formatting
PiperOrigin-RevId: 552889922
2023-08-01 12:45:21 -07:00
Google APIs
4221b78ecd chore(php): remove non-ads php_grpc_library targets
PiperOrigin-RevId: 536549230
2023-05-30 17:06:44 -07:00
Google APIs
d0da39a25e chore(bazel): remove all no-op go_test targets
PiperOrigin-RevId: 535010591
2023-05-24 15:55:02 -07:00
Google APIs
be8c6cd96b feat: add new client surface for GA php clients
PiperOrigin-RevId: 534898708
2023-05-24 10:38:49 -07:00
Google APIs
3f3a22540e feat!: update go_package to v2 in google.cloud.dataproc.v1
PiperOrigin-RevId: 524929591
2023-04-17 13:13:31 -07:00
Google APIs
57b675c153 chore: update go_gapic_assembly_pkg with snippets archive
PiperOrigin-RevId: 524917171
2023-04-17 12:24:09 -07:00
Google APIs
42ba7e6302 chore(deps): Update gapic-generator-java to 2.15.3
PiperOrigin-RevId: 516900470
2023-03-15 12:39:28 -07:00
Google APIs
b5b457107d fix: Add service_yaml_parameters to java_gapic_library targets
PiperOrigin-RevId: 515423972
2023-03-09 13:24:42 -08:00
Google APIs
5544503224 feat: Support REST transport
PiperOrigin-RevId: 515156929
2023-03-08 15:20:57 -08:00
Google APIs
be1bdffd89 feat: Support REST transport
PiperOrigin-RevId: 514827824
2023-03-07 13:44:05 -08:00
Google APIs
9111603ba0 feat: add support for new Dataproc features
1. Allow to change shielded config defaults for 2.1+ images
2. Support batches filtering in list API
3. Support Trino jobs on 2.1+ image clusters
4. Support batch TTL
5. Support custom staging bucket for batches
6. Expose approximate and current batches resources usage
7. Support Hudi and Trino components

PiperOrigin-RevId: 511550277
2023-02-22 11:27:30 -08:00
Google APIs
d12657564d feat: ROLLBACK: add support for new Dataproc features
PiperOrigin-RevId: 511238112
2023-02-21 10:23:29 -08:00
Google APIs
5a395e4add feat: add support for new Dataproc features
PiperOrigin-RevId: 510421528
2023-02-17 06:58:15 -08:00
Google APIs
c35b98606b feat: Add appropriate mixin clients
PiperOrigin-RevId: 510193779
2023-02-16 11:11:54 -08:00
Google APIs
5edc235617 fix: Add service_yaml_parameters to py_gapic_library BUILD.bazel targets
PiperOrigin-RevId: 510187992
2023-02-16 10:51:01 -08:00
Google APIs
7a702a989d feat: enable "rest" transport in Python for services supporting numeric enums
PiperOrigin-RevId: 508143576
2023-02-08 11:56:06 -08:00