Commit graph

92 commits

Author SHA1 Message Date
Google APIs
3dd18827bc chore: migrate dataproc/logging to the PHP microgenerator
Committer: @miraleung
PiperOrigin-RevId: 373699884
2021-05-13 19:11:48 -07:00
Google APIs
5b3bf78c16 chore: migrate dataproc to the PHP microgenerator
Committer: @miraleung
PiperOrigin-RevId: 370932893
2021-04-28 10:27:13 -07:00
Google APIs
439f098cb7 feat: update the Dataproc V1 API client library
This includes the following:
1. The new start and stop cluster methods.
2. The ability to specify a metastore config in a cluster.
3. The ability to specify a (BETA) GKE cluster when creating a Dataproc cluster.
4. The ability to configure the behavior for private IPv6 cluster networking.
5. The ability to specify node affinity groups for clusters.
6. The ability to specify shielded VM configurations for clusters.
7. Support for service-account based secure multi-tenancy.
8. The ability to specify cluster labels for picking which cluster should run a job.
9. Components for DOCKER, DRUID, FLINK, HBASE, RANGER, and SOLR
10. The ability to specify a DAG timeout for workflows.

Committer: @ojarjur
PiperOrigin-RevId: 367518225
2021-04-08 15:22:55 -07:00
Google APIs
d9b32e92fa chore: clean up unused gapic.legacy.yaml files
Committer: @miraleung
PiperOrigin-RevId: 359580699
2021-02-25 12:14:41 -08:00
Google APIs
959b0bcea3 feat: Update the ruby_cloud_gapic_library rules for the libraries published to google-cloud-ruby to the form that works with build_gen (separate parameters for ruby_cloud_title and ruby_cloud_description).
chore: Update Bazel-Ruby rules version.
chore: Update build_gen version.

PiperOrigin-RevId: 358357761
2021-02-19 01:21:43 -08:00
Google APIs
61ab0348bd feat: Migrate the Bazel rules for the libraries published to google-cloud-ruby to use the gapic-generator-ruby instead of the monolith generator.
PiperOrigin-RevId: 352069361
2021-01-15 13:09:14 -08:00
Google APIs
6dae98144d chore: Remove unused 'package' attr from java_gapic_library rules
Committer: @miraleung
PiperOrigin-RevId: 347459563
2020-12-14 13:41:43 -08:00
Google APIs
bddb3d7479 chore: add resource_definitions for Cluster and Service
Committer: @miraleung
PiperOrigin-RevId: 347029491
2020-12-11 10:43:53 -08:00
Google APIs
160f80d81d chore: Make microgenerators default for all languages
In particular this applies to Java and Python microgenerators.
With this change `java_gapic_*` and `py_gapic_*` rules mean microgenerator versions. The monolith versions of the rules are named as `java_gapic_*_legacy` and `py_gapic_*_legacy` respectively.

Also change Ads BAZEL template to reflect the change in default rule names.

Also change `DO NOT OVERRIDE` comment warnings meaning (to reflect that now by default microgenerator rules are generated and the generated version must be accepted only if the API is being migrated to the microgenerator).

PiperOrigin-RevId: 346227314
2020-12-07 18:51:08 -08:00
Google APIs
565b9a5f01 chore: migrate java-dataproc to the Java microgenerator
Committer: @miraleung
PiperOrigin-RevId: 346132878
2020-12-07 11:58:07 -08:00
Google APIs
d189e87120 chore: generate GAPIC metadata JSON file
PiperOrigin-RevId: 345596855
2020-12-03 21:01:09 -08:00
Google APIs
269083b6ed feat!: (v1beta1) remove DOCKER/FLINK from Component enum; adds HBASE
Update the protobuf definitions for the v1beta2 Dataproc API.

BREAKING CHANGE:

1. The `DOCKER` and `FLINK` values have been removed from the `Component` enum, and an `HBASE` value was added.

Other changes:

1. There is a new `temp_bucket` field in `ClusterConfig`.
2. There is a new `preemptibility` field in `InstanceGroupConfig`.
3. The `project_id` field of `JobReference` is now optional instead of required.
4. There is a new `dag_timeout` field in `WorkflowTemplate`.
5. There are new `dag_timeout`, `dag_start_time`, and `dag_end_time` fields in `WorkflowMetadata`.
6. There are various updates to the doc comments.

PiperOrigin-RevId: 345127100
2020-12-01 16:47:06 -08:00
Google APIs
b1e1e0b13b fix: Remove redundant service config files.
PiperOrigin-RevId: 341774654
2020-11-11 00:10:17 -08:00
Google APIs
7391e775fd fix: switch all local LRO Go GAPIC deps to remote
PiperOrigin-RevId: 338561467
2020-10-22 15:30:23 -07:00
Google APIs
80eada6dbc feat: Add Dataproc Logging protos
Document Dataproc Logging protos. autoscaler_log.proto contains protos for Dataproc Autoscaler logs (dataproc.googleapis.com/autoscaler).

PiperOrigin-RevId: 335745163
2020-10-06 16:28:04 -07:00
Google APIs
b821f32047 feat: use https://github.com/googleapis/gapic-generator-csharp for generating C# libraries.
PiperOrigin-RevId: 331104099
2020-09-11 01:16:20 -07:00
Google APIs
43a62a87b7 migrate dataproc python BUILD file to use microgen
PiperOrigin-RevId: 326109811
2020-08-11 15:35:58 -07:00
Google APIs
6fd07563a2 docs: change relative URLs to absolute URLs to fix broken links.
PiperOrigin-RevId: 324941614
2020-08-04 19:42:38 -07:00
Google APIs
d8a3dfb82f feat: Additional fields for the ClusterConfig and InstanceGroupConfig messages.
This change includes the following updates:
1. There is a new `temp_bucket` field for clusters.
2. There is a new `endpoint_config` field for clusters.
3. There is a new `preemptibility` field for instance group configs.
4. There are various updates to the doc comments.

PiperOrigin-RevId: 323829608
2020-07-29 11:27:24 -07:00
Google APIs
0e7900e395 fix!: fix LRO annotations for method DiagnoseCluster.
PiperOrigin-RevId: 321255718
2020-07-14 16:13:38 -07:00
Google APIs
3b634f6060 build: drop Artman config
PiperOrigin-RevId: 321028717
2020-07-13 14:02:36 -07:00
Google APIs
ec05fa81a4 fix: migrate dataproc/v1 to grpc_service_config
PiperOrigin-RevId: 320442976
2020-07-09 12:05:27 -07:00
Google APIs
979372fbeb fix: migrate dataproc/v1beta2 to grpc_service_config
PiperOrigin-RevId: 320442657
2020-07-09 11:54:44 -07:00
Google APIs
d13e2da372 build: move gapic-generator-typescript parameters to BUILD.bazel files.
PiperOrigin-RevId: 318386808
2020-06-25 18:07:32 -07:00
Google APIs
60c7a4c6e8 fix: increase dataproc lro polling timeouts
PiperOrigin-RevId: 315548051
2020-06-09 13:27:00 -07:00
Google APIs
148a3caa5f fix: dataproc/v1 raise workflow template service timeouts in gapic v2
PiperOrigin-RevId: 315516848
2020-06-09 10:58:59 -07:00
Google APIs
150cfa0d99 fix: dataproc/v1 raise timeouts in gapic v2
PiperOrigin-RevId: 314840739
2020-06-04 18:03:44 -07:00
Google APIs
c1fae183dd docs: change relative URLs to absolute URLs to fix broken links.
PiperOrigin-RevId: 314634470
2020-06-03 17:15:28 -07:00
Google APIs
ce56112c35 chore: fix all deps on LRO in go_gapic_library
Removes uses of external dependency on longrunning/autogen:go_default_library
in favor of the local target //google/lonrunning:longrunning_go_gapic.

PiperOrigin-RevId: 314387187
2020-06-02 12:57:24 -07:00
Google APIs
ded05197da fix: use grpc_service_config in nodejs_gapic_library
The nodejs_gapic_library targets were migrated to gapic-generator-typescript
which doesn't use gapic_yaml, rendering that attribute unused. Instead it uses
the proto annotations & grpc_service_config, which this change reflects.

PiperOrigin-RevId: 314206960
2020-06-01 14:44:30 -07:00
Google APIs
744591190e docs: change relative URLs to absolute URLs to fix broken links.
PiperOrigin-RevId: 305323909
2020-04-07 13:18:49 -07:00
Google APIs
ff74d47d47 fix: PHP-related fixes in BUILD.bazel and service.yamls
This PR also adds the rules for all 7 langauges in OsLogin and Kms BUILD.bazel files. Those build files were missing rules for 5 langagues, including PHP.

This PR is the prerequisite for migrating PHP synth.py scripts from artman to bazel.

The fixes in service.yaml fix regression made during proto annotation migration. This became visible only during PHP generation, because only PHP depends on the affected sections of the service.yaml config.

PiperOrigin-RevId: 305108224
2020-04-06 13:46:40 -07:00
Google APIs
9ff6fd3b22 Updates Dataproc v1 API:
- Adds Dataproc Jobs.SubmitJobAsOperation RPC
- Adds SparkR and Presto job types to WorkflowTemplates
- Adds new Optional Components
- Clarifies usage of some APIs

PiperOrigin-RevId: 305053617
2020-04-06 10:06:54 -07:00
Google APIs
cad0f5137a Updates to Dataproc v1beta2 API:
- Adds SparkR and Presto job types to WorkflowTemplates
- Adds new Optional Components
- Clarifies usage of some APIs

PiperOrigin-RevId: 305053062
2020-04-06 09:56:11 -07:00
Google APIs
5378173a88 Add v1beta2 SubmitJobAsOperation RPC to Dataproc.
PiperOrigin-RevId: 304594381
2020-04-03 05:16:28 -07:00
Google APIs
75047719f7 fix Dataproc: add missing REQUIRED annotation.
PiperOrigin-RevId: 304305096
2020-04-01 18:40:40 -07:00
Google APIs
a62857d26b fix: add proto_package to the artman config of dataproc v1beta2 to make artman smoketest pass.
PiperOrigin-RevId: 303853989
2020-03-30 17:05:43 -07:00
Google APIs
a45b0a2a8f dataproc: add back non-default retry parameters.
committer: @hzyi-google

PiperOrigin-RevId: 303830177
2020-03-30 15:00:49 -07:00
Google APIs
558b800ed5 chore: turn on gapic v2 for Dataproc API.
fix:
- add missing method signatures
- remove resource_reference not on a string field
- adjust resource name pattern orders

PiperOrigin-RevId: 303431167
2020-03-27 16:35:56 -07:00
Google APIs
25a1781c09 bazel: migrate all go_gapic_library targets to microgenerator implementation
* update rules_go and gazelle bazel dependencies
* update gapic-generator bazel dependency (with build file generator changes)

PiperOrigin-RevId: 302730217
2020-03-24 13:05:53 -07:00
Google APIs
0aba1900ff cluster: use square brace for cross-reference
PiperOrigin-RevId: 297204568
2020-02-25 14:31:47 -08:00
Google APIs
1e47e676cd Fix: Restore a method signature for UpdateCluster
PiperOrigin-RevId: 296901854
2020-02-24 08:55:53 -08:00
Google APIs
7f910bcc4f Update Dataproc v1beta2 client.
PiperOrigin-RevId: 296451205
2020-02-21 09:37:31 -08:00
Google APIs
8c12e2b4dc Update Dataproc v1 client.
PiperOrigin-RevId: 296336662
2020-02-20 17:44:31 -08:00
Google APIs
ab2685d8d3 fix: Dataproc v1 - AutoscalingPolicy annotation
This adds the second resource name pattern to the
AutoscalingPolicy resource.

Committer: @lukesneeringer
PiperOrigin-RevId: 295738415
2020-02-18 08:21:39 -08:00
Google APIs
e7d8a694f4 Depend on the latest gapic-generator and resource names plugin.
This fixes the very old an very annoying bug: https://github.com/googleapis/gapic-generator/pull/3087

PiperOrigin-RevId: 293903652
2020-02-07 15:18:00 -08:00
Google APIs
2717b8a1c7 Fix dataproc artman client library generation.
PiperOrigin-RevId: 292555664
2020-01-31 09:06:47 -08:00
Google APIs
7ac66d9be8 Add Dataproc Autoscaling API to V1.
PiperOrigin-RevId: 292450564
2020-01-30 16:41:30 -08:00
Google APIs
73cebb2043 Update v1beta2 clusters and jobs to include resource ids in GRPC header.
PiperOrigin-RevId: 286261392
2019-12-18 14:05:46 -08:00
Google APIs
27d0e0f202 Remove inappropriate resource_reference annotations for UpdateWorkflowTemplateRequest.template.
PiperOrigin-RevId: 285802643
2019-12-16 10:53:53 -08:00