Skip to main content

gcp.project.dataprocService.cluster.config

Supported platform

  • gcp

Description

Google Cloud (GCP) Dataproc cluster config

Fields

IDTYPEDESCRIPTION
parentResourcePathstringParent resource path
autoscalingdictAutoscaling configuration for the policy associated with the cluster
configBucketstringCloud Storage bucket used to stage job dependencies, config files, and job driver console output
metricsdictDataproc metrics configuration
encryptiondictEncryption configuration
endpointdictPort/endpoint configuration
gceClustergcp.project.dataprocService.cluster.config.gceClusterShared Compute Engine configuration
gkeClustergcp.project.dataprocService.cluster.config.gkeClusterKubernetes Engine config for Dataproc clusters deployed to Kubernetes
initializationActions[]dictCommands to execute on each node after config is completed
lifecyclegcp.project.dataprocService.cluster.config.lifecycleLifecycle configuration
mastergcp.project.dataprocService.cluster.config.instanceCompute Engine config for the cluster's master instance
metastoredictMetastore configuration
secondaryWorkergcp.project.dataprocService.cluster.config.instanceCompute Engine configuration for the cluster's secondary worker instances
securitydictSecurity configuration
softwaredictCluster software configuration
tempBucketstringCloud Storage bucket used to store ephemeral cluster and jobs data
workergcp.project.dataprocService.cluster.config.instanceCompute Engine configuration for the cluster's worker instances

References