Skip to content

Commit 81a3779

Browse files
authored
add docs on glue k8s executor (#91)
1 parent 0c9aa1e commit 81a3779

File tree

3 files changed

+11
-1
lines changed

3 files changed

+11
-1
lines changed

src/content/docs/aws/capabilities/config/configuration.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -222,6 +222,14 @@ Also see [OpenSearch configuration variables](#opensearch) which are used to man
222222
| - | - | - |
223223
| `PROVIDER_OVERRIDE_EVENTS` | `legacy`\|`v2` (default) | The [new EventBridge provider](https://discuss.localstack.cloud/t/introducing-eventbridge-v2-in-localstack/946) is active by default since LocalStack 4.0. |
224224

225+
### Glue
226+
227+
| Variable | Example Values | Description |
228+
| - | - | - |
229+
| `GLUE_JOB_EXECUTOR_PROVIDER` | `v1` (default) \| `v2` | Feature flag to switch between the old and new Glue job executor providers. |
230+
| `GLUE_JOB_EXECUTOR` | `docker` (default) \| `kubernetes` | Whether to run Glue jobs when LocalStack is deployed on Kubernetes. Jobs are run as pods in the Kubernetes cluster. |
231+
| `DOCKER_GLOBAL_IMAGE_PREFIX` | | Specify custom images for Glue jobs by configuring their custom image repository. |
232+
225233
### IAM
226234

227235
| Variable | Example Values | Description |

src/content/docs/aws/enterprise/kubernetes-executor.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,8 @@ You can run the following services on Kubernetes clusters using the LocalStack E
6464

6565
- [DocumentDB](/aws/services/docdb)
6666
- [MWAA](/aws/services/docdb)
67+
- [Glue](/aws/services/glue) (requires setting `GLUE_JOB_EXECUTOR_PROVIDER` to `v2`)
6768
- [RDS](/aws/services/rds) ([MySQL](/aws/services/rds/#mysql-engine) & [MSSQL](/aws/services/rds/#microsoft-sql-server-engine))
6869

6970
To use Kubernetes as the runtime backend, set the `CONTAINER_RUNTIME` configuration variable to `kubernetes`.
70-
Note that there are no service-specific configuration variables for these services.
71+
Note that there are no service-specific configuration variables for these services.

src/content/docs/aws/services/glue.mdx

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ Key enhancements include:
2525
- Executing multiple jobs in parallel
2626
- Ensuring correct versioning of Spark, Hadoop, Python, Java, and related libraries
2727
- Improving startup times and offline execution support
28+
- Ability to run Glue jobs on Kubernetes clusters
2829

2930
To use it, set `GLUE_JOB_EXECUTOR=docker` and `GLUE_JOB_EXECUTOR_PROVIDER=v2` in your LocalStack configuration.
3031
The new executor additionally deprecates older versions of Glue (`0.9`, `1.0`, `2.0`).

0 commit comments

Comments
 (0)