Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Groovy container w/ examples and Redpanda #4673

Merged
merged 4 commits into from
Jan 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions containers/groovy-examples-redpanda/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Overview

A Docker Compose deployment for [Deephaven](https://deephaven.io).

## Features

- [Deephaven](https://deephaven.io)
- [Groovy](https://groovy-lang.org/) scripting
- [Deephaven Examples](https://github.com/deephaven/examples)
- [Redpanda](https://vectorized.io/), a Kakfa-compatible event streaming platform.

## Launch Deephaven

For instructions on launching and using Kafka in Deephaven, see[How to connect to a Kafka stream](https://deephaven.io/core/groovy/docs/how-to-guides/data-import-export/kafka-stream/). For instructions on getting started with Deephaven, see the [Quickstart](https://deephaven.io/core/groovy/docs/tutorials/quickstart).

To launch Deephaven, execute the following in your deployment directory:

```bash
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy-examples-redpanda/docker-compose.yml
docker compose pull
docker compose up -d
```
34 changes: 34 additions & 0 deletions containers/groovy-examples-redpanda/docker-compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
version: "3.4"

services:
deephaven:
image: ghcr.io/deephaven/server-slim:${VERSION:-latest}
ports:
- "${DEEPHAVEN_PORT:-10000}:10000"
volumes:
- ./data:/data
environment:
- START_OPTS=-Xmx4g

examples:
image: ghcr.io/deephaven/examples
volumes:
- ./data:/data
command: initialize

redpanda:
command:
- redpanda
- start
- --kafka-addr internal://0.0.0.0:9092,external://0.0.0.0:19092
- --advertise-kafka-addr internal://redpanda:9092,external://localhost:19092
- --schema-registry-addr internal://0.0.0.0:8081,external://0.0.0.0:18081
- --smp 1
- --memory 1G
- --mode dev-container
image: docker.redpanda.com/redpandadata/redpanda:v23.2.18
ports:
- 8081:8081
- 18081:18081
- 9092:9092
- 19092:19092
8 changes: 3 additions & 5 deletions containers/groovy-examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy-examples/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy-examples/docker-compose.yml
docker compose pull
jjbrosnan marked this conversation as resolved.
Show resolved Hide resolved
docker compose up -d
```
19 changes: 19 additions & 0 deletions containers/groovy-redpanda/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# Overview

## Features

- [Deephaven](https://deephaven.io)
- [Groovy](https://groovy-lang.org/) scripting
- [Redpanda](https://vectorized.io/), a Kafka-compatible event streaming platform

## Launch Deephaven

For instructions on launching and using Kafka in Deephaven, see[How to connect to a Kafka stream](https://deephaven.io/core/groovy/docs/how-to-guides/data-import-export/kafka-stream/). For instructions on getting started with Deephaven, see the [Quickstart](https://deephaven.io/core/groovy/docs/tutorials/quickstart).

To launch Deephaven, execute the following in your deployment directory:

```sh
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy-redpanda/docker-compose.yml
docker compose pull
docker compose up -d
```
28 changes: 28 additions & 0 deletions containers/groovy-redpanda/docker-compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
version: "3.4"

services:
deephaven:
image: ghcr.io/deephaven/server-slim:${VERSION:-latest}
ports:
- "${DEEPHAVEN_PORT:-10000}:10000"
volumes:
- ./data:/data
environment:
- START_OPTS=-Xmx4g

redpanda:
command:
- redpanda
- start
- --kafka-addr internal://0.0.0.0:9092,external://0.0.0.0:19092
- --advertise-kafka-addr internal://redpanda:9092,external://localhost:19092
- --schema-registry-addr internal://0.0.0.0:8081,external://0.0.0.0:18081
- --smp 1
- --memory 1G
- --mode dev-container
image: docker.redpanda.com/redpandadata/redpanda:v23.2.18
ports:
- 8081:8081
- 18081:18081
- 9092:9092
- 19092:19092
10 changes: 4 additions & 6 deletions containers/groovy/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,14 +10,12 @@ A Docker Compose deployment for [Deephaven](https://deephaven.io).

## Launch Deephaven

For launch instructions, see the [README](https://github.com/deephaven/deephaven-core/#launch-groovy--java). For full instructions to work with Deephaven, see the [Quick start](https://deephaven.io/core/docs/tutorials/quickstart).
For launch instructions, see the [README](https://github.com/deephaven/deephaven-core/#launch-groovy--java). For full instructions to work with Deephaven, see the [Quick start](https://deephaven.io/core/groovy/docs/tutorials/quickstart).

To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/groovy/docker-compose.yml
docker compose pull
jjbrosnan marked this conversation as resolved.
Show resolved Hide resolved
docker compose up -d
```
12 changes: 5 additions & 7 deletions containers/python-examples-redpanda/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,18 +7,16 @@ A Docker Compose deployment for [Deephaven](https://deephaven.io).
- [Deephaven](https://deephaven.io)
- [Python](https://python.org/) scripting
- [Deephaven Examples](https://github.com/deephaven/examples)
- [Redpanda](https://vectorized.io/), a Kakfa-compatible event streaming platform.
- [Redpanda](https://vectorized.io/), a Kakfa-compatible event streaming platform

## Launch Deephaven

For instructions on launching and using Kafka, see [Kafka in Deephaven: an introduction](https://deephaven.io/core/docs/conceptual/kafka-in-deephaven/) and [Simple Kafka import](https://deephaven.io/core/docs/how-to-guides/kafka-simple/). For full instructions to work with Deephaven, see the [Quick start](https://deephaven.io/core/docs/tutorials/quickstart).
For instructions on launching and using Kafka in Deephaven, see[How to connect to a Kafka stream](https://deephaven.io/core/groovy/docs/how-to-guides/data-import-export/kafka-stream/). For instructions on getting started with Deephaven, see the [Quickstart](https://deephaven.io/core/docs/tutorials/quickstart).

To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples-redpanda/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples-redpanda/docker-compose.yml
docker compose pull
jjbrosnan marked this conversation as resolved.
Show resolved Hide resolved
docker compose up -d
```
35 changes: 10 additions & 25 deletions containers/python-examples-redpanda/docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,30 +20,15 @@ services:
command:
- redpanda
- start
- --smp
- '1'
- --reserve-memory
- 0M
- --overprovisioned
- --node-id
- '0'
- --kafka-addr
- PLAINTEXT://0.0.0.0:29092,OUTSIDE://0.0.0.0:9092
- --advertise-kafka-addr
- PLAINTEXT://redpanda:29092,OUTSIDE://localhost:9092
image: docker.redpanda.com/vectorized/redpanda:v22.2.2
- --kafka-addr internal://0.0.0.0:9092,external://0.0.0.0:19092
- --advertise-kafka-addr internal://redpanda:9092,external://localhost:19092
- --schema-registry-addr internal://0.0.0.0:8081,external://0.0.0.0:18081
- --smp 1
- --memory 1G
- --mode dev-container
image: docker.redpanda.com/redpandadata/redpanda:v23.2.18
ports:
- 8081:8081
- 18081:18081
- 9092:9092
- 29092:29092

registry:
image: apicurio/apicurio-registry-mem:1.2.2.Final
expose:
- 8080
ports:
- "8081:8080"
environment:
QUARKUS_PROFILE: prod
KAFKA_BOOTSTRAP_SERVERS: redpanda:9092
APPLICATION_ID: registry_id
APPLICATION_SERVER: localhost:9000
- 19092:19092
29 changes: 0 additions & 29 deletions containers/python-examples/All-AI/README.md

This file was deleted.

17 changes: 0 additions & 17 deletions containers/python-examples/All-AI/docker-compose.yml

This file was deleted.

8 changes: 3 additions & 5 deletions containers/python-examples/NLTK/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/NLTK/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/NLTK/docker-compose.yml
docker compose pull
docker compose up -d
```
8 changes: 3 additions & 5 deletions containers/python-examples/PyTorch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/PyTorch/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/PyTorch/docker-compose.yml
docker compose pull
docker compose up -d
```
8 changes: 3 additions & 5 deletions containers/python-examples/SciKit-Learn/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/SciKit-Learn/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/SciKit-Learn/docker-compose.yml
docker compose pull
docker compose up -d
```
8 changes: 3 additions & 5 deletions containers/python-examples/TensorFlow/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/TensorFlow/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/TensorFlow/docker-compose.yml
docker compose pull
docker compose up -d
```
8 changes: 3 additions & 5 deletions containers/python-examples/base/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,9 +15,7 @@ For launch instructions, see the [README](https://github.com/deephaven/deephaven
To launch Deephaven, execute the following in your deployment directory:

```bash
compose_file=https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/base/docker-compose.yml
curl -O "${compose_file}"

docker-compose pull
docker-compose up -d
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-examples/base/docker-compose.yml
docker compose pull
docker compose up -d
```
21 changes: 21 additions & 0 deletions containers/python-redpanda/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Overview

A Docker Compose deployment for [Deephaven](https://deephaven.io).

## Features

- [Deephaven](https://deephaven.io)
- [Python](https://python.org) scripting
- [Redpanda](https://vectorized.io/), a Kafka-compatible event streaming platform

## Launch Deephaven

For instructions on launching and using Kafka, see [How to connect to a Kafka stream](https://deephaven.io/core/docs/how-to-guides/data-import-export/kafka-stream/). For instructions on getting started with Deephaven, see the [Quickstart](https://deephaven.io/core/docs/tutorials/quickstart).

To launch Deephaven, execute the following in your deployment directory:

```sh
curl -O https://raw.githubusercontent.com/deephaven/deephaven-core/main/containers/python-redpanda/docker-compose.yml
docker compose pull
docker compose up -d
```
28 changes: 28 additions & 0 deletions containers/python-redpanda/docker-compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
version: "3.4"

services:
deephaven:
image: ghcr.io/deephaven/server:${VERSION:-latest}
ports:
- "${DEEPHAVEN_PORT:-10000}:10000"
volumes:
- ./data:/data
environment:
- START_OPTS=-Xmx4g

redpanda:
command:
- redpanda
- start
- --kafka-addr internal://0.0.0.0:9092,external://0.0.0.0:19092
- --advertise-kafka-addr internal://redpanda:9092,external://localhost:19092
- --schema-registry-addr internal://0.0.0.0:8081,external://0.0.0.0:18081
- --smp 1
- --memory 1G
- --mode dev-container
image: docker.redpanda.com/redpandadata/redpanda:v23.2.18
ports:
- 8081:8081
- 18081:18081
- 9092:9092
- 19092:19092
28 changes: 0 additions & 28 deletions containers/python/All-AI/README.md

This file was deleted.

Loading
Loading