-
Notifications
You must be signed in to change notification settings - Fork 69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to set a higher JVM heap size or spark driver/executor memory #97
Comments
The heap size should be configurable via |
Could you please paste here pod spec? |
Here's the pod spec, started by the cronjob. I've removed irrelevant fields and changed names
I did exec into the pod and checked
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there a way to increase java heap size or spark driver/executor memory? The default JVM heap size of 4096MB is not enough and we are looking to increase the memory to 10GB at least.
How can we set a higher JVM heap size or spark memory?
We are running this job as a kubernetes cronjob and setting JAVA_OPTS environment variable (JAVA_OPTS="-Xms10g -Xmx10g") doesn't work.
Both memory request and limit are set to 16GB
The text was updated successfully, but these errors were encountered: