Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document memory autotuning strategy #540

Merged
merged 1 commit into from
Oct 10, 2023
+32 −2
Merged

Document memory autotuning strategy #540

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 32 additions & 2 deletions api/services/ocean/spark/schemas/oceanSparkApplicationSpec.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -700,8 +700,9 @@ components:
type: object
memory:
oneOf:
- $ref: '#/components/schemas/OOMRecoveryStrategy'
- $ref: '#/components/schemas/StaticMemoryString'
- $ref: '#/components/schemas/OOMRecoveryStrategy'
- $ref: '#/components/schemas/MemoryAutotuningStrategy'
memoryOverhead:
title: Memoryoverhead
type: string
Expand Down Expand Up @@ -1226,7 +1227,7 @@ components:
#example: [ '4096m', '16g' ]
type: string
OOMRecoveryStrategy:
description: Memory allocation strategy that automatically increments the memory when a previous app failed with a OOM
description: Memory allocation strategy that automatically increments the memory when a previous app failed with an OOM
properties:
strategy:
type: string
Expand All @@ -1243,6 +1244,35 @@ components:
type: string
required:
- strategy
MemoryAutotuningStrategy:
description: Memory allocation strategy that automatically increments the
memory when a previous app failed with an OOM, and decreases it based on
past applications' memory usage
properties:
strategy:
type: string
title: autotuning
enum: [autotuning]
description: Automatically increase memory if a previous app failed with an OOM error, and decrease it based on
past applications' memory usage
scalingFactor:
title: scalingFactor
description: Memory multiplier after an OOM failure. Optional, defaults to 2.0
type: number
maxMemory:
title: maxMemory
description: Optional, maximum allocatable memory
type: string
historySize:
title: historySize
description: Number of past apps to take into account to compute the recommended memory, defaults to 6
type: integer
marginRatio:
title: marginRatio
description: Additional safety margin on top of the recommended memory, defaults to 0.1
type: number
required:
- strategy

PersistentVolumeClaimVolumeSource:
properties:
Expand Down
Loading