Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Devel 202410 #496

Merged
merged 14 commits into from
Oct 31, 2024
4 changes: 2 additions & 2 deletions en/docs/abci-datasets.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,8 +78,8 @@ Citation:

# More detailed description or additional information
# This item is for describing additional information which are not shown in the above, and for the case that another web page specified by UsageInfo is not available.
# The description can be written in the Markdown format.
#AdditionalInfo:
# The description can be written in the Markdown format, starting from the line following “AdditionalInfo: | ”.
#AdditionalInfo: |
```

Next, upload the YAML file to the ABCI Cloud Storage. When the dataset is stored in the ABCI Cloud Storage, upload it to the same bucket as the dataset. Otherwise, upload it to the newly created bucket. Note that the file name of `my_dataset_info.yaml` is just an example. You can use an arbitrary name.
Expand Down
113 changes: 59 additions & 54 deletions en/docs/gpu.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,80 +32,85 @@ The following is a list of CUDA Toolkit, cuDNN, and NCCL that can be used with t
| cuda/12.4 | 12.4.1 | Yes | Yes | Yes |
| cuda/12.5 | 12.5.0 | Yes | Yes | Yes |
| cuda/12.5 | 12.5.1 | Yes | Yes | Yes |
| cuda/12.6 | 12.6.1 | Yes | Yes | Yes |

[^1]: Provided only for experimental use. Rocky Linux 8.6 is supported with CUDA 11.7.1 or later.

## cuDNN

Compute Node (V):

| Version | cuda/11.2[^1] | cuda/11.6[^1] | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 |
| ------- | ------------- | ------------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- |
| 8.1.1 | Yes | - | - | - | - | - | - | - | - |
| 8.3.3 | Yes | Yes | - | - | - | - | - | - | - |
| 8.4.1 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.6.0 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.7.0 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.8.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 8.9.7 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.0.0[^2] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.1.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.2.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Version | cuda/11.2[^1] | cuda/11.6[^1] | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 | cuda/12.6 |
| ------- | ------------- | ------------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- |
| 8.1.1 | Yes | - | - | - | - | - | - | - | - | - |
| 8.3.3 | Yes | Yes | - | - | - | - | - | - | - | - |
| 8.4.1 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.6.0 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.7.0 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.8.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 8.9.7 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.0.0[^2] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.1.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.2.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.3.0 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.4.0 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |

Compute Node (A):

| Version | cuda/11.2 | cuda/11.6 | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 |
| :------ | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- |
| 8.1.1 | Yes | - | - | - | - | - | - | - | - |
| 8.3.3 | Yes | Yes | - | - | - | - | - | - | - |
| 8.4.1 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.6.0 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.7.0 | Yes | Yes | Yes | Yes | - | - | - | - | - |
| 8.8.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 8.9.7 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.0.0[^2] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.1.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.2.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Version | cuda/11.2 | cuda/11.6 | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 | cuda/12.6 |
| :------ | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- |
| 8.1.1 | Yes | - | - | - | - | - | - | - | - | - |
| 8.3.3 | Yes | Yes | - | - | - | - | - | - | - | - |
| 8.4.1 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.6.0 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.7.0 | Yes | Yes | Yes | Yes | - | - | - | - | - | - |
| 8.8.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 8.9.7 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.0.0[^2] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.1.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.2.1 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.3.0 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| 9.4.0 | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |

[^2]: We have confirmed that when cuDNN 9.0.0 is used with CUDA 11.0 to CUDA 11.3, an error occurs when calling the `cudnnRNNBackwardWeights_v8` function.

## NCCL

Compute Node (V):

| Version | cuda/11.2[^1] | cuda/11.6[^1] | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 |
| --------- | ------------- | ------------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- |
| 2.8.4-1 | Yes | - | - | - | - | - | - | - | - |
| 2.11.4-1 | - | Yes | - | - | - | - | - | - | - |
| 2.12.12-1 | - | Yes | - | - | - | - | - | - | - |
| 2.13.4-1 | - | - | Yes | - | - | - | - | - | - |
| 2.14.3-1 | - | - | Yes | - | - | - | - | - | - |
| 2.15.5-1 | - | - | - | Yes | - | - | - | - | - |
| 2.16.2-1 | - | - | - | Yes | - | - | - | - | - |
| 2.17.1-1 | - | - | - | - | Yes | - | - | - | - |
| 2.18.5-1 | - | - | - | - | - | Yes | - | - | - |
| 2.19.3-1 | - | - | - | - | - | Yes | Yes | - | - |
| 2.20.5-1 | - | - | - | - | - | Yes | - | Yes | - |
| 2.21.5-1 | - | - | - | - | - | Yes | - | Yes | Yes |
| 2.22.3-1 | - | - | - | - | - | Yes | - | Yes | Yes |
| Version | cuda/11.2[^1] | cuda/11.6[^1] | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 | cuda/12.6 |
| --------- | ------------- | ------------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- | --------- |
| 2.8.4-1 | Yes | - | - | - | - | - | - | - | - | - |
| 2.11.4-1 | - | Yes | - | - | - | - | - | - | - | - |
| 2.12.12-1 | - | Yes | - | - | - | - | - | - | - | - |
| 2.13.4-1 | - | - | Yes | - | - | - | - | - | - | - |
| 2.14.3-1 | - | - | Yes | - | - | - | - | - | - | - |
| 2.15.5-1 | - | - | - | Yes | - | - | - | - | - | - |
| 2.16.2-1 | - | - | - | Yes | - | - | - | - | - | - |
| 2.17.1-1 | - | - | - | - | Yes | - | - | - | - | - |
| 2.18.5-1 | - | - | - | - | - | Yes | - | - | - | - |
| 2.19.3-1 | - | - | - | - | - | Yes | Yes | - | - | - |
| 2.20.5-1 | - | - | - | - | - | Yes | - | Yes | - | - |
| 2.21.5-1 | - | - | - | - | - | Yes | - | Yes | Yes | - |
| 2.22.3-1 | - | - | - | - | - | Yes | - | Yes | Yes | - |

Compute Node (A):

| Version | cuda/11.2 | cuda/11.6 | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 |
| :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- |
| 2.8.4-1 | Yes | - | - | - | - | - | - | - | - |
| 2.11.4-1 | - | Yes | - | - | - | - | - | - | - |
| 2.12.12-1 | - | Yes | - | - | - | - | - | - | - |
| 2.13.4-1 | - | - | Yes | - | - | - | - | - | - |
| 2.14.3-1 | - | - | Yes | - | - | - | - | - | - |
| 2.15.5-1 | - | - | - | Yes | - | - | - | - | - |
| 2.16.2-1 | - | - | - | Yes | - | - | - | - | - |
| 2.17.1-1 | - | - | - | - | Yes | - | - | - | - |
| 2.18.5-1 | - | - | - | - | - | Yes | - | - | - |
| 2.19.3-1 | - | - | - | - | - | Yes | Yes | - | - |
| 2.20.5-1 | - | - | - | - | - | Yes | - | Yes | - |
| 2.21.5-1 | - | - | - | - | - | Yes | - | Yes | Yes |
| 2.22.3-1 | - | - | - | - | - | Yes | - | Yes | Yes |
| Version | cuda/11.2 | cuda/11.6 | cuda/11.7 | cuda/11.8 | cuda/12.1 | cuda/12.2 | cuda/12.3 | cuda/12.4 | cuda/12.5 | cuda/12.6 |
| :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- | :-------- |
| 2.8.4-1 | Yes | - | - | - | - | - | - | - | - | - |
| 2.11.4-1 | - | Yes | - | - | - | - | - | - | - | - |
| 2.12.12-1 | - | Yes | - | - | - | - | - | - | - | - |
| 2.13.4-1 | - | - | Yes | - | - | - | - | - | - | - |
| 2.14.3-1 | - | - | Yes | - | - | - | - | - | - | - |
| 2.15.5-1 | - | - | - | Yes | - | - | - | - | - | - |
| 2.16.2-1 | - | - | - | Yes | - | - | - | - | - | - |
| 2.17.1-1 | - | - | - | - | Yes | - | - | - | - | - |
| 2.18.5-1 | - | - | - | - | - | Yes | - | - | - | - |
| 2.19.3-1 | - | - | - | - | - | Yes | Yes | - | - | - |
| 2.20.5-1 | - | - | - | - | - | Yes | - | Yes | - | - |
| 2.21.5-1 | - | - | - | - | - | Yes | - | Yes | Yes | - |
| 2.22.3-1 | - | - | - | - | - | Yes | - | Yes | Yes | - |

## GDRCopy

Expand Down
Loading