Artifacts download failure due to TOOMANYREQUESTS

[mykaul]

Description

ykaul@ykaul:~/github/scylladb$ trivy repository https://github.com/prometheus/node_exporter --branch release-1.8 --scanners vuln --detection-priority comprehensive --debug
2024-11-04T11:25:06+02:00 DEBUG No plugins loaded
2024-11-04T11:25:06+02:00 DEBUG Default config file "file_path=trivy.yaml" not found, using built in values
2024-11-04T11:25:06+02:00 DEBUG Cache dir dir="/home/ykaul/.cache/trivy"
2024-11-04T11:25:06+02:00 DEBUG Cache dir dir="/home/ykaul/.cache/trivy"
2024-11-04T11:25:06+02:00 DEBUG Parsed severities severities=[UNKNOWN LOW MEDIUM HIGH CRITICAL]
2024-11-04T11:25:06+02:00 DEBUG Ignore statuses statuses=[]
2024-11-04T11:25:06+02:00 DEBUG [vulndb] There is no valid metadata file err="unable to open a file: open /home/ykaul/.cache/trivy/db/metadata.json: no such file or directory"
2024-11-04T11:25:06+02:00 INFO [vulndb] Need to update DB
2024-11-04T11:25:06+02:00 DEBUG [vulndb] No metadata file
2024-11-04T11:25:06+02:00 INFO [vulndb] Downloading vulnerability DB...
2024-11-04T11:25:06+02:00 INFO [vulndb] Downloading artifact... repo="ghcr.io/aquasecurity/trivy-db:2"
2024-11-04T11:25:07+02:00 ERROR [vulndb] Failed to download artifact repo="ghcr.io/aquasecurity/trivy-db:2" err="OCI repository error: 1 error occurred:\n\t* GET https://ghcr.io/v2/aquasecurity/trivy-db/manifests/2: TOOMANYREQUESTS: retry-after: 1.066267ms, allowed: 44000/minute\n\n"
2024-11-04T11:25:07+02:00 FATAL Fatal error

• init error:
  github.com/aquasecurity/trivy/pkg/commands/artifact.Run
  /home/runner/work/trivy/trivy/pkg/commands/artifact/run.go:367
• DB error:
  github.com/aquasecurity/trivy/pkg/commands/artifact.NewRunner
  /home/runner/work/trivy/trivy/pkg/commands/artifact/run.go:119
• failed to download vulnerability DB:
  github.com/aquasecurity/trivy/pkg/commands/operation.DownloadDB
  /home/runner/work/trivy/trivy/pkg/commands/operation/operation.go:40
• OCI artifact error:
  github.com/aquasecurity/trivy/pkg/db.(*Client).Download
  /home/runner/work/trivy/trivy/pkg/db/db.go:158
• failed to download vulnerability DB:
  github.com/aquasecurity/trivy/pkg/db.(*Client).downloadDB
  /home/runner/work/trivy/trivy/pkg/db/db.go:207
• failed to download artifact from any source:
  github.com/aquasecurity/trivy/pkg/oci.Artifacts.Download
  /home/runner/work/trivy/trivy/pkg/oci/artifact.go:247
• 1 error occurred:
  • OCI repository error: 1 error occurred:
  • GET https://ghcr.io/v2/aquasecurity/trivy-db/manifests/2: TOOMANYREQUESTS: retry-after: 1.066267ms, allowed: 44000/minute

Desired Behavior

Successful run.

Actual Behavior

Fails.

Reproduction Steps

1.trivy repository https://github.com/prometheus/node_exporter --branch release-1.8 --scanners vuln   --detection-priority comprehensive --debug

Target

Git Repository

Scanner

Vulnerability

Output Format

None

Mode

Standalone

Debug Output

ykaul@ykaul:~/github/scylladb$ trivy repository https://github.com/prometheus/node_exporter --branch release-1.8 --scanners vuln   --detection-priority comprehensive --debug
2024-11-04T11:25:06+02:00	DEBUG	No plugins loaded
2024-11-04T11:25:06+02:00	DEBUG	Default config file "file_path=trivy.yaml" not found, using built in values
2024-11-04T11:25:06+02:00	DEBUG	Cache dir	dir="/home/ykaul/.cache/trivy"
2024-11-04T11:25:06+02:00	DEBUG	Cache dir	dir="/home/ykaul/.cache/trivy"
2024-11-04T11:25:06+02:00	DEBUG	Parsed severities	severities=[UNKNOWN LOW MEDIUM HIGH CRITICAL]
2024-11-04T11:25:06+02:00	DEBUG	Ignore statuses	statuses=[]
2024-11-04T11:25:06+02:00	DEBUG	[vulndb] There is no valid metadata file	err="unable to open a file: open /home/ykaul/.cache/trivy/db/metadata.json: no such file or directory"
2024-11-04T11:25:06+02:00	INFO	[vulndb] Need to update DB
2024-11-04T11:25:06+02:00	DEBUG	[vulndb] No metadata file
2024-11-04T11:25:06+02:00	INFO	[vulndb] Downloading vulnerability DB...
2024-11-04T11:25:06+02:00	INFO	[vulndb] Downloading artifact...	repo="ghcr.io/aquasecurity/trivy-db:2"
2024-11-04T11:25:07+02:00	ERROR	[vulndb] Failed to download artifact	repo="ghcr.io/aquasecurity/trivy-db:2" err="OCI repository error: 1 error occurred:\n\t* GET https://ghcr.io/v2/aquasecurity/trivy-db/manifests/2: TOOMANYREQUESTS: retry-after: 1.066267ms, allowed: 44000/minute\n\n"
2024-11-04T11:25:07+02:00	FATAL	Fatal error
  - init error:
    github.com/aquasecurity/trivy/pkg/commands/artifact.Run
        /home/runner/work/trivy/trivy/pkg/commands/artifact/run.go:367
  - DB error:
    github.com/aquasecurity/trivy/pkg/commands/artifact.NewRunner
        /home/runner/work/trivy/trivy/pkg/commands/artifact/run.go:119
  - failed to download vulnerability DB:
    github.com/aquasecurity/trivy/pkg/commands/operation.DownloadDB
        /home/runner/work/trivy/trivy/pkg/commands/operation/operation.go:40
  - OCI artifact error:
    github.com/aquasecurity/trivy/pkg/db.(*Client).Download
        /home/runner/work/trivy/trivy/pkg/db/db.go:158
  - failed to download vulnerability DB:
    github.com/aquasecurity/trivy/pkg/db.(*Client).downloadDB
        /home/runner/work/trivy/trivy/pkg/db/db.go:207
  - failed to download artifact from any source:
    github.com/aquasecurity/trivy/pkg/oci.Artifacts.Download
        /home/runner/work/trivy/trivy/pkg/oci/artifact.go:247
  - 1 error occurred:
	* OCI repository error: 1 error occurred:
	* GET https://ghcr.io/v2/aquasecurity/trivy-db/manifests/2: TOOMANYREQUESTS: retry-after: 1.066267ms, allowed: 44000/minute

Operating System

Fedora 41

Version

ykaul@ykaul:~/github/scylladb$ trivy --version
Version: 0.57.0
Java DB:
  Version: 1
  UpdatedAt: 2024-10-29 02:43:29.210209896 +0000 UTC
  NextUpdate: 2024-11-01 02:43:29.210209776 +0000 UTC
  DownloadedAt: 2024-10-29 13:54:36.864502667 +0000 UTC

Checklist

• Run trivy clean --all
• Read the troubleshooting

[nikpivkin]

Duplicate of #7538