Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloudflare_list is very slow when working with bulk redirect lists #4566

Closed
3 tasks done
thedoc31 opened this issue Nov 12, 2024 · 3 comments
Closed
3 tasks done

cloudflare_list is very slow when working with bulk redirect lists #4566

thedoc31 opened this issue Nov 12, 2024 · 3 comments
Labels
triage/duplicate Indicates an issue is a duplicate of other open issue.

Comments

@thedoc31
Copy link

Confirmation

  • This is a bug with an existing resource and is not a feature request or enhancement. Feature requests should be submitted with Cloudflare Support or your account team.
  • I have searched the issue tracker and my issue isn't already found.
  • I have replicated my issue using the latest version of the provider and it is still present.

Terraform and Cloudflare provider version

Terraform v1.9.8
on darwin_arm64

  • provider registry.terraform.io/cloudflare/cloudflare v4.43.0

Affected resource(s)

cloudflare_list

Terraform configuration files

terraform {
  required_providers {
    cloudflare = {
      source = "cloudflare/cloudflare"
      version = "~> 4"
    }
  }
}

provider "cloudflare" {
  api_token = "<redacted>"
}

variable "zone_id" {
  default = "<redacted>"
}

variable "account_id" {
  default = "<redacted>"
}

variable "domain" {
  default = "<redacted>"
}

Link to debug output

https://gist.github.com/thedoc31/e27b01df01a13bd68977728c353617ca

Panic output

N/A

Expected output

Lists with a large number of items export as quickly as other objects being managed by the terraform provider

Actual output

The longer the list, the longer the terraform provider takes to work through it. A list with more than 1800 items takes 90+ seconds to load, and a second list with 5700 items takes 7-10 minutes during every terraform plan/apply. It appears the terraform provider may iterate over each list item one at a time when it should load the whole thing as one big blob of data.

Steps to reproduce

  1. Generate a bulk redirect list with 5000+ items
  2. Run the cloudflare_list operation on that bulk redirect list
  3. Wait...

Additional factoids

I am trying to migrate a full configuration set from one Cloudflare account to another.

References

N/A

@thedoc31 thedoc31 added kind/bug Categorizes issue or PR as related to a bug. needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Nov 12, 2024
Copy link
Contributor

Terraform debug log detected ✅

@github-actions github-actions bot added the triage/debug-log-attached Indicates an issue or PR has a complete Terraform debug log. label Nov 12, 2024
Copy link
Contributor

Community Note

Voting for Prioritization

  • Please vote on this issue by adding a 👍 reaction to the original post to help the community and maintainers prioritize this request.
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.

Volunteering to Work on This Issue

  • If you are interested in working on this issue, please leave a comment.
  • If this would be your first contribution, please review the contribution guide.

@jacobbednarz jacobbednarz added triage/duplicate Indicates an issue is a duplicate of other open issue. and removed kind/bug Categorizes issue or PR as related to a bug. needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. triage/debug-log-attached Indicates an issue or PR has a complete Terraform debug log. labels Nov 12, 2024
@jacobbednarz
Copy link
Member

duplicate of #4293

@jacobbednarz jacobbednarz closed this as not planned Won't fix, can't repro, duplicate, stale Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triage/duplicate Indicates an issue is a duplicate of other open issue.
Projects
None yet
Development

No branches or pull requests

2 participants