Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Permission issue running dbt code using production schema in QA cluster #793

Closed
rachellougee opened this issue Aug 9, 2023 · 3 comments
Closed
Labels
Data Engineering product:data-platform Issues related to the Data Platform product

Comments

@rachellougee
Copy link
Contributor

rachellougee commented Aug 9, 2023

Description/Context

As data analysts, we would like to run dbt code on the dev_qa target but use the production schema because QA data is often not useful

  • database: ol_data_lake_qa
  • schema: ol_warehouse_production_dev
  • host: mitol-ol-data-lake-qa-0.trino.galaxy.starburst.io

This is the error I got when running dbt code against dev_qa
TrinoExternalError(type=EXTERNAL, name=HIVE_METASTORE_ERROR, message="User: arn:aws:sts::610119931565:assumed-role/data-lake-query-engine-role-qa/trino-session is not authorized to perform: glue:CreateDatabase on resource: arn:aws:glue:us-east-1:610119931565:database/ol_warehouse_production_rlougee_staging because no identity-based policy allows the glue:CreateDatabase action (Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException; Request ID: ee46b622-8933-492b-b914-c0b358b6b3c8; Proxy: null)", query_id=20230809_185544_08799_3cv42)

Expected Behavior

Run dbt code against dev_qa using schema ol_warehouse_production_dev successfully

@rachellougee
Copy link
Contributor Author

@blarghmatey FYI, this is the issue we talked about.

@pdpinch
Copy link
Member

pdpinch commented Jan 9, 2024

@blarghmatey @rachellougee has this been fixed?

@rachellougee
Copy link
Contributor Author

This can be closed. We can now use dev_production to create separate dev schema in production database as oppose to dev_qa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Data Engineering product:data-platform Issues related to the Data Platform product
Projects
None yet
Development

No branches or pull requests

3 participants