Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create MITx Online user activities intermediate model, updates to xPro #795

Merged
merged 3 commits into from
Aug 14, 2023
Merged

Create MITx Online user activities intermediate model, updates to xPro #795

merged 3 commits into from
Aug 14, 2023

Conversation

rachellougee
Copy link
Contributor

@rachellougee rachellougee commented Aug 11, 2023 •
edited
Loading

What are the relevant tickets?

https://github.com/mitodl/hq/issues/1672

Description (What does it do?)

This PR adds

  • int__mitxonline__user_courseactivities
    • courseactivity_num_days_activity
    • courseactivity_num_events
    • courseactivity_num_unique_play_video
    • courseactivity_num_play_video
    • courseactivity_last_play_video_timestamp
    • courseactivity_last_problem_check_timestamp
    • courseactivity_first_event_timestamp
    • courseactivity_last_event_timestamp
  • int__mitxonline__user_courseactivity_problemcheck
    • user_username
    • courserun_readable_id
    • useractivity_problem_name
    • useractivity_problem_id
    • useractivity_problem_attempts
    • useractivity_problem_success
    • useractivity_problem_current_grade
  • int__mitxonline__user_courseactivity_video
    • user_username
    • courserun_readable_id
    • useractivity_video_id
    • useractivity_video_duration
    • useractivity_video_currenttime

How can this be tested?

To test against production data, you will need to update your profile.xml with production host mitol-ol-data-lake-production.trino.galaxy.starburst.io due to resource limitation of our QA cluster to run large model (#793 is created to solve this problem without updating profiles.yml)
then run

 dbt build --select +int__mitxonline__user_courseactivities --vars 'schema_suffix: YOURSCHEMA' --target dev_production 

 dbt build --select +int__mitxpro__user_courseactivities --vars 'schema_suffix: YOURSCHEMA' --target dev_production

Tests should all pass

abeglova
abeglova approved these changes Aug 14, 2023
View reviewed changes
Copy link
Contributor

@abeglova abeglova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@rachellougee rachellougee merged commit 9dad1df into main Aug 14, 2023
1 check passed
@rachellougee rachellougee deleted the create-mitxonline-user-activity-intermediate-model branch August 14, 2023 18:36
quazi-h pushed a commit that referenced this pull request Aug 22, 2023
@rachellougee @quazi-h
Create MITx Online user activities intermediate model, updates to xPro (
7fdcf9e 
#795)

* Create MITx Online user activities intermediate model, updates to xPro

* updates for production data

* Create MITx Online user activities intermediate model, updates to xPro
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@abeglova abeglova abeglova approved these changes

Assignees
No one assigned
Labels
needs review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@rachellougee @abeglova