Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stepper: Figure out why the wide discrepancy on signup start referrer between start and stepper during the experiment #97073

Closed
MicBosi opened this issue Dec 4, 2024 · 2 comments
Assignees
Labels

Comments

@MicBosi
Copy link
Contributor

MicBosi commented Dec 4, 2024

Slack conversation: p1732718523042509-slack-C073776NJ66

It appears that stepper is getting the majority of the traffic from the LOHP without locale suffix, while control is getting most of its traffic from the LOHP with the locale suffix.

Control also gets practically all the other referring traffic (google, bing, random sites etc.) and stepper appears to be getting none of it.

However, if we look at the distribution of languages (based on the browser lang reported by Tracks) we appear to see languages roughly evenly distributed between the two variations.

We would like to understand the mechanics of how this happens so that we can explain whether there is a qualitative difference between the traffic sent to stepper vs the one sent to control that can explain the SRM issue at the signup start step.

@MicBosi
Copy link
Contributor Author

MicBosi commented Dec 9, 2024

I think we might have found the cause of the issue being the fact that all Stepper traffic in the experiment is redirected in JS/Calypso using Referrer Policy: origin which truncates the referrer to just be the domain, in this case wordpress.com

See full explanation in Slack: p1733786423894269-slack-C073776NJ66

@MicBosi MicBosi self-assigned this Dec 10, 2024
@MicBosi
Copy link
Contributor Author

MicBosi commented Dec 10, 2024

@escapemanuele I'm closing this issue as per Slack conversation mentioned above I think we have a satisfactory explanation.

@MicBosi MicBosi closed this as completed Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant