sourcegraph/about

A/B test Cody sign up flow

Closed this issue · 1 comments

A/B test our current sign in/up pop-up modal throughout the site vs sending people to a more optimized/dedicated sign up landing page and measure Cody sign up rates.

inspiration: https://conversion-rate-experts.com/mobbin-simplified-signup-win-report/

examples: https://login.retool.com/auth/signup?source=navbarcta

Couple risks to call out:

  • Creating valid A/B tests on the site right now is a lil tricky just with our current setup/site tech stack. Not impossible, but just a lil tougher than it should be.
  • Admittedly getting clean cody web sign up data/KPI on GA4 is a lil tricky as well (just because of oAuth/3rd party authentication nature of our sign up flow). As a proxy, we could use that handy looker dashboard to look at daily or weekly cody sign ups / daily or weekly web traffic...

Think the potential reward of improving rates, even by 5-10% would be worth the risk….

Realize there's a TON of high priority website projects right now (and that this would be a rather large undertaking spanning data/design/web updates), so putting this at top of backlog for now, but eager to discuss on next week's web team meeting!

cc @kevin.chen @tracey.johnson @alex.isken @chris.sev @Kelvin @shannon.king