Yes ofc. Beside the statistically relevance there are other factors like user aquisition, cohorts have to be very similar and there is also an error margin of at least 5% which should be taken into consideration when comparing the stats.
That is part of the business part of doing tests, I tried to cover only the technical details.
The web is full of articles on how to do proper testing, but it was lacking on the implementation details, so I wrote this story.
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
Yes ofc. Beside the statistically relevance there are other factors like user aquisition, cohorts have to be very similar and there is also an error margin of at least 5% which should be taken into consideration when comparing the stats.
That is part of the business part of doing tests, I tried to cover only the technical details.
The web is full of articles on how to do proper testing, but it was lacking on the implementation details, so I wrote this story.