FAQ: A/B Testing: Sample Size Calculators - Review

Frequently Asked Questions Python FAQ
1

Community%20FAQs%20on%20Codecademy%20Exercises
Community%20FAQs%20on%20Codecademy%20Exercises1000×208 141 KB

This community-built FAQ covers the “Review” exercise from the lesson “A/B Testing: Sample Size Calculators”.

Paths and Courses
This exercise can be found in the following Codecademy content:

Master Statistics with Python

FAQs on the exercise Review

There are currently no frequently asked questions associated with this exercise – that’s where you come in! You can contribute to this section by offering your own questions, answers, or clarifications on this exercise. Ask or answer a question by clicking reply (reply) below.

If you’ve had an “aha” moment about the concepts, formatting, syntax, or anything else with this exercise, consider sharing those insights! Teaching others and answering their questions is one of the best ways to learn and stay sharp.

Join the Discussion. Help a fellow learner on their journey.

Ask or answer a question about this exercise by clicking reply (reply) below!
You can also find further discussion and get answers to your questions over in Language Help.

Agree with a comment or answer? Like (like) to up-vote the contribution!

Need broader help or resources? Head to Language Help and Tips and Resources. If you are wanting feedback or inspiration for a project, check out Projects.

Looking for motivation to keep learning? Join our wider discussions in Community

Learn more about how to use this guide.

Found a bug? Report it online, or post in Bug Reporting

Have a question about your account or billing? Reach out to our customer support team!

None of the above? Find out where to ask other questions here!

2

Hi,

The min sample size is for 2 variants?

My best,
David Dias

3

Hello,
This topic is not clear to me. It says to check the solution, to check how it works. However, this number is not explained how to be calculated:

# calculate total sample size: 
samp_size= 	2060
print("sample size: ", samp_size)

A topic where it encourages keeping in mind the sample size, calculates beforehand and not to interfere with the test without explaining how to calculate it. It’s really poor, keeping in mind the previous module lacks the simplicity in the examples provided and/or additional resources to reinforce its content.

4

I am also confused how the sample size is equal to 2060 - my code is identical to the solution, but the calculator does not show 2060, it is showing me 180000 instead.

5

I was hoping to be taught the function that the “sample size calculator” is using. What is the point of driving home that we need to calculate sample sizes in advance but not giving us the mathmatical tools to do so. Or are we just ment to bookmark the generator?

6

Saying that, I guess the function is here in the html code:
function getSampleSize(minimum_detectable, significance, conversion_rate) {
let zscore = 1.959964
if(significance == 0.15) {
zscore = 1.439531
}
else if(significance == 0.1){
zscore = 1.644854
}

let factor = 2*(0.8416212+zscore)**2
let conv_b = conversion_rate * (1+minimum_detectable)

let numerator = Math.sqrt(conversion_rate * (1 - conversion_rate) + conv_b * (1-conv_b));
let denominator = Math.abs(conversion_rate * minimum_detectable);
let min_sample_size = factor * Math.pow(numerator/denominator, 2);

return parseFloat(min_sample_size.toPrecision(3));