Introductory Statistics: cram pack

Descriptive statistics: the mean is the sum divided by n; the median is the middle value of the sorted data (the average of the two middle values when n is even). The sample standard deviation is s = √(Σ(x − x̄)²/(n − 1)). A z-score z = (x − μ)/σ says how many standard deviations a value lies from the mean.

Descriptive statistics: the mean is the sum divided by n; the median is the middle value of the sorted data (the average of the two middle values when n is even). The sample standard deviation is s = √(Σ(x − x̄)²/(n − 1)). A z-score z = (x − μ)/σ says how many standard deviations a value lies from the mean.

Discrete random variables: a probability distribution lists every value x a variable can take with its probability p(x); the probabilities are between 0 and 1 and add up to 1. The expected value (mean) is E(X) = Σx·p(x), the long-run average. The variance is Var(X) = Σ(x − μ)²·p(x) = E(X²) − μ², and the standard deviation σ = √Var(X). For a linear change Y = aX + b: E(Y) = a·E(X) + b, Var(Y) = a²·Var(X) and σ_Y = |a|·σ_X; adding a constant does not change the spread.

Discrete random variables: a probability distribution lists every value x a variable can take with its probability p(x); the probabilities are between 0 and 1 and add up to 1. The expected value (mean) is E(X) = Σx·p(x), the long-run average. The variance is Var(X) = Σ(x − μ)²·p(x) = E(X²) − μ², and the standard deviation σ = √Var(X). For a linear change Y = aX + b: E(Y) = a·E(X) + b, Var(Y) = a²·Var(X) and σ_Y = |a|·σ_X; adding a constant does not change the spread.

Sums and differences of normal variables: if X and Y are independent and normal, X + Y and X − Y are normal too. Means add or subtract: E(X ± Y) = μ_X ± μ_Y. Variances always add, also for a difference: Var(X ± Y) = σ_X² + σ_Y², so σ = √(σ_X² + σ_Y²). Standard deviations never add directly. The total of n independent items with the same distribution has mean n·μ and standard deviation σ·√n. Then standardise as usual: z = (x − mean)/σ and read Φ(z).

Normal distribution: convert a value x to a z-score, z = (x − μ)/σ, which counts standard deviations from the mean. A z-table (or Φ(z)) gives the area to the left of z, which is P(X < x). The area to the right is 1 − Φ(z), and the area between two values is the difference of their two areas.

Confidence interval for a mean: x̄ ± margin of error. With a known population σ the margin is z·σ/√n; with only the sample standard deviation s, use t with n − 1 degrees of freedom: t·s/√n. Critical values: z = 1.645 (90%), 1.96 (95%), 2.576 (99%). To get a margin E or smaller, you need n ≥ (z·σ/E)², rounded up.

Confidence interval for a proportion: p̂ ± z·√(p̂(1 − p̂)/n), where p̂ = x/n. To reach a margin E you need n ≥ z²·p(1 − p)/E², rounded up; without a prior estimate use p = 0.5, which gives the largest n.

Testing a mean: the test statistic measures how many standard errors the sample mean lies from the value claimed in H₀: z = (x̄ − μ₀)/(σ/√n) when σ is known, t = (x̄ − μ₀)/(s/√n) when it is estimated from the sample. A confidence interval is x̄ ± (critical value)·(standard error).

Hypothesis test: the test statistic = (estimate − value under H₀)/(standard error under H₀). The p-value is the probability, assuming H₀ is true, of a statistic at least as extreme as the one observed: the area in one tail for a one-sided H₁, twice the tail area for a two-sided H₁. Reject H₀ when p ≤ α.

Least-squares regression: with x̄ and ȳ the means, Sxx = Σ(x − x̄)², Syy = Σ(y − ȳ)² and Sxy = Σ(x − x̄)(y − ȳ), the line ŷ = a + b·x has slope b = Sxy/Sxx and intercept a = ȳ − b·x̄, so it always passes through (x̄, ȳ). Pearson's correlation coefficient r = Sxy/√(Sxx·Syy) lies between −1 and 1; r² is the fraction of the variation in y explained by the line.

Least-squares regression: with x̄ and ȳ the means, Sxx = Σ(x − x̄)², Syy = Σ(y − ȳ)² and Sxy = Σ(x − x̄)(y − ȳ), the line ŷ = a + b·x has slope b = Sxy/Sxx and intercept a = ȳ − b·x̄, so it always passes through (x̄, ȳ). Pearson's correlation coefficient r = Sxy/√(Sxx·Syy) lies between −1 and 1; r² is the fraction of the variation in y explained by the line.