Indicative Module Content:
• Revision on Probability:
Probability
Conditional probability
Independence
Law of total probability
Random Variables
Cumulative Distribution Function
Density and Mass Functions
Independent and Identically Distributed
Expectation
Moments
Moment Generating Functions
Bernoulli distribution
Binomial distribution
Geometric distribution
Negative binomial distribution
Poisson distribution
Uniform distribution
Gamma distribution
Normal (or Gaussian) distribution
• Multivariate Probability Distribution
Random vectors
Discrete random vectors
marginal probability mass functions
Continuous random vectors
joint probability density function
Conditional Distributions
conditional probability mass function
conditional probability density function
Independence
Conditional Expectation
Properties of the Expectation Operator
• Some more basic concepts
Covariance
correlation
Jointly Gaussian random variables
Bivariate normal distribution
Mutually Independent Random Variables
• Random samples
Statistics and Estimators
Sample mean and sample variance, and their properties
The chi-squared distribution
Student's t distribution
F distribution
• Convergence concepts
Chebyshev's Inequality
Convergence in probability
Convergence in distribution
Weak law of large numbers
Consistent estimators
Central Limit Theorem
• Parametric statistical inference, point estimation methods
Method of moments
Maximum Likelihood Estimation
Iterative likelihood maximization
Newton-Raphson scheme
• Properties of estimators: how to compare estimators
Unbiased/biased
Consistent estimators
Efficiency
Cramer-Rao lower bound
Sufficient statistics
Fisher-Neyman factorization
Rao-Blackwell theorem
Exponential families
• Confidence intervals
The pivot method
Approximate confidence intervals
Newton-Raphson
• Hypothesis testing I
Standard material
one-sided, two-sided, and composite tests
• Hypothesis testing II
Neyman-Pearson lemma
Significance level and power
Uniformly most powerful tests
Generalized likelihood ratio tests
Wilks Theorem
• Introduction to Bayesian inference
Bayesian inference
Prior distributions
Posterior distributions
Conjugacy