Learning Outcomes:
On successful completion of the module, students should be able to:
Formulate regression, classification, forecasting, clustering, and dimension-reduction tasks using appropriate outcomes, predictors, and loss functions.
Explain the central ideas underlying regularisation, cross-validation, and the bias–variance trade-off,
Apply popular machine learning methods, including tree-based methods, ensemble methods, and neural networks.
Select and compare predictive models using out-of-sample evaluation procedures and performance measures.
Process a range of data types for machine learning methods in social science, e.g. text data, time series data, high dimensional data.
Indicative Module Content:
Topic 1: Introduction and overview: research questions, machine learning tasks, types of data.
Topic 2: (Linear and Nonlinear) Regression: predicting continuous variables. Regularization, variable selection, boosting, bagging, tree-based methods, and neural networks.
Topic 3: Classification: predicting categorical variables. Regularized logistic regression, trees, and neural networks for classification. Loss functions and calibration. Ordered and unordered categorical variables.
Topic 4: Forecasting/nowcasting: predicting variables in a time series context with machine learning. Autoregression, forecast evaluation, macroeconomic nowcasting.
Topic 5: Unsupervised Learning, dimension reduction: principal components analysis, partial least squares, and nonlinear dimension reduction methods.
Topic 6: Text as Data: co-occurrence of words, latent Dirichlet allocation, embeddings, sentiment analysis, and customer reviews.