# CS565100 Machine Learning, Fall 2015

## Course Description

This course presents a consistent treatment of selected machine learning problems and solutions. Basically, machine learning is about programming computers to optimize a performance criterion using example data or past experience. Consider the recognition of spoken speech—that is, converting the acoustic speech signal to an ASCII text; humans can do this task seemingly without any difficulty, but we are unable to explain how we do it. In machine learning, the approach is to collect a large collection of sample utterances from different people and learn to map these to words. Another example is that developers of a web site (e.g., YouTube) usually collect user behaviors (e.g., mouse clicks), apply machine learning to analyze the preference of individual users, and recommend items (e.g., clips) that may be interesting to these users.

This year we will focus on geometric learning methods. All models and algorithms are explained in deep to help students move from the equations to runnable computer programs.

This course is intended for senior undergraduate and graduate students who have proper understanding of computer programming, calculus, linear algebra, and probability.

### Lecturer

Prof. Shan-Hung Wu

E-mail: shwu@cs.nthu.edu.tw

Phone: +886-3-5742961

Office: Delta 603

### TAs

Office hour: 13:30 ~ 15:00 on Thursday at Delta 723

* Main contact.

## Announcements

- 2015/12/14 The last TA course is on December 15.
- 2015/11/09 No class on November 10.
- 2015/10/26 No class on October 27.
- 2015/10/19 No class on October 20.
- 2015/10/12 Appendix D "Probability and Statistics" will be covered by TA on Thursday(10/15).
- 2015/10/12 Appendix A "Calculus" will be covered by TA on Tuesday(10/13).
- 2015/09/30 "Convex Optimization" part2 by TA will continue next Tuesday.
- 2015/09/30 Assignment 1 is uploaded.
- 2015/09/16 No class on September 17.
- 2015/09/16 Change classroom to Delta 109.
- 2015/09/16 Course site is online.

## Materials

### Textbook

- Ethem Alpaydin, Introduction to Machine Learning, 2ed, MIT Press, 2010, ISBN: 026201243X

### References

- Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006, ISBN: 0387310738
- Ian H. Witten et al., Data Mining: Practical Machine Learning Tools and Techniques, 3ed, Morgan Kaufmann, 2011, ISBN: 0123748569

## Lecture Notes

### Trunk

- 01 Introduction
- 02 Supervised Learning
- 06 Probabilistic Modeling
- 07 Experiments and Ensembling
- 09 Dimensionality Reduction
- 10 Clustering and Expectation Maximization(updated on 11/19)
- 14 Markov Chains and Link Analysis
- 15 Graphical Models(updated on 1/12)
- 16 Hidden Markov Models
- 17 Reinforcement Learning

### Appendices

- A Calculus
- B Linear Algebra and Geometry
- C Convex Optimization
- D Probability and Statistics
- E Information Theory

## Assignments

- Assignment 1 (updated on 2015/10/01) (Solution)
- Assignment 2 (updated on 2015/10/29) (Solution)
- Assignment 3 (updated on 2015/11/19) (Solution)
- Assignment 4 (updated on 2016/1/4) (Solution)

## Attendance

## Grading

### Evaluation

- Midterm Exam: 30%
- Final Exam: 30%
- Assignments & Presentations: 30%
- High-performance rewards: 10%