|
| 1.
| [1]
understand the motivations and principles for building deep learning systems based on empirical data, and how deep learning relates to the broader field of artificial intelligence. |
| 2.
| [2]
formulate problems associated with domain specific data (e.g., image recognition, image generation, reinforcement learning, and language translation) in terms of deep learning models.
|
| 3.
| [3]
implement solutions to computer vision, natural language processing, and robotic problems using deep learning toolboxes such as PyTorch or Tensorflow, apply numerical optimization algorithms. |
Mapping from Course Learning Outcomes to Programme Learning Outcomes
| | PLO a | PLO b | PLO c | PLO d | PLO e | PLO f | PLO g | PLO h | PLO i | PLO j |
| CLO 1 | T | T | | | | | | | | T |
| CLO 2 | T | | T | T | | | | | | |
| CLO 3 | T | | | T | | | | | T | |
T - Teach, P - Practice
For BEng(CompSc) Programme Learning Outcomes, please refer to
here.
|
|
Calendar Entry:
An introduction to algorithms and applications of deep learning. The course helps students get hands-on experience of building deep learning models to solve practical tasks including image recognition, image generation, reinforcement learning, and language translation. Topics include: machine learning theory; optimization in deep learning; convolutional neural networks; recurrent neural networks; generative adversarial networks; reinforcement learning; self-driving vehicle.
|
|
Detailed Description:
| Introduction |
Mapped to CLOs
|
| Course Introduction:
Overview of computer vision, natural language processing, reinforcement learning in video game, and historical context.
Introduction to Python/NumPy.
| 1 |
| Loss Functions and Optimization:
Linear classification, higher-level representations, image features, optimization, stochastic gradient descent (SGD).
| 1, 2 |
| Introduction to Neural Networks:
Backpropagation, Multi-layer Perceptrons.
| 1, 2 |
| Case #1: Able to build neural networks with backpropagation and SGD. | 2, 3 |
| Convolutional Neural Networks |
Mapped to CLOs
|
| Convolutional Neural Networks:
History, Convolution and pooling, ConvNets beyong vision, Introduction to PyTorch
| 1, 2 |
| CNN Architectures:
AlexNet, VGG, GoogLeNet, ResNet, etc
| 1, 2 |
| Case #2: Able to finetune and evaluate deep neural networks (e.g. AlexNet) for image recognition and others. | 2, 3 |
| Generative Adversarial Networks |
Mapped to CLOs
|
| GAN Architectures:
Vanilla GAN, WGAN, DCGAN, CGAN, BEGAN, SRGAN, etc.
| 1, 2 |
| Case #3: Able to finetune and evaluate SRGAN on CelebA for face image generation, super resolution, and others | 2, 3 |
| Reinforcement Learning |
Mapped to CLOs
|
| RL basics: policy gradients, hard attention | 1, 2 |
| Q-Learning | 1, 2 |
| Actor-Critic | 1, 2 |
| Case #4: Able to train CNN_DQN to play Atari. | 2, 3 |
|