Download Lesson 6: Deep Learning 2019 - Regularization; Convolutions; Data ethics
Lesson 6: Deep Learning 2019 - Regularization; Convolutions; Data ethics
Lesson 6: Deep Learning 2019 - Regularization; Convolutions; Data ethics
Today we discuss some powerful techniques for improving training and avoiding over-fitting:
- *Dropout*: remove activations at random during training in order to regularize the model
- *Data augmentat...
Today we discuss some powerful techniques for improving training and avoiding over-fitting:
- *Dropout*: remove activations at random during training in order to regularize the model
- *Data augmentation*: modify model inputs during training in order to effectively increase data size
- *Batch normalization*: adjust the parameterization of a model in order to make the loss surface smoother.

Next up, we'll learn all about *convolutions*, which can be thought of as a variant of matrix multiplication with tied weights, and are the operation at the heart of modern computer vision models (and, increasingly, other types of models too).

We'll use this knowledge to create a *class activated map*, which is a heat-map that shows which parts of an image were most important in making a prediction.

Finally, we'll cover a topic that many students have told us is the most interesting and surprising part of the course: data ethics. We'll learn about some of the ways in which models can go wrong, with a particular focus on *feedback loops*, why they cause problems, and how to avoid them. We'll also look at ways in which bias in data can lead to biased algorithms, and discuss questions that data scientists can and should be asking to help ensure that their work doesn't lead to unexpected negative outcomes.
Show more
Loading...
You are about to download a video in MP4 format.
If you'd like to adjust the format or resolution, just select it here
Download
Download has already started, please wait 10 Seconds
Youtube Vimeo Metacafe Flicker Photobcket Dailymotion Google video Youku 56.com Break Ustream Xhamster Wat Wrzuta Worldstarhiphop Web of Stories Washington Post Vk Vidme Video Mega Videa Viddler Vee HD Twitter Facebook USA Discovery
Loading...