Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
62,800 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

JS

Apr 4, 2021

Fantastic course and although it guides you through the course (and may feel less challenging to some) it provides all the building blocks for you to latter apply them to your own interesting project.

AM

Oct 8, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

Filter by:

251 - 275 of 7,215 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By OMAL P B

•

Feb 24, 2020

This is an wonderful course for people who want to learn about the ways to improve their models and make their best and more robust. Andrew Sir makes the math behind the scenes very easy to understand. The course is easy to follow as it gradually moves from the basics to more advanced topics, building gradually. Highly recommended.

By Tanveer M

•

Aug 27, 2019

Professor Ng's very clearly put a lot of thought into breaking down deep learning into the most understandable way for students around the world and it shows through the quality of this course. I cannot recommend this course enough to anybody who is looking to do machine learning, or simply understand the process from a high level.

By Murali T

•

Jan 14, 2021

As usual Andrew ng Course is Awesome.

A bit of more video expatiation is needed for Tensorflow.

Labs are really helpful.

It would be grateful if they had provided notes after each lesson like in the first course(probably 1st I guess) of Andrew ng Machine Learning .

That's it, overall it is really good and useful .Thank you Andrew Sir

By Satvik C

•

Sep 10, 2020

Andrew NG is such a fantastic teacher especially in this online mode. He provides crystal clear explanations and examples to understand why the methods work. As a learner I was only expecting to learn how to apply this to solve real problems and not to learn theoretical subtities, this is probably the best course in deep learning.

By Hari G S

•

May 13, 2020

Excellent course over all, but what I like the most is how the complex math behind all these techniques are carefully hid and instead, we're given an intuition about how these techniques work. Of course, for a deeper understanding much more mathematics is needed, but they make sure that everyone has an idea about why things work.

By Bernard O

•

Oct 23, 2018

The tips and great guidelines one gets from this course are gems in their own right. Practitioners in particular will get to appreciate all the usable advice to improve their neural networks and at the same time get to understand the principles behind the scenes on what truly drives those optimizations. Highly recommended course.

By Kristina S

•

Aug 15, 2018

The course material is detailed and comprehensive and presented in a very digestible way. I felt like the home works lack a few topics (e.g. learning rate decay implementation, which I would find to be a useful exercise), but they give you a good understanding of what is going on. All in all, I definitely recommend this course!

By Dinesh T

•

Feb 17, 2021

Improving DL Networks in fact improved my understanding of hyperparameter tuning, regularization and optimization. The quizzes helped me getting clarity and the assignment of tensor flow gave a good introduction using functions in the tensor flow. I really enjoy learning from Andrew and look forward deep diving farther into DL.

By Zhenwei Z

•

Mar 16, 2020

After learning the basic knowledge of the first course, this course deepened my understanding of deep learning, and explained how to optimize the model of deep learning from the perspectives of hyperparameter tuning, regularization and normalization, and finally provided the basic knowledge of the framework based on TensorFlow.

By Mahbubur R

•

Jun 6, 2018

From this course I have learnt several important hyper parameters, regularisation and optimization of deep neural network. Most importantly I got my first hand-on experience on Tensorflow framework by which creating deep net modes are quite easy if someone knows the elements of a deep net. I wish I will proceed for next course.

By Ian C

•

Oct 1, 2017

Learning about TensorFlow is brilliant. It's very hard to get a good understanding of what goes on in TensorFlow without fully understanding the neural network coding setup. This course beautifully combines the two. There were some minor frustrations with the final TensorFlow programming exercise, but overall this is excellent.

By Pawan S S

•

Jan 8, 2021

One of the rare courses teaching about structured hyperparameter tuning. All the subject matter are well taught and the flow of the module is very easy to follow and understand. Together with the programming assignments, I was able to quickly grab the essentials. I highly recommend this course for any deep learning enthusiast.

By Jeroen M

•

Jan 10, 2018

Great course, a few rough edges in the exercises and I also feel the exercise comments give away a bit too much (would be better if the student needed to figure out things by himself a little more). But these are minor details, I've learned a great deal in an amazingly short span of time, from one of the top minds in AI today!

By Jeff R

•

Oct 1, 2017

I appreciate the large amount of time that has gone into preparing this course. I note that there are a large number of corrections in the errata forum that have not been reviewed by staff. In particular there are some obvious errors in the programming assignments that could easily be corrected with a small investment in time.

By Pranshu A

•

Aug 22, 2020

Awesome, Amazing, Best, Fabulous course. Learnt a lot about Hyperparameter tuning and atlast got an intro about tensorflow framework which i wanted to start learning but earlier afraid from it's complexity which is explained so good in this course. Best course for Tensorflow Intro and Hyperparameter tuning in Neural Networks.

By Murat T

•

Dec 23, 2018

Topics cut in to sections are well defined and so clear. Programming assignments definitely gives you hands on experience. Also, math is demystified that you track with high school math. If you used framework like Keras and you want to know why and when you need to use that function,parameter etc., you would love this course.

By Gilles D

•

Sep 5, 2017

Eventually a clear and definitive explanation about Network initialization, regularization and optimization. Good insight share on hyper-parameters prioritization.

We learn the how and why and suddenly, it all becomes a little bit less mysterious. It is all clearly explained in a very accessible way.

Great value for my needs

By Xuefeng P

•

Aug 29, 2017

This course really gives you a fundamental and practical ideas about the hyper-parameters of DNN, and the way of tuning them. The part I liked most is the last programming assignment ---- play with Tensorflow!!! The assignment walks you through Tensorflow structure and basics in a very organized fashion.

Highly recommended!

By Akash K

•

Mar 20, 2021

Really enjoyed the course as it covered a lot of regularization and optimization techniques in depth. Programming assignments are really easy as it needed to write only few lines of code but serves its purpose and enforces the learnings from lectures. Highly recommended to get the exposure before starting your own journey.

By Ali n

•

Jul 7, 2020

Best course for learning Hyper parameter tuning, Regularization and Optimization topics further more the batch and other various optimization algos like momentum, Adam, Batch norm etc are much easier here. Please have a look on ground reality too, Take quiz before staring any course that this candidate is suitable or not

By Mihai L

•

Jan 21, 2018

This course is also interesting. The art of tuning hyper parameters and other optimization techniques are very interesting and nicely explained.

The introduction to Tensorflow and assignment is also interesting.Overall the difficulty is not high but the concepts are really powerful and important ,most scaffollding is done

By Ferry v A

•

Mar 22, 2021

This course provides a good overview of the optimalization techniques for neural networks. It refers to both the basics by providing an explanation of moving averages, and the advanced by providing references to academic literature. Finally, it provides the rules of thumb that a practitioner needs when iterating models.

By Vlad M

•

Sep 7, 2018

The course part is overall good.

The last assignment can be improved in two key ways:

The comment # Z3 = np.dot(W3,Z2) + b3 should be # Z3 = np.dot(W3,A2) + b3 - figured this out by myself without help from forums. :)

Also, the Adam optimization is not very apparent in the instructions - searched in the forums for issues.

By Adam F

•

Nov 1, 2021

I completed the entire specialization and having nothing but good things to say. Highly recommend it! Lectures are engaging, and Andrew does a fantastic job explaining some very complex topics. Programming assignments are challenging in a good way. You’ll really feel like you’ve learned a lot by the time you’re done.

By Evandro R

•

Oct 22, 2020

Another wonderful course of this amazing specialization. I could say a lot of things, maybe even pages on how Professor Andrew it's the right person to teach you about Deep Learning but I'll shorten in this review and recommend the whole specialization for you! It's worthy and there's a lot of knowledge to be shared!