Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
62,800 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

JS

Apr 4, 2021

Fantastic course and although it guides you through the course (and may feel less challenging to some) it provides all the building blocks for you to latter apply them to your own interesting project.

AM

Oct 8, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

Filter by:

226 - 250 of 7,215 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By K R

•

Jun 12, 2020

This course is very helpful in the matter of enhancing the knowledge from the previous course and getting the right intuitions about improving deep learning neural networks.

Thanks to Professor Andrew Ng for making it very clear and easy to understand and giving me the right tools for my Phd research .

I look forward to getting to the next course.

By RUDRA P D

•

Jun 6, 2020

All the topics are very understandable, the way Andrew sir describe a concepts is just awesome. During the first specialization course i.e Neural Networks and Deep Learning , I was very confused about the hyperparameters tunning (like how to know what to chose). Khan Academy has helped me a lot to understand the underlying mathematical concepts.

By Nestor H

•

Jun 5, 2018

It was a great course to take. I could grab basic knowledge on TensorFlow and on some optimization techniques. I consider all the optimization algorithms are based on gradient descent, it is just that they tweak some parameters, but they are gradient-descent like algorithms. In summary, Dr. Ng is a genius and it is worth taking all his classes.

By Jay P G

•

Dec 30, 2019

After knowing the basics of Deep Learning and Neural Networks (From the course 1) , this course explains the crux of improving and tuning of the neural networks and it's parameters and Hyper parameters . And the intro to tensor flow at last was just awesome(not exaggerating it!!!) . Congrats to Andrew and his team for such an awesome course .

By Shivdas P

•

Dec 24, 2019

This course extends what has been taught in the preceding course, especially the different hyper parameters and optimisation strategies. Getting started with TensorFlow in a complete end-to-end example has been one of the things I was looking for and this course puts all that and many other things into perspective. Thanks Andrew and team !!

By Tamás K

•

Aug 3, 2019

The course was great, thank you! However, I'm really looking forward using Tensorflow in C++ or Swift. The obscure, untyped nature of Python facilitates cargo-cult habits, creates some mystic fog around the variables (since it's not explicit if e.g. 'cost' is a concrete float or an entire computation waiting to be executed) and error-prone.

By Eulier A G M

•

Aug 31, 2019

The course is very well structured, most of the topics here is perhaps kind of boring due the lack of real-problems projects, but if you stick to it and learn the concepts, will boost your understanding when using Deep Neural Network Frameworks, such as Tensorflow. That makes creating DNN easy to set, understand and apply to your problems.

By Suhas P

•

Sep 21, 2017

Introduction to TensorFlow was wonderful. This course has helped me visualize and experience end to end flow of an actual machine learning project that helped a lot. Thanks to Andrew for taking efforts to design the course in a user friendly way. Programming tips are intuitive, helps save your time and allows you to focus more on learning.

By Chandan N

•

Nov 27, 2019

Great insights into the theory of regularization and famous optimization algorithms like RMSProp and Adam. Helps in developing intuition regarding these algorithms work and implementing them from scratch was pretty rewarding as well.

As usual, Prof Andrew Ng patiently explains the theory and helps in building understanding of the material.

By Saransh M

•

Aug 20, 2019

Started from the basics but made sure that they provided an in depth understanding of some very important concepts like hyperparameters and regularization will well structured quizzes and interesting programming assignments. Really liked the course and would suggest it to anyone trying to set their feet in the field of ML or Deep Learning

By Shuvayan G D

•

Jun 16, 2019

This is probably one of the best courses on hyperparameter tuning. Along with Andrew's teaching , the course assignments are just perfect to get the perfect intuition of how optimizers work in the deep learning frameworks , also you will be able to build your own optimizer from scratch after doing this course , though not recommended. : P

By Mohd F

•

May 17, 2019

This is an amazing course, it helps me a lot to gain the basic intuition, and the idea behind tunning our model, this course provides understanding basic maths of how we can knob various hyperparameters, which would eventually lead us to a better statistical model in term of both speed and performance... Thankyou coursera ...Thanks Andrew

By Ivan T

•

Feb 4, 2018

Another great course! Enjoyed it very much. Learned a lot of useful techniques. One thing that could be nice to do is to add references and optional material for students who want to go deeper (i.e. add references to publications related to some technique or a blog page). Looking forward to taking more courses in the Deep Learning series!

By Jonah N

•

Jun 4, 2018

The course really gave me insight into some of the optimization methods that are commonly used. It also helped me to get a better understanding of Tensorflow. I think y'all have done a good job presenting the information with just the right amount of math and explanation. I have recommended this course series to multiple friends already.

By Arpit B

•

Sep 11, 2017

Thanks Andrew, As always you have been a superb teacher, I am very happy with the content of the course.

One suggestion is to increase the level of difficulty in assignments. Or you can have one more course to develop an difficult deep learning application from scratch, through which we can all apply the concepts and tricks you explained.

By Zihao Z

•

Apr 25, 2020

It is really helpful to NN rookies like me. I have learnt a lot of important concepts and skills, such as hyperparameters tuning and variables initialization. More importantly, I gain some basic knowledge about Tensorflow, which is a widely used NN framework. I really appreciate the step-by-step instructions in the notebook assignments.

By Yan

•

Apr 13, 2019

Although the concepts of deep learning ( ie. the gradient descent, the chain rule ) are quite easy-understanding and clear to most people, how to choose the hyperparameter and how to effectively carry out the projects are real essence. That's what I learn from this course. Thanks for so many genius researchers contributing to this area.

By Jayant R

•

Feb 24, 2019

I didn't knew much about different optimization algorithms and how they work. This course helped in understanding those concepts. Also leaened how to tune hyperparameters. Now, I am able to read tensorflow codes on net and also able to write basic code. Prof. Andrew Ng is the best. Concepts gets very clear on first time watching video.

By ALBERICO S D L F

•

Apr 12, 2020

This is a best serie I've ever seen on digital courses overall, the sequence os topics are well planned and applied, the level is perfectly balanced to be challenger and also understandble. Contrags to professor Andrew and all his team for more on great resource to spread AI knowledge and make it accessible to most interested people.

By Edwin G

•

Dec 12, 2017

Some of the coding at the end was pretty tricky and I had to use the forums for help. That's what they're there for of course but I don't think the introduction to Tensorflow syntax was really sufficient - or maybe there could be some more optional help or resource to look through to help. Still very interesting and rewarding course!!

By Hellen H

•

Sep 21, 2020

This is great course if you have taken NN network and deep learning course to sharpen knowledge about dl optimization algorithm. Teaching was good and clear. However i think the video duration is quite long, at least it can be made under 10 minutes. Give a thumb to this course and it also introduce tensorflow to program the algorithm

By Virginia A

•

Apr 7, 2020

highly illuminating. Finally, with this second course, I could grab the deep concepts and consequences of many terms I heard so many times during talks between data scientists. I feel now I could easily use what learnt to participate actively to those meetings and practically try things out on my methods and make them perform better.

By Karan S

•

Apr 27, 2019

I'd been working on Neural network Models in my undergrad projects, but really couldn't answer much of the problems that I faced. The title isn't too appealing, because no new Network Architectures are taught, but in my opinion, this course is on par with the previous course on building Deep Networks from scratch. Highly Recommended.

By Anand K M

•

Feb 10, 2018

A very nice course providing intuitions and concepts for tuning the hyper parameters in a neural network.

Also, provides a taste of using Tensor Flow (Neural Network Framework) in a comprehensive manner.

I would give my deepest thanks to the instructor, Prof. Andrew Ng for his invaluable time for building the course for the learners.

By Senthil V V

•

Jun 25, 2020

Thank you so much Coursera for providing me such a good course. It was a great learning experience. The assignments and quizzes played an important role in improving my skills and giving me the confidence to implement deep NNs. I'll definitely recommend this course to others. Looking forward in doing more courses in deeplearning.ai