Вернуться к Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

звезд

Оценки: 60,677

•

Рецензии: 7,028

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically.
By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow.
The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

AM

8 окт. 2019 г.

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

XG

30 окт. 2017 г.

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

Фильтр по:

автор: Brennon B

•23 апр. 2018 г.

Walking away from this course, I do *not* feel adequately prepared to implement (end-to-end) everything that I've learned. I felt this way after the first course of this series, but even more so now. Yes, I understand the material, but the programming assignments really don't amount to more than "filling in the blanks"--that doesn't really test whether or not I've mastered the material. I understand that this is terribly hard to accomplish through a MOOC, and having taught university-level courses myself, I understand how much effort is involved in doing so in the "real world". In either case, if I'm paying for a course, I expect to have a solid grasp on the material after completing the material, and though you've clearly put effort into assembling the programming exercises, they don't really gauge this on any level. Perhaps it would be worth considering a higher cost of the course in order to justify the level of effort required to put together assessments that genuinely put the student through their paces in order to assure that a "100%" mark genuinely reflects both to you and the learner that they have truly internalized and mastered the material. It seems to me that this would pay off dividends not only for the learner, but also for the you as the entity offering such a certificate.

автор: oli c

•9 дек. 2018 г.

Lectures are good. Quizzes and programming exercises too easy.

автор: Alan S

•30 сент. 2017 г.

As far as the video lectures is concerned, the videos are excellent; it is the same quality as the other courses from the same instructor. This course contains a lot of relevant and useful material, and is worth studying, and complements the first course (and the free ML course very well).

The labs, however, are not particularly useful. While it's good that the focus of the labs is applying the actual formulas and algorithms taught, and not really on the mechanical aspects of putting the ideas in actual code, the labs have structured basically all of the "glue" and just leave you to basically translate formulas to the language-specific construct. This makes the lab material so mechanical as to almost take away the benefit.

The TensorFlow section was disappointing. It's really difficult to learn much in a 15 minute video lecture, and a lab that basically does everything (and oddly, for some things leaves you looking up the documentation yourself). I didn't get anything out of this lab, other than to get a taste for what it looks like. What makes it even worse is TensorFlow framework uses some different jargon that is not really explained, but the relevant code is almost given to you so it doesn't matter to get the "correct" answer. I finished the lab not feeling like I knew very much about it at all. It would have been far better to either spend more time on this, or basically omit it.

As with the first course, it is somewhat disappointing lecture notes are not provided. This would be handy as a reference to refer back to.

Still, despite these flaws, there's still a lot of good stuff to be learned. This course could have been much better, though.

автор: Lien C

•31 мар. 2019 г.

The course provides very good insights of the practical aspect of implementing neural networks in general. Prof. Ng, as always, delivered very clear explanation for even the difficult concepts, and I have thoroughly enjoyed every single lecture video.

Although I do appreciate very much the efforts put in by the instructors for the programming assignments, I can't help but thinking I could have learnt much more if the instruction were *LESS* detailed and comprehensive. I found myself just "filling in the blank" and following step-by-step instruction without the need to think too much. I'm also slightly disappointed with the practical assignment of Tensorflow where everything is pretty much written out for you, leaving you with less capacity to think and learn from mistakes.

All in all, I think the course could have made the programming exercise much more challenging than they are now, and allow students to learn from their mistakes.

автор: Xiao G

•31 окт. 2017 г.

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

автор: NASIR A

•14 янв. 2020 г.

After completion of this course I know which values to look at if my ML model is not performing up to the task. It is a detailed but not too complicated course to understand the parameters used by ML.

автор: Alexandre M

•9 окт. 2019 г.

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

автор: Md. R K S

•15 апр. 2019 г.

Excellent course. When I learned about implementing ANN using keras in python, I just followed some tutorials but didn't understand the tradeoff among many parameters like the number of layers, nodes per layers, epochs, batch size, etc. This course is helping me a lot to understand them. Great work Mr. Andrew Ng. :)

автор: Matthew G

•17 апр. 2019 г.

Very good course. Andrew really steps it up in part two with lots of valuable information.

автор: Abhishek S

•19 апр. 2020 г.

Very good course to give you deep insight about how to enhance your algorithm and neural network and improve its accuracy. Also teaches you Tensorflow. Highly recommend especially after the 1st course

автор: Carlos V

•24 дек. 2017 г.

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow

Thanks.

автор: Yuhang W

•25 нояб. 2018 г.

programming assignments too easy

автор: Anand R

•17 февр. 2018 г.

To set the context, I have a PhD in Computer Engineering from the University of Texas at Austin. I am a working professional (13+ years), but just getting into the field of ML and AI. Apologies for flashing this preamble for every course that I review on coursera.

This course is the 2nd in a 5 part series offered by Dr. Andrew Ng on deep learning on coursera. I believe it is useful to take this course in order and makes sense as a part of the series, though technically it is not necessary.

The course covers numerous tuning strategies and optimization strategies to help seed up as well as improve the quality of the machine learning output. It is very well planned and comprehensive (to the extent possible) -- and gives the student a very power toolbox of stratgies to attack a problem.

The instructor videos are very good, usually 10 min long, and Dr. Ng tries hard to provide intution using analogies and real-life examples. The quizzes that accompany the lectures are quite challenging and help ensure that the student has understood the material well. The programming exercises are the best part of the course. They help the student practice the strategies and also provide a jump-start for the student to use the code for their own problems at work or in school.

Overall, this is an excellent course. Thank you Dr Ng and the teaching assistants, Thank you coursera.

автор: Abiodun O

•6 апр. 2018 г.

Fantastic course! For the first time, I now have a better intuition for optimizing and tuning hyperparameters used for deep neural networks.I got motivated to learn more after completing this course.

автор: Youdinghuan C

•28 дек. 2017 г.

This is a logical continuation of the previous course. The 3-week topics were excellently chosen. Andrew did a great job of delivering the lectures. The programming assignments really reinforced my understanding. In particular, essential knowledge and equations from video lectures were reiterated in the programming assignments for review and ease of reference. The amount of work was reasonable, and the level of challenge was appropriate. I especially appreciate the instructional team for making this course open to the public.

автор: Alessandro T

•22 янв. 2018 г.

A right balance between theory (you are required to code know the models and code them from scratch) and practice (you get an overview of the frameworks available out there to put your code into production quickly and efficiently; and time is spent on practical aspects of the training phase).

A small "criticism": in the notebook, more than programming you just have to fill a template where a good part of the algorithm is already drafted for you. It is too much, students should be left scratching their heads a bit longer :)

автор: Hassan S

•3 апр. 2018 г.

Andrew Ng and the teaching assistants' team of this class are obviously very very determined not to leave any single major subject in deep learning without coverage. I have been using deep learning for the past couple years, but I have to say by completing the second course of this specialization, they helped me deepen my understanding, overcome fear of implementing math and equations line by line, fix my intuitions about deep learning, and most importantly erase all the superstitions! Bravo and excellent job.

автор: Hernan F D

•5 дек. 2019 г.

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.

the only thing i didn't have completely clear is the barch norm, it is so confuse

автор: Shah Y A

•28 окт. 2019 г.

TL;DR: lectures are awesome, notebooks are bad.

The lectures by Prof. Ng are amazing, comprehensive and intuitive. The prof starts from first principles of simple neural networks and goes onto show concepts like normalization, bias, variance, overfitting, underfitting, regularization, dropout, L1 and L2 regularization, exponentially weighted averages, stochastic, mini batch and batch gradient descent, momentum, RMSprop, Adam optimization, batch normalization and intro to deep learning frameworks. He not only gives the mathematical foundations and code implementations of each concept, but spends a lot of time explaining the intuition behind it, so that we grasp the concept well. It's amazing how he starts from decade old neural networks in the first video, and within 2-3 hours of lecturing, he brings us into the state-of-the-art deep learning models. Thank you Prof. Ng!

But the notebooks have many flaws. The lectures don't set you up for the programming needed in the notebooks. The descriptions in the notebooks are lacking proper tutorial in many places, leading the students incompetent for the exercises that follow. Example: Week 3 tensorflow tutorail; the sigmoid function exercise; the description above the exercise doesn't really teach you how to effectively use placeholders and variables. I was confused and had to go through the noisy dicsussion forum. Please fix it, and if you'd really like more constructive criticism from me, contact me yasser.aziz94 (at da rate ov) gee mail dut com. (lol)

автор: Hequn W

•18 апр. 2018 г.

I can't open week1 assignment initialization, and can't get any help from coursera. I've completed all five courses, but can't get certification without this assignment....

автор: Văn H B

•27 мая 2019 г.

I would rate for this course 4.5, but Coursera's system does not have it.

About the first and second week, explanation about terms in Deep Learning are very good from Prof. Andrew, the preparation for exams is quite good for you to revise lectures. I think programming exercices should be more challenge and more suggestive for students, but it was okay for me after having some knowledge from Machine Learning Course. I suggest you to finish Machine Learning Course before taking this.

About the third week, i expect a lot more about TensorFlow that Mr.Andrew can give me, or maybe more intuiation about it. Moreover, Batch Norm 's explanation is quite hard to understand, because we do not have any programming exercise for it, so I hope teachers can prepare a programming exercises among with the programiing exercise for TensorFlow.

автор: Nimish S

•15 авг. 2017 г.

Having done multiple Udacity Nano Degrees and other deep-learning/AI courses on Coursera/edX, I can say that deeplearning specialization is probably the best and most detailed to master the basics of Neural Networks and deep learning. This course is great in helping understand tuning of hyper-params, various optimization techniques and approaches. Videos do a great job in explaining complex and confusing concepts in easy to understand style. Assignments cement the understanding further.

Kudos to the Prof Andres Ng and rest of the deeplearning.ai team for putting up such a great content.

автор: Mohanad A N

•25 февр. 2019 г.

I'm actually learning and comprehending the course, I do pause the videos occasionally to research some concepts, write some notes in a copybook but overall this specialty(so far course 1 & 2 ) is really filling the gaps in my mind to build a clearer picture of the topic of Machine Learning and Deep Learning. Andrew Ng explains really well, sometimes he through some good recommendations based in his practical experience and this is really valuable for me because it actually helps in improving the learning process.

Thank you Andrew and Coursera Team.

автор: Yashveer S Y

•2 июня 2018 г.

This course is perfect bite for your hunger of Deep learning. Before taking this course I have gone through some books and and some blogs too but there was not that much of clarity to topic so finally I tried for this one and trust me this course is so organised and very informatic so go for this one, I assure you will feel more confident and knowledgeable after completing this course. I would like to thanks Coursera as well as deeplearning.ai community for providing this course and Want to specially thanks to Mr. Andrew Ng for his contribution

автор: Heshmat S

•26 дек. 2017 г.

This is the 2nd course from Andrew Ng in the "deep learning specialization". Having introduced the building blocks of deep neural networks, in this course Andrew teaches more advanced and practical concepts - like: regularization, advanced optimization techniques, batch-normalization, etc - that can significantly improve the implementation of the models we build.

Also, in this course we get to learn TensorFlow, a widely used and wonderful deep learning framework.

I highly recommend this course.

Thank you Andrew & Co. :-)

- Аналитик данных Google
- Управление проектами от Google
- UX-дизайн от Google
- ИТ-поддержка Google
- Наука о данных IBM
- Аналитик данных от IBM
- Анализ данных с помощью Excel и R от IBM
- Аналитик по кибербезопасности от IBM
- Инженерия данных IBM
- Разработчик комплексных облачных приложений IBM
- Маркетинг в социальных сетях от Facebook
- Маркетинговая аналитика Facebook
- Представитель по развитию продаж от Salesforce
- Сбытовые операции Salesforce
- Бухгалтерия от 'Интуит'
- Подготовка к сертификации Google Cloud: облачный архитектор
- Подготовка к сертификации Google Cloud: специалист по инженерии облачных данных
- Начните карьеру
- Подготовьтесь к сертификации
- Продвинуться по карьерной лестнице

- бесплатные курсы
- Изучите иностранный язык
- Python
- Java
- веб-дизайн
- SQL
- Cursos Gratis
- Microsoft Excel
- Управление проектами
- Безопасность в киберпространстве
- Людские ресурсы
- Бесплатные курсы в области науки о данных
- говорить на английском
- Написание контента
- Веб-разработка: полный спектр технологий
- Искусственный интеллект
- Программирование на языке C
- Навыки общения
- Блокчейн
- Просмотреть все курсы

- Навыки для команд по науке о данных
- Принятие решений на основе данных
- Навыки в области программной инженерии
- Навыки межличностного общения для проектных групп
- Управленческие навыки
- Навыки в области маркетинга
- Навыки для отделов продаж
- Навыки менеджера по продукту
- Навыки в области финансов
- Популярные в Великобритании курсы по науке о данных
- Beliebte Technologiekurse in Deutschland
- Популярные сертификаты по кибербезопасности
- Популярные сертификаты по ИТ
- Популярные сертификаты по SQL
- Профориентация: маркетолог
- Профориентация: руководитель проектов
- Навыки программирования на языке Python
- Профориентация: веб-разработчик
- Навыки для аналитика данных
- Навыки для UX-дизайнеров

- Сертификаты MasterTrack®
- Профессиональные сертификаты
- Сертификаты университетов
- MBA и другие дипломы в области бизнеса
- Степени в области науки о данных
- Степени в области компьютерных наук
- Дипломные программы по анализу данных
- Степени в области общественного здравоохранения
- Степени в области социальных наук
- Дипломные программы в области управления
- Дипломы ведущих европейских университетов
- Дипломы магистра
- Степени бакалавра
- Дипломы с карьерными путями, ориентированными на результат
- Бакалаврские курсы
- Что такое диплом бакалавра?
- Сколько времени нужно для получения диплома магистра?
- Стоит ли получать диплом MBA онлайн?
- 7 способов оплатить магистратуру
- Посмотреть все сертификаты