Вернуться к Fundamentals of Reinforcement Learning

звезд

Оценки: 2,385

Reinforcement Learning is a subfield of Machine Learning, but is also a general purpose formalism for automated decision-making and AI. This course introduces you to statistical learning techniques where an agent explicitly takes actions and interacts with the world. Understanding the importance and challenges of learning agents that make decisions is of vital importance today, with more and more companies interested in interactive agents and intelligent decision-making.
This course introduces you to the fundamentals of Reinforcement Learning. When you finish this course, you will:
- Formalize problems as Markov Decision Processes
- Understand basic exploration methods and the exploration/exploitation tradeoff
- Understand value functions, as a general-purpose tool for optimal decision-making
- Know how to implement dynamic programming as an efficient solution approach to an industrial control problem
This course teaches you the key concepts of Reinforcement Learning, underlying classic and modern algorithms in RL. After completing this course, you will be able to start using RL for real problems, where you have or can specify the MDP.
This is the first course of the Reinforcement Learning Specialization....

AT

6 июля 2020 г.

An excellent introduction to Reinforcement Learning, accompanied by a well-organized & informative handbook. I definitely recommend this course to have a strong foundation in Reinforcement Learning.

HT

7 апр. 2020 г.

This course is one of the best I've learned so far in coursera. The explanations are clear and concise enough. It took a while for me to understand Bellman equation but when I did, it felt amazing!

Фильтр по:

автор: Harshit S

•19 сент. 2019 г.

One of the best courses I finished on Coursera, I really like the structure of the course. Textbook is also provided which really helps. Looking forward to next course in the series.

автор: 姚佳奇

•6 авг. 2019 г.

Very good courses. It helps me to understand reinforcement learning a lot.

автор: Andrei C

•27 сент. 2019 г.

The course is overall well structured and concise. I am sure that the instructors could do a better job of putting more emphasis on the difficult parts of the course (such as how to actually use the Bellman Equations and how to calculate the State/Action Value functions). More examples of calculation would have made things far easier. All in all, it was a decent introduction to RL and the videos cleared some of the confusion that arised just by reading the RL handbook by Sutton & Barto.

автор: K. S

•22 сент. 2019 г.

Some of the sections seemed a bit rushed up. While the book provided a good source to clarify, I would prefer a slightly slower pace with emphasis on understanding during the video presentation. However, I have learnt significantly on reinforcement learning during the course. Thanks to the instructors who are highly accomplished, and have taken the time to create this video course.

автор: satheeshkumar v

•12 сент. 2019 г.

What ever the content taught was really really good. but still more hands-on algorithms such as Monte Carlo would have been even better. overall worth studying the course

автор: Akshay P

•23 окт. 2019 г.

Good overall. Need to work with your assignments and their submission procedure. Lectures should be more interactive than just going through slides.

автор: Waziha K

•4 июня 2020 г.

Course instructors should improve their teaching style by writing equations in hand and explaining point-by-point. There is no need to show their faces in the video while teaching. They sounded like 'radio' throughout the course.

автор: Pickton B

•21 июня 2020 г.

Very low pedagogy in there. Just a bunch of slides (not all that good) being narrated by a standing person. You're better off reading a book.

автор: Ekaterina R

•13 февр. 2020 г.

Not recommended

автор: Roger S

•17 мая 2021 г.

My rating and review is for the entire specialization. Big compliments to the course instructors for developing a truly insightful and challenging course. Out of all the specializations and courses I have done on Coursera, this definitely has been the most challenging and rewarding one. The use of a textbook in addition to the video and programming materials is a very useful approach - to get the most out of this course, I recommend everyone to study all the material in advance of the lectures. This really increases the added value of the course.

As has been said by others, the capstone project (course 4) is the least developed. It is mostly a reiteration of videos from previous courses, and a few programming assignments (numbers 1 and 3 of which are very easy, whereas number 2 is very challenging). A drawback is that as the courses progress, but in particular in course 4, the programming exercises become quite mechanical, and mostly involve following specific instructions with a bit of debugging, without keeping proper sight of the bigger picture. Then again, I've felt this is the case for many courses in ML, and not particular to this course.

At this point, I feel I have a pretty good understanding of the theoretical basis of RL, but I would definitely not be able to implement an RL agent independently. I guess with this basis in hand, it is now time for some more applied (self-)study in this domain. I have definitely become even more eager to do so.

автор: Jonathan B

•1 мая 2020 г.

Very well put together course. It does a good job of walking you through concepts in a way that's direct and accessible, while not dumbing things down. I had bought the Intro to RL textbook some months back but ran into problems getting its material to 'stick', but the ideas in chapters 1-4 are much more concrete now.

Assignments were reasonably difficult, but not overwhelmingly so. Homeworks are designed to make sure you understand key concepts moreso than being vigilantly 'rigorous' for their own sake. Emphasis of the class is making sure you understand fundamental concepts moreso than hacking your way into a working prototype of something.

While the class is designed to be easily digested, the material assumes a working knowledge of programming and mathematical formalism, so people without some background knowledge you might struggle to keep pace, even if the material is well designed.

Also, like others have mentioned.......this class follows the book pretty carefully. Don't expect anything to be covered that's not in the RL textbook the course is based off of. By the end of the class the book material will be more vivid and concrete in your mind, but you will not have branched into a direction not covered within it.

автор: Daniel P

•30 дек. 2020 г.

The course is very good, I already had some experience with Markov chains. I found the hardest part to understand was week 3 with the Bellman equations. The course should be reinforced in this part so that everyone can understand, and it would even be to pass some of the material in this section to the second week (since it is a lot of topic).

I had to do a lot of research with other sources to be able to understand the content of week 3, since the book is not very clear material, especially on this topic. It would be very interesting if you could explain us better how to create these environments that are mentioned (eg GridWorld, Pole Car, etc) in Python in order to improve the form and intuition in the application of these concepts, this as off-topic material.

The guest talks were very beneficial to me, they give some very interesting historical and practical perspectives on the application of the concepts. Professor Warren Powell's talk was the most interesting in my opinion and he left me wondering how we could apply these concepts to real life problems.

Thanks to the team for this course.

автор: Neil H

•10 нояб. 2021 г.

The same review for all 4 courses: This is the first time I have done a Coursera module building courses up rather than just individual courses. You really feel you have achieved something out of it. Some people have commented that it is just presenting material from the Sutton and Barto book. But that book is *the* text book in the subject. The course selected particular chapters from the book. I wouldn't have got as much just from trying to read the book on its own (I probably wouldn't have read as much as I did). It was good to have the supplementary videos with other experts - and great to watch Sutton and Barto just sat down being recorded having a retrospective conversation. The programming exercises would sometimes feel they weren't testing much (in fact, the challenges were largely due to my lack of skill in Python - my Python abilities have improved which is a side benefit) but they would actually get you into the weeds as it were. All in all, the best courses I've done. Great job Martha and Adam!

автор: Max B

•10 мар. 2022 г.

I think it's really good course, probably the best that I have done on Coursera (and I have done a few). I like the approach of combining independent reading with high-quality video content. They do a great job of breaking down complicated topics in reinforcement learning, and the programming problems help gain a deeper and intuitive understanding of the underlying maths. I think some of the proofs in the book could be more detailed. For one or two I went on line to find more step-by-step proofs. This is in principle more an issue with the book and less with the course. But I think it could be helpful if the course would provide a reference to some more in-detail proofs. That's it though, I am really enjoying this specialization :)

автор: John W

•11 сент. 2020 г.

This course teaches you by having you read the textbook chapters (free pdf) followed by complementary videos that help you gain intuition. The quizzes focus on you truly understanding the material and are not easy. Quizzes plus two programming assignments help you actively learn rather than just passively reading or watching videos. I do wish the Discussion Forums kept a longer history of Q&A and had more responses from the instructors and mentors. For example, I had a question that someone else had already asked (so it wasn't an unusual question), but there was no response, and enough time had passed where the post became locked from any responses. So, I would really rate this course as 4.5 stars.

автор: Mukund C

•7 мар. 2020 г.

Phenomenal Course. Very nicely done. Wish there were more active mentor engagement, however, since the student community for this course is not as large as at the time of this writing, so not much material to search through in the discussion forums. It will be good if some of the videos are consistent with the book - e.g. the notion of "control" is not in the text, but is introduced in Week4 for DP. Also, it'd be great to have some more lectures that dig deeper into "alternate" representation of Bellman equations (we are thrown this question in the quiz, but some working professionals, like myself can be quite rusty in English<=>Notation mindset, but that's a "very" small nitpick item.

автор: Maximiliano B

•30 янв. 2020 г.

This course is excellent and it is a great introduction to reinforcement learning. I really liked that an electronic version of the book from Sutton and Barto is available for download as part of the course. However, it is fundamental to read the book in advance before watching the videos every week to have a better understanding of the concepts. Mr. and Mrs. White explain the content very well and it helped me a lot because the book is sometimes quite abstract if you are dealing with this subject for the first time. I definitely recommend this course to have a solid foundation in Reinforcement Learning and I am looking forward to start the next course of the specialization.

автор: Samuel L

•27 мар. 2021 г.

The course is vary good constructed. Very clear. And the homework is relatively easy compared to the excercises in the textbook, which is a good intro for coming back for those excercises.

A deep insight can not be built by this fundamentals course, but i don't mean that in a bad way. It's not easy for instructors to lead beginners through these fundamental concepts without losing well explaination of the basic therom and illustrating meaning and purposes of them straightforwardly. But Instructors here did a good job. Great respect for the high quality of this lectur. Thx again. I will keep up with the rest courses.

автор: Everest L

•7 мая 2020 г.

I've taken a few Coursera courses on machine learning/AI, and this is by far my favorite one. I love how the course is theoretically rigorous while still providing you with hands-on practice. Note: the short lecture videos don't contain all useful details, reading the (free) recommended textbook is a wise thing to do. Sometimes the quiz questions are drawn from the textbook, with slight modifications, and you'd be glad that you've worked through them prior.

No need to fret over reading every page of the textbook either, because recommended page ranges are given and they help.

автор: Deleted A

•17 сент. 2019 г.

I found the course really helpful. I have been learning RL for some time and it was hear that almost finally i can say that a lot of the concepts that were vague in my head became clearer. Also it made me look at the book of Sutton and Barto and found that it was a good experience. Maybe more examples and questions in between videos as in deeplearning.ai of Andrew NG could be good for keeping with the attention could be nice. Also maybe doing more programming exercises in between the ones we did in order to implement each step would be great. Thank you very much!!!!

автор: Leyong L

•26 февр. 2021 г.

Pros: - the time required to complete this course is reasonable and flexible

-the teaching videos explain unclarity from just reading the textbook.

-the practical examples and programming exercises help learners to relate the learned knowledge to a greater context

Cons: - some part it is not clear what do the variables of the equation meant and how it is related to real-world variables. (nevertheless, the user can find resources online to better understand the mathematics behind reinforcement learning)

автор: Douglas D R M

•1 июля 2020 г.

I believe that, as of now, this is the most educational and informative resource available online to learn the fundamentals of RL from scratch. the instructors use Sutton’s book as reference material (which is freely available online), guide you to details that no one would know are important when studying RL alone and prepare you to venture further into the area, with a solid foundation. I definitely recommend this as a starting point for anyone who wants to dig deep into RL.

автор: Saraj S

•28 авг. 2019 г.

This is the best RL course I have ever attended. Even before starting this course I had brought the textbook (the one which course instructors also recommend) and was through the first 4 chapters. I understood most of the material but when I attended the class, everything was crystal clear. I hope instructors follow up and create the remaining courses as well. Please increase prgramming assignments in number as well. Thumbs up. Thanks for this course, very grateful.

автор: Kaylee Z

•3 окт. 2019 г.

I really like this course. This course introduces the basic mathematical background needed in RL, as well as provided algorithms and hands-on programming practices in translating algorithms into actual code, which is a well-blended material for students to learn! The quizzes are very helpful as well, which helps me understand the concepts better. All the methods discussed here are quite practical and intuitive. Thanks Martha and Adam making this course fun!

автор: Aseem P C L

•30 янв. 2022 г.

wow....It was the best course for the basic of reinforcement learning. Before enrollment I was roaming all over internet for getting started but every other courses I visited from You Tube were not on order and often were too vast so early with proper background of fundamentals on reinforcement learning. But this courses from University of Alberta was just amazing.

Thank you for this course. It will be huge boost for preparing my college minor project.

- Аналитик данных Google
- Управление проектами от Google
- UX-дизайн от Google
- ИТ-поддержка Google
- Наука о данных IBM
- Аналитик данных от IBM
- Анализ данных с помощью Excel и R от IBM
- Аналитик по кибербезопасности от IBM
- Инженерия данных IBM
- Разработчик комплексных облачных приложений IBM
- Маркетинг в социальных сетях от Facebook
- Маркетинговая аналитика Facebook
- Представитель по развитию продаж от Salesforce
- Сбытовые операции Salesforce
- Бухгалтерия от 'Интуит'
- Подготовка к сертификации Google Cloud: облачный архитектор
- Подготовка к сертификации Google Cloud: специалист по инженерии облачных данных
- Начните карьеру
- Подготовьтесь к сертификации
- Продвинуться по карьерной лестнице

- бесплатные курсы
- Изучите иностранный язык
- Python
- Java
- веб-дизайн
- SQL
- Cursos Gratis
- Microsoft Excel
- Управление проектами
- Безопасность в киберпространстве
- Людские ресурсы
- Бесплатные курсы в области науки о данных
- говорить на английском
- Написание контента
- Веб-разработка: полный спектр технологий
- Искусственный интеллект
- Программирование на языке C
- Навыки общения
- Блокчейн
- Просмотреть все курсы

- Навыки для команд по науке о данных
- Принятие решений на основе данных
- Навыки в области программной инженерии
- Навыки межличностного общения для проектных групп
- Управленческие навыки
- Навыки в области маркетинга
- Навыки для отделов продаж
- Навыки менеджера по продукту
- Навыки в области финансов
- Популярные в Великобритании курсы по науке о данных
- Beliebte Technologiekurse in Deutschland
- Популярные сертификаты по кибербезопасности
- Популярные сертификаты по ИТ
- Популярные сертификаты по SQL
- Профориентация: маркетолог
- Профориентация: руководитель проектов
- Навыки программирования на языке Python
- Профориентация: веб-разработчик
- Навыки для аналитика данных
- Навыки для UX-дизайнеров

- Сертификаты MasterTrack®
- Профессиональные сертификаты
- Сертификаты университетов
- MBA и другие дипломы в области бизнеса
- Степени в области науки о данных
- Степени в области компьютерных наук
- Дипломные программы по анализу данных
- Степени в области общественного здравоохранения
- Степени в области социальных наук
- Дипломные программы в области управления
- Дипломы ведущих европейских университетов
- Дипломы магистра
- Степени бакалавра
- Дипломы с карьерными путями, ориентированными на результат
- Бакалаврские курсы
- Что такое диплом бакалавра?
- Сколько времени нужно для получения диплома магистра?
- Стоит ли получать диплом MBA онлайн?
- 7 способов оплатить магистратуру
- Посмотреть все сертификаты