**Theory Lectures (recorded):** Mondays, 10:00 -- 11:00; LectureCast

**Lab Lectures (on-campus/online, live):** Wednesday, 10:00 -- 11:00; Archaeology 612

**Research Lectures (online, live):** Thursdays, 16:00 -- 17:00; Zoom

University College London (UCL)

Instructors: Dimitrios Kanoulas, Francisco Vasconcelos

In this course, we will discuss a range of sensing and cognitive control strategies. This theory will then be used to design robotic systems to perform manipulation tasks to cope with unstructured environments such as localizing objects for grasping.

- Understand the main concepts related to robotic manipulation and sensing.
- Develop methods for tackling uncertainty in robotic manipulation systems.
- Read scientific literature in robotics to choose approaches for a particular problem.
- Implement state-of-the-art algorithms on simulated manipulators and sensors.

- A working knowledge of linear algebra: a linear algebra refresher (Khan Academy lecture) are

- Representing Poses and Kinematics for Robot Manipulation
- Visual & other Exteroceptive Sensing
- Visual pose estimation under uncertainty
- Force/Torque & other Proprioceptive Sensing
- Sensing-based Grasping
- Pick-and-Place Methods
- Navigation Among Movable Objects (NAMO)
- Human-Robot Interaction and Collaboration
- Reinforcement Learning for Grasping

- One 2-hours lecture will discuss background theory.
- One 1-hour lecture for research reading and presentation from the students.
- One 1-hour lab session will focus on simulated experiments on manipulators and sensors for grasping purposes.

- Previous programming experience: C++, ROS, PCL.
- Motivation to work hard.
- An introductory course on ROS from ETH can be found here.

**Lecture 1-2:**P. Corke, "Robotics, Vision and Control: Fundamental Algorithms in Matlab, 2nd ed", Springer Tracts in Advanced Robotics, 2017.**Lecture 1-2:**J. Craig, "Introduction to Robotics: Mechanics and Control", Global Edition, 3rd Edition, Pearson.**Lecture 5-6:**I. Goodfellow, Y. Bengio, and A. Courville, "Deep Learning", The MIT Press.**Lecture 5-6:**G. Strang, "Linear Algebra and Learning from Data", Wellesley-Cambridge Press.**Lecture 9:**R. Murphy, "Introduction to AI Robotics", Second Edition, The MIT Press.**Lecture 10:**R. Sutton and A. Barto, "Reinforcement Learning", Second Edition, The MIT Press.**Supplementary (Kalman Fusion):**S. Thrun, W. Burgard, and D. Fox, "Probabilistic Robotics", The MIT Press.**Supplementary (Data Structures):**Cormen, Leiserson, Rivest, Stein, "Introduction to Algorithms", The MIT Press.**Supplementary (Perception):**Siegwart, Nourbakhsh, Scaramuzza, "Introduction to Autonomous Mobile Robots", Second Edition, The MIT Press.**Supplementary (Robot Walking):**Uchida, Delp, "Biomechanics of Movement, The Science of Sports, Robotics, and Rehabilitation", The MIT Press.

The Moodle page for the course: here.

- Coursework 0 (CW0): 0%
- Coursework 1 (CW1): 20%
- Coursework 2 (CW2): 35%
- Coursework 3 (CW2): 45%

Unless specified differently, the research presentations, practical sessions, homework assignments, and final project will be done by students that they form groups (not necessary the same groups for every category). The pairs will be assigned randomly and based only on some requirements such that at least every group has an Ubuntu 18.04LTS, ROS Melodic system to work on.

- Total number of students: 52
- Research Presentation: 3-4 students (total: 14 teams)
- Coding HW: 3 students (total: 17 teams)
- Research Report: 3 students (total: 17 teams)
- Project and Report: 3 students (total: 17 teams)

The UCL academic integrity policy applies to your work in this course for: written homework, coding work, and coding assignments. Cheating and other acts of academic dishonesty will be referred to the corresponding UCL office: here.

__Instructors:__

- Dimitrios Kanoulas - 60% (d.kanoulas@ucl.ac.uk)

Office hours: TBA, 09:00-10:00am, Zoom (link). - Francisco Vasconcelos - 40% (f.vasconcelos@ucl.ac.uk)

Office hours (Dimitrios): TBA, 09:00-10:00am, Zoom (link).

__TAs:__

- Denis Hadjivelichkov (dennis.hadjivelichkov@ucl.ac.uk), PhD Student in Robotics and Machine Learning
- Luke Beddow: (luke.beddow.20@ucl.ac.uk), PhD Student in Robotics and Mechatronics
- Maria Stamatopoulou: (maria.stamatopoulou.21@ucl.ac.uk), PhD Student in Robotics and Machine Learning
- Sicelukwanda Zwane (sicelukwanda.zwane.20@ucl.ac.uk), PhD Student in Robotics and Machine Learning