Senior Thesis in Control and Dynamical Systems
Research in control and dynamical systems, supervised by a Caltech faculty member. The topic selection is determined by the adviser and the student and is subject to approval by the CDS faculty. First and second terms: midterm progress report and oral presentation during finals week. Third term: completion of thesis and final presentation. Not offered on a pass/fail basis.
Introduction to Feedback Control Systems
An introduction to analysis and design of feedback control systems, including classical control theory in the time and frequency domain. Input/output modeling of dynamical systems using differential equations and transfer functions. Stability and performance of interconnected systems, including use of block diagrams, Bode plots, the Nyquist criterion, and Lyapunov functions. Design of feedback controllers in state space and frequency domain based on stability, performance and robustness specifications.
Optimal Control and Estimation
Optimization-based design of control systems, including optimal control and receding horizon control. Introductory random processes and optimal estimation. Kalman filtering and nonlinear filtering methods for autonomous systems.
Linear Systems Theory
Basic system concepts; state-space and I/O representation. Properties of linear systems, including stability, performance, robustness. Reachability, observability, minimality, state and output-feedback.
Network Control Systems
Variety of case studies and projects from control, communication and computing in complex tech, bio, neuro, eco, and socioeconomic networks, particularly smartgrid, internet, sensorimotor control, cell biology, medical physiology, ecosystems, and human and animal social organization. Leveraging universal laws and architectures including laws, layers, levels, diversity, and sweet spots, but adding domain specific details. Optional math and more domain details will be available for each topic, and students are encouraged to pursue one or more in greater depths. CDS 231 focuses on the theory and math motivated by 141.
Independent Work in Control and Dynamical Systems
Research project in control and dynamical systems, supervised by a CDS faculty member.
Robust Control Theory
Synthesis of robust control systems. Co-design of sparse and limited (delayed, localized, quantized, saturating, noisy) sensing, communications, computing, and actuation using System Level Synthesis (SLS). Layering, localization, and distributed control. Interplay between automation, optimization, control, modeling and system identification, and machine learning. Computational scalability exploiting sparsity and structure. Start with linear input/output models (multi-state difference and differential equations). Stability, input/output norms. Uncertainty, including noise, disturbances, parametric uncertainty, unmodeled dynamics, and structured uncertainty (LTI/LTV). Tradeoffs, robustness versus efficiency, conservation laws and hard limits in time and frequency domain. Nonlinear dynamics and sum of squares, global stability, regions of attraction. Motivation throughout from case studies in tech, neuro, bio, and socioeconomic networks, as introduced in CDS 141, but not a prerequisite.
This course studies nonlinear dynamical systems beginning from first principles. Topics include: existence and uniqueness properties of solutions to nonlinear ODEs, stability of nonlinear systems from the perspective of Lyapunov, and behavior unique to nonlinear systems; for example: stability of periodic orbits, Poincaré maps and stability/invariance of sets. The dynamics of robotic systems will be used as a motivating example.
This course studies nonlinear control systems from Lyapunov perspective. Beginning with feedback linearization and the stabilization of feedback linearizable system, these concepts are related to control Lyapunov functions, and corresponding stabilization results in the context of optimization based controllers. Advanced topics that build upon these core results will be discussed including: stability of periodic orbits, controller synthesis through virtual constraints, safety-critical controllers, and the role of physical constraints and actuator limits. The control of robotic systems will be used as a motivating example.
Advanced Robotics: Planning
Advanced topics in robotic motion planning and navigation, including inertial navigation, simultaneous localization and mapping, Markov Decision Processes, Stochastic Receding Horizon Control, Risk-Aware planning, robotic coverage planning, and multi-robot coordination. Course work will consist of homework, programming projects, and labs. Given in alternate years.
Advanced Robotics: Kinematics
Advanced topics in robot kinematics and robotic mechanisms. Topics include a Lie Algebraic viewpoint on kinematics and robot dynamics, a review of robotic mechanisms, and a detailed development of robotic grasping and manipulation. Given in alternate years. Not offered 2022-23.
Hybrid Systems: Dynamics and Control
This class studies hybrid dynamical systems: systems that display both discrete and continuous dynamics. This includes topics on dynamic properties unique to hybrid system: stability types, hybrid periodic orbits, Zeno equilibria and behavior. Additionally, the nonlinear control of these systems will be considered in the context of feedback linearization and control Lyapunov functions. Applications to mechanical systems undergoing impacts will be considered, with a special emphasis on bipedal robotic walking. Not offered 2022-23.
Specification and design of control systems that operate in the presence of uncertainties and unforeseen events. Robust and optimal linear control methods, including LQR, LQG and LTR control. Design and analysis of model reference adaptive control (MRAC) for nonlinear uncertain dynamical systems with extensions to output feedback. Given in alternate years.
Mathematical treatment of system identification methods for dynamical systems, with applications. Nonlinear dynamics and models for parameter identification. Gradient and least-squares estimators and variants. System identification with adaptive predictors and state observers. Parameter estimation in the presence of non-parametric uncertainties. Introduction to adaptive control. Not offered 2022-23.
Mathematical treatment of data-driven machine learning methods for controlling robotic and dynamical systems with various uncertainties. Gradient and least-squares estimators and variants for dynamical systems for system identification and residual learning. Adaptive control methods for online adaptation and combination with deep learning. Learning-based control certificates such as neural Lyapunov functions and neural contraction metrics.
Closed Loop Flow Control
This course seeks to introduce students to recent developments in theoretical and practical aspects of applying control to flow phenomena and fluid systems. Lecture topics in the second term drawn from: the objectives of flow control; a review of relevant concepts from classical and modern control theory; high-fidelity and reduced-order modeling; principles and design of actuators and sensors. Third term: laboratory work in open- and closed-loop control of boundary layers, turbulence, aerodynamic forces, bluff body drag, combustion oscillations and flow-acoustic oscillations. Not offered 2022-23.
Advanced Topics in Systems and Control
Topics dependent on class interests and instructor. May be repeated for credit.
Research in Control and Dynamical Systems
Research in the field of control and dynamical systems. By arrangement with members of the staff, properly qualified graduate students are directed in research.