- Home
- A-Z Publications
- Annual Review of Control, Robotics, and Autonomous Systems
- Early Publication
Annual Review of Control, Robotics, and Autonomous Systems - Early Publication
Reviews in Advance appear online ahead of the full published volume. View expected publication dates for upcoming volumes.
-
-
Modeling, Monitoring, and Controlling Road Traffic Using Vehicles to Sense and Act
First published online: 03 February 2025More LessThis review offers a comprehensive overview of current traffic modeling, estimation, and control methods, along with resulting field experiments. It highlights key developments and future directions in leveraging technological advancements to improve traffic management and safety. The focus is on macroscopic, microscopic, and micro-macro models, as well as state-of-the-art control techniques and estimation methods for deploying vehicles in traffic field experiments.
-
-
-
Machine Learning for Sparse Nonlinear Modeling and Control
First published online: 14 January 2025More LessMachine learning is rapidly advancing nearly every field of science and engineering, and control theory is no exception. In particular, it has shown incredible promise for handling several of the main challenges facing modern dynamics and control, including complexity, unmodeled dynamics, strong nonlinearity, and hidden variables. However, machine learning models are often expensive to train and deploy, fail to generalize beyond the training data, and suffer from a lack of explainability, interpretability, and guarantees, all of which limit their use in real-world and safety-critical control applications. Sparse nonlinear modeling and control techniques are a powerful class of machine learning that promote parsimony through sparse optimization, providing data-efficient models that are more interpretable and generalizable and have proven effective for control. In this review, we explore the use of sparse optimization in the context of machine learning to develop compact models and controllers that are easy to train, require significantly less data, and make low-latency predictions. In particular, we focus on applications in model predictive control and reinforcement learning, two of the foundational algorithms in control theory.
-
-
-
Urban Air Mobility Research Challenges and Opportunities
First published online: 02 January 2025More LessThis article reviews the literature on urban air mobility (UAM), examining both the research challenges it presents and the transformative opportunities that make these challenges worth addressing. While UAM has historical precedents, the current iteration is born of novel aircraft technology, primarily electric vertical takeoff and landing (eVTOL) and electric short takeoff and landing (eSTOL) aircraft. These advances raise new questions in aerodynamics, control, and integration with urban infrastructure. We explore several key research areas, including aircraft design, vertiport development, network planning, and air traffic management. We also address the scalability challenges in air traffic management for high-density UAM operations and the potential of autonomous and remotely piloted systems. If new aircraft are to birth a new urbanism, they will do so by integrating aircraft engineering and computational intelligence in control, systems, robotics, and human factors.
-
-
-
Control Engineer Roles in the Next Power Market Transition
First published online: 02 January 2025More LessThis survey of power operations and power markets is a collaboration between members of academia and industry. It describes the thinking behind rules in organized electricity markets, which are rooted in the theory of efficient markets, and why this theory is ill suited to address the range of challenges in real-world power systems operations. The mismatch between market theory and reality includes a lack of consideration of fixed costs and a lack of understanding of value to the consumers. Moreover, the efficient equilibrium is the solution to a risk-neutral, single-objective optimal control problem. Every control engineer knows that such solutions are rarely the final answer to a practical control problem. It is hoped that this work will inspire the control community to collaborate with industry in the design of the next generation of power markets.
-
-
-
Generative AI Agents for Knowledge Work Augmentation in Finance
First published online: 16 December 2024More LessThe development of software agents that can autonomously take actions to achieve goals has been a long-standing foundational objective in the field of AI. Recent advances in generative AI have given rise to a new class of agents. These advances have opened up the possibility of developing agents that can augment knowledge work in finance that primarily involves the cognitive processing of information by skilled humans. In this article, we bring these fields together. We break down the specific challenges in knowledge work in finance, review the current literature on generative AI agents, and identify potential directions for research and development that would help realize the potential of generative AI agents in finance. We conclude by proposing a framework to delineate the levels of autonomy for AI agents in the context of knowledge work, and an architecture for human–AI collaboration that can pave the path for progressively increasing the autonomy of agents.
-
-
-
Unfolding the Literature: A Review of Robotic Cloth Manipulation
First published online: 02 December 2024More LessThe realm of textiles spans clothing, households, healthcare, sports, and industrial applications. The deformable nature of these objects poses unique challenges that prior work on rigid objects cannot fully address. The increasing interest within the community in textile perception and manipulation has led to new methods that aim to address challenges in modeling, perception, and control, resulting in significant progress. However, this progress is often tailored to one specific textile or a subcategory of these textiles. To understand what restricts these methods and hinders current approaches from generalizing to a broader range of real-world textiles, this review provides an overview of the field, focusing specifically on how and to what extent textile variations are addressed in modeling, perception, benchmarking, and manipulation of textiles. We conclude by identifying key open problems and outlining grand challenges that will drive future advancements in the field.
-
-
-
Robotics at the University of Pennsylvania from Birth to Maturity: A Review of 30 Years of Research
First published online: 02 December 2024More LessThis article is an attempt to reexamine the evolution of robotics research at the University of Pennsylvania and all that it entailed, covering the successes and struggles of PhD students, postdoctoral researchers, and a few dedicated faculty between 1972 and 2000. In 1945, Penn's Moore School of Electrical Engineering was famous for developing the first electronic digital computer, ENIAC, but after a few years, the research had diminished. In 1972, a new Department of Computer and Information Science was formed. I came to Penn from Stanford University's Artificial Intelligence Laboratory full of energy, enthusiasm, and the goal of establishing a similar lab at Penn. This article demonstrates the creativity and ingenuity of young professionals at the General Robotics, Automation, Sensing, and Perception (GRASP) Laboratory. We built hardware. We built software. We collaborated with psychologists and electrical and mechanical engineers and tried to build a community of roboticists. Our curiosity led us to build new vision and tactile systems and to investigate cooperative robotics systems on the ground and in the air. We used computational models supported and verified by experiments. Today, I am proud to say that almost all of the students who cycled through the GRASP Lab are successful in academia or industry.
-
-
-
Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes
First published online: 26 November 2024More LessReinforcement learning (RL), particularly its combination with deep neural networks, referred to as deep RL (DRL), has shown tremendous promise across a wide range of applications, suggesting its potential for enabling the development of sophisticated robotic behaviors. Robotics problems, however, pose fundamental difficulties for the application of RL, stemming from the complexity and cost of interacting with the physical world. This article provides a modern survey of DRL for robotics, with a particular focus on evaluating the real-world successes achieved with DRL in realizing several key robotic competencies. Our analysis aims to identify the key factors underlying those exciting successes, reveal underexplored areas, and provide an overall characterization of the status of DRL in robotics. We highlight several important avenues for future work, emphasizing the need for stable and sample-efficient real-world RL paradigms; holistic approaches for discovering and integrating various competencies to tackle complex long-horizon, open-world tasks; and principled development and evaluation procedures. This survey is designed to offer insights for both RL practitioners and roboticists toward harnessing RL's power to create generally capable real-world robotic systems.
-
-
-
Stage Motion Control: Nonlinear Integrators Revisited
First published online: 26 November 2024More LessAbstractLinear integrators are well known for their ability to counter static forces and improve low-frequency disturbance rejection properties in control systems. However, linear integrators introduce phase lag, which is a frequency-dependent time shift or delay. Since the early introduction of the Clegg integrator, nonlinear integrators have held the promise of providing phase advantages over linear integrators when evaluated from the perspective of a describing function. This could potentially reduce delay and therefore provide the means to surpass linear design limitations; for example, overshoot and settling times can be reduced or even avoided. In addition, loop gains can be increased, which improves the low-frequency disturbance rejection properties. For five nonlinear integrators—the Clegg integrator, a generalized first-order reset integrator called the constant-in-gain–lead-in-phase (CgLp) element, a hybrid integrator–gain system, a variable gain integrator, and a split-path integrator—this article provides a comparison and overview of recent developments in stage motion control. Benchmark examples are taken from the industrial practice of wafer scanners, which form the pivotal machines used in the manufacturing of computer chips.
-
-
-
Robots and Dance: A Promising Young Alchemy
First published online: 26 November 2024More LessResearch at the intersection of robots and dance promises to create vehicles for expression that enable new creative pursuits and allow robots to function better, especially in human-facing scenarios. Moving this research beyond fringe spectacle and establishing it as a serious, systematic field—a proper subdiscipline of both robotics and dance—will require answering a key question: How does dance advance the fundamentals of robotics, and vice versa? Focusing on the former, this article offers glimpses of this new field with examples of meaningful contributions to control, robotics, and autonomous systems, such as novel actuator designs, improved sensing systems, salient motion profiles for robots, reproducible experiment designs, and new theories of motion derived from the study of dance. It also poses two grand challenges for the emerging field of choreobotics: developing a robust symbolic system for representing bodily action and establishing rich, repeatable testing environments for human–robot interaction.
-
-
-
Using Delay for Control
First published online: 12 November 2024More LessThis article reviews two techniques that use delay for control: time-delay approaches to control problems (which initially may be free of delays) and the intentional insertion of delays into the feedback. We begin with a now widely used time-delay approach to sampled-data control. In networked control systems with communication constraints, this is the only method that accommodates transmission delays larger than the sampling intervals. We present a predictor-based design that enlarges the maximum allowable delay, which is important for practical implementations. We then discuss methods that use artificial delays via simple Lyapunov functionals that lead to feasible linear matrix inequalities for small delays and simple sampled-data implementations. Finally, we briefly present a new time-delay approach—this time to averaging. Unlike previous results, this approach provides the first quantitative bounds on the small parameter, making averaging-based control (including vibrational and extremum-seeking control) reliable.
-
-
-
Targeted Drug Delivery: From Chemistry to Robotics at Small Scales
First published online: 12 November 2024More LessThe limited bioavailability, susceptibility to degradation, and adverse side effects of novel drugs often hinder their effective administration. Nanoparticles, with customizable properties and small size, have emerged as potential carriers, though their delivery efficiency remains low. With their ability to navigate fluid environments, micro- and nanorobots offer promising solutions to improve the delivery and retention of drugs at targeted tissues. The design and composition of these motile devices, often inspired by natural locomotion mechanisms, are currently being refined for improved biocompatibility, adaptability, and collective task performance. Recent research has focused on loading these devices with therapeutic agents and evaluating their efficacy in living organisms. While chemotherapy has been predominant, micro- and nanorobots also show significant potential for biological and physical therapies, and hybrid methods combining multiple therapies have demonstrated synergistic benefits. This review identifies major challenges, including the need for application-specific solutions, standardized performance evaluation methods, and the integration of engineering with pharmacology.
-
-
-
Scene Representations for Robotic Spatial Perception
First published online: 11 November 2024More LessThe ability of a robot to build a persistent, accurate, and actionable model of its surroundings through sensor data in a timely manner is crucial for autonomous operation. While representing the world as a point cloud might be sufficient for localization, denser scene representations are required for obstacle avoidance. On the other hand, higher-level semantic information is often crucial for breaking down the necessary steps to autonomously complete a complex task, such as cooking. So the looming question is, What is a suitable scene representation for the robotic task at hand? This survey provides a comprehensive review of key approaches and frameworks driving progress in the field of robotic spatial perception, with a particular focus on the historical evolution and current trends in representation. By categorizing scene modeling techniques into three main types—metric, metric–semantic, and metric–semantic–topological—we discuss how spatial perception frameworks are transitioning from building purely geometric models of the world to more advanced data structures incorporating higher-level concepts, such as the notion of object instances and places. Special emphasis is placed on approaches for real-time simultaneous localization and mapping, their integration with deep learning for enhanced robustness and scene understanding, and their ability to handle scene dynamicity as some of the hottest topics of interest driving robotics research today. We conclude with a discussion of ongoing challenges and future research directions in the quest to develop robust and scalable spatial perception systems suitable for long-term autonomy.
-
-
-
Stretchable Shape Sensing and Computation for General Shape-Changing Robots
First published online: 30 October 2024More LessAn ideal robot could autonomously complete diverse tasks such as ocean surveying, kitchen cleaning, and aerial environmental monitoring. However, robots optimized for each task typically have different shapes, posing a challenge in reconciling form and function. This challenge inspires the pursuit of general shape-changing robots (GSCRs). While soft materials and actuators are promising for GSCRs due to their ability to accommodate extreme deformations, there is a gap between the vision of GSCRs and the simple examples we see today. Two critical components are needed: robot-agnostic stretchable shape sensing and stretchable computing. Together, these components would enable closed-loop shape control and the first instantiations of GSCRs. This review aims to consolidate the literature on these components, encouraging researchers to bridge the gap between today's shape-changing robots and the envisioned GSCRs, ultimately advancing the field toward more versatile and adaptive robots.
-
-
-
An Overview of Systems-Theoretic Guarantees in Data-Driven Model Predictive Control
First published online: 16 October 2024More LessThe development of control methods based on data has seen a surge of interest in recent years. When applying data-driven controllers in real-world applications, providing theoretical guarantees for the closed-loop system is of crucial importance to ensure reliable operation. In this review, we provide an overview of data-driven model predictive control (MPC) methods for controlling unknown systems with guarantees on systems-theoretic properties such as stability, robustness, and constraint satisfaction. The considered approaches rely on the fundamental lemma from behavioral theory in order to predict input–output trajectories directly from data. We cover various setups, ranging from linear systems and noise-free data to more realistic formulations with noise and nonlinearities, and we provide an overview of different techniques to ensure guarantees for the closed-loop system. Moreover, we discuss avenues for future research that may further improve the theoretical understanding and practical applicability of data-driven MPC.
-