Robustness of Robotic Manipulation:
Foundations and Frontiers
June 30, 2026
Humans and animals exhibit remarkable robustness in physical manipulation, yet robots remain far behind. Progress toward human-level manipulation robustness is hindered by the absence of a unified and systematic understanding: different subfields frame robustness in distinct ways, often leaving the concept ambiguous and limiting deeper analysis as well as communication across research areas. This paper presents a systematic study of manipulation robustness. We begin with a formal definition, characterizing robustness as the degree to which a manipulation system can achieve its goal in the presence of uncertainty and variation. Building on this definition, we introduce general formulations of manipulation robustness from probabilistic and control-theoretic perspectives. We then synthesize the guiding principles and concrete mechanisms of manipulation robustness across perception, planning, control, policy learning, and hardware, illustrating each mechanism through representative works, including foundational and recent studies. In addition, we revisit existing metrics and evaluation methods for quantifying manipulation robustness. Finally, we distill broader lessons for designing robust manipulation systems and discuss open problems and future directions toward achieving human-level robustness in robotic manipulation.
Manipulation in the real world is inherently uncertain [1]. Object pose may be partially observed, friction and compliance may be poorly modeled, contact events are discontinuous and difficult to predict, and task instances may vary substantially across episodes. Robust manipulation is therefore not simply a matter of executing a nominal plan accurately in an idealized environment. Instead, it is the ability to achieve task goals despite such uncertainty and variation.
Biological systems provide compelling evidence that robust manipulation is possible. Humans often handle these uncertainties and variations without explicit deliberation, relying instead on sensorimotor control strategies that combine prediction with rapid feedback correction [2]. For instance, humans regulate grip forces to prevent objects from slipping in the hand. When grasping objects such as fruits (Fig. 1), humans apply grip forces with a safety margin above the expected slip threshold. Under varying or dynamic conditions, this margin is adjusted accordingly [3], preventing grasp failure even in uncertain environments.
Robust behaviors are also generally observed in animals. Sea otters, for example, juggle pebbles on their bellies [4]. They maintain this behavior despite turbulent disturbances and across wide variations in object shape, mass, and body posture. Even far less complex organisms exhibit robust interaction with their environment. For example, coordinated ciliary motion in paramecium generates fluid flows that draw and capture food particles [5]. Without complex visual perception, the organism can handle uncertainty in particle location using only mechanosensory cilia in highly dynamic fluid environments. These examples suggest that robustness in physical interaction is a fundamental property of biological systems [6].
In contrast, today’s robotic systems manipulate objects with a level of robustness still below that of humans and many animals [1], [13]. Even routine behaviors such as pick-and-place, which humans perform effortlessly, remain challenging for robots to execute reliably in the presence of contact uncertainty [14]. Although impressive demonstrations from academia and industry have shown remarkable capabilities under controlled conditions, many of these systems degrade significantly when deployed outside carefully engineered environments. Ultimately, robotic manipulation must operate in open, time-varying environments characterized by significant uncertainty.
This evident gap between the robustness of robotic and human manipulation motivates this paper. A major obstacle to progress is the absence of a deep understanding and overarching framework for manipulation robustness. Each subfield of robotics discusses robustness in its own terms, often restricted to a narrow domain and leaving the concept implicit or underspecified [15]–[17]. To address this issue, we propose a shared conceptual language and a taxonomy to connect existing research threads and enable the accumulation and accessibility of insights across subfields. We also identify several foundational but unanswered questions: What explains the extraordinary robustness observed in human and animal manipulation? What mechanisms and principles enable robust manipulation? How should robustness be quantified and measured? This paper calls attention to these questions and encourages the field to pursue a deeper and more systematic understanding of robust manipulation skills.
Robust manipulation skills appear not to arise from a single mechanism, but rather from the coordination of mechanisms across perception, planning, control, policy learning, and hardware, calling for joint research across subfields [13]. This perspective distinguishes the present paper from prior reviews on robotic manipulation, such as data-driven grasp synthesis [18], robot learning for manipulation [19], foundation models for robotics [20], etc. While these works have made significant contributions to broad areas of manipulation, robustness is typically treated only incidentally rather than as the central object of study. To our knowledge, there has not yet been a comprehensive review that systematically examines the principles, mechanisms, and evaluation methods underlying robust manipulation under real-world uncertainty and variation.
This paper makes the following contributions: (i) it proposes a task-centered definition of manipulation robustness; (ii) it formulates manipulation robustness from both probabilistic and control-theoretic perspectives; (iii) it organizes robustness mechanisms across perception, planning, control, policy learning, and hardware under a set of guiding principles; and (iv) it synthesizes evaluation protocols and open challenges for future research.
In the following, we begin by introducing a definition (Section 2) and a mathematical formulation (Section 3) of manipulation robustness. We then present robustness principles (Section 4), followed by a systematic summary of existing robustness mechanisms (Section 5). Next, we analyze current metrics and evaluation protocols (Section 6). We then synthesize key insights and observations (Section 7). Finally, we highlight open challenges and suggest future directions toward achieving human-level manipulation robustness (Section 8).
This section introduces the concept of robustness progressively. We begin with general definitions of robustness across disciplines, narrow the scope to robotics, and finally formalize the notion of manipulation robustness.
Despite its frequent use, the notion of robustness is often interpreted differently across contexts and disciplines. Several domain-specific efforts have attempted to formalize robustness in biology [6], machine learning [21], and robotics [22]. We provide representative definitions below for illustration.
Definition 1 (Biological robustness). Robustness is a property that allows a system to maintain its functions despite external and internal perturbations [6].
Definition 2 (Machine learning robustness). The robustness of machine learning models denotes the capacity of a model to sustain stable predictive performance in the face of variations and changes in the input data [21].
Definition 3 (Robotic robustness). Robustness specifies the degree to which a behavior can fulfill its task despite being challenged by an adversity [22].
Synthesizing these perspectives reveals a common theme: robustness is inherently context-dependent. It is not an absolute property of a system, but a relational one. It is defined only with respect to what the system is intended to achieve and the conditions under which it operates. Without context, claims of robustness become ill-posed and difficult to compare across domains or methods.
To make this dependence explicit, we identify four foundational dimensions that together define the context of robustness: goal, challenge, mechanism, and evaluation. With these dimensions, we define robustness as follows:
Definition 4 (Robustness). Robustness refers to a system’s ability to achieve a given goal under specified challenges, enabled by particular mechanisms, and assessed through quantitative evaluation.
This structure applies broadly across disciplines. For example, in machine learning, robustness typically refers to maintaining predictive performance (goal) [21] under distribution shifts or adversarial perturbations (challenge) [23], achieved through techniques such as adversarial training (mechanism), and evaluated using quantitative metrics such as worst-case accuracy, or performance degradation under controlled perturbations (evaluation) [24].
What distinguishes robotics is the embodied physical interactions and tight integration of subsystems. Goals: Because robotic systems integrate sensing, mechanics, planning, control, actuation, and learning, robustness must often be addressed both within and across the components. Thus, goals may be defined at different levels of abstraction, ranging from high-level task completion (e.g., object transport or assembly) to component-level objectives such as state estimation accuracy, collision avoidance, or trajectory tracking performance. Challenges: Direct interaction with the physical world exposes robots to uncertainty in perception and contact dynamics, sensing noise and external disturbances, as well as variations in system parameters and environmental conditions. Mechanisms: Robustness is realized through complementary passive and active strategies spanning hardware and algorithms. Passive strategies, such as compliant hardware and soft materials, physically tolerate disturbances. Active strategies, such as motion planning, feedback control, and learning methods, proactively mitigate model mismatch or compensate for noise or disturbances. Evaluation: Robustness in robotics is commonly evaluated on task execution success rates, complemented by more fine-grained metrics such as stability measure, control convergence, or theoretical guarantees, defined at the level of individual tasks or system components.
Manipulation is characterized as “an agent’s control of its environment through selective contact” [1], which makes manipulation robustness a distinct subclass of robotic robustness, with unique challenges arising from contact interactions among the robot, manipulated objects, and the environment.
Manipulation is dominated by multi-body contact interactions, which induce dynamics that are high-dimensional, hybrid, discontinuous, constrained, and therefore difficult to model accurately. These interaction dynamics constitute a major challenge, as small variations in geometry, contact conditions, or material properties can lead to qualitatively different outcomes. Perception introduces additional challenges in manipulation because effective contact interaction depends on estimating interaction-relevant states that are largely external to the robot, such as object pose, insertion depth, local contact geometry, material properties, and deformation. Many of these quantities are only partially observable, visually ambiguous, or occluded during contact. Therefore, it has substantially higher demands on perception than tasks such as locomotion, where the robot primarily regulates its own state. Together, these factors complicate the design of robust mechanisms in manipulation planning, control, and learning.
Moreover, real-world manipulation encompasses a broad spectrum of task specifications, in which robots must achieve diverse objectives across domestic, industrial, and open-world environments. Unlike locomotion, manipulation relies on multi-body contact interactions among the robot, manipulated objects, and the environment that actively change the state of the world, leading to a combinatorial diversity of manipulation goals. Finally, the discontinuous and task-dependent nature of contact interactions makes the definition of general evaluation criteria and the establishment of formal robustness guarantees particularly difficult.
We refine Definition 4 for manipulation by specifying the four foundational dimensions as follows:
Goals: Robotic manipulation robustness is defined relative to manipulation goals, which involve achieving desired object states through contact interactions, potentially within task-specific tolerance levels.
Challenges: Challenges arise from uncertainty and variation, which we categorize into epistemic uncertainty, aleatoric uncertainty, and episodic variation.
Mechanisms: Robustness mechanisms improve task goal achievement by tolerating or mitigating uncertainty and variation in contact interactions, preventing failures, or enabling recovery when failures occur.
Evaluation: Evaluation methods define quantitative criteria for measuring manipulation performance and robustness, enabling principled comparison across approaches.
Among these dimensions, challenges play a central role. The importance of uncertainty has been recognized since the earliest days of robotics in the 1950s [25], which remains a central theme in robotics research [26]. Specifically, epistemic uncertainty stems from incomplete or inaccurate knowledge of system properties and can, in principle, be reduced through additional data or modeling. Aleatoric uncertainty reflects irreducible randomness, such as observation noise or stochastic transition disturbances. Episodic variation refers to systematic differences in the physical world that remain fixed within a single task execution but change across task episodes, such as variations in object identity, environment configuration, or robot embodiment [27]. An intuitive analogy is that of a robot searching for a light switch in a dark room. Episodic variation: across different rooms, the position or shape of the switch may vary. Epistemic uncertainty: within a given room, the initial belief about the switch location is uncertain but can be refined through interaction, such as touching the wall. Aleatoric uncertainty: even with perfect knowledge, however, randomness such as sensor noise, slips of the hand, or minor actuation errors may still occur.
Given the definition in Section 2, we formulate the general problem of manipulation robustness using a unified partially observable stochastic control model. We then instantiate this model through probabilistic and control-theoretic perspectives, respectively. The unified model serves as an analytical framework to structure the discussion in the remainder of the paper. It is intended as a conceptual tool for analysis rather than a prescriptive model; it does not imply that a robot must explicitly represent these processes to achieve robust manipulation.
We formalize a manipulation episode as a discrete-time control process over a finite horizon \(T\), denoted by the sequence \(\{(x_t, u_t, y_t)\}_{t=0}^T\). Here, \(x_t \in \mathcal{X}\) is the system state (encompassing both robot and object generalized coordinates), \(u_t \in \mathcal{U}\) is the control input, and \(y_t \in \mathcal{Y}\) is the partial observation. Note that we present here a time-discretized model, though in principle a continuous-time formulation can also be adopted.
The evolution of this system is driven by underlying deterministic functions subjected to noise: \[\begin{align} \label{eq:unified95dynamics} x_{t+1} &= f(x_t, u_t, w_t ; \theta), \\ y_t &= g(x_t, v_t ; \theta). \end{align}\tag{1}\] In this framework, manipulation robustness is defined by how well a system achieves a target goal \(\mathcal{G}\) despite three fundamental challenges:
The variables \(w_t \in \mathcal{W}\) and \({v_t \in \mathcal{V}}\) represent exogenous process and measurement noise. This captures inherent, irreducible stochasticity in the physical world, such as thermal sensor noise, unmodeled micro-impacts, or random slip during contact.
The parameter \(\theta \in \Theta\) dictates the true physical and perceptual properties of the task, such as object mass, surface friction, and camera calibration. However, the robot rarely has perfect knowledge of \(\theta\) or the true state \(x_t\). It operates using internal estimates \(\hat{\theta}\) and \(\hat{x}_t\). The discrepancy between reality (\(\theta, x_t\)) and the robot’s belief (\(\hat{\theta}, \hat{x}_t\)) constitutes epistemic uncertainty. Unlike aleatoric noise, this uncertainty can theoretically be reduced through exploration or learning.
While epistemic uncertainty concerns what the robot does not know, episodic variation describes the objective physical differences between separate executions of a task. We define an episodic variation \(\nu\) as a specific draw of the environment parameters, initial state, and goal region: \[\nu = (\theta, x_0, \mathcal{G}) \in \mathcal{N}, \label{eq:variation-def}\tag{2}\] where \(\mathcal{N}\) denotes the space of all possible task episodes. Note that the goal \(\mathcal{G} \subset \mathcal{X}\) represents a desired set of states, especially the desired state of the manipulated object. This compact notation covers many terminal manipulation objectives, but it does not by itself encode temporal ordering among subgoals. Ordered long-horizon tasks, such as opening a door, entering a room, and then closing the door, would require a richer formulation, e.g., a sequence of goal sets \((\mathcal{G}_1,\ldots,\mathcal{G}_K)\) or a temporal task specification.
| Submodule | Mechanism | Principle | Section |
|---|---|---|---|
| Perception | Active and Interactive Perception | Uncertainty Reduction | [sec:sec:perception:interactive] |
| Invariance in Perceptual Representations | Uncertainty & Variation Toleration | [sec:sec:perception:invariance] | |
| Multimodality | Local Failure Toleration | [sec:sec:perception:multimodality] | |
| Planning | Reasoning over Uncertainties | Uncertainty Reduction | [sec:subsec:planning-uncertainty] |
| Motion Strategy and Funneling | Uncertainty Reduction | [sec:subsec:planning-funnel] | |
| Robustness Margin | Uncertainty & Variation Toleration | [sec:subsec:planning-manifold] | |
| Closure | Uncertainty & Variation Toleration | [sec:subsec:planning-closure] | |
| Control | Predictivity | Failure Prevention | [sec:control:predictivity] |
| Active Compliance | Uncertainty & Variation Toleration | [sec:control:compliance] | |
| Control Invariance | Uncertainty & Variation Toleration | [sec:control:invariance] | |
| Hardware | Passive Compliance | Uncertainty & Variation Toleration | [sec:mechanical:passive-compliance] |
| Adhesion | Uncertainty & Variation Toleration | [sec:mechanical:adhesion] | |
| Morphology Adaptation | Temporary Failure Recovery | [sec:mechanical:morphology-adaptation] |
Learning-based and probabilistic planning methods treat the noise variables (\(w_t, v_t\)) and episodic variations (\(\nu\)) as probability distributions. Consequently, the dynamics and observation models are viewed as stochastic transitions, \[\begin{align} x_{t+1} \sim \mathcal{T}(\cdot \mid x_t, u_t; \theta), \;y_t \sim \mathcal{O}(\cdot \mid x_t; \theta). \end{align}\] Robustness in this paradigm is typically formulated as a Partially Observable Markov Decision Process (POMDP) and evaluated as the expected performance of a policy \(\pi\) across a distribution of episodes \(\rho_\mathcal{N}\): \[\Gamma(\pi) = \mathbb{E}_{\nu \sim \rho_\mathcal{N}} \bigl[ J_{\nu}(\pi) \bigr],\] where \(J_\nu(\pi)\) is the expected return of the trajectory under the true parameters \(\theta\), despite the policy acting on its imperfect belief \(\hat{\theta}\). A policy is defined as a mapping \(\pi : \mathcal{B} \to \mathcal{U}\) from beliefs to actions, where a belief \(b_t \in \mathcal{B}(\mathcal{X})\) is a probability distribution over the state space \(\mathcal{X}\) conditioned on the history of observations and actions.
In contrast, we follow robust control frameworks (e.g., \(H_\infty\) or Robust MPC) and model aleatoric noise \(w_t, v_t\) and episodic variations \(\nu\) as unknown, deterministic variables confined within bounded sets \(\mathcal{W}, \mathcal{V}\), and \(\mathcal{N}\). Robustness here is framed as a min-max optimization problem. The goal is to synthesize a policy that guarantees constraint satisfaction and minimizes a cost function \(c(x_t, u_t)\) against the worst-case possible realizations of the uncertainties: \[\min_{\pi} \max_{\nu \in \mathcal{N}, w_t \in \mathcal{W}, v_t \in \mathcal{V}} \sum_{t=0}^{T} c(x_t, u_t). \label{eq:robust-policy-maxmin}\tag{3}\] While the probabilistic view maximizes average reliability across a distribution of environments, the control-theoretic view provides strict performance and safety guarantees in a worst-case robustness sense.
There are diverse mechanisms for achieving robustness in robotic manipulation, spanning perception, planning, control, learning, and hardware. While these mechanisms are often studied separately, many can be understood through several recurring principles. At a high level, robustness mechanisms can be organized along two axes. The first concerns how systems cope with uncertainty and variation: either by reducing epistemic uncertainty or by tolerating uncertainty and variation. The second concerns failure management: whether robustness is achieved primarily through preventing failures from occurring, recovering from temporary failures or tolerating local failures.
One route to robustness is to reduce epistemic uncertainty by improving the robot’s knowledge of the environment, task, or system state. This principle underlies active and interactive perception (Section 5.1.1), belief-space planning methods that explicitly reason over uncertainty (5.2.1), and world-model-based learning approaches that learn predictive representations of environment dynamics (5.4.2).
In contrast, a second route is based on tolerating the challenges: it accepts that aleatoric uncertainty and episodic variation cannot be eliminated, and instead seeks to make task execution insensitive to them. This principle is perhaps more ubiquitously employed in robotic manipulation. One common strategy is compliance, realized both actively through control (Section 5.3.1) and passively through hardware and materials (5.5.1), which reduces sensitivity to contact uncertainty and modeling errors. Another is invariance, where behaviors or representations are designed to remain unaffected by uncertainty or variation, as exemplified by closure-based grasping (5.2.4), invariant perceptual representations (5.1.2), and control invariance (5.3.2). Robustness can also arise from mechanics-driven strategies that exploit task and environmental structure, such as motion strategies and funnels (5.2.2). Toleration also appears in learning-based methods that generalize across scenes, tasks, and environments through data diversity or policy design (5.4.1, 5.4.2), as well as in hardware mechanisms such as adhesion (5.5.2), which leverage favorable contact physics to tolerate uncertainty and variation.
These two strategies are not mutually exclusive. Robust manipulation systems typically combine them, reducing uncertainty where possible while remaining effective in the presence of irreducible uncertainty.
Along the second axis, robustness can be understood through failure management. Here, two complementary strategies emerge: failure prevention, which seeks to avoid failure a priori, and failure recovery or tolerance, which assumes that failures may occur and emphasizes recovery from them or tolerance of local failure. Tasks involving safety-critical operations or irreversible consequences (e.g., an object’s fragility) often demand preventative mechanisms, as failures are unacceptable. In contrast, for tasks where temporary failures can be tolerated, such as regrasping a rigid object after a drop, recovery mechanisms may be sufficient. Local failure tolerance further complements these strategies by allowing failures confined to specific components, sensing modalities, or subtasks to be absorbed without causing overall task failure.
Failure prevention aims to avoid entering failure-prone states altogether. This principle appears in a variety of robustness mechanisms. Examples include predictive control methods that down-weight risky rollouts in receding-horizon optimization (Section 5.3.3), closure-based grasp synthesis that remains stable under disturbance wrenches (5.2.4), and compliance-based control and hardware design (5.3.1, 5.5.1), which reduce the likelihood of failure arising from contact modeling errors. Many learning-based manipulation policies similarly emphasize failure avoidance, either by training predominantly on successful demonstrations or by incorporating conservative and safety-aware objectives that discourage risky behaviors and constraint violations (5.4.3).
By contrast, a complementary strategy focuses on restoring task execution once failure has occurred. From this perspective, failures need not be catastrophic; they may be temporary and recoverable, or local and confined to particular components. Recent learning-based systems have demonstrated the ability to acquire recovery behaviors from imperfect or failed demonstrations (Section 5.4.1), or to explicitly learn recovery policies that resume task execution following failure. Temporary failures may also arise from distribution shifts or changing task conditions, motivating adaptation mechanisms, either through morphological adaptation (5.5.3) or learning-based adaptation (5.4.4).
Local system failures, on the other hand, refer to failures confined to a particular component, sensing modality, actuator, module, or subtask, without immediately implying failure of the overall manipulation task. Such failures can be mitigated through modularity and redundancy. Modular robotic systems [28], [29] can localize failure and prevent its propagation to the rest of the system. Redundancy provides multiple pathways to task success and allows degradation in one component to be compensated for by others. Examples include multi-sensor fusion (Section 5.1.3), dual end-effectors [30], and alternative task-level plans [31]. Both modularity and redundancy are also common principles in biological systems; for example, ants dynamically reassign roles during cooperative transport, using redundant individuals to maintain collective performance despite local failures [32].
Guided by these two axes of robustness principles—uncertainty and variation regulation, and failure management—we next revisit the mechanisms that enable robust manipulation.
In this section, we revisit existing approaches to robustness in robotic manipulation. We organize the literature into five submodules of a robotic system—perception, planning, control, learning, and hardware (Fig. 1)—and summarize the mechanisms in Table 1 and Table 2. Within each submodule, we discuss the mechanisms through the lens of the robustness principles introduced in Section 4, while noting that each mechanism is listed under its dominant principle even though it may reflect multiple principles in practice. We also highlight the challenges they address, representative works, and illustrative manipulation tasks. Owing to the rapid recent progress and growing attention to robot learning, the policy learning section (5.4) covers a comparatively larger body of recent work. At the same time, we emphasize foundational contributions, particularly in planning and control, to modern robotic manipulation.
In the context of manipulation, the goal of perception is to acquire sufficient information for a robot to interact effectively with objects in its environment. Perception is particularly challenged by epistemic uncertainty, since task-relevant properties and system dynamics are often initially unknown. Important information, such as the number of objects in a scene, their motion constraints, or friction properties, may only become available through interaction with the environment. Consequently, active and interactive perception (Section 5.1.1) constitute important mechanisms for reducing uncertainty. At the same time, perception should maintain beliefs only over variables that are relevant to the task while remaining invariant to irrelevant features (5.1.2); such invariance is an effective mechanism for tolerating episodic variation across scenes. From a failure-management perspective, multimodal perception provides redundancy across sensing modalities and can mitigate local failures within the perception system (5.1.3).
Epistemic uncertainty in robot perception can be reduced by exploiting a robot’s ability to act in and interact with its environment [36]. A major challenge is occlusion, which can often be addressed simply by moving a camera to acquire a different viewpoint [37], for example, to support grasp execution [38] (Fig. 2-a). By actively selecting viewpoints that reveal previously hidden information, perceptual uncertainty about the environment is reduced, facilitating subsequent manipulation. Beyond contact-free viewpoint selection, robots can also physically interact with their environment to acquire information. This paradigm, known as interactive perception [39], [40], is likewise observed in animals that employ exploratory behaviors to gather information about their surroundings [41]. Many task-relevant object properties are difficult or impossible to infer from passive observation alone. For example, lifting a milk carton reveals its mass distribution, while removing the lid of a box may reveal its contents. In cluttered environments, robots may need to manipulate obstructing objects to expose a target object [42]. Interactive perception can also reveal motion constraints and kinematic structures of articulated objects [43]. Across these examples, the common principle is the active reduction of epistemic uncertainty through action and interaction.
Perception for manipulation is challenging because objects need to be reliably detected from different viewing angles and lighting conditions (Fig. 2-b). In this sense, invariant perceptual representations help tolerate episodic variations in viewpoint, appearance, and environmental conditions. Before deep learning approaches started to dominate computer vision [44], computer vision pipelines were often based on features such as SIFT [45], SURF [46], or ORB [47], which were designed to be invariant to rotation, scale, and possibly other transforms. In deep learning based approaches, such invariance is often achieved using data-augmentation [44] and pooling mechanisms [48]. More recently, foundation models such as DINO [49] have demonstrated the ability to learn task-agnostic visual representations that are robust to clutter, occlusion, and illumination changes. At an even higher level of abstraction, language-based scene representations exhibit strong invariance to visual variations, contributing to the robustness and generalization capabilities observed in vision-language-action models [50].
Robotic manipulation can leverage multiple sensing modalities, including visual, tactile, auditory, and proprioceptive information, to perceive and model the environment, thereby enabling more effective interaction with it (Fig. 2-c). These modalities are both complementary and partially redundant in their functions. As a result, failure in one modality need not lead to failure of the overall perception system; other modalities can still provide sufficient information to support task execution. Humans, for example, often rely on touch when vision is unavailable. In robotics, vision provides rich global scene awareness but is susceptible to occlusion, whereas tactile sensing offers detailed local information about properties such as stiffness, texture, friction, and contact geometry. Audition can capture transient interaction events, such as the sound of a snap-fit assembly [35]. These modalities have been successfully combined in prior work to improve perception robustness [51], [52]. Beyond multimodal sensing, redundancy can also arise within a single sensing modality, as exemplified by the large number of whiskers in rodents or the compound eyes of insects. From a failure-management perspective, such redundancy helps mitigate local failures and prevents them from compromising overall perceptual functionality.
Manipulation planning operates on information provided by perception and is therefore inevitably affected by perceptual imperfections. In particular, imperfect perception and state estimation introduce epistemic uncertainty: a mismatch between the true robot–environment parameters \(\theta\) and the internal model \(\hat{\theta}\) (dynamics uncertainty), and consequently between the true state \(x_t\) and its estimate \(\hat{x}_t\) (state uncertainty). Under such mismatches, trajectories computed by the planner may fail to achieve the desired goal \(\mathcal{G}\). Manipulation planning must also contend with aleatoric uncertainty in the dynamics and observation models, as well as episodic variation across task instances.
Existing robust planning mechanisms improve manipulation performance through two complementary strategies. On the one hand, epistemic uncertainty can be reduced by explicitly reasoning about it (Section 5.2.1) or by exploiting task mechanics through motion strategies and funnels (5.2.2). On the other hand, planning can tolerate uncertainty and disturbances by incorporating robustness margins (5.2.3) or by establishing forms of closure around target objects (5.2.4).
Even high-quality sensors and advanced perception algorithms cannot fully eliminate epistemic uncertainty. A direct way to mitigate its effect is to represent uncertainty explicitly as a probability distribution over possible states—commonly referred to as a belief—and to update this belief online using new observations (Fig. 3-a). Formally, the agent maintains a belief \(b_t \in \mathcal{B}(\mathcal{X})\) over the state \(x_t\), conditioned on the history \(h_t = (y_{0:t}, u_{0:t-1})\) under the internal model \(\hat{\theta}\), i.e., \(b_t(x) = \mathbb{P}(x_t = x \mid h_t, \hat{\theta})\). Planning then operates in belief space through a policy \(u_t = \pi(b_t)\), aiming to improve expected task performance \(\Gamma(\pi)\) across episodic variations \(\nu\).
Belief representations enable exploration that actively reduces uncertainty by trading off immediate task performance against information gathering. They also support cautious control, allowing robot policies to account for the reliability of available information. For instance, [53] applied belief dynamics to grasping, synthesizing locally optimal feedback policies in belief space with replanning. Similarly, [54] incorporated pose and contact-dynamics uncertainty into a belief-space formulation and validated it on planar pushing without sensory feedback. At longer horizons, belief reasoning extends to uncertainty-aware task and motion planning; [55] integrated belief propagation with symbolic decision making to address incomplete knowledge of object properties and locations in mobile manipulation.
Besides reasoning over uncertainties in belief space, another way to reduce uncertainty is to exploit task mechanics. In motion strategies, also termed sensorless manipulation by [56], contact dynamics and gravity provide passive negative feedback that drives objects toward desired configurations, often without exteroceptive sensing. This contrasts with sensor strategies, which rely on rich observations but are susceptible to perceptual errors. Motion strategies are effective in diverse settings, including tray-tilting to orient objects of unknown pose using only gravity and contact [56], push–grasp behaviors in clutter that funnel the target into the gripper while displacing distractors [57], and industrial part feeders whose fences enforce consistent orientation under pose and contact variability [58]. More generally, environmental contact and gravity as task mechanics can reduce uncertainties, or collapse episodic variations into a predictable, smaller set of outcomes (often termed extrinsic dexterity [59]). For example, pressing a loose pair of chopsticks against a tabletop passively aligns their tips through the collision.
A representative abstraction of motion strategy is funneling [60]. A funnel is a region of attraction \(\mathcal{F}\subset\mathcal{X}\) such that, for \(x_0\in\mathcal{F}\) and bounded disturbances \(w_t \in \mathcal{W}, v_t \in \mathcal{V}\), the resulting execution converges to the goal set \(\mathcal{G}\) (i.e., \(x_T \in \mathcal{G}\)), in other words reducing the pose or geometry uncertainty and model mismatch. Such strategies exploit repeated contacts and environmental constraints to steer outcomes without precise sensing, as in vibrating bowl feeders used for industrial part feeding. The funneling concept traces to pre-image backchaining [61], which recursively constructs sets of states from which motions succeed under bounded execution errors. It was later extended by LQR-Tree methods [62], where verified funnels cover the reachable state space to enable robust trajectory planning under model uncertainty. More recently, composing simple in-hand manipulation funnels has shown surprising robustness to variations in object mass and pose [63] (Fig. 3-b).
Beyond explicitly estimating or compensating for uncertainty, an alternative strategy is to tolerate uncertainty by planning with a robustness margin. The central idea is to generate motions that remain sufficiently far from constraint boundaries, so that moderate disturbances or model mismatch do not immediately lead to failure. Many manipulation tasks require changing the object’s state through interaction while satisfying state and input constraints, \(x_t\in\mathcal{X}\) and \(u_t\in\mathcal{U}\). These constraints encode collision avoidance, contact consistency, kinematic limits, torque bounds, and related feasibility conditions. Classical methods in this category primarily guarantee feasibility under a nominal model [31], [67], [68].
However, under epistemic mismatch in \(\theta\) and stochastic disturbances, executions may deviate from the nominal constraint manifold and violate constraints. Robust manipulation planning addresses this gap by constructing robustified feasible subsets, thereby maintaining a “margin” from constraint violation to tolerate uncertainty. For example, chance-constrained formulations enforce the probabilistic satisfaction of contact and state constraints under stochastic dynamics [69], [70], while set-based approaches employ tightened constraint sets or disturbance-invariant tubes to guarantee feasibility under bounded uncertainty [71]. These approaches ensure that constraint satisfaction is preserved within a specified disturbance or risk budget, thereby tolerating uncertainty at the planning level. We will discuss several more works along this line in Section 6.2.2 and how they can be used as robustness evaluation protocols. The rich body of work in robust control theory provides a strong foundation for future developments of this mechanism.
In the spirit of uncertainty tolerance, robustness can also be achieved through closure, which imposes geometric or force constraints on object motion and thereby makes the motion resistant to, for example, external disturbances to manipulated objects. In many grasping and fixturing tasks, the goal is to maintain the object within an in-hand stable set. Therefore, closure can be viewed as shaping the robot-object interactions such that the object’s reachable configurations remain within a bounded subset \({\mathcal{G} \subset \mathcal{X}}\) despite bounded disturbances \({w_t\in\mathcal{W}}\) in the dynamics \({x_{t+1}=f(x_t,u_t,w_t ; \theta)}\). Force closure captures equilibrium grasps that can resist arbitrary external wrenches via internal contact forces [72] (Fig. 3-c1). Form closure is a geometric condition in which contact constraints eliminate all object motions even without friction [73] (Fig. 3-c2). Caging (also referred to as “object closure” in some contexts) further relaxes contact requirements by trapping the object within a bounded region of its configuration space without precise force regulation [74] (Fig. 3-c3). Across these closure methods, the shared principle is to restrict the configuration space so that the object cannot move freely or escape, thereby making the manipulation outcome tolerant to perceptual errors, control imprecision, and external disturbances.
Whereas planning operates at a higher level, often through open-loop decision making, control closes the loop in real time by responding to sensory feedback and correcting deviations that no plan can fully anticipate. A large class of robotic control methods addresses motion control in free space, such as trajectory tracking or point-to-point reaching, where the manipulator operates without contact. Manipulation, however, is fundamentally characterized by the making and breaking of unilateral frictional contacts, which introduce discontinuities and uncertainties. As a result, manipulation control must regulate not only motion but also forces and contact events. Controllers in contact-rich settings must therefore contend with external disturbances and actuation errors, as well as epistemic uncertainty arising from imperfect contact models. Poorly designed controllers can amplify these challenges, leading to instability or excessive contact forces, particularly in interactions with rigid environments. From the perspective of robustness, compliance (5.3.1) and invariance (5.3.2) primarily serve to tolerate uncertainty and variation, whereas predictive control (5.3.3) contributes to failure prevention by anticipating future contact events and system evolution.
Compliance balances the control of position and force; higher compliance allows larger position deviations under external forces. It can be realized passively through mechanical design (Section 5.5.1) or actively within the control loop [75]. Active compliance control regulates how a robot responds to external forces during contact, allowing it to comply rather than rigidly enforcing a motion. This property makes compliance a toleration strategy that bridges the gap between the robot’s internal model and the complex, often unpredictable, physics of the real world. Impedance and admittance control represent the two classical approaches. Impedance control enforces compliance from motion to force by commanding motion trajectories that indirectly regulate contact forces [76], \[M_d(\ddot x - \ddot x_d) + D_d (\dot{x} - \dot{x}_d) + K_d (x-x_d) = \tau_{\text{ext}}, \label{eq:impedance}\tag{4}\] where \(x \in \mathbb{R}^m\) denotes the task-space position (or pose) of the end-effector, \(x_d\) is the desired trajectory, and \(\tau_{\text{ext}}\) is the external wrench arising from contact. The matrices \(M_d\), \(D_d\), and \(K_d\) are the desired inertia, damping, and stiffness parameters that define a virtual mass–spring–damper system. This equation specifies the closed-loop interaction dynamics: external forces induce bounded motion deviations governed by \((M_d,D_d,K_d)\). On the other hand, admittance control does so from force to motion by computing the motion response to a commanded force [77].
Classical active compliance methods typically rely on accurate models or restrictive assumptions. More recently, model-free approaches have emerged, learning compliant manipulation behavior from human demonstrations or through reinforcement learning [78]–[80]. For example, an adaptive compliance policy can adjust compliance both spatially and temporally from demonstrations for contact-rich tasks [79]. Future directions may explore combining active compliance with passive mechanical compliance to enhance adaptability under contact uncertainty.
Invariance ensures that a system executes the behavior prescribed by a nominal controller while remaining within a certified safe set, such as bounds on force tracking error [81] or admissible state regions. Like other active compliance control, invariance-based methods do not reduce epistemic uncertainty in states or parameters. Rather, they achieve robustness by constraining system evolution so that bounded disturbances or modeling errors cannot drive the state outside a prescribed safe set; in this way, disturbances are tolerated rather than eliminated. Formally, consider the closed-loop dynamics \(x_{t+1} = f(x_t, u_t, w_t; \theta)\) under an output-feedback policy \(u_t=\pi_t(b_t)\), where \(b_t(x) = \mathbb{P}(x_t = x \mid h_t, \hat{\theta})\). A set \(\mathcal{C}\subset\mathcal{X}\) is robustly forward invariant if \[x_t \in \mathcal{C} \;\Rightarrow\; x_{t+1}\in \mathcal{C}, \quad \forall w_t\in\mathcal{W}.\] Invariance-based control enforces this condition by modifying or projecting control inputs when the boundary of \(\mathcal{C}\) is at risk of being violated, thereby guaranteeing constraint satisfaction despite aleatoric uncertainty and bounded modeling errors.
Practical approaches include reachability analysis, which conservatively overapproximates all possible evolutions to guarantee safety [82], and control barrier functions (CBFs), which enforce invariance through real-time inequality constraints. When combined with control Lyapunov functions, CBF-based methods unify safety and goal achievement in an optimization framework, as demonstrated in tasks such as ball balancing [83].
Neuroscience suggests that human manipulation relies on the integration of long-term prediction with short-horizon reactivity [2]. Reactivity provides rapid sensory feedback, particularly tactile and visual, to detect mismatches between expected and actual outcomes and correct errors. Predictivity, on the other hand, enables the anticipation of collisions or contact events. In this way, predictive control primarily tolerates uncertainty and variation by proactively compensating for their future effects, thereby helping prevent failures before they occur. Purely local reactive control may fail in contact-rich settings, where abrupt changes in dynamics due to contacts can drive the system into unsafe states. To address this, model predictive control (MPC) incorporates a lookahead structure with reactive schemes. It optimizes actions over a finite horizon and executes the first control input. For example, MPC-based hybrid force–motion control is employed to simultaneously regulate end-effector trajectories and contact forces during interaction, explicitly accounting for contact mode transitions within the prediction horizon [84]; a contact-implicit MPC is utilized that predicts motion and contact forces within a trust region, enabling stable local control under unilateral contact and friction constraints [85]; tube-based MPC guarantees that the real trajectory remains within a bounded “tube” around the nominal one, ensuring performance under external disturbances and model mismatch [86].
| Mechanism | Method | Principle | Section |
|---|---|---|---|
| Training Distribution | Domain Randomization | [sec:learning-distribution-centric] | |
| Data Augmentation | Variation Toleration | ||
| Data Scaling and Task Diversity | |||
| Policy Architecture | Perceptual and Structural Inductive Biases | Uncertainty & Variation Toleration | [sec:architecture-distribution-centric] |
| Generative Policy Parameterizations | Uncertainty & Variation Toleration | ||
| Temporal Abstraction and Hierarchy | Failure Prevention | ||
| World-model-based Policies | Uncertainty Reduction | ||
| Learning Objective | Adversarial Training Objectives | Uncertainty & Variation Toleration | [sec:objective-distribution-centric] |
| Safety- and Constraint-based Objectives | Failure Prevention | ||
| Regularized and Conservative Objectives | Failure Prevention | ||
| Policy Adaptation | Interactive Human-in-the-loop Imitation | Temporary Failure Recovery | [sec:adaptation-distribution-centric] |
| Autonomous Continual Improvement |
In parallel with the classical perception–planning–control pipeline, end-to-end policy learning has emerged as an alternative paradigm for manipulation. Learned policies can adapt to unstructured variations in the open world that are difficult to address analytically. In this sense, policy learning mainly improves robustness by tolerating episodic variation and disturbances. Depending on the policy design, it can both prevent failure through robust action selection and recover after temporary task failure.
Within the formalism of Section 3, these methods instantiate a parameterized policy \(\pi_\phi\) and train it from data so that the robust performance functionals \(\Gamma(\pi)\) remain high across an episodic distribution \(\rho_\mathcal{N}(\nu)\). In the rest of this section, we group policy-learning approaches according to four complementary ways (Table 2) in which they achieve robustness: some methods shape the tasks, environments, and perturbations that \(\pi_\phi\) is trained on (5.4.1); some methods design policy classes and architecture whose inductive biases and temporal structure reduce sensitivity to nuisance variation and partial observability (5.4.2); some methods modify the learning objective to better align training with robust performance (5.4.3); and others allow policies to adapt at deployment through residual corrections, online updates, or test-time adaptation (5.4.4).
In the notation of Section 3, robustness is measured by the functional \(\Gamma(\pi)\) evaluated over an episodic distribution \(\rho_\mathcal{N}(\nu)\). A branch of approaches acts directly on this distribution: it shapes how training episodes are generated while keeping the policy class \(\Pi\) and the learning objective fixed. These methods aim to tolerate variations across episodes by broadening the training distribution over dynamics, initial states, environments, and goals.
A first family of methods uses domain randomization, widely used, particularly in reinforcement learning. Instead of a single nominal environment, one defines a family of “worlds” \(\theta\) (and sometimes \(x_0\) and \(\mathcal{G}\)) from a broad distribution. Policies trained under such variation can transfer to real manipulation with minimal tuning, as demonstrated for vision-based grasping appearance [87] and for dexterous in-hand manipulation [88], [89]. By expanding the training distribution \(\rho_\mathcal{N}\) to encompass diverse scenarios, these methods enable the policy to tolerate variations in dynamics and appearance.
A second line achieves robustness via data augmentation on training trajectories. These methods keep the generator of \(\nu\) fixed, but expand the empirical distribution \(\hat{\rho}_\mathcal{N}\) by transforming demonstrations according to task priors: prior work applies SE(2)/SE(3) transformations to scenes and actions to exploit invariance and equivariance [90]–[92], re-renders fixed trajectories from novel viewpoints to vary appearance [93], [94], and retargets demonstrated trajectories to new object and scene configurations [95]–[97]. Beyond such structured priors, a related class injects calibrated noise into states and actions to mitigate covariate shift and compounding error, making the policy more robust [98]–[100].
A third class relies on data scaling and task diversity, as most visibly demonstrated in recent vision–language–action (VLA) models. Rather than explicitly parameterizing randomization or augmentations, these methods assemble very large, heterogeneous datasets of manipulation episodes spanning many robots, scenes, tasks, and language-specified goals, and train a single policy across this mixture [50], [101]–[103]. Robustness here is treated as generalization over a very broad empirical \(\hat{\rho}_\mathcal{N}\) that pools demonstrations and deployments across embodiments, tasks, and environments, with a single \(\pi_\phi\) expected to maintain high \(\Gamma(\pi_\phi)\) throughout this mixture. An important direction in data scaling extends beyond successful task executions to include recovery behaviors following temporary failures, capturing the adaptive strategies required in unstructured environments. Policies trained only on ideal trajectories may overfit to nominal conditions. For example, Large Behavior Models incorporate hybrid sim-to-real datasets containing both successful executions and recovery episodes [104].
A policy is a mapping \(\pi : \mathcal{B} \to \mathcal{U}\) from beliefs to actions. A line of approaches pursues robustness by designing policy architecture and data representation: they constrain how information about observations is encoded and how actions are parameterized, without changing the training distribution \(\rho_\mathcal{N}\) or the learning objective. The goal is to make the mapping \(b_t \mapsto u_t\) inherently tolerant to nuisance variation, partial observability, and long horizons.
First, perceptual and structural inductive biases build a geometric state from raw observations. Keypoint-based representations encode objects and goals as a small set of 2D/3D landmarks and express tasks as geometric relations among these keypoints, so the policy operates in a low-dimensional space aligned with contacts and affordances rather than raw pixels [105]–[107]. SE(3)-equivariant representations constrain internal features (and sometimes actions) to transform consistently under rigid motions of the workspace, so that rotating or translating the scene induces the same transformation in the encoded state and allows one controller to reuse a strategy across pose-shifted instances of a task [108]–[111]. Graph-structured encoders treat objects, robot links, and goals as nodes with edges capturing spatial or relational constraints, and use message passing to learn local interaction rules that generalize to scenes with more objects, new goal configurations, and multi-object rearrangement [112]–[114]. Across these designs, robustness comes from aligning the learned representation with the geometry and relational structure of the task, so that pose- and relation-preserving changes in the scene tend to yield similar decisions, resulting in stable performance under these variations.
Second, generative policy parameterizations implement \(\pi_\phi\) as a conditional generative process over short action sequences, most commonly using diffusion or flow-matching models for manipulation tasks [115], [116]. The policy maps beliefs \(b_t\) to actions by starting from injected noise and iteratively refining a sample via a supervised denoising or flow-integration process. Empirically, this iterative computation with noise injection induces an inductive bias that improves closed-loop robustness to covariate shift [117].
Temporal abstraction and hierarchy represent actions as skills or options that span multiple timesteps. The policy acts in an extended action space of options: a high-level policy selects a skill, and a low-level controller executes it until termination, so the decision-making problem becomes a semi-MDP with a shorter effective horizon [118]. Hierarchical RL methods learn both the skills and the high-level policy, often using subgoal states as the interface between levels and off-policy updates to remain sample efficient in continuous control [119]. In manipulation, skill-based approaches learn and plan with such temporally extended behaviors, such as predicting long-horizon discrete action sequences from a scene image for sequential physical reasoning [120], discovering reusable closed-loop skills from unsegmented demonstrations and training a meta-controller to compose them [121], or chaining separate diffusion models for individual skills to solve unseen long-horizon tasks under constraints [122]. Robustness in this class arises from horizon reduction: the high-level policy makes skill-level decisions per episode, which reduces compounding error, supports reuse of skills across task variations, and thereby helps prevent failures before they occur.
Lastly, world-model-based policies couple the controller with a learned dynamics model in a latent space. They maintain a latent state \(z_t = e(o_{0:t}; \theta)\) together with a predictive model \(\hat{p}_\psi(z_{t+1} \mid z_t, u_t)\), and use short imagined rollouts in this latent space to reason about future states before committing to an action [123]–[126]. World-model-based policies can reduce effective epistemic uncertainty by learning predictive structure over how the environment evolves under the robot’s actions. Rather than eliminating uncertainty, the learned model provides an internal approximation of otherwise unknown or partially observed dynamics that can be queried during decision making. In manipulation, such latent models are used for planning and runtime monitoring to score candidate actions under many predicted futures and reject those that would enter unsafe, constraint-violating, or high-risk regions [127]–[129].
While distribution- and architecture-centric approaches shape what the policy sees and how it represents it, in this part we introduce methods that instead shape what the policy optimizes for, embedding worst-case performance, safety, or conservatism directly into the learning objective.
Adversarial training objectives make robustness explicit by optimizing the min–max criteria of Eq. 3 rather than a nominal expected return. The policy is trained against an adversary that chooses disturbances, environment parameters, or competing behaviors to minimize task performance while the protagonist maximizes it. In practice, the adversary injects destabilizing forces or physical perturbations to grasps and object poses, so policies are trained on deliberate worst cases rather than randomly sampled disturbances [130]–[132]. By repeatedly optimizing against these hard cases, the learned policy becomes less sensitive to uncertainty and variation, thereby improving its ability to tolerate them at deployment.
Safety- and constraint-based objectives restrict which policies are admissible when we evaluate robustness. In the POMDP view of Section 3, one augments the control problem with constraint costs and searches for policies that achieve high task performance \(\Gamma(\pi)\) while keeping these costs below a threshold, as in constrained MDP methods such as Constrained Policy Optimization [133]. Related work uses safety layers or control barrier functions that project or override the learned action when it would violate certified constraints [134], [135], thereby preventing failures by keeping execution within admissible regions.
Regularized and conservative objectives aim to improve robustness to epistemic uncertainty and limited data coverage by constraining how far the learned policy and value function extrapolate beyond the empirical episodic distribution \(\hat{\rho}_\mathcal{N}(\nu)\). Offline RL work frames this as “extrapolation error” and shows that robust performance typically requires (i) behavior regularization, which keeps \(\pi\) close to actions well supported by the data, and (ii) pessimistic value estimates that down-weight out-of-distribution actions [136]–[139]. In real-robot manipulation, these ideas appear in conservative offline RL that improves over imitation on tabletop tasks using logs from safe operation [140], in large-scale deployments that rely on heavily regularized off-policy updates for stable long-term waste-sorting with mobile manipulators [141], and in regularized imitation methods that combine optimal-transport trajectory matching with a pull toward demonstration behavior to achieve few-shot real visual manipulation [142]. Across these examples, robustness comes from biasing learning toward regions of state–action space that are well covered and conservatively valued, thereby reducing out-of-distribution actions and helping prevent failures during execution.
This line of work assumes a base policy \(\pi_{\text{base}}\) has been trained under some episodic distribution \(\rho_\mathcal{N}^{\text{train}}(\nu)\), and focuses on how its behavior is modified using feedback from the deployed environment when the test-time distribution \(\rho^{\text{test}}(\nu)\) differs from \(\rho_\mathcal{N}^{\text{train}}(\nu)\). Unlike distribution-centric approaches, they do not redesign \(\rho_\mathcal{N}\) up front, but instead close the loop between deployment performance and further adaptation.
First, interactive human-in-the-loop imitation refines a pretrained policy at deployment using online expert feedback. Humans can intuitively identify and correct failure-imminent situations or recover from temporary failure, providing targeted supervision where pre-trained policies are weakest [143]. In DAgger-style methods, imitation learning is reduced to online no-regret learning: at each iteration, the current policy is rolled out to generate states, the expert labels those visited states with preferred actions, these pairs are added to an aggregate dataset, and a new policy is trained on the union [144]. This ensures that the learned stationary policy performs well under the state distribution it induces, rather than only on states seen in expert demonstrations, which directly addresses covariate shift in sequential decision making. Subsequent work adapts this idea to human experts in safety-critical or latency-limited settings [145], to remote teleoperation for contact-rich manipulation [146], to “on-the-job” deployment where autonomy and learning run continuously with humans stepping in on hard cases [143], and to kinesthetic delta corrections with force-aware residual policy via compliance [78].
Second, autonomous continual improvement adapts policies during deployment without relying on explicit expert labels. One branch uses online RL on the real robot: a warm-start policy (often from demonstrations or offline data) continues to collect rollouts on the hardware, and policy updates \(\pi_\phi\) under the actual test-time episodic distribution, with mechanisms such as safety constraints, automatic or cheap resets, and simple reward specification to make this practical for contact-rich manipulation [147]–[152]. A second branch uses in-context and prompt-based adaptation: sequence models are trained on multi-task data so that, at test time, a short prompt of teleoperated demonstrations or recent trajectories for the current variation \(\nu\) conditions the model, enabling few-shot adaptation to new objects, layouts, and goals without gradient updates [153]–[155].
Manipulation robustness can also be achieved through the robot’s embodiment, complementing the contributions of perception, planning, control, and learning. This perspective is grounded in the concept of morphological computation, where physical structures perform functions that would otherwise require explicit control [156]. Through the design of materials, geometry, and actuation, the body can shape the system dynamics \(f\) such that a wider range of states \(x_t\) and actions \(u_t\) lead to successful outcomes, while reducing the consequences of errors in perception, modeling, and execution.
A recurring theme of hardware-based robustness is the toleration of object variation and external disturbances through physical design. This can be achieved through passive compliance (Section 5.5.1), which absorbs disturbances and accommodates contact uncertainty, or through adhesive contact mechanisms (5.5.2), which remain effective despite geometric variation and perturbations. In addition, some robotic systems achieve robustness through morphological adaptation (5.5.3), reconfiguring their physical structure in response to changing conditions and thereby restoring performance when an existing morphology becomes ineffective.
Passive compliance enhances manipulation robustness by physically tolerating disturbances and contact uncertainty through compliant, soft surface material, before they propagate through the control loop. It can be viewed as a mechanical counterpart to active compliance (Section 5.3.1) that shapes the interaction dynamics prior to control. By allowing bounded motion in response to external forces, compliant structures reduce the sensitivity of contact interactions to disturbances, geometric variation, and modeling errors. As a result, reliable and adaptive manipulation can often be achieved with reduced reliance on precise sensing, accurate models, and high-bandwidth control.
This principle is widely observed in both biological and robotic systems. Dolphins, for example, use marine sponges as protective tools while foraging on rocky seabeds (Fig. 4-a), thereby tolerating environmental uncertainty and avoiding damaging contacts [157]. In robotic manipulation, passive compliance is commonly used to tolerate misalignment and reduce impact forces in assembly tasks [158]. Similar principles underlie soft grippers based on compliant materials or tendon-driven structures, which passively conform to object geometry under uncertainty [159]. Hybrid designs further combine compliance with controllable stiffening, as exemplified by granular-jamming grippers, enabling compliant exploration followed by adaptive stiffening to securely grasp the object [160], [161].
Adhesive material modifies robot-object contact surfaces to sustain strong tangential (shear) forces with minimal normal force, which is particularly suitable for delicate, thin, or flat objects. By enabling surface-based attachment rather than relying solely on friction-limited point contacts, adhesion alters the contact dynamics and makes manipulation more tolerant to uncertainty in contact location, object pose, and contact modeling. Common adhesion mechanisms include gecko-inspired dry adhesion and vacuum-based suction [160]. Gecko-inspired adhesives exploit van der Waals forces to generate strong shear interactions across a wide range of surface textures without requiring active control (Fig. 4-b). Such systems have been used to grasp bulky objects in microgravity [164], demonstrating robustness to object misalignment and uncertain contact conditions. Vacuum-based suction is another widely adopted adhesion mechanism. Besides adhesion, many suction cups incorporate bellows that provide passive compliance, allowing the system to accommodate pose errors and conform to local surface curvature. Multi-affordance manipulators that combine suction cups with parallel-jaw grippers [30] further exploit mechanical redundancy, improving robustness and extending applicability across a broader range of objects and environments.
The environment and task requirements encountered by a robot are often not fixed. As a result, a morphology that performs well under one set of conditions may become ineffective when the environment, object properties, or task requirements change. Some robotic systems address this challenge by adapting their embodiment, modifying geometry, stiffness distribution, or kinematic structure to suit new conditions. In this way, morphological adaptation can be viewed as a mechanism for recovering from temporary failure caused by changing environments or task requirements [165]. Complementary to passive compliance and adhesion, which shape interactions locally at the contact interface, morphological adaptation reshapes the embodiment at a global level.
In soft robotic hands, for example, the bending location and range can be adjusted by inserting a stiff rod into the center of each finger [166]. Such reconfiguration enables the end-effector to switch between grasping modes and maintain performance across different object types without requiring complex sensing or control. PolyBot [28] further illustrates modular reconfiguration, where detachable modules autonomously rearrange to accommodate new workspace constraints. By adapting their morphology to changing conditions, such systems improve robustness, support fault tolerance, and extend manipulation capabilities in unstructured environments.
Evaluating manipulation robustness requires quantitative criteria that reflect a system’s capability to achieve its task objectives under challenges. In this section, we first present empirical evaluation protocols that assess how effectively a robot performs physical manipulation tasks in simulation or in the real world. We then revisit analytical evaluation protocols that assess robustness using grasp-quality measures, margin-based metrics, and other abstract mathematical constructs rather than empirical test-time task performance.
Based on task performance, these evaluation protocols empirically assess whether and how effectively a manipulator achieves the task goal \(\mathcal{G}\) despite varying challenges. They provide more direct comparisons for end users [167] and are widely adopted by both empirical (learning-based) and analytical methods.
Given a manipulation task specification together with domains of epistemic uncertainty, aleatoric uncertainty, and episodic variation, the most widely used robustness evaluation protocol is to measure empirical task success or failure [1]. This approach, commonly referred to as Monte Carlo robustness tests, executes the system repeatedly under a sampled model mismatch \((\hat{\theta},\theta)\), stochastic disturbances \(w_t\) and \(v_t\), and episodic variations \(\nu\), and estimates the probability of achieving the task goal. Concretely, robustness is the expected probability of goal satisfaction under the challenges, \[\mathbb{E}_{\nu \sim \rho_\mathcal{N}, w_{0:T} \sim \rho_\mathcal{W}, v_{0:T} \sim \rho_\mathcal{V}} \left[\mathbf{1}\{x_T \in \mathcal{G}\} \mid (\hat{\theta}, \theta) \right], \label{eq:evaluation-target}\tag{5}\] often approximated by empirical success rates \({n_{\text{success}}}/{n_{\text{total}}}\) computed over multiple trials. This evaluation directly aligns with the robustness formulations introduced in Section 3.
Following this evaluation protocol, examples include success rates in object pose estimation under perception noise and occlusion [91]; success rates or expected returns in reinforcement learning, which often reduce to goal satisfaction indicators, evaluated across episodic variations such as different initial object placements or object instances [89], [152]; and success under adversarial perturbations, including external disturbances applied to manipulated objects or injected joint-level perturbations during execution [132]. Variants of this approach include systematic parameter sweeps, where parameters in \(\theta\) (e.g., inference latency, friction coefficients, lighting conditions) are varied across controlled ranges and performance is plotted as a function of the parameter [115].
While the formulation in Eq. 5 focuses on terminal goal satisfaction, there are many manipulation tasks more naturally characterized by trajectory-level subgoals. In such cases, success depends not only on reaching a final state but also on correctly executing a sequence of intermediate stages. Consequently, several works adopt stage-wise evaluation metrics, in which a task is decomposed into semantically meaningful phases and success is assessed at each stage. For example, [168] evaluate fragile-object manipulation policies across three stages: approach, stable grasp, and task completion. [169] decompose a paper-cup lifting task into clamping and lifting stages. Evaluators may also design task-specific semantic rubrics to assess policy behavior beyond aggregate success rates [170]. For instance, in a Flip-and-Serve Pancake task, relevant criteria may include: “Robot collided with anything?”, “Robot flipped pancake?”, “Robot picked up pancake?”, in addition to overall task success. The stage-wise protocols provide a more fine-grained assessment of policy performance, enabling the identification of failure modes that may be obscured by a single binary success measure.
While success probability under challenges provides an empirical, task-level notion of robustness, it is often insufficiently fine-grained for answering more specific questions about how a manipulation system withstands challenges. In many scenarios, one is not only interested in whether a task succeeds, but also in the structure and degree of tolerance to disturbances, uncertainty, or variation. This is where analytical evaluation protocols become valuable: they aim for potential capability, rather than only realized capability, through explicit mathematical constructs. They are structured and interpretable, tailored to specific manipulation mechanisms and failure modes. They are often approximated by the success probability in Eq. 5 . Unlike performance-based protocols, which primarily serve as empirical diagnostic tools for robustness assessment, analytical protocols can also function as optimization objectives embedded within planning, control, or learning methods for the synthesis of robust manipulation behavior. As follows, we introduce several analytical evaluation protocols.
Closure properties characterize how contact forces and geometric constraints prevent an object from deviating from a desired configuration or set of configurations. These properties are typically analyzed from two different perspectives: local conditions at the contact and global conditions within the object’s configuration space.
Local measures derived from force closure or form closure quantify the instantaneous robustness of quasistatic manipulation via wrench-space or geometric analysis. These measures can be evaluated either analytically or empirically. Analytical approaches, commonly referred to as grasp quality measures [171], compute robustness using physics-based models to determine the system’s ability to resist external disturbances. In contrast, empirical approaches approximate these analytic measures by learning from data. For instance, grasp datasets labeled with analytic quality values are used to train neural networks that predict robustness directly from visual or sensory inputs [172], enabling scalable estimation in unstructured environments.
While local measures assess stability via instantaneous force or geometric conditions, many complex manipulation tasks depend on the global characteristics of the configuration and contact spaces—specifically, how reachable, connected, or “trapped” an object remains within its environment. Topological analysis captures such global invariants, providing a perspective complementary to purely local evaluations [173], [174]. For example, energy-bounded caging [175] defines robustness in terms of the size or persistence of the configuration-space region that keeps the object contained. In this context, a larger connected component implies a greater structural tolerance to uncertainty or disturbances.
“Margin” to failure quantifies robustness by measuring the distance between a system’s operating state and the boundary of task failure. Intuitively, systems maintaining larger margins are more robust, as they can tolerate greater disturbances, modeling errors, or stochastic noise before a failure occurs. Consider the task of placing a cup of coffee on a coaster: precise positioning is secondary as long as the liquid level remains safely below the rim. If the goal region \(\mathcal{G}\) is defined as the set of states where all liquid remains inside the cup, its complement \(\mathcal{G}^{c}\) corresponds to failure (spillage). While a binary reward only detects the occurrence of failure, a safety margin quantifies the resilience of the current state: \[\sigma_{\text{margin}} = \operatorname{dist}(x, \partial \mathcal{G}),\] where \(\operatorname{dist}(\cdot)\) denotes a task-appropriate distance metric and \(\partial \mathcal{G}\) is the boundary of the goal region. Positive values indicate the system is within \(\mathcal{G}\), with larger values implying greater robustness.
In neurophysiology, this distance is often defined through energy, i.e., the energy required for the system to transition from a safe state \(x\) to failure \(\mathcal{G}^c\) [176]. Humans intuitively maintain such margins by relying on simplified internal models rather than exact dynamics, selecting control strategies that preserve safety margins [177]. Similar concepts have been applied to evaluate robotic manipulation robustness [178]. Analogous ideas appear in force- and wrench-based robustness metrics, such as grasp stability measures that quantify the maximum external wrench a grasp can resist before slippage [179]. Extending the concept over time leads to the notion of a “safety tube”, a region surrounding a nominal trajectory within which the system can remain despite bounded disturbances [86], [180].
Signal Temporal Logic (STL) is a formal language for describing time-dependent task requirements over real-valued signals, such as contact force, object position, or velocity — examples include conditions such as maintaining a grasp force below a threshold, reaching a target region within a given time, or keeping an object stable throughout execution. STL further provides quantitative semantics that assign a robustness score measuring how strongly a trajectory satisfies or violates the specified requirements [181], [182]. In robotics manipulation, STL robustness has been predominantly used as an optimization target — either as a reward signal in reinforcement learning [183], [184], a loss function for neural predictive control [185], or a planning objective in task-and-motion planning [186]. Its use as a post-hoc evaluation metric remains rare: [170] have explicitly leveraged STL robustness for grading learned manipulation policies after training, demonstrating how the robustness score reveals not only whether a policy succeeds but how close it is to failure across complex, temporally structured objectives. The STL measures are conceptually related to the margin-to-failure measures discussed above, but generalize them to composite temporal specifications involving sequencing, timing, and conditional constraints. A practical limitation is that STL robustness is scale-dependent: predicates expressed in different physical units (e.g., millimeters versus Newtons) produce robustness values on incomparable scales, so that the min/max aggregation inherent in the semantics can be dominated by the choice of units rather than by task-relevant difficulty [187], [188]. Despite these challenges, the broader use of STL measures as an evaluation tool for manipulation robustness remains a promising direction.
In dynamically complex manipulation tasks such as tossing, catching, or balancing, robustness often arises from the intrinsic structure of the system dynamics. Humans routinely exploit such dynamics by inducing self-correcting behaviors in which small perturbations are naturally compensated, allowing motion to remain stable under bounded aleatoric disturbances \(w \in \mathcal{W}\). From an evaluation perspective, this form of robustness can be captured by convergence or divergence measures [189], which quantify how trajectories evolve under perturbations. For example, the largest eigenvalue of the symmetric part of the system Jacobian measures the local rate of trajectory divergence or contraction, with negative values indicating stabilizing, disturbance-rejecting dynamics. Such measures can be incorporated into constrained optimization or planning formulations, e.g., as constraints on contact dynamics, to favor actions that induce convergent behavior and naturally funnel executions back toward desired outcomes.
In this section, we discuss several complementary insights and implications that emerge from the robustness mechanisms.
Manipulation performance is inherently context-dependent. A system may exhibit high performance in controlled laboratory settings, yet experience sharp degradation in unstructured real-world environments. Systems optimized for narrow conditions can achieve exceptional speed or precision, but often do so at the expense of robustness when those conditions change. In nature, star-nosed moles exemplify this trade-off: their specialized nasal appendages enable rapid prey detection in wetland tunnels, but such specialization may be fragile under environmental shifts [190]. By contrast, some systems with moderate peak performance may trade efficiency or accuracy for robustness. Compliant robotic grippers, for example, adapt well to variations in object shape or mass, but typically sacrifice positional precision [159]. These observations suggest that progress in manipulation should be evaluated not only by peak performance under ideal conditions, but by the ability to sustain reliable function under imperfect and unpredictable in-the-wild challenges.
Robustness often intersects with but differs from other fundamental concepts, including safety, stability, generalizability, etc. Safety concerns preventing harm to humans, the environment, or the robot itself, and is critical in domains such as autonomous driving, navigation, and human–robot interaction [191]. Stability, common in control and grasping, refers to maintaining or converging to a desired state under perturbations. Robustness extends beyond these notions, encompassing not just safe or stable operation but the broader pursuit of general task goals under uncertainty or variation.
Robustness and generalizability are also frequently discussed interchangeably, especially in robot learning, but they capture different aspects of system behavior. Generalizability concerns the scope over which a learned policy or model can be applied beyond its training conditions, such as new objects, scenes, embodiments, task instructions, or simulation-to-real transfer [19], [192], [193]. Robustness, in contrast, concerns the reliability of task achievement under a specified set or distribution of uncertainty and variation. Thus, generalization may serve as one mechanism for robustness when the deployment variations are covered by the generalized competence of the policy, but it is neither necessary nor sufficient: a controller may be robust within a narrow operational condition without generalizing broadly, while a generalist policy may cover many tasks yet remain sensitive to small perturbations, contact uncertainty, or distributional shifts not represented in its evaluation protocol.
Robustness research in domains beyond manipulation offers valuable insights. As mentioned in Section 2, locomotion robustness is particularly relevant, as locomotion can be viewed as a form of “self-manipulation” [1], [194]. Techniques such as adversarial training for controller robustness [195], widely explored in locomotion, remain comparatively underutilized in manipulation and represent a promising direction. Similarly, biological inspirations such as gecko-inspired adhesives, originally studied in climbing and locomotion, have motivated gripper designs [164]. Despite these overlaps, manipulation presents unique challenges: unlike locomotion, which often reduces interaction to discrete foot–ground contacts, manipulation involves rich, multi-body interactions among the hand, object, and environment, with diverse contact types and combinatorial complexity that significantly complicate robustness analysis and design.
Finally, perturbations, typically viewed as detrimental, can in some cases enhance robustness. In granular media, small vibrations can break clogging arches when pouring sand into a funnel [196]. The vibrating bowl feeder discussed in Section 5.2.2 provides another example, where controlled vibrations guide parts toward consistent configurations. Analogously in manipulation, slight, intentional perturbations can dislodge unstable contacts, reduce excessive contact forces, or guide objects out of shallow local minima. Everyday actions such as wiggling a Jenga block or flicking an omelette exemplify how controlled perturbations stabilize interactions rather than destabilize them. These observations highlight that robustness is not always achieved by tackling uncertainties or variations, but sometimes by strategically exploiting them.
The frameworks and principles presented thus far provide a basis for understanding how robustness arises, yet they also make clear that essential scientific and engineering questions remain unanswered. This section identifies some of the open problems and discusses the challenges that must be overcome to achieve manipulation robustness under real-world challenges.
Effective comparison of manipulation robustness across different methods requires well-designed benchmarks and consistent evaluation methods. Simulation-based benchmarking [197]–[199] allows experiments under identical conditions and facilitates large-scale testing, yet faces the persistent challenge of the sim-to-real gap that limits physical realism and transferability, as well as being confined to a very narrow distribution of tasks and environments. Real-world benchmarking efforts, including standardized object sets [200], manipulation competitions [201], [202], cloud-based robotic platforms [203], and community-run distributed infrastructures [204], [205], aim to address this gap, yet each makes trade-offs among task diversity, scalability, accessibility, authenticity, or consistency. Future progress depends on balancing these aspects through advances in computation, communication, and standardized cross-community protocols. Most importantly, the existing simulation or real-world benchmarks rarely treat robustness as an explicit evaluation criterion, instead evaluating performance primarily under relatively fixed conditions. Fair comparison further requires robustness evaluation methods that quantify system performance. While analytical and empirical methods have been developed for specific manipulation tasks (Section 6), a unified framework that systematically captures real-world uncertainty or variation remains an open challenge.
Consistent with the analytical and empirical evaluation protocols discussed in Section 6, these two methodological traditions also appear broadly in robustness research. Analytical robustness methods reflect Plato’s philosophy of abstraction, seeking general principles and guarantees through formal modeling and analysis; empirical methods follow Aristotle’s practical spirit, emphasizing performance validated through data and experience. The field continues to debate whether progress in robotics lies in one paradigm or their synthesis [206], and robustness as a core robotic topic follows the same divide. Data offer robots experiential knowledge that models alone cannot provide, enabling robustness to emerge from interaction, much as humans develop know-how before know-why through sensorimotor learning. Yet unlike human toddlers, robots are not bound to start from scratch. They can inherit models and priors designed by humans, effectively knowing why before knowing how. Such models allow robots to adapt behavior in a data-efficient way while mitigating the limitations of purely data-driven methods, which are often sensitive to aleatoric uncertainty and distribution shift. Consider the game of Jenga: humans learn to play robustly not only through trial and error but also by leveraging internal models of perception, planning, and control. Similarly, the future of manipulation robustness likely lies in unifying data-driven learning and model-based reasoning—integrating know-how and know-why into robot systems.
Achieving human-level manipulation robustness remains a grand challenge in robotics. Evidence suggests that such robustness emerges from the integration of multiple complementary strategies, such as extensive lifetime experience, accurate world models grounded in physical reasoning, domain-specific embodiment, and rapid adaptation. For example, crows bend hooks to retrieve food, effectively co-designing hardware and control in the wild [207]; such behavior cannot be explained by mechanics or control alone. Humans similarly integrate rich lifetime priors with online exploration and adaptation, inspiring approaches such as reinforcement learning bootstrapped with prior data [152]. Yet, synthesizing all these strategies in a single robotic system remains rare and challenging. Other principles evident in animals and humans, such as redundancy in planning and sensing, are gaining attention as essential components for manipulation robustness. Reaching animal-level manipulation robustness already exceeds current robotic capabilities, but is prospective; attaining human-level robustness represents a far greater leap and the ultimate aspiration for robotic manipulation.
This paper makes advances towards a systematic understanding of manipulation robustness by defining the concept, formulating the problem, and revisiting prior work across subfields. We revisited representative mechanisms and evaluation methods, highlighting the core principles that enable robustness in robotic manipulation and providing insights for future practitioners interested in this topic. Despite decades of progress, achieving human-level manipulation robustness on robotic systems under real-world uncertainties and variations remains a central challenge. Bridging this gap will require not only improved algorithms and hardware, but also clearer formulations of robustness and more consistent evaluation methods. We hope this paper will help organize future research efforts toward robotic manipulation systems that routinely approach the robustness demonstrated by humans and animals in the physical world.
The project is partially funded by the European Commission under the Horizon Europe Framework Program project SoftEnable, grant number 101070600. The authors thank Oliver Brock, Matthew T. Mason, Yan Zhang, Yunke Ao, Rafael I. Cabral Muchacho, Shaohang Han, Haoyu Li, Zizhe Zhang, and Jinda Cui for helpful discussions, comments, or proofreading. Part of Fig. 1, 3-c were created using generative AI tools (ChatGPT/OpenAI). These figures are original representative illustrations intended for conceptual explanation. The authors verified their technical accuracy and take full responsibility for the final content.
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.