Bimanual Assembly Demonstration
Belief-Space Receding-Horizon Action Selection
We consider a hybrid system with continuous flows, discrete mode transitions, and an unknown parameter that remains fixed during an execution. A candidate feedback action consists of a feedback law and a stopping rule, so action selection determines both the feedback applied and when its outcome is observed. We maintain a probability distribution over the unknown parameter and update this belief from the observed action outcome.
Predict Progress
A nonnegative target-set progress function supplies the quantity used in the expected-decrease constraint. For each candidate feedback action, we predict its expected value at the action endpoint using the current parameter belief.
Enforce Admissibility
Nonnegative slack relaxes the expected-decrease requirement for an individual action. A scalar controller state tracks the remaining slack and enforces a bounded cumulative sum.
Anticipate Information
In two-step selection, each possible observation conditions a predicted posterior belief. We evaluate the next feedback action under that posterior, execute the first action, observe its outcome, and replan.
Almost-Sure Target-Set Convergence
Under distance-comparison bounds, correct conditional prediction, and recursive feasibility, we prove almost-sure convergence to the target set at decision times. We also bound the sum of expected progress-function values and the expected time to enter a target neighborhood.
Upper confidence bounds extend the analysis to bounded model samples with summable error probabilities.
Posterior-conditioned lookahead accounts for how an action changes the information available at the next decision. The predicted observation changes the parameter belief and therefore both the cost and admissibility of the subsequent feedback action.
Numerical Example 1
Learning an Unknown Control Direction
In a two-dimensional regulation problem, the unknown input sign determines which feedback gain contracts the state toward the origin. Two-step selection first applies a test input to identify this sign, then applies the corresponding contracting feedback. We verified recursive feasibility along both resulting trajectories; the state norm fell below 0.01 within 11 decisions for either sign. A one-step selector instead applied zero input and left no admissible action at the next decision.
Planar Control with an Unknown Input Sign. The axes are the state coordinates x1 and x2; the star marks the target at the origin and the black dot marks the initial state. Blue solid and green dashed curves show two-step selection for control-direction signs θ = +1 and θ = −1, respectively. The first test interval reveals the sign through a change in radius, after which the selected feedback contracts both trajectories toward the target. The dotted circle shows the constant-radius motion produced by the rotational drift with zero input.
Numerical Example 2
Feedback Selection in Bimanual Assembly
The assembly example instantiates one-step feedback selection on a RealHand A7 Black bimanual robot with two L6 hands in Drake. Physical finger contacts support acquisition and transport of two free-body parts. After insertion, the selector chooses clearance feedback for hand withdrawal while preserving the assembled part pose.
| Quantity | Belief-Informed | Reference Tracking |
|---|---|---|
| Infinity-norm relative-position error | 0.188 mm | 5.20 mm |
| Minimum hand–assembly clearance | 7.14 mm | 0 mm |
| Summed hand–housing contact-force magnitude | 0 N | 0.704 N |
Effect of Belief Refinement
At lower friction, 0.35, conditioning on acquisition observations produced an empty admissible set. With the prior held fixed, the alternative selector admitted an action that violated the conditional expected-decrease constraint. The acquisition observations therefore changed which actions were admissible. The planar example separately establishes recursive feasibility and demonstrates informative two-step lookahead.
BibTeX
@misc{enwerem2026beliefinformedhybrid,
title = {Belief-Informed Hybrid Control with Almost-Sure Target-Set Convergence},
author = {Enwerem, Clinton and Kemal, Saleh and Baras, John S. and Belta, Calin},
year = {2026},
eprint = {2610.07674},
archivePrefix = {arXiv},
primaryClass = {eess.SY},
doi = {10.48550/arXiv.2610.07674},
url = {https://arxiv.org/abs/2610.07674}
}





