Paper · 2024-12-09 · cs.RO
Haptics in Micro- and Nano-Manipulation
Bilateral haptic tele-manipulation of magnetically guided microrobots: operator motion is scaled down to the tool, and interaction forces are scaled up to a haptic device. Gives a dynamics model and a PI force-feedback controller, tested in three single-trial experiments. Headline: 8 µm steady-state position error for a microbead. The stability analysis promised in the abstract is absent.
TeleoperationMagnetic actuationhapticsteleoperationmicromanipulationmagnetic-actuationforce-feedback
AI-compiled by claude-haiku-5-5 on 2026-10-25, not yet reviewed by a human. Every claim cites its source; check it when a detail matters.
In plain words
Some medical robots are so small that they cannot carry sensors. A surgeon who moves a tiny magnetic robot from outside therefore cannot feel what it touches. This chapter describes a setup where a person moves a handheld haptic device, a magnetic field moves the micro-robot to match, and the forces the micro-robot meets are scaled up and sent back to the person's hand. The motion is scaled down and the forces are scaled up, so the operator can feel the tiny world.
The chapter gives the equations of such a loop and a controller that lets the force feedback override the operator when pushing would damage tissue. It then shows three experiments with a single trial each: moving a bead, pushing a cell, and moving a gas bubble. The experiments show that the approach works in the lab. They do not show that it is better than other methods.
TL;DR
- A haptic device (master) drives a magnetically guided micro-robot (slave) through bilateral tele-manipulation; the position is scaled down and the interaction force scaled up p. 2 fig. 1.
- Dynamics of the micro-robot eq. 1 and of the positioning system eq. 2 are written as general models; their parameters are not given.
- A PI force controller eq. 3 and a user-level position controller eq. 4 are described; no gain or scale values are stated.
- Evidence is three single-trial experiments: an 8 µm steady-state tracking error for a bead, a 0.4 µN force for a cell-penetration case, and a qualitative bubble trial p. 11 p. 12 p. 13.
- The abstract claims closed-loop stability from absolute stability theory, but no stability analysis appears in the text p. 1 p. 13.
Problem
Micro-robots cannot carry the force sensors, electronics and transmission modules that macro-scale tele-manipulation uses, so the interaction forces have to be measured or estimated another way p. 2. At micro-scale the forces on the robot are small and cannot be perceived by the operator directly, so they must be scaled up before they are fed back p. 8 p. 9. Force feedback is also needed to protect tissue: the operator must be stopped from pushing harder than is safe p. 8 p. 9. The chapter assumes that the positioning system and the tool can be modelled, and that the surroundings can be sensed only partly (visual feedback, with force predictions) p. 7 p. 10.
Method
The chapter has unnumbered sections, so citations give PDF page numbers
[p. N]. Equations and figures are numbered as in the paper.
The system has four layers, shown as nested blocks in fig. 3 p. 8: the environment (disturbances), the user-level control (position command plus haptic feedback), a closed-loop force controller, and the positioning system with the micro-robot at its centre. The operator's command is sent through the force controller, which can cancel it, to the positioning system. The force on the tool is sent back to the operator through the scale matrix S₁ p. 8 fig. 3.
-
Micro-robot dynamics. The motion of the micro-robot is described by a mass matrix, a generalised coordinate d, and four force groups: drag, actuation by the external field, contact, and gravity eq. 1 p. 7. The authors note that in low-Reynolds-number flow viscous forces dominate and inertia is negligible p. 7. They do not give the forms of these force terms.
m\ddot{d} = F_{drag}(d,\dot d) + F_{actuation}(d) + F_{contact}(d,\dot d) + F_{gravity}(d) eq. 1
-
Positioning-system dynamics. The actuator coordinates q follow a manipulator-style equation with inertia D, Coriolis matrix C, friction terms P and T, stiffness K, gravity g, input u, and the transpose of the manipulator Jacobian J acting on the micro-robot force F eq. 2 p. 8. The positioning system can be a kinematic chain, electromagnetic coils, piezoelectric elements or a light source p. 7.
D(q)\ddot q + C(q,\dot q)\dot q + P\dot q + T\dot q + Kq + g(q) = u + S_{\{1,2\}}J^T(q)F(q,\dot q) eq. 2
-
Force feedback. The force on the micro-robot is scaled with the factor matrix S₁ to reflect the force on the manipulator, because the two differ in dimension p. 8. The scaled force goes to the haptic device fig. 4 p. 9. Scaling is needed because micro-scale forces cannot be perceived by the operator p. 9.
-
Closed-loop force control. A PI loop on top of the positioning system compares the desired force f_d with a predicted force. The error is f_e = f_d − f_predicted. The controller accepts the force predictions and compares them with the maximum allowable force; it cancels excess user input when needed p. 8 p. 9. The damping term limits acceleration of the manipulator p. 9.
u = g(q) + S_1J^T(q)\left(f_d + k_p f_e(t) + k_i\int f_e(t)\,dt - k_{damp}\dot q\right) eq. 3
Pseudocode# Closed-loop force control under the user's input [eq. 3] [p. 9] # Inputs: f_desired desired (allowed) force vector [p. 9] # f_predicted predicted force vector [p. 9] # q, q_dot joint position and velocity [eq. 3] # Output: u command to the positioning system def force_control_step(f_desired, f_predicted, q, q_dot, integral, dt): # Force error, desired minus predicted [p. 9] f_error = f_desired - f_predicted # Running integral of the error, for the I term [eq. 3] integral = integral + f_error * dt # PI correction on the desired force, minus damping [eq. 3] task_command = ( f_desired + k_p * f_error + k_i * integral - k_damp * q_dot ) # Map to actuator space with S1, plus the gravity term [eq. 3] u = gravity(q) + S1 @ transpose(J(q)) @ task_command return u, integral -
User-level position control. The user's position command is tracked with a PI loop on the position error d_e = d_desired − d_predicted, with a derivative term, and an inertia-like matrix M and a remaining-terms vector h that includes the scaled haptic feedback eq. 4 p. 9 p. 10. The predicted position is not taken from eq. 1 but is meant to come from neural networks working on live visual feedback p. 10.
u = M(q)\left(\ddot d_{desired} + k_p d_e(t) + k_i\int d_e(t)\,dt + k_d\dot d_e\right) + h(q,\dot q) eq. 4
-
Scaling. The position of the operator's end-effector is scaled down and the drag force on the micro-object is scaled up fig. 1 p. 2. The scale values are not given in the text.
Hyperparameters
| Name | Value | Where | Notes |
|---|---|---|---|
| Force-control gains k_p, k_i | not stated | eq. 3 p. 9 | PI gains; the text says they are in the matrices k_p and k_i |
| Damping gain k_damp | not stated | eq. 3 p. 9 | Limits acceleration on the manipulator |
| User-level gains k_p, k_i, k_d | not stated | eq. 4 p. 9 p. 10 | |
| Force scale factor S₁ | not stated | p. 8 eq. 3 | Only the scale-up size is given (below) |
| Force scale-up | about 6 orders of magnitude | p. 12 | Given for the bubble experiment; unit conflict, see Pitfalls |
| Position scale-down | not stated | fig. 1 p. 2 | |
| Magnetic field gradient, cell experiments | about 5 T/m | fig. 2 p. 6 p. 12 | Four orthogonal electromagnetic coils p. 12 |
| Cluster size, cell aggregate (top row) | about 10 µm × 4 µm (length × width) | fig. 2 p. 12 | Two clusters |
| Cluster size, single cell (bottom row) | about 6 µm × 4 µm (length × width) | fig. 2 p. 12 | |
| Cluster size, penetration (Fig. 5) | about 10 µm × 4 µm (length × width) | fig. 5 p. 12 | Text gives width 4 µm and length 10 µm |
| Bead material | blue polystyrene, Micromod | p. 10 | Bead diameter not stated |
| Gas bubble size | not stated | p. 11 fig. 6 | |
| Control or sampling rate | not stated | ||
| Haptic device model | not stated | fig. 1 p. 2 | Picture only |
Results
Author-reported. Each experiment is a single representative trial. No baseline controller, repeat count or statistics are stated. Setups: microbead manipulation with a paramagnetic slave robot p. 10 fig. 4; MCF-7 cells with iron-oxide nanoparticle clusters in a container under four coils p. 12; gas bubble with a trapped paramagnetic microparticle p. 11 fig. 6.
| Experiment | Metric | Reported value | Setup | Source |
|---|---|---|---|---|
| Microbead positioning | Maximum steady-state position tracking error | 8 µm | One trial, reference position | p. 11 fig. 4 |
| Cluster force vs cluster size | Force on the probe | Roughly linear with cluster size; plot axis to 0.9 µN | Mean ± SD per size group, field gradient 5 T/m | fig. 2 p. 6 p. 9 |
| Cell penetration by cluster | Force on the cluster during uptake | 0.4 µN | Penetration at 21 s (caption); uptake at about 66 s (text) | fig. 5 p. 12 |
| Cell aggregate uptake (two clusters) | Time to engulfment | 64 s (text) | Top row of Fig. 2 | fig. 2 p. 12 |
| Single-cell uptake | Time to engulfment | 22 s | Bottom row of Fig. 2 | fig. 2 p. 12 |
| Gas bubble manipulation | Estimated forces | Plotted only; no summary value | One trial; haptic and micro-particle forces over 25 s | fig. 6 fig. 7 p. 13 |
Paper vs code
No official code. The paper and its metadata have no code link and no
project page. The GitHub
search used these queries: haptic microrobot, bilateral teleoperation magnetic microrobot, magnetic microrobot haptic tele-manipulation,
khalil microrobot, and a user search for Islam Khalil utwente. None
returned a repository or user from the authors. One result,
Zongcai23/digital-twin-visuo-haptic, is a visuo-haptic project with no
license and no link to the authors, so it was not used.
Pitfalls
- Stability is not shown. The abstract promises closed-loop stability from absolute stability theory p. 1. No stability analysis appears in the chapter, and the conclusion says only that "stable position control" was implemented p. 13. Do not treat stability as demonstrated.
- Model terms are not specified. Eqs. 1 and 2 leave the drag, contact, actuation and gravity forces, the matrices D, C, P, T, K, and the mass m unspecified. The authors say the model cannot represent the physical system exactly p. 9. An implementer must supply these from other sources.
- Predicted forces and positions have no method. The error term f_e is said to come "from the solution of the very first equation" p. 9, but no solver, state estimator or prediction procedure is given. The predicted position is said to come from neural networks on visual feedback p. 10. No architecture, training data or accuracy is reported.
- Unit conflict in the force scaling. The haptic-side force is plotted in µN in Fig. 4(b) and Fig. 7 p. 9 p. 13, yet the text says the force is scaled up by about six orders of magnitude p. 12. Six orders of magnitude would take µN to N. The plots do not resolve this, and S₁ is not given.
- Equation 3 mixes frames as typeset. The damping term k_damp q̇ is a joint-space velocity, but it sits inside a bracket that is otherwise a force vector mapped by J^T eq. 3. The text does not say how this is meant to be read. Check the dimensions before implementing.
- Gains and sampling are absent. No gain values, sampling rate, latency or saturation limits are given anywhere in the chapter.
- Timings are inconsistent. The last frame of the top row of Fig. 2 is labelled t = 91.0 s, but the text gives 64 s for the same engulfment fig. 2 p. 12. Fig. 5's caption puts penetration at 21 s, while the text gives about 66 s for the uptake fig. 5 p. 12.
- Results are single trials. Each experiment shows one representative trial p. 11 p. 12 p. 13. The 8 µm error is the maximum in the steady state of that trial, and the authors suspect hydrodynamic interaction affects it p. 11.
- Tracking error is not defined. The paper does not say whether the 8 µm figure is in image coordinates or in the physical frame.
- Magnetic conditions differ by experiment. The 5 T/m gradient and four coils are given for the cell experiments only p. 6 p. 12. The field settings for the bead and bubble experiments are not stated.
- Scope. The chapter is a book chapter that describes its own framework. The experiments are in vitro or ex vivo; the conclusion talks about in vivo use as a future goal p. 13.
Lineage
- Builds on: its own earlier bilateral magnetic system with paramagnetic microparticles, Seif et al. (2017), which the chapter cites as ref. [1] p. 2 p. 14. Not on arXiv and not compiled.
- Fig. 1 is cited to ref. [3] (Sun and Nelson, 2002) in its caption fig. 1 p. 14. No figure is reproduced here.
- Compared against: none stated.
- Superseded by: not known from the wiki.
Source and license
Adapted from “Haptics in Micro- and Nano-Manipulation” by Ahmet Fatih Tabak, Islam S. M. Khalil (arXiv:2412.06917), used under CC BY 4.0. Changes: condensed and restructured for implementation, with tables, equations and algorithms taken from the paper and its code, each cited to its source. Not affiliated with or endorsed by the authors.