What's a good beginner sensor fusion project before tackling a full robot?

IMUs, force/torque sensors, depth cameras, LiDAR, tactile skin, SLAM, and state estimation.
rebecca_lefe
Posts: 56
Joined: Sun Nov 23, 2025 6:36 am

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by rebecca_lefe »

Genuine beginner question - Unitree's Dex3-1 dexterous hand packs around 33 pressure/tactile sensors per hand across the fingers and palm, capable of sensing pressure roughly in the 10g-2500g range - a useful reference point for what 'production tactile sensing' looks like right now.
she/her
emily.kumar
Posts: 41
Joined: Fri Jan 30, 2026 2:42 pm

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by emily.kumar »

Counterpoint: Event cameras (which report per-pixel brightness changes rather than full frames) are still more of a research curiosity than a production sensor for humanoids, mainly because the software ecosystem and processing pipelines around them are far less mature than for standard frame-based cameras. SLAM in a working warehouse is harder than in a controlled lab mainly because the map keeps changing - pallets move, people walk through, lighting shifts near dock doors - so a lot of production systems lean on semi-static maps refreshed periodically rather than pure continuous SLAM.
Currently: 3D printing my way to bankruptcy.
zoeanderson
Posts: 243
Joined: Sat Oct 26, 2024 2:39 am

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by zoeanderson »

@emily.kumar Genuinely curious - Multi-camera calibration drifts over time from thermal expansion, vibration, and mechanical wear, which is why production systems typically run periodic recalibration routines rather than assuming a one-time factory calibration holds forever. Kind of makes me think about how different this all looked even three years ago.
young56
Posts: 123
Joined: Mon Jun 09, 2025 5:26 pm

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by young56 »

Related question - Estimating joint torque from motor current draw is cheap and requires no extra sensor, but it's less accurate than a dedicated torque sensor because it doesn't capture friction losses through the gearbox - good enough for coarse control, not always for precise force-controlled tasks.
she/her | grad student, biped locomotion
sarah.santos3
Posts: 213
Joined: Thu Feb 13, 2025 5:30 am

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by sarah.santos3 »

Genuinely curious - Proprioception (the robot's sense of its own joint angles, velocities, and forces) tends to get less attention than flashy vision systems, even though a lot of balance and manipulation failures trace back to proprioceptive noise or miscalibration rather than a vision problem. Makes me wonder how this looks in another five years.
they/them
jlefebvre
Posts: 59
Joined: Wed Jan 14, 2026 3:07 pm

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by jlefebvre »

Can I ask a dumb follow-up - Tactile skin arrays have improved a lot, but 'good enough to matter' really depends on the task - coarse contact detection across a large area is fairly mature, while fine, high-resolution force distribution sensing (like a human fingertip) is still the harder problem. SLAM in a working warehouse is harder than in a controlled lab mainly because the map keeps changing - pallets move, people walk through, lighting shifts near dock doors - so a lot of production systems lean on semi-static maps refreshed periodically rather than pure continuous SLAM.
Ex-automotive, now full-time robots.
jessica_faro
Posts: 95
Joined: Sat Oct 11, 2025 5:26 am

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by jessica_faro »

@jlefebvre Here's the relevant bit as far as I understand it: A minimum viable sensing suite for safe bipedal walking generally includes joint encoders, an IMU for orientation/angular velocity, and either force/torque sensing or accurate current-based torque estimation at the ankles - everything else (vision, tactile, LiDAR) adds capability rather than being strictly required just to stay upright. Multi-camera calibration drifts over time from thermal expansion, vibration, and mechanical wear, which is why production systems typically run periodic recalibration routines rather than assuming a one-time factory calibration holds forever.
they/them
edward.nelson
Posts: 40
Joined: Tue Jun 02, 2026 2:23 pm

Re: What's a good beginner sensor fusion project before tackling a full robot?

Post by edward.nelson »

I dealt with almost this exact situation. Estimating joint torque from motor current draw is cheap and requires no extra sensor, but it's less accurate than a dedicated torque sensor because it doesn't capture friction losses through the gearbox - good enough for coarse control, not always for precise force-controlled tasks.
she/her
Post Reply