Robotics & Autonomous Systems

Robotics software turns sensor readings into motion. A warehouse robot, a robotic arm, a delivery drone, and an autonomous tractor all run the same loop: sense the world through cameras, lidar, IMUs, and encoders; estimate where they are and what is around them; decide what to do; and control motors and actuators to do it — dozens to thousands of times per second, with uncertainty at every step.

What makes robotics different from most software is the physical world. Sensors are noisy and miscalibrated, clocks disagree, wheels slip, and models of the robot are only approximately right. Mistakes do not throw exceptions; they move mass. The engineering disciplines that matter most are therefore estimation under uncertainty, stable control, and safety and operations — designing systems that degrade predictably and stop safely when the software is wrong.

TL;DR

The Autonomy Stack

Most production robots run on ROS 2 or a similar middleware, with real-time control on microcontrollers or dedicated controllers and heavier perception on embedded GPUs. See Embedded Systems & IoT.

Featured Topics

Foundations

Perception & Localization

Planning & Simulation

Operations & Safety

Aerial Robotics

Common Questions

Do I need a lot of math for robotics software?

More than for most application work. Linear algebra (vectors, matrices, rotations), probability (noise, Gaussians, Bayes' rule), and some calculus (rates of change, integration) appear constantly — in transforms, filters, and controllers. You do not need to derive everything, but you need to read the equations behind the libraries you use. See Probability and Linear Algebra for Computing.

Should I start with ROS 2?

For anything beyond a single microcontroller project, usually yes. ROS 2 provides messaging, transforms, drivers, logging, simulation integration, and a large ecosystem of packages for navigation (Nav2) and manipulation (MoveIt). Learn the concepts underneath it too — frames, estimation, and control — because ROS packages are configured, debugged, and tuned using exactly those ideas.

How important is simulation?

Very. Simulators let you test control, planning, and failure handling without risking hardware, and replay recorded sensor data to reproduce field problems. They never match reality perfectly, so the gap between simulation and real robots — friction, sensor noise, latency — must be measured and tested on hardware as well. See Robot Simulation and Validation, Gazebo, and MuJoCo.

Why do robots that work in the lab fail in the field?

Lighting, weather, reflective and transparent surfaces, uneven floors, people, wireless dropouts, worn parts, and calibration drift. Field reliability comes from recording data, testing against recorded edge cases, monitoring fleets, and designing explicit recovery behaviors.

Is software safety enough to make a robot safe?

No. Safety functions such as emergency stops and speed limits around people rely on safety-rated hardware and controllers designed to functional safety standards. Application software works within those limits and adds supervision, but must never be the only barrier. See Robot Safety and Fleet Operations.

Learning Path

Beginner

Learn coordinate frames and rotations, write a PID loop for a motor, and drive a simulated differential-drive robot. Read IMU and encoder data from a microcontroller.

Intermediate

Fuse odometry and IMU data with a Kalman filter, calibrate a camera, build a map with a SLAM package, and tune navigation on a real or simulated robot. Plan paths with A* and a sampling planner, and test them with seeded simulation scenarios.

Advanced

Model-based and predictive control, multi-sensor calibration and time synchronization, perception pipelines on embedded GPUs, drone missions validated in autopilot SITL, and safe fleet rollout with telemetry and recovery.

Related Hubs