How self-driving cars see the world
Four kinds of sensors. Each one has strengths and blind spots. The magic is in how they work together.
The big idea
Four senses, one picture
Your eyes are great in daylight but struggle in fog. Your ears can hear a car behind you, but not tell you its color. Self-driving cars face the same trade-offs — so they don't rely on a single sense.
They layer four: camera, lidar, radar, and ultrasonic. Each one is good at something the others aren't.
Sensor 1 of 4
Camera — the detail specialist
Cameras work like yours: they capture light. That makes them the only sensor that can read a STOP sign, see a traffic light turn green, or tell the difference between a pedestrian and a cardboard cutout.
- +Strengths: color, fine detail, reading text and signs.
- −Blind spots: darkness, fog, heavy rain, direct sun flaring the lens.
Sensor 2 of 4
Lidar — the shape surveyor
Imagine firing thousands of laser pulses per second and timing how long each one takes to bounce back. That's lidar. The result is a precise 3D map of everything around the car — down to the centimeter — even in pitch darkness.
- +Strengths: precise geometry, works in darkness, measures distance directly.
- −Blind spots: rain and snow can scatter the laser. Historically expensive, though prices keep dropping.
Sensor 3 of 4
Radar — the weatherproof veteran
Radar's the oldest of the four — ships and planes have used it for nearly a century. Radio waves push through fog, rain, and snow. And because of the Doppler effect, radar tells the car not just where something is, but how fast it's moving, instantly.
- +Strengths: weatherproof, direct speed measurement, long range.
- −Blind spots: lower resolution than lidar — great at spotting that something is there, less great at telling you exactly what it is.
Sensor 4 of 4
Ultrasonic — the parking helper
These are the beepers that tell you you're about to bump the curb. Short-range, low-cost, and perfect for the last meter — parking, tight maneuvers, and checking the blind spot right next to the bumper at low speed.
- +Strengths: cheap, reliable up close, works in any weather.
- −Blind spots: range is only a few meters. Useless at highway speed.
Side by side
How the four sensors stack up
No sensor wins across the board. Each one is a specialist, and that's the point.
Camera | Lidar | Radar | Ultrasonic | |
|---|---|---|---|---|
| Typical range | ~200 m | ~150 m | ~250 m | ~5 m |
| Works in darkness | Poor | Excellent | Excellent | Excellent |
| Works in rain / fog | Poor | Fair | Excellent | Good |
| Sees color / text | Yes | No | No | No |
| Measures speed directly | No | No | Yes | No |
| Relative cost | Low | High | Medium | Very low |
How they work together
Sensor fusion — four senses, one truth
No single sensor gives the full picture. The car's software stitches them together in real time. A camera catches the red light. Radar tracks the delivery truck approaching at 40 mph. Lidar confirms it's 80 meters out and decelerating. Ultrasonics watch for anyone stepping off the curb next to the car. Every sensor checks the others.
Keep going
Related explainers