LiDAR Failure Modes and Sensor Fusion Tradeoffs

The comparison between Tesla’s vision-only approach and Waymo’s use of LIDAR highlights a fundamental disagreement in self-driving philosophy. Tesla relies exclusively on visual cameras, while Waymo utilizes LIDAR (Light Detection and Ranging) as a primary sensor to map the vehicle's surroundings.The sources provide the following insights into how these two systems compare:Technical Philosophy and Sensor Suite• Tesla (Vision-Only): Tesla’s strategy is based on the belief that vision is the only necessary input for self-driving, similar to how the human nervous system functions. However, critics in the sources argue that Tesla has "blown what could have been a data advantage" by refusing to use additional sensors like LIDAR.• Waymo (LIDAR-based): Waymo’s system is often viewed as "far superior" in its current state because LIDAR provides precise depth and spatial data that cameras alone may struggle to replicate.Safety and Performance Records• Crash Rates: Reports indicate that Tesla’s robotaxis have a crash rate approximately four times higher than human drivers, based on data from Austin where the fleet logged four crashes in four months. Conversely, some users suggest that Waymo operates with fewer accidents than human drivers.• Reliability: User experiences with Waymo are frequently described as "almost flawless" or working "pretty flawlessly" in cities like San Francisco and Austin. In contrast, Tesla's system is described by some as "lagging on roads" and currently under investigation for incidents, such as those involving railroads.Current Limitations• Waymo's Weaknesses: Despite its perceived superiority, Waymo still faces challenges. Users have noted that the vehicles can struggle in heavy rain or become confused by temporary road closures for events. Additionally, some reports suggest Waymo may rely on remote operators in other countries to assist the vehicles.• Tesla's Weaknesses: Critics argue that it is impossible to compete with LIDAR using only visual cameras. Further, there are reports that Tesla’s "driverless" tests still involve human safety monitors following the robotaxis in trailing cars.The Debate on "Vision-Only"While some argue that a vision-only system will "never ever" be as good as LIDAR, others suggest that technology may eventually advance to a point where vision is sufficient. However, the current consensus among the provided sources is that LIDAR provides a level of safety and reliability that Tesla’s camera-based system has yet to achieve