• Source: Tesla Autopilot hardware

Tesla Autopilot, an advanced driver-assistance system for Tesla vehicles, uses a suite of sensors and an onboard computer. It has undergone several hardware changes and versions since 2014, most notably moving to an all-camera-based system by 2023, in contrast with ADAS from other companies, which include radar and sometimes lidar sensors.
Initially, the ADAS used a combination of cameras capturing the visual spectrum, forward-facing radar, ultrasonic proximity sensors, and a Mobileye EyeQ3 computer as Hardware 1, fitted to Model S vehicles starting in October 2014. After Mobileye ended its partnership with Tesla in 2016, Tesla began shipping cars equipped with an Nvidia Drive PX 2 computer and an increased number of cameras as Hardware 2. In 2019, Tesla shifted to a computer using a custom "FSD Chip" designed by Tesla, branded as Hardware 3. Starting in 2021, Tesla stopped installing the radar sensor in new vehicles, and the ADAS was updated to drop radar support. In 2022, Tesla announced it also would drop support for the ultrasonic sensors, moving the ADAS to an all-visual system. The most recent sensor and computer implementation is Hardware 4, which began shipping in January 2023.




Physical versions






= Hardware 1

=

Vehicles manufactured after late September 2014 are equipped with a single camera mounted at the top of the windshield, forward looking radar in the lower grille, and 12 ultrasonic acoustic location sensors in the front and rear bumpers that provide a 360-degree view around the car. The computer is the Mobileye EyeQ3; as implemented, this chip is built on a 40 nm process with a TDP of 2.5 W and a clock speed of 500 MHz.: 5  This equipment allows suitably equipped Tesla Model S and Model X vehicles to detect lane markings, obstacles, and other vehicles, enabling advanced driver-assistance functions branded Autosteer (automatic lane-keeping), Auto lane change, Autopark (parallel parking robot), and Side-collision warning. The EyeQ3 used a neural network approach, relying primarily on inputs from the camera to recognize and label objects to determine which potential areas in the camera's field of view are unoccupied and possible for the vehicle to travel through.: 4 
Auto lane change can be initiated by the driver turning on the lane changing signal when safe (due to the ultrasonic sensors' 16-foot limited range capability), and then the system completes the lane change. In 2016 the system did not detect pedestrians or cyclists, and while Autopilot detects motorcycles, there have been two instances of HW1 cars rear-ending motorcycles.
Tesla released a new version of Autopilot in September 2016 that changed the object detection algorithm to more fully use the radar sensor; previously, primary obstacle detection responsibilities fell to the cameras and the radar was used in a secondary role to confirm their presence, but was not given the authority to initiate emergency braking alone. After the update, the radar data was given an equal role in object detection and made capable of identifying "dense obstacles," including "other vehicles, moose, or even alien spaceships," according to Musk. He added that Tesla "believes it would have" prevented the fatal May 2016 underride crash in Williston, Florida, in which Autopilot failed to detect a white trailer against the sky.
Mobileye ended its partnership with Tesla in 2016, stating that Tesla was "going to hurt the interests of [Mobileye] and hurt the interests of an entire industry, if a company of our reputation will continue to be associated with this type of pushing the envelope in terms of safety". Tesla responded that Mobileye backed away after learning Tesla was developing its own vision-based sensor system. Speculation immediately following the announcement included partnering with Nvidia and potentially designing its own ADAS computer. After Hardware 2 was released, an upgrade from Hardware 1 to Hardware 2 was not offered as it would have required substantial work and cost.




= Hardware 2

=

HW2, included in vehicles manufactured after October 2016, includes an Nvidia Drive PX 2 GPU for CUDA based GPGPU computation. Tesla claimed that the hardware was capable of processing 200 frames per second. Elon Musk called HW2 "basically a supercomputer in a car", referring to its capacity of up to 12 trillion operations per second. The Autopilot computer hardware, housed just above the glovebox, is replaceable to allow for future upgrades. Tesla claimed the HW2 suite of sensors and computation provided the necessary equipment to allow FSD at SAE Level 5.

The hardware includes eight cameras covering an aggregate view of 360° around the car and 12 ultrasonic sensors, in addition to forward-facing radar with enhanced processing capabilities. The radar is able to observe beneath and ahead of the vehicle in front of the Tesla; the radar can see vehicles through heavy rain, fog or dust. The eight cameras are mounted in various locations around the vehicle: three forward-facing, next to the central rearview mirror mounted on the windshield; two front/side cameras, one each mounted in the left and right B-pillars; two rear/side cameras, mounted in the left and right front fender turn-signal repeaters; and one rear camera, above the license plate.
When "Enhanced Autopilot" was enabled in February 2017 by the v8.0 (17.5.36) software update, testing showed the system was limited to using one of the eight onboard cameras—the main forward-facing camera. The v8.1 software update released a month later enabled a second camera, the narrow-angle forward-facing camera. With all eight cameras enabled, data extracted from Autopilot in debugging mode showed the cameras provide a black-and-white feed to the computer, possibly to improve image processing speed.
The Tesla Model 3, introduced in 2017, and related Model Y, introduced in 2019, are equipped with an additional driver-facing in-cabin camera. This was disabled at launch and was intended to monitor the cabin remotely while the owner was operating the vehicle as an autonomous robotaxi, but was activated in May 2021 to monitor driver attentiveness while using Autopilot in vehicles without radar sensors.



Hardware 2.5


In August 2017, Tesla announced that HW2.5 included a secondary processor node to provide more computing power and additional wiring redundancy to slightly improve reliability; it also enabled dashcam and "sentry mode" capabilities. During this time, the supplier for the system's radar components was changed from Bosch to Continental, using the ARS4-B unit.
Tesla will upgrade HW2.5 vehicles to HW3 at no cost if the owner purchases Full Self-Driving.




= Hardware 3

=
According to Tesla's director of Artificial Intelligence (AI) Andrej Karpathy, Tesla had, as of Q3 2018, trained large neural networks but they could not be deployed to Tesla vehicles built up to that time due to insufficient computational resources. HW3 was designed to run these neural networks. Overall, Tesla claims HW3 has 2.5× improved performance over HW2.5, with 1.25× higher power and 0.2× lower cost.
HW3 is based on a custom Tesla-designed system on a chip called "FSD Chip", fabricated using a 14 nm process by Samsung. Jim Keller and Pete Bannon, among other architects, have led the project since February 2016. FSD Chip features twelve ARM Cortex-A72 CPUs operating at 2.6 GHz, two Neural Network Arrays operating at 2 GHz and a Mali GPU operating at 1 GHz. Tesla claimed that FSD Chip processes images at 2,300 frames per second (fps), which is a 21× improvement over the 110 fps image processing capability of HW2.5. The firm described FSD Chip as a "neural network accelerator" custom-designed for Tesla AI processing. Each of the two neural network arrays on a single FSD Chip are capable of 36 trillion operations per second, and there are two FSD Chips for redundancy.

HW3 cars are equipped with eight cameras, in the same locations and covering the same directions as the HW2 and HW2.5 cameras. Each of the eight cameras supplied with HW3 use the same AR0136A image sensor supplied by Onsemi, which has a maximum resolution of 1280×960 (1.2-megapixel) and a 3.75 μm pixel size. Initial versions of HW3 also included a Continental ARS4-B radar module. The HW3 system board is the same physical size as the HW2.5 board, but carries more components. This makes it possible to upgrade from HW2 / HW2.5 to HW3, which was not possible during the prior generational change from HW1 to HW2/2.5.
The company claimed that HW3 was necessary for FSD, but not for "enhanced Autopilot" functions. The first availability of HW3 was April 2019. Customers with HW2 or HW2.5 who purchased the FSD package were promised an upgrade to HW3 without cost; however, when FSD Beta was released in 2021, Tesla owners who had subscribed to FSD and owned a vehicle with HW2 or HW2.5 were required to pay US$1500 to upgrade to HW3. Owners who had purchased FSD with a one-time fee as part of their initial vehicle acquisition were eligible for a free upgrade to HW3. Within days, Tesla reduced the cost of the upgrade to US$1000. In 2022, a Tesla owner in the State of Washington won a default judgment against Tesla which ordered the company to upgrade his vehicle to HW3 without cost; in the ruling, the judge cited Tesla's promises that all cars sold since 2016 included the hardware for FSD.



Tesla Vision


In late May 2021, Elon Musk posted to Twitter that "Pure Vision Autopilot" was starting to be implemented. The system, which Tesla brands "Tesla Vision", eliminates the forward-facing radar starting in May 2021 from the Autopilot hardware package on Model 3 and Model Y vehicles built for the North American market. The Washington Post reported in March 2023 the immediate result was "an uptick in crashes, near misses and other embarrassing mistakes by Tesla vehicles suddenly deprived of a critical sensor." For vehicles without the forward radar, temporary limitations were applied to certain features such as Autosteer, and other features (Smart Summon and Emergency Lane Departure Avoidance) were disabled, but Tesla promised to restore the features "in the weeks ahead ... via a series of over-the-air software updates".
In response, Consumer Reports delisted the Model 3 from its Top Picks in 2021, and the Insurance Institute for Highway Safety (IIHS) announced plans to delist the Model 3 as a Top Safety Pick+, but after further testing, both organizations restored those designations. Also, NHTSA rescinded the agency's check marks for forward collision warning, automatic emergency braking, lane departure warning, and dynamic brake support, applicable to Model 3 and Model Y vehicles built on or after April 27, 2021, but as of October 2022, those check marks have been restored.
In December 2021, the New York Times reported that Musk had made a unilateral decision to pursue the camera-only approach and had "repeatedly told members of the Autopilot team that humans could drive with only two eyes and that this meant cars should be able to drive with cameras alone." Several autonomous vehicle experts have denounced the analogy. According to former employees, Tesla engineers attempted to convince Musk that removing the radar could lead to crashes if the cameras became obscured, but Musk "was unconvinced and overruled" their objections. Brad Templeton noted that lidar "will never fail to see a train or truck, even if it doesn't know what it is. It knows there is an object in front and the vehicle can stop without knowing more than that." In contrast, Tesla Vision relies on the "Autopilot labeling team", hundreds of Tesla employees that view short video clips recorded by the cameras to label visible signs and objects, which trains the machine vision interpreter.
Tesla announced in October 2022 they would remove ultrasonic sensors by 2023; vehicles without the ultrasonic sensors would be shipped without Autopark, Park Assist, Summon, and Smart Summon features initially. Vehicles shipped in 2023 featured Park Assist, however it relied on the cameras to determine the distance from objects. In late 2023, Tesla rolled out High Fidelity Park Assist for AMD-equipped vehicles. Throughout 2024, additional features were rolled out, including Summon (renamed to Dumb Summon) and the revamped Autopark and Smart Summon (named Actual Smart Summon).




= Hardware 4

=

Samsung manufactures the processor for Hardware 4 (HW4) in Hwasung, South Korea, on a 7 nm process. The custom System on a chip (SoC) is called "FSD Computer 2". According to a teardown of a production HW4 unit in August 2023, the board has 16 GB of RAM and 256 GB of storage, which are two and four times the RAM and storage in HW3, respectively. Musk stated that HW4 computational capabilities are three to eight times more powerful than HW3.
In June 2022, Tesla filed an application with the US Federal Communications Commission (FCC) to use a new radar module in future vehicles. Based on filings with the Chinese government and a prototype Tesla Model 3 spotted in December 2022 while undergoing testing in Santa Cruz, it is believed that HW4 could include radar, high-resolution cameras, and fans and/or heaters fitted to the cameras to prevent fogging. While automotive radar modules used in other manufacturer's cars have up to 200 channels (giving them capabilities similar to lidar), an updated filing with the FCC in 2023 indicates the new radar module that might be included with HW4 is not likely to be high-resolution.
Tesla started shipping cars with HW4 in January 2023, starting with the refreshed Model S and Model Y; however, FSD was not available initially. It took six months before HW4-based cars ran camera-based software. Despite the increased image sensor resolution with HW4-equipped cars, HW4 runs the FSD software by emulating HW3, including downsizing the camera images, as Tesla has postponed training based on the new HW4 cameras. Musk stated that the HW4-specific training of FSD will start after the new data center is finished at the Texas Gigafactory.




= Hardware 5

=
Musk announced Hardware 5 (HW5), being named AI5, during the Tesla annual meeting on June 13, 2024. Musk stated it is scheduled for release in January 2026, and will be ten times more powerful than HW4. Musk also stated that it will use up to 800 watts when processing complex environments (versus 300 watts for HW3 and HW4).




Feature history






Hardware






Notes






References

Kata Kunci Pencarian:

• Tesla Model S
• Deadman
• Tesla Autopilot hardware
• Tesla Autopilot
• List of Tesla Autopilot crashes
• Tesla, Inc.
• Tesla Model S
• Tesla Dojo
• Tesla Model 3
• Criticism of Tesla, Inc.
• List of Easter eggs in Tesla products
• Mobileye