Tesla: “Full self-driving beta” isn’t designed for full self-driving | Ars Technica Skip to main content Biz & IT Tech Science Policy Cars Gaming & Culture Store Forums Subscribe Close Navigate Store Subscribe Videos Features Reviews RSS Feeds Mobile Site About Ars Staff Directory Contact Us Advertise with Ars Reprints Filter by topic Biz & IT Tech Science Policy Cars Gaming & Culture Store Forums Settings Front page layout Grid List Site theme Black on white White on black Sign in Comment activity Sign up or login to join the discussions! Stay logged in | Having trouble? Sign up to comment and more Sign up Mixed messages — Tesla: “Full self-driving beta” isn’t designed for full self-driving Tesla told California regulators the FSD beta lacks "true autonomous features." Timothy B. Lee - Mar 9, 2021 11:15 pm UTC Enlarge / YouTuber Brandon M captured this drone footage of his Tesla steering toward a parked car in October 2020, shortly after the FSD beta became available to the public. Brandon M / YouTube reader comments 486 with 145 posters participating, including story author Share this story Share on Facebook Share on Twitter Share on Reddit The transparency site PlainSite recently published a pair of letters Tesla wrote to the California Department of Motor Vehicles in late 2020. The letters cast doubt on Elon Musk's optimistic timeline for the development of fully driverless technology. For years, Elon Musk has been predicting that fully driverless technology is right around the corner. At an April 2019 event, Musk predicted that Teslas would be capable of fully driverless operation—known in industry jargon as "level 5"—by the end of 2020. "There's three steps to self-driving," Musk told Tesla investors at the event. "There's being feature complete. Then there's being feature complete to the degree where we think the person in the car does not need to pay attention. And then there's being at a reliability level where we also convince regulators that that is true." Tesla obviously missed Musk's 2020 deadline. But you might be forgiven for thinking Tesla is now belatedly executing the strategy he described two years ago. In October, Tesla released what it called its "full self-driving beta" software to a few-dozen Tesla owners. A few days ago, Musk announced plans to expand the program to more customers. Further Reading “Oh Jeeeesus”: Drivers react to Tesla’s full self-driving beta release Given that the product is called "full self-driving," this might seem like the first step in Musk's three-step progression. After a few more months of testing, perhaps it will become reliable enough to operate without human supervision. That could allow Musk to make good on his latest optimistic timeline for Autopilot: in a December 2020 interview, Musk said he was "extremely confident" that Tesla vehicles would reach level 5 by the end of 2021. But a letter Tesla sent to California regulators the same month had a different tone. Despite the "full self-driving" name, Tesla admitted it doesn't consider the current beta software suitable for fully driverless operation. The company said it wouldn't start testing "true autonomous features" until some unspecified point in the future. “We do not expect significant enhancements” Enlarge In a pair of letters last November and December, officials at the California DMV asked Tesla for details about the FSD beta program. Tesla requires drivers using the beta software to actively supervise it so they can quickly intervene if needed. The DMV wanted to know if Tesla planned to relax requirements for human supervision once the software was made available to the general public. Advertisement In its first response, sent in November, Tesla emphasized that the beta software had limited functionality. Tesla told state regulators that the software is "not capable of recognizing or responding" to "static objects and road debris, emergency vehicles, construction zones, large uncontrolled intersections with multiple incoming ways, occlusions, adverse weather, complicated or adversarial vehicles in the driving path, and unmapped roads." In a December follow-up, Tesla added that "we expect the functionality to remain largely unchanged in a future, full release to the customer fleet." Tesla added that "we do not expect significant enhancements" that would "shift the responsibility for the entire dynamic driving task to the system." The system "will continue to be an SAE Level 2, advanced driver-assistance feature." SAE level 2 is industry jargon for driver-assistance systems that perform functions like lane-keeping and adaptive cruise control. By definition, level 2 systems require continual human oversight. Fully driverless systems—like the taxi service Waymo is operating in the Phoenix area—are considered level 4 systems. In its letter to California officials, Tesla added that "Tesla's development of true autonomous features will follow our iterative process (development, validation, early release, etc.) and any such features will not be released to the general public until we have fully validated them." Critics pounced on the disclosure. "Here it is, straight from Tesla," tweeted prominent Tesla skeptic Ed Niedermeyer. "'Full Self-Driving' is not, and will never be, actually self-driving." This might not be quite fair to Tesla—the company apparently does plan to develop more advanced software eventually. But at a minimum, Tesla's public communication about the full self-driving package could easily give customers the wrong impression about the software's future capabilities. Full autonomy is always right around the corner Enlarge / Elon Musk in 2020. BRENDAN SMIALOWSKI / Getty Since 2016, Tesla has given customers every reason to expect that its "full self-driving" software would be, well, fully self-driving. Early promotional materials for the FSD package described a driver getting out of the vehicle and having it find a parking spot on its own. Tesla has repeatedly talked about the FSD package enabling a Tesla vehicle to operate as an autonomous taxi—an application that requires the car to drive itself without anyone behind the wheel. In 2016, Musk predicted that, within two years, a Tesla owner in Los Angeles would be able to summon their vehicle from New York City. Advertisement Further Reading Tesla’s autonomy event: Impressive progress with an unrealistic timeline If Tesla is really going to achieve fully driverless operation in 2021, that doesn't leave much time to develop, test, and validate complex, safety-critical software. So it would be natural for customers to assume that the software Tesla named "Full Self Driving beta" is, in fact, a beta version of Tesla's long-awaited fully self-driving software. But in its communications with California officials, Tesla makes it clear that's not true. Of course, Elon Musk has a long history of announcing over-optimistic timelines for his products. It's not really news that Tesla failed to meet an optimistic deadline set by its CEO. But there's a deeper philosophical issue that may go beyond a few blown deadlines. The long road to full autonomy Enlarge / Waymo tested its driverless taxis in the Phoenix area for more than three years before beginning driverless commercial operations. Waymo Tesla's overall Autopilot strategy is to start with a driver-assistance system and gradually evolve it into a fully driverless system. A bunch of other companies in the industry—led by Google's Waymo—believe that this is a mistake. They think the requirements of the two products are so different that it makes more sense to create a driverless taxi, shuttle, or delivery service from scratch. In particular, companies like Waymo argue that it's too difficult to get regular customers to pay close attention to an almost-but-not-fully driverless vehicle. If a car drives perfectly for 1,000 miles and then makes a big mistake, there's a significant risk the human driver won't be paying close enough attention to prevent a crash. Waymo initially considered creating an Autopilot-like driver assistance system and licensing it to automakers, but the company ultimately decided that doing so would be too risky. Musk has always shrugged this critique off. As we've seen, he believes improvements to Autopilot's driver-assistance features will transform it into a system capable of fully driverless operation. But in its comments to the DMV, Tesla seems to endorse the opposite viewpoint: that adding "true autonomous features" to Autopilot will require more than just incrementally improving the performance of its existing software. Tesla acknowledged that it needs more sophisticated systems for handling the "static objects, road debris, emergency vehicles, construction zones." And this makes it a little hard to believe Musk's boast that Tesla will achieve level 5 autonomy by the end of 2021. Notably, Google's prototype self-driving vehicles have been able to navigate most roadway conditions—much like today's Tesla FSD beta software—since roughly 2015. Yet the company needed another five years to refine the technology enough to enable fully driverless operation. And that was within a limited geographic area and with help from powerful lidar sensors. Tesla is trying to achieve the same feat for every street nationwide—and using only cameras and radar. Perhaps Tesla will move faster than Waymo, and it won't take another five years to achieve fully driverless operation. But customers considering whether to pay $10,000 for Tesla's full self-driving software package should certainly take Musk's optimistic timeline with a grain of salt. Promoted Comments Frodo Douchebaggins Ars Tribunus Militum jump to post I bought FSD over three years ago when Elon's charisma roll beat my wisdom save. There have been a number of questionable claims, and a few outright lies regarding things that were 100% within their control ( https://web.archive.org/web/20190304232 ... capability being a notable example. TLDR; If you bought FSD and were not thrilled with the price drop after you bought it but well before a single feature was delivered, take heart, for you won’t receive a refund of the difference like an ethical business will do, but you will receive an invite to the early access program and get to use the upcoming features before other people! Except that a month or so later they took down that blog post, and the invites never happened.) I understand that they probably really did think they'd be further along now than they are, but the fact that they're not letting us transfer our FSD license if we want to buy a new car means I'm likely not buying another tesla. It's tantamount to preordering a product and then being told you can't change your shipping address when you move a few years later, and is a slap in the face to the early FSD buyers who have received only a single small feature for that money. Why would I give them more money after what they've done? Their pride is costing them their relationship with the customers that should be the most loyal, and they're doing it over something that costs them nothing except flipping a bit each on the current car and the new car, and for that they get to sell another car. At this point I think we have to be close to large class actions finally emerging, and while they won't help us get what we paid for, and won't get our money back, maybe it'll hurt enough to make them stop over promising and underdelivering 2710 posts | registered 12/17/2012 nimble Ars Centurion et Subscriptor jump to post jeffpkamp wrote: Soon tesla will have four assist levels. Autopilot, Full Self driving, level 5, and , no-for-real-la-to-ny-without-assistance (NFRLNWA). But all joking and sarcasm aside. I've watched probably 2 hours of FSD beta videos, and the only thing that really seemed to give the car trouble was roundabouts. Residential level streets, busy commercial streets, and highways were all navigated with relatives from what I could see. And the computer seemed to be accurately picking up everything important. There were some hilarious glitches as the CV software tried to classify things like turning semi trucks, but it got the positions right. Honestly I think this is just a report from someone who speaks fluent bureaucrat, which Elon obviously does not. In terms of achieving full unmonitored self driving, a video like that means very little. It can demonstrate that the car did the right thing in the particular circumstances of the video. It says next to nothing about how reliably it can do it, nor whether it can deal with the enormous range of possible situations that aren't in the video. For such a video to be meaningful, it would need to be hundeds of thousands of hours long, contain a random selection of driving situations that the software is expected to deal with, and show that no driver interventions were required. In other words, it's only large scale statistics that can demonstrate whether self driving systems are safe, not a bunch of short and quite possibly cherry-picked video clips. The good news is that Tesla are collecting those statistics. The bad news is that they're not sharing them. https://www.forbes.com/sites/bradtemple ... 95cc0f7fab 216 posts | registered 5/30/2005 reader comments 486 with 145 posters participating, including story author Share this story Share on Facebook Share on Twitter Share on Reddit Timothy B. Lee Timothy is a senior reporter covering tech policy, blockchain technologies and the future of transportation. He lives in Washington DC. Email timothy.lee@arstechnica.com // Twitter @binarybits Advertisement You must login or create an account to comment. Channel Ars Technica ← Previous story Next story → Related Stories Sponsored Stories Powered by Today on Ars Store Subscribe About Us RSS Feeds View Mobile Site Contact Us Staff Advertise with us Reprints Newsletter Signup Join the Ars Orbital Transmission mailing list to get weekly updates delivered to your inbox. Sign me up → CNMN Collection WIRED Media Group © 2021 Condé Nast. All rights reserved. Use of and/or registration on any portion of this site constitutes acceptance of our User Agreement (updated 1/1/20) and Privacy Policy and Cookie Statement (updated 1/1/20) and Ars Technica Addendum (effective 8/21/2018). Ars may earn compensation on sales from links on this site. Read our affiliate link policy. Your California Privacy Rights | Do Not Sell My Personal Information The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of Condé Nast. Ad Choices