One day I’ll be Luke Skywalker

Cyril Clocher

What happens when you blend ADAS with infotainment? Guest post by Cyril Clocher, business manager for automotive processors at Texas Instruments

As we all begin preparing for our trek to Vegas for CES 2015, I would like my young friends (born in the 70s, of course) to reflect on their impressions of the first episode of Lucas’s trilogy back in 1977. On my side, I perfectly remember thinking one day I would be Luke Skywalker.

The eyes of young boys and girls were literally amazed by this epic space opera and particularly by technologies used by our heroes to fight the Galactic Empire. You have to remember it was an era where we still used rotary phones and GPS was in its infancy. So you can imagine how impactful it was for us to see our favorite characters using wireless electronic gadgets with revolutionary HMIs such as natural voice recognition, gesture controls or touch screens; droids speaking and enhancing human intelligence; and autonomous vehicles traveling the galaxy safely while playing chess with a Wookiee. Now you’re with me…

But instead of becoming Luke Skywalker a lot of us realized that we would have a bigger impact by inventing or engineering these technologies and by transforming early concepts into real products we all use today. As a result, smartphones and wireless connectivity are now in our everyday lives; the Internet of Things (IoT) is getting more popular in applications such as activity trackers that monitor personal metrics; and our kids are more used to touch screens than mice or keyboards, and cannot think of on-line gaming without gesture control. In fact, I just used voice recognition to upgrade the Wi-Fi plan from my Telco provider.

But the journey is not over yet. Our generation has still to deliver an autonomous vehicle that is green, safe, and fun to control – I think the word “drive” will be obsolete for such a vehicle.

The automotive industry has taken several steps to achieve this exciting goal, including integration of advanced and connected in-car infotainment systems in more models as well as a number of technologies categorized under Advanced Driver Assistance Systems (ADAS) that can create a safer and unique driving experience. From more than a decade, Texas Instruments has invested in infotainment and ADAS: “Jacinto” and TDAx automotive processors as well as the many analog companion chips supporting these trends.

"Jacinto 6 EP" and "Jacinto 6 Ex"
infotainment processors

A unique approach of TI is our capability to leverage best of both worlds for non-safety critical features, and to provide a seamless integration of informational ADAS functions into existing infotainment systems so the vehicle better informs and warns the driver. We announced that capability at SAE Convergence in Detroit in October 2014 with the “Jacinto 6 Ex” processor (DRA756), which contains powerful CPU, graphics multimedia, and radio cores with differentiated vision co-processors, called embedded vision engines (EVE), and additional DSPs that perform the complex ADAS processing.

For the TI’s automotive team, the CES 2015 show is even more exciting than in previous years, as we’ve taken our concept of informational ADAS to the next step. With joint efforts and hard work from both TI and QNX teams, we’ve together implemented a real informational ADAS system running the QNX CAR™ Platform for Infotainment on a “Jacinto 6 Ex” processor.

I could try describing this system in detail, but just like the Star Wars movies, it’s best to experience our “Jacinto 6 Ex” and QNX CAR Platform-based system in person. Contact your TI or QNX representative today and schedule a meeting to visit our private suite at CES at the TI Village (N115-N119) or to immerse yourself in a combined IVI, cluster, megapixel surround view, and DLP® based HUD display with augmented reality running on a single “Jacinto 6 Ex” SoC demonstration. And don't forget to visit the QNX booth (2231), where you can see the QNX reference vehicle running a variety of ADAS and infotainment applications on “Jacinto 6” processors.

Integrated cockpit featuring DLP powered HUD and QNX CAR Platform running on a single “Jacinto 6 Ex” SoC.

One day I’ll experience Skywalker’s life as I will no doubt have the opportunity to control an intelligent and autonomous vehicle with my biometrics, voice, and gestures while riding with my family to the movie theater playing chess with my grandkids, not yet a Wookiee.

Volvo to ship self-driving cars in 2014

Yes, you read that right. According to an article published yesterday in the Wall Street Journal, the Swedish car maker has stated that, within two years, it will launch cars that can drive themselves at speeds of up to 31 miles per hour. It's all part of an ambitious plan to produce "accident free" vehicles by 2020.

I knew that some automakers were planning to roll out their first autonomous vehicles in the relatively near future. It seems that one automaker has decided to eliminate the "relatively".

Who will foot the legal bill for your self-driving car?

If a self-driving car gets in an accident and hurts someone, who is at fault? This isn’t an academic question. Unless automakers get a consistent answer as to whom will be held accountable, and when, the era of autonomous vehicles may be off to a rocky start.

Ideally, automakers would like to see regulations set at the federal level: one set of rules for each entire country, rather than different rules for each province, state, county, or region. That may or may not happen. For instance, only a small number of states in the U.S. allow self-driving cars to be tested on their roadways, but already, the laws governing liability vary from state to state. (I assume that, in the European Union, such laws would be consistent from country to country — please comment if I assume incorrectly.)

This inconsistency is but one of the legal roadblocks to a self-driving future, according to a recent article published by Law360.com. For instance, the article also discusses how an automaker may be subject to liability claims if it simply designs a vehicle in a way that allows someone to install driverless technology.

Will all this put a stop to self-driving cars? Don’t count on it. People will inevitably demand cars with autonomous capabilities, if a recent survey is anything to go by. And automakers will get in the game if for no other reason than to stay competitive and attract customers (which, when you think of it, is the raison d’être of any business).

In fact, automakers may have little choice. According to Law360, some automakers have been subject to lawsuits because they didn’t install electronic stability control in their vehicles, a technology known to save thousands of lives annually. If some self-driving technologies can indeed reduce accidents, as research suggests, then automakers may, in effect, be forced to deploy them. And call me naïve, but I assume that governments could likewise be held accountable if they implement laws that slow the deployment of accident-reducing technology.

My take? It seems to be in everyone’s interest to make the self-driving car happen.

Read the full Law360 article here. Registration is required, but is fast and painless.

Look ma, no driver!

Some of us talk about autonomous cars, some of us dream of owning one, and some of us actually get to ride in one. Andy Gryc is one of the latter. Head over to his blog to see a video he took while being chauffeured in a self-driving vehicle developed at the University of Parma — think of it as the ultimate in hands-free systems.

Would this be an awesome way to tour Italy, or what?

What if…

Imagine if your car could help you become more connected to friends and family — and to the road ahead. Enter a new video that peers into the not-so-distant future.

It blows my mind, but some people still see connectivity in the car as the enemy. They think that, the more connected the car, the more distracting and dangerous it will be. But you know what? Responding to their concerns is easy. I simply ask them what if.

For instance, what if connectivity helped you drive with greater situational awareness? What if it helped you sidestep traffic jams and axle-busting pot holes? What if it helped you detect a stop sign hidden behind a tree? And what if it helped you become more connected to the people important to you, as well as to the road and the cars around you?

When we talk connectivity at QNX, that’s the kind of connectivity we envision. It isn’t just about Bluetooth or Wi-Fi or LTE — that’s only the plumbing. Rather, it’s about keeping you in tune and in sync with your car, your environment, your business, your friends. Your life.

A need for speed... and safety

Matt Shumsky

For me, cars and safety go hand in hand. Don’t get me wrong, I have a need for speed. I do, after all, drive a 2006 compact with 140 HP (pause for laughter). But no one, and I mean no one, wants to be barreling down a highway in icy conditions at 120 km/hr without working brakes, am I right?

So this begs the question, what’s the best way to design a software system that ensures the adaptive cruise control system keeps a safe distance from the car ahead? Or that tells the digital instrument cluster the correct information to display? And how can you make sure the display information isn’t corrupted?

Enter QNX and the ISO 26262 functional safety standard.

QNX Software Systems is partnering with LDRA to present a webinar on “Ensuring Automotive Functional Safety”. During this webinar, you’ll learn about:

• Development and verification tools proven to help provide safer automotive software systems
• How suppliers can develop software systems faster with an OS tuned for automotive safety

Ensuring Automotive Functional Safety with QNX and LDRA
Thursday, November 20, 2014
9:00 am PST / 12:00 pm EST / 5:00 pm UTC

I hope you can join us!

Japan update: ADAS, wearables, integrated cockpits, and autonomous cars

Yoshiki Chubachi

Will the joy of driving be a design criterion for tomorrow’s vehicles? It had better be.

A couple of weeks ago, QNX Software Systems sponsored Telematics Japan in Tokyo. This event offers a great opportunity to catch up with colleagues from automotive companies, discuss technology and business trends, and showcase the latest technology demos. Speaking of which, here’s a photo of me with a Japan-localized demo of the QNX CAR Platform. You can also see a QNX-based digital instrument cluster in the lower-left corner — this was developed by Three D, one of our local technology partners:



While at the event, I spoke on the panel, “Evolving ecosystems for future HMI, OS, and telematics platform development.” During the discussion, we conducted a real-time poll and asked the audience three questions:

1) Do you think having Apple CarPlay and Android Auto will augment a vehicle brand?
2) Do you expect wearable technologies to be integrated into cars?
3) If your rental car were hacked, who would you complain to?

For question 1, 32% of the audience said CarPlay and Android Auto will improve a brand; 68% didn't think so. In my opinion, this result indicates that smartphone connectivity in cars is now an expected feature. For question 2, 76% answered that they expect to see wearables integrated into cars. This response gives us a new perspective — people are looking at wearables as a possible addition to go with ADAS systems. For example, a wearable device could help prevent accidents by monitoring the driver for drowsiness and other dangerous signs. For question 3, 68% said they would complain to the rental company. Mind you, this raises the question: if your own car were hacked, who would you complain to?

Integrated cockpits
There is growing concern around safety and security as companies attempt to grow more business by leveraging connectivity in cars. The trend is apparent if you look at the number of safety- and security-related demos at various automotive shows.

Case in point: I recently attended a private automotive event hosted by Renesas, where many ADAS and integrated cockpit demos were on display. And last month, CEATEC Japan (aka the CES of Japan) featured integrated cockpit demos from companies like Fujitsu, Pioneer, Mitsubishi, Kyocera, and NTT Docomo.

For the joy of it
Things are so different from when I first started developing in-car navigation systems 20 years ago. Infotainment systems are now turning into integrated cockpits. In Japan, the automotive industry is looking at early 2020s as the time when commercially available autonomous cars will be on the road. In the coming years, the in-car environment, including infotainment, cameras and other systems, will change immensely — I’m not exactly sure what cars in the year 2020 will look like, but I know it will be something I could never have imagined 20 years ago.

A panel participant at Telematics Japan said to me, “If autonomous cars become reality and my car is not going to let me drive anymore, I am not sure what the point of having a car is.” This is true. As we continue to develop for future cars, we may want to remind ourselves of the “joy of driving” factor.

What happens when autonomous becomes ubiquitous?

Seventeen ways in which the self-driving car will transform how we live.

Let’s speculate that at least 25% of cars on the road are autonomous — and that those cars are sufficiently advanced to operate without a human driver. Let’s also assume that the legal issues have been sorted out somehow.

How would this impact society?

• The elderly could maintain their independence. Even if they have lost the ability to drive, they could still get groceries, go to appointments, visit family and friends, or just go for a drive.
   
• Cars could chauffer intoxicated folks safely home — no more drunk drivers.
   
• Municipalities could get rid of buses and trains, and replace them with fleets of vehicles that would pick people up and drop them off exactly where they want to go. Mass transit would become individual transit.
   
• Car sharing would become more popular, as the cost could be spread among multiple people. Friends, family members, or neighbors could chip in to own a single car, reducing pollution as well as costs. The cars would shuffle themselves to where they are needed, depending on everyone’s individual needs.
   
• Fewer vehicles would be produced, but they would be more expensive. This could drive some smaller automakers out of business or force more industry consolidation.
   
• Cities could get rid of most parking lots and garages, freeing up valuable real estate for homes, businesses, or parks.
   
• Taxi companies would either go out of business or convert over to autonomous piloted vehicles. Each taxi could be equipped with anti-theft measures, alerting police if, say, the taxi detects it is being boarded onto a truck.
   
• We could have fewer roads with higher capacities. Self-directed cars would be better equipped to negotiate inter-vehicle space, being more “polite” to other vehicles; they would also enable greater traffic density.
   
• Instead of creating traffic jams, heavy traffic would maintain a steady pace, since the vehicles would operate as a single platoon.
   
• Autonomous cars could completely avoid roads under construction and scatter themselves evenly throughout the surrounding route corridors to minimize the impact on detour routes.
   
• There would be no more hunting for parking spots downtown. Instead, people could tell their cars to go find a nearby parking spot and use their smartphones to summon the cars back once they’re ready to leave.
   
• Concerts or sporting events would operate more smoothly, as cars could coordinate where they’re parking. The flow of vehicles exiting from events would be more like a ballet than a mosh pit.
   
• Kids growing up with autonomous cars would enjoy a new level of independence. They could get to soccer games without needing mom or dad to drive them. Parents could program the car to drive the children to fixed destinations: sports game and home.
   
• School buses could become a thing of the past. School boards could manage fleets of cars that would pick up the children as needed by geographic grouping.
   
• You could send your car out for errands, and companies would spring up to cater to “driverless” cars. For example, you could set up your grocery list online and send your car to pick them up; a clerk would fill your car with your groceries when it shows up at the supermarket.
   
• Rental car companies could start offering cars that come to you when you need them. Renting cars may become more popular than owning them, since people who drive infrequently could pay by the ride, as opposed to paying the capital cost of owning a vehicle.
   
• Cars would become like living rooms and people would enjoy the ride like never before — reading, conversing, exercising, watching TV. Some people may even give up their home to adopt a completely mobile existence.
   

Autonomous cars? Suddenly, I’m not so skeptical

Guest post from Emil Dautovic, European automotive business development manager for QNX Software Systems

As a driving enthusiast, I have always felt a bit skeptical about the notion of autonomous cars. The reason is simple: I actually enjoy driving and don’t want someone else to do it for me, in this case the car itself.

Recently, however, my skepticism has begun to soften. I am fascinated, for example, by the SARTRE road train project, where a lead vehicle takes responsibility for a platoon of semi-autonomous cars. Also, recent research from the U.S. Highway Loss Data Institute suggests that, when it comes to some driving tasks, ADAS systems can already put many human drivers to shame.

Autonomous drive will become especially important when today’s “always on” generation starts to buy cars in earnest. They will, no doubt, want to consume multimedia and interact through social media even while on the road, and automakers will need to accommodate them.

HMIs with more (and less) distraction
What would this mean for car makers? Among other things, the infotainment system in a self-driving car could offer an HMI mode that gives the driver more freedom to pay attention to non-driving activities. When the car subsequently needs a human driver (for instance, it becomes disconnected from a road train), the infotainment system could disable these features and immediately go back to a less distracting user interface.

Also, driver assist systems — such as those for detecting animals and pedestrians — would need to be integrated with the road train system to decide how to react when, say, a rabbit runs in front of the car. For instance, should the car brake and warn other cars of the fact, or would it be safer to simply keep driving? It will be interesting to follow this initiative and see how the technical and business aspects evolve, and how, for example, the owner of the lead vehicle will be paid.

For another interesting example of research into autonomous drive, check out the BRAiVE project led by the VisLab team at the University of Parma. The BRAiVE project uses a variety of sensors, with a focus on low-cost alternatives that could realistically integrated into in production cars.

Bells and whistles
So what kind of impact could all this have on a company providing automotive software platforms?

There will, I believe, be an increased demand for a platform that could run all of these applications, enabling the advanced use cases while ensuring that critical functions always have enough processor power. And, of course, the platform will have to be reliable. If this same platform could offer all the bells and whistles available in consumer electronics and demanded by younger drivers, the self-driving future might prove to be a bit closer than we think.

By the way, if you’re unfamiliar with the SARTRE road train project, check out this video:

---

More about Emil
Emil Dautovic is an automotive business development manager at QNX Software Systems, where he is responsible for the European automotive market. Prior to joining QNX, he worked as a business area manager for The Astonishing Tribe (TAT), where he built TAT's automotive business from scratch and helped transform the company into an important player in the automotive HMI field with leading automotive OEMs and tier ones. He has also worked at AU-System (later Teleca and Obigo), where he served as a consultant on GSM base station development and as a sales representative serving mobile phone OEMs and ODMs worldwide. Emil holds an M.Sc. in Electronic Engineering from Lunds Tekniska Högskola.

Top 10 challenges facing the ADAS industry

Tina Jeffrey

It didn’t take long. Just months after the release of the ISO 26262 automotive functional safety standard in 2011, the auto industry began to grasp its importance and adopt it in a big way. Safety certification is gaining traction in the industry as automakers introduce advanced driver assistance systems (ADAS), digital instrument clusters, heads-up displays, and other new technologies in their vehicles.

Governments around the world, in particular those of the United States and the European Union, are calling for the standardization of ADAS features. Meanwhile, consumers are demonstrating a readiness to adopt these systems to make their driving experience safer. In fact, vehicle safety rating systems are becoming a vital ‘go to’ information resource for new car buyers. Take, for example, the European New Car Assessment Programme Advanced (Euro NCAP Advanced). This organization publishes safety ratings on cars that employ technologies with scientifically proven safety benefits for drivers. The emergence of these ratings encourages automakers to exceed minimum statutory requirements for new cars.

Sizing the ADAS market
ABI Research claims that the global ADAS market, estimated at US$16.6 billion at the end of 2012, will grow to more than US$260 billion by the end of 2020, representing a CAGR of 41%. Which means that cars will ship with more of the following types of safety-certified systems:



The 10 challenges
So what are the challenges that ADAS suppliers face when bringing systems to market? Here, in my opinion, are the top 10:

1. Safety must be embedded in the culture of every organization in the supply chain. ADAS suppliers can't treat safety as an afterthought that is tacked on at the end of development; rather, they must embed it into their development practices, processes, and corporate culture. To comply with ISO 26262, an ADAS supplier must establish procedures associated with safety standards, such as design guidelines, coding standards and reviews, and impact analysis procedures. It must also implement processes to assure accountability and traceability for decisions. These processes provide appropriate checks and balances and allow for safety and quality issues to be addressed as early as possible in the development cycle.
    
2. ADAS systems are a collaborative effort. Most ADAS systems must integrate intellectual properties from a number of technology partners; they are too complex to be developed in isolation by a single supplier. Also, in a safety-certified ADAS system, every component must be certified — from the underlying hardware (be it a multi-core processor, GPU, FPGA, or DSP) to the OS, middleware, algorithms, and application code. As for the application code, it must be certified to the appropriate automotive safety integrity level; the level for the ADAS applications listed above is typically ASIL D, the highest level of ISO 26262 certification.
    
3. Systems may need to comply with multiple industry guidelines or specifications. Besides ISO 26262, ADAS systems may need to comply with additional criteria, as dictated by the tier one supplier or automaker. On the software side, these criteria may include AUTOSAR or MISRA. On the hardware side, they will include AEC-Q100 qualification, which involves reliability testing of auto-grade ICs at various temperature grades. ICs must function reliably over temperature ranges that span -40 degrees C to 150 degrees C, depending on the system.
    
4. ADAS development costs are high. These systems are expensive to build. To achieve economies of scale, they must be targeted at mid- and low-end vehicle segments. Prices will then decline as volume grows and development costs are amortized, enabling more widespread adoption.
    
5. The industry lacks interoperability specifications for radar, laser, and video data in the car network. For audio-video data alone, automakers use multiple data communication standards, including MOST (media-oriented system transport), Ethernet AVB, and LVDS. As such, systems must support a multitude of interfaces to ensure adoption across a broad spectrum of possible interfaces. Also, systems may need additional interfaces to support radar or lidar data.
    
6. The industry lacks standards for embedded vision-processing algorithms. Ask 5 different developers to develop a lane departure warning system and you’ll get 5 different solutions. Each solution will likely start with a Matlab implementation that is ported to run on the selected hardware. If the developer is fortunate, the silicon will support image processing primitives (a library of functions designed for use with the hardware) to accelerate development. TI, for instance, has a set of image and video processing libraries (IMGLIB and VLIB) optimized for their silicon. These libraries serve as building blocks for embedded vision processing applications. For instance, IMGLIB has edge detection functions that could be used in a lane departure warning application.
    
7. Data acquisition and data processing for vision-based systems is high-bandwidth and computationally intensive. Vision-based ADAS systems present their own set of technical challenges. Different systems require different image sensors operating at different resolutions, frame rates, and lighting conditions. A system that performs high-speed forward-facing driver assistance functions such as road sign detection, lane departure warning, and autonomous emergency breaking must support a higher frame rate and resolution than a rear-view camera that performs obstacle detection. (A rear-view camera typically operates at low speeds, and obstacles in the field of view are in close proximity to the vehicle.) Compared to the rear-view camera, an LDW, AEB, or RSD system must acquire and process more incoming data at a faster incoming frame rate, before signaling the driver of an unintentional lane drift or warning the driver that the vehicle is exceeding the posted speed limit.
    
8. ADAS cannot add to driver distraction. There is an increase in the complexity of in-vehicle tasks and displays that can result in driver information overload. Systems are becoming more integrated and are presenting more data to the driver. Information overload could result in high cognitive workload, reducing situational awareness and countering the efficacy of ADAS. Systems must therefore be easy to use and should make use of the most appropriate modalities (visual, manual, tactile, sound, haptic, etc.) and be designed to encourage driver adoption. Development teams must establish a clear specification of the driver-vehicle interface early on in development to ensure user and system requirements are aligned.
    
9. Environmental factors affect ADAS. ADAS systems must function under a variety of weather and lighting conditions. Ideally, vision-based systems should be smart enough to understand when they are operating in poor visibility scenarios such as heavy fog or snow, or when direct sunlight shines into the lens. If the system detects that the lens is occluded or that the lighting conditions are unfavorable, it can disable itself and warn the driver that it is non-operational. Another example is an ultrasonic parking sensor that becomes prone to false positives when encrusted with mud. Combining the results of different sensors or different sensor technologies (sensor fusion) can often provide a more effective solution than using a single technology in isolation.
    
10. Testing and validating is an enormous undertaking. Arguably, testing and validation is the most challenging aspect of ADAS development, especially when it comes to vision systems. Prior to deploying a commercial vision system, an ADAS development team must amass hundreds if not thousands of hours of video clips in a regression test database, in an effort to test all scenarios. The ultimate goal is to achieve 100% accuracy and zero false positives under all possible conditions: traffic, weather, number of obstacles or pedestrians in the scene, etc. But how can the team be sure that the test database comprises all test cases? The reality is that they cannot — which is why suppliers spend years testing and validating systems, and performing extensive real-world field-trials in various geographies, prior to commercial deployment.
     

There are many hurdles to bringing ADAS to mainstream vehicles, but clearly, they are surmountable. ADAS systems are commercially available today, consumer demand is high, and the path towards widespread adoption is paved. If consumer acceptance of ADAS provides any indication of societal acceptance of autonomous drive, we’re well on our way.

Are you ready to stop micromanaging your car?

I will get to the above question. Honest. But before I do, allow me to pose another one: When autonomous cars go mainstream, will anyone even notice?

The answer to this question depends on how you define the term. If you mean completely and absolutely autonomous, with no need for a steering wheel, gas pedal, or brake pedal, then yes, most people will notice. But long before these devices stop being built into cars, another phenomenon will occur: people will stop using them.

Allow me to rewind. Last week, Tesla announced that its Model S will soon be able to “steer to stay within a lane, change lanes with the simple tap of a turn signal, and manage speed by reading road signs and using traffic-aware cruise control.” I say soon because these functions won't be activated until owners download a software update in the coming weeks. But man, what an update.

Tesla may now be at the front of the ADAS wave, but the wave was already forming — and growing. Increasingly, cars are taking over mundane or hard-to-perform tasks, and they will only become better at them as time goes on. Whether it’s autonomous braking, automatic parking, hill-descent control, adaptive cruise control, or, in the case of the Tesla S, intelligent speed adaptation, cars will do more of the driving and, in so doing, socialize us into trusting them with even more driving tasks.

Tesla Model S: soon with autopilot

In other words, the next car you buy will prepare you for not having to drive the car after that.

You know what’s funny? At some point, the computers in cars will probably become safer drivers than humans. The humans will know it, but they will still clamor for steering wheels, brake pedals, and all the other traditional accoutrements of driving. Because people like control. Or, at the very least, the feeling that control is there if you want it.

It’s like cameras. I would never think of buying a camera that didn’t have full manual mode. Because control! But guess what: I almost never turn the mode selector to M. More often than not, it’s set to Program or Aperture Priority, because both of these semi-automated modes are good enough, and both allow me to focus on taking the picture, not on micromanaging my camera.

What about you? Are you ready for a car that needs a little less micromanagement?

Trend Spotting at SAE Convergence 2012

Guest post from automotive journalist Doug Newcomb

One of the Technical Sessions at the semi-annual SAE Convergence in Detroit on October 16 and 17 is titled Mega Trends and Their Effect on Automotive Electronics. While you’ll have to wait to find out what the participating executives, engineers, and analysts will reveal in the session concerning the rapidly evolving car technology space, here are three areas that are bound to be hot topics at the show.

Driver Distraction
This issue is at the forefront of everyone’s minds — automakers, suppliers, safety advocates, government officials, and consumers — as cars become increasingly connected. In order to help drivers keep their eyes on the road and hands on the wheel while still accessing the features they want, car companies and suppliers like QNX are developing cutting-edge technologies ranging from intuitive and configurable touchscreen displays to more accurate voice-activation systems that make control easier and less distracting.

Automakers are also being proactive in anticipating distractions: Ford is developing technology that assesses a driver’s workload so that some features can be deactivated in certain situations, and BMW’s pioneering work in “pupilometry” helps determine how drivers visually react when receiving information behind the wheel.



Ford's driver workload estimator (source Ford)

Standards
As more automakers integrate portable devices into the dash, drivers are increasingly frustrated by the fragmentation that’s occurring with first-generation systems. Features that are available for one smartphone platform may not be available for another, for example, and incompatibility issues are common. A push for an industry-wide standard has resulted in the Car Connectivity Consortium (CCC), of which QNX is a member. With MirrorLink, CCC’s industry-wide standard, portable device integration would be more straightforward and seamless for consumers. Getting all parties onboard will take significant effort though, since automakers have traditionally developed proprietary systems. But MirrorLink has substantial support, and the HomeLink system that’s allowed integration of garage-door openers into vehicles for years shows that such standards can be achieved.

Autonomous Cars
Two years ago, self-driving cars would have seemed like a distant sci-fi dream. But since the last SAE Convergence in 2010, Google has logged more than a quarter of a million miles with its fleet of self-driving Toyota Prius and Lexus RX450h vehicles. And this year the company has been instrumental in pushing through legislation that’s made self-driving cars legal in Nevada and California.

Audi is another pioneer in the space, developing an autonomous TT that drove solo up Colorado’s Pikes Peak. BWM has also debuted self-driving technology, and Cadillac recently revealed that its semi-autonomous Super Cruise lane-keeping technology will be available by the middle of the decade. Plus, Google’s announcement of its intention at the SAE World Congress in April to work directly with automakers and suppliers on self-driving technology will undoubtedly help accelerate this game-changing trend.

These are three topics are sure to be heavily discussed — and debated — at SAE Convergence 2012. Stop by the QNX booth during the show to see what the company is doing in these and other areas — or to share what trends you’ve spotted.

---

More about Doug
A widely respected reporter and editor with nearly three decades of experience in automotive journalism, Doug Newcomb currently writes for WIRED Autopia and for his own car technology portal, dougnewcomb.com. In 2008, he joined Edmunds.com as a senior editor, where he created the site’s Car Technology section. Prior to Edmunds, he worked as an editor for a variety of automotive publications, including Car Audio and Electronics, Car Stereo Review, and Road&Track Road Gear; he also contributed to many others, including Popular Mechanics, MSN Autos, Corvette Quarterly, and SEMA News. In 2008, he published his first book, Car Audio for Dummies (Wiley).

Squeezing into a tight spot

Paul Leroux

No doubt about it, autonomous and semi-autonomous cars will present a variety of legal and ethical challenges. But they'll also offer many benefits — some of which will be pleasantly surprising.

Take parking, for example. Cars are getting wider, but parking spaces generally aren't. So how do you squeeze into a tight spot and then step out of your car without slamming your door into the car next to you? Well, what if you didn't have to be in the car? This new video from Ford tells all...



This technology is cool, especially for aging drivers who can't crane their necks as well as they used to. Still, some gotchas come to mind. For instance, other drivers might get peeved if you momentarily leave your car on the road so you can park it remotely. Also, what if you squeeze your car into a tight parking spot just inches away from driver's door of the adjacent car — but that car doesn't support remote-controlled parking? How will the driver get back into his or her vehicle?

That said, these problems can be avoided with a little common sense on the part of the user. And I'll bet you dimes to donuts that this new technology from Ford can negotiate parking spaces more adroitly than most motorists. Which means that, eventually, we'll all have vehicles with fewer bumps, scuffs, and scratches. I could live with that.

Will adaptive cruise control spell the end of traffic jams?

Did you know that rear-end collisions account for about 30% of car crashes? For that reason alone, widespread adoption of adaptive cruise control (ACC) can’t come too soon. ACC helps prevent such collisions in two ways: 1) by maintaining a safe, preset distance from the car ahead; and 2) by applying the brakes quickly if that car comes to a sudden stop — more quickly, in fact, than most humans.

Good news is, ACC may soon become pervasive. The folks at Global Industry Analysts crunched some numbers and determined that annual installations of ACC systems will reach 6.9 million units by 2017.

Mind you, ACC isn’t just about safety; it’s also about traffic flow. For instance, a study by Suzuki and Nakatsuji (2003) suggests that travel times shrink significantly when at least 20% of vehicles on the road use ACC. And a study by Kesting et al. (2008) suggests that, in some scenarios, traffic congestion simply disappears when 25% of vehicles use ACC.

Example of adaptive cruise control
Source: Volvo

The picture isn’t all rosy, however. ACC may improve traffic flow, but not in every situation, such as merging from an on-ramp onto a freeway. That said, a study by L. C. Davis (2010) suggests that a technique called cooperative merging can significantly the improve the performance of ACC in this scenario. Meanwhile, a study by Jerath and Brennan (2010) suggests that the benefits associated with ACC may come at a possible cost — “self-organized” traffic jams. This effect, caused mostly by human behavior, may occur in a traffic system where most, but not all, cars use ACC.

Caveats aside, ACC systems continue to evolve. Some drivers tend to slam their brakes and use heavy throttle in traffic, creating congestive shockwaves that ripple down the highway. According to J.C. Power, newer versions of ACC help alleviate this problem by smoothly modulating brakes and throttle in stop-and-go traffic.

And now, a look at ACC from 1939…
If you think the concept of ACC is relatively new, think again. Over 70 years ago, GM created a “Futurama” exhibit for the 1939 World's Fair that showcased a scale-model highway in which cars automatically maintain a safe, efficient distance from one another.

GM predicted this technology would be in place by 1960. They got the timing wrong, but the idea right. Click the video to see a surprisingly prescient look at the car of the future — I’ve already bookmarked the spot for you:



What about you? Have you had much experience with ACC? And if so, has it helped or hindered your driving experience?

QNX automotive summit in Shanghai: the recap

Guest post from Alan Zhang, technical solutions manager, QNX Software Systems

Alan Zhang

On August 27 the QNX Automotive Summit returned to China, bringing together global automotive leaders in beautiful downtown Shanghai. Despite the morning traffic, by 9:30 a.m. more than 130 delegates from the automotive industry had filled up the Grand Ball Room at Ritz-Carlton, Pudong. The number of delegates exceeded our expectations — our event manager Alison had to ask the hotel for extra chairs!

The theme of the summit was “explore new opportunities in automotive and mobile convergence”. The convergence of the car and the smartphone is becoming a universal topic, but China is a particularly interesting place to discuss this subject: not only is the prevalence of the car relatively new, but the country is already the world’s largest automotive market. Competition is fierce — the leaders gathered at the summit shared their expert insights for winning new and unique automotive opportunities in China.

Mission-critical pedigree: Derek Kuhn
delivers his opening remarks.

The word from Audi, AutoNavi, Foryou, Harman
Derek Kuhn, QNX vice president of sales and marketing, got things rolling with a talk on how our mission-critical pedigree and mobile experience help automotive companies address the challenges of the connected car. Following Derek were Xiaodan Tang of Audi China and Tong Zao of Harman International who shared their views on automotive trends from the OEM and tier one perspectives.

The day before the summit, we hosted a press conference announcing our collaborations with the Chinese companies AutoNavi and Foryou. The press event attracted 37 journalists, all curious to hear about our strategy for China and who in China we are working with (see our recent posts on AutoNavi and Foryou). On the summit day we were honored to have guest speakers from these companies — Yongqi Yang, executive VP of AutoNavi, and Zou Hong, director of product management, Foryou.

Autonomous drive
In China, collaboration with the government and academia is a key topic in the automotive industry. Jin Xu, our global education program manager, and Professor T. John Koo from Shenzhen Institute of Advanced Technologies, Chinese Academy of Sciences (SIAT CAS), shared a session titled “Shaping Future Cars in China: Research and Education.” Professor Koo leads research using QNX software at SIAT CAS and has been involved in autonomous drive research since 2003, long before the word ADAS existed. Jin introduced QNX Software Systems’ academic initiatives in China and how we are enabling future automotive engineers.

Global reach, local services
Deploying services and features that are regionally relevant is a key challenge for global automotive companies. Weiyu Liang, our director of engineering services for APAC, spoke on QNX engineering services and how we support local customers. Localization is hugely important for anybody targeting the China market. Our last guest speaker, Suo fei Li of Baidu, provider of the biggest Chinese language search engine, spoke on how Baidu can work with automotive companies as a trusted partner rather than as just a supplier. A Baidu application running on the QNX CAR Platform was also shown at the event along with the latest features included in version 2.1.

Our hardware partners Altera, Elektrobit, Freescale, NVIDIA, Renesas, TI, Xilinx were also on hand, showcasing their latest automotive demos.

A unique combination
Andrew Poliak, our automotive business development director, delivered the closing presentation. Tying together various discussions that happened throughout the day, Andrew’s speech focused on QNX advantages such as platform flexibility, HMI options, advanced acoustic technology, and our unique ability to combine all of the above with functional safety. This all tied into our event theme — enabling automotive customers and giving them competitive edge to seize the new and unique opportunities in China.

---

Summit at a glance — a pictorial overview from QNX marketing manager Noko Kataoko

So many people were in the room, the camera couldn't fit them all in. Next year, we'll have to invest in a wider lens: ;-)



Taking QNX for a drive. The exhibit hall featured several QNX automotive partners, including Altera, Elektrobit, Freescale, NVIDIA, Renesas, TI, and Xilinx:



The summit included talks from Audi, AutoNavi, Foryou, Harman, QNX, and the Shenzhen Institute of Advanced Technologies. Speakers included our own Andrew Poliak, who looks like he's discussing the virtues of the QNX logo, but is in fact pointing to his presentation on stage right:



Did I mention there was a draw for a shiny new Nikon camera? Did I mention I didn't win? Did I mention it's because, as a QNX employee, I wasn't allowed to participate? Now don't get me wrong, I'm not bitter, or anything...



Mmm... don't they look good? Besides getting a taste of what's in store for the connected car, attendees got to enjoy some other tastes as well:

Drivers want ADAS, but not so sure about autonomous cars: study

In May, market researcher Penn Schoen Berland canvassed 2,506 American drivers about their driving habits. The findings, presented last week at a Ford press conference, are sobering:

• 76% of respondents admitted to eating or to drinking non-alcoholic drinks while behind the wheel
• 53% admitted to talking on a handheld phone
• 33% admitted to fiddling with their mobile gadgets
• 55% admitted to driving beyond the speed limit
• 37% admitted to driving when too tired

And here’s the kicker: 99% of respondents claimed they were safe drivers.

I know, it's a major disconnect. But here's what I find interesting: most respondents also expressed interest in driver assistance systems. In other words, even self-proclaimed safe drivers tacitly admitted they could use help now and then. For instance:

• 8 out of 10 respondents expressed interest in technologies that would help them stay in their lane
• 9 out of 10 expressed interest in technologies that could detect an impending collision and slow the car down

Respondents also expressed interest in systems that could detect a car in their blind-spot, provide voice-activated phone dialing, or park the car automatically. That said, only 39% said they’d feel comfortable riding an autonomous car.

My take? That number will grow significantly once more people drive cars equipped with adaptive cruise control, automatic parallel park, and other driver-assist systems. The more people become accustomed to such systems, the more they'll accept a car that does most of the driving for them.

For media coverage of this study, visit Forbes, Scientific American, and the Wall Street Journal.

Domo arigato, for self-driving autos

Lynn Gayowski

When talk moves to autonomous cars, Google's self-driving car is often the first project that springs to mind. However, there are a slew of automakers with autonomous or semi-autonomous vehicles in development — Audi, BMW, General Motors, Mercedes-Benz, and Toyota, to name a few. And did you know that QNX has been involved with autonomous projects since 1997?

Let's begin at the beginning. Obviously the first step is to watch the 1983 Mr. Roboto music video. To quote selectively, "I've come to help you with your problems, so we can be free." As Styx aptly communicated with the help of synthesizers, robots have the potential to improve our lives. Current research predicts autonomous cars will reduce traffic collisions and improve traffic flow, plus drivers will be freed up for other activities.

So let's take a look at how QNX has been participating in the progress to self-driving vehicles.

The microkernel architecture of the QNX operating system provides an exemplary foundation for systems with functional safety requirements, and as you can see from this list, there are projects related to cars, underwater robots, and rescue vehicles.

Take a look at this 1997 video from the California Partners for Advanced Transportation Technology (PATH) and the National Automated Highway System Consortium (NAHSC) showing their automated driving demo — the first project referenced on our timeline. It's interesting that the roadway and driving issues mentioned in this video still hold true 17 years later.



We're estimating that practical use of semi-autonomous cars is still 4 years away and that fully autonomous vehicles won't be available to the general public for about another 10 years after that. So stay tuned to the QNX Auto Blog. I'm already envisioning a 30-year montage of our autonomous projects. With a stirring soundtrack by Styx.

Autonomous cars by 1976?

By Paul Leroux

When you hear "Firebird," what image comes to mind? Chances are, it looks something like this:



Or this:



But did you know that the Firebird brand dates back to the 1950s? In those days, the Firebird looked like this:



Clearly, this wasn't a production car. Rather, GM designed it to promote a variety of forward-looking technologies, including a rear-view camera, a CRT-based instrument panel, and, yes, autonomous drive.

Speaking of which, here's a video from 1956 that shows how an "electronic control strip" embedded in the road allowed the Firebird II to drive itself. Jump to the :37 mark to catch the action:



My favorite part? The closing comment, "This may well be part of the American scene in 1976." The prediction was on the optimistic side, to say the least. But it does reflect our long-standing fascination with self-driving cars. In fact, it goes beyond that. The Firebird II also embodies a persistent belief that such cars are inherently safer than cars driven by humans.

Here, for example, is an excerpt from the Firebird II brochure, which extols the benefits of putting technology in the driver's seat:

Not only do you relax and enjoy your journey, but you are as safe as modern science can make you. For, while human beings err in judgment, the electronic brain is completely foolproof.

Does that sound familiar? It does to me. A few weeks ago, I wrote about an article published in 1958 that claimed:

Driving will one day be foolproof, and accidents unknown, when science finally installs the Electronic Highway of the Future.

Part of me laughs at the sheer naïvety of these statements. But you know what? They aren't all that far from the truth. I'd like to think I'm better than any "electronic brain" at driving safely, but the evidence is starting to suggest otherwise. According to data gathered by the Highway Loss Data Institute, automatic crash-avoidance systems in cars are, in fact, better than humans at responding to a variety of dangerous situations.

So, in some small way, I'm threatened by these statements. After all, who wants think of themselves as Captain Dunsel? :-)

Will autonomous cars motivate more teenagers to get behind the wheel?

I know, it seems like an odd question. But allow me to provide some context.

A few months ago, my colleague Andy Gryc predicted that autonomous cars will, in a few years, start rolling off the assembly lines. To support this prediction, he cited several trends, including two demographic factors: 1) baby boomers are getting older and hence losing their ability to drive safely, and 2) young people today are much more interested in connecting than in driving; they prefer to live their lives online.

I must admit, I thought the second factor was anecdotal at best. But boy, was I wrong… I think.

According to a new study published by the journal Traffic Injury Prevention, the number of young drivers is, in fact, falling precipitously. For instance, in 1983, 87.3% of 19-year-olds had a driver’s license. By 2008 that number had fallen to 75.5%, and by 2010 it had tumbled to 69.5%.

Similar drops occurred in other age groups under 40, but the trend is far more pronounced among teenagers and twenty-somethings. Here’s a graph from the article:



So what accounts for the trend? According to the authors, Michael Sivak and Brandon Schoettle, the decrease in driver licensing is consistent with the increase in Internet usage — an interpretation that falls in line with Andy Gryc’s hypothesis. I, too, believe that the Internet is a factor. But is it the only one?

In July, Jordan Weissmann of The Atlantic wrote a short piece on Sivak and Brandon’s article, and if the comments are anything to go by, the trend is the result of many contributing factors, not just one. Commenters noted that, since the 1980s, gas prices have gone up; teenagers face more restrictions when applying for licenses; parents have become more protective; and cars, with all their electronics, can no longer be maintained by an teenager with a wrench and a smattering of mechanical skills. And let’s not forget the elephant in the room: the lack of jobs available to young people.

So, to return to our original question, will autonomous cars spur more young people to get behind the wheel? If young people are losing interest in driving because they’d rather stay connected, possibly yes. But if serious economic factors are at play, probably not.

What do you think?

The summer road trip of 2017 – Part II

Lynn Gayowski

Our series looking at how in-car technologies will transform your summer road trip continues with part II. 2017 is around the corner, and between now and then, automakers will introduce a bevy of new features that will make for a safer and more enjoyable summer road trip. In our first part, we looked at your road trip soundtrack, navigation, and mobile device connectivity. This week, we look at safety, acoustics, and autonomous cars as we cruise to the last exit for this blog series.

Staying safe
By 2017, we likely won’t have developed the technology to shrink your mechanic down to a size that allows you to perch one on your dashboard like a bobble-head, but many cars will have a “virtual mechanic.” This application will let you check lights, fluids, tire pressure and other system vitals, all through your center stack, digital instrument cluster, or phone – as seen below. The idea of a safety speedometer is hardly new in concept (see the Plymouth safety speedometer from 1939), but its modern implementation in the cars of 2017 in the form of vision systems performing road sign detection might just mean fewer speeding tickets on your road trip, especially as you cruise through unfamiliar areas. 

Staying in touch
Sometimes you want to take a road trip to get away from the world, but sometimes you still want (or need) to stay connected. Whether it’s phone calls, texts, or emails, all of this information will continue to be seamlessly integrated into your car in 2017. Less fumbling, fewer distractions.

And low-quality, stilted speakerphone calls will be a thing of the past with the emerging crop of acoustic technologies. Driving alone on a stretch of road and miss having your loved ones close by? Advanced duplex technology will make it seem as though the person on the other end of your phone conversation is sitting right beside you in the passenger’s seat.  

Another cool development? You won’t have to struggle to use voice recognition technologies because of your noisy in-car cabin (that’s right, serenely quiet cabins will no longer be exclusive to luxury cars). Vehicles will continue to evolve to meet the strictest CAFÉ and emissions standards, while the negative acoustic side-effects from less damping materials will be countered using software to remove unwanted engine sound. And your engine in 2017 might really sound like purring (or growling, if that’s your preference), as signature sounds are enabled by engine sound enhancement software. So not only will you not feel crazy for talking to your car, you’ll also be less frustrated as you do so cruising down the interstate. 

Beyond 2017: Look ma, no hands!
While it won’t happen quite as soon as 2017, autonomous cars will hit the roads in the relatively near future, forever changing the dynamic of the road trip. Will road trips be more accessible for the elderly and others who can’t physically drive long distances? Will the new meaning of "cruise control" make the road trip more or less enjoyable? All of these considerations are up for discussion. One thing is certain: many of the advanced safety systems of today and 2017 are precursors to cars that could drive themselves. One such example of what the future of autonomous driving will look like is the University of Parma’s DEEVA autonomous car project being developed by the Artificial Vision and Intelligent Systems Laboratory (VisLab).  

How is in-car technology playing a role in your current summer road trip? How do you want it to improve your future road trips? Stay tuned to our QNX_Auto Twitter account and Facebook page for weekly discussions throughout the rest of the summer about 2017 has in store for your road trip.