HTML5 and the software engineer

HTML5 appears to have a number of benefits for consumers and car manufacturers. But what is often good for the goose is not necessarily good for the developer. Talking to the guys in the trenches is critical to understanding the true viability of HTML5.

Andy Gryc and Sheridan Ethier, manager of the automotive development team at QNX, pair up for a technical discussion on HTML5. They explore whether this new technology can support rich user interfaces, how HTML5 apps can be blended with apps written in OpenGL, and if interprocess communication can be implemented between native and web-based applications.

So without further ado, here’s the latest in the educational series of HTML5 videos from QNX.



This interview of Sheridan Ethier is the third in a series from QNX on HTML5.

Meet the QNX concept team: Allan Hudgins, web developer

In this installment of the concept team interview series, we catch up with one of the team’s newest members: Allan Hudgins

Allan Hudgins

Allan, tell us a bit about yourself and your role on the concept team.
I’ve been a software developer for a decade or so, having previously worked on satellite communication systems and emergency notification systems. On the concept team, I have been making use of new ‘real-time’ web technologies that make it possible to have near-instant, bi-directional communications between a web browser and a QNX-based device, over the Internet.

What do you like best about being on the concept team?
It’s a refreshing change from developing production software. The pressure and deadlines are still there, but it’s much easier to focus on coming up with the right ideas and executing on them than it sometimes is under a production-oriented process. I like how much control I have over the design of the solutions I contribute to the team’s projects. There are no mandates beyond getting things done, getting them done well, and getting them done quickly. Well, and have fun doing it!

Has there been a standout moment for you while working on the team?
On my first day at QNX I discovered that a developer had ported Node.js, a real-time web technology, to the QNX OS. I knew I could do some interesting things with Node.js, and within the next two weeks, I was able to create a demo that got everyone excited. I remember Mark Rigley telling me, “Wow, you don’t know what you’ve done!” That was pretty cool — eased the ‘new guy’ jitters for sure.

What is your biggest challenge right now? What keeps you up at night?
I’m usually thinking about how to solve the next problem — right now, it’s a feature for the technology concept car at CES. Creating scalable architectures is part of it, which is an interesting challenge when you’re leveraging a lot of very new technologies. Things don’t always work like it says on the back of the box.

What is your dream car?
Growing up, I always wanted a mini-van like my father. Now, with two kids, I’m afraid that wish might actually come true. I’ve driven the Porsche concept car – I’d like one of those. Please.

Anything particular you’re excited about right now?
The new concept car, of course! It’s beautiful, and it will be cool to see when it’s finished. Generally, though, I like the idea of a car pushing data to the cloud and the user being able to see that data in a meaningful way. For instance, by getting data gathered from other cars, the driver could see if there was a faster way to commute to work, and how long it would take. I think that’s not too far off.

Who would you like to see seated in a QNX technology concept car or reference vehicle?
I’d like to see my 15 month old in the passenger seat, but I don’t know what he’d do — play with the windows, maybe!

Is HTML5 a good gamble?

As the consumer and automotive worlds continue to collide, HTML5 looks like a good bet. And not a long shot either. In fact, the odds are all automakers will eventually use it. But since the standard won’t be mature for some time yet, should you take a chance on it now? 

To answer this, Andy Gryc talks to Matthew Staikos of RIM. Matthew is the manager of the browser and web platform group at RIM, and has over 10 years of software development experience with a strong focus on WebKit for mobile and embedded systems. Matthew co-founded Torch Mobile, which was acquired by RIM for their browser technology.

Andy’s conversation with Matthew is the subject of the following video, the second in an educational series designed to get an industry-wide perspective on HTML5. 

This interview of Matthew Staikos is the second in a series from QNX on HTML5.

The ultimate show-me car

The fifth installment in the CES Cars of Fame series. Our inductee for this week: a most bodacious Bentley.

It's one thing to say you can do something. It's another thing to prove it. Which helps explain why we create technology concept cars.

You see, we like to tell people that flexibility and customization form the very DNA of the QNX CAR Platform for Infotainment. Which they do. But in the automotive world, people don't just say "tell me"; they say "show me". And so, we used the platform to transform a Bentley Continental GT into a unique concept car, equipped with features never before seen in a vehicle.

Now here's the thing. This is the same QNX CAR Platform found in the QNX reference vehicle, which I discussed last week. But when you compare the infotainment systems in the two vehicles, the differences are dramatic: different features, different branding, different look-and-feel.

The explanation is simple: The reference vehicle shows what the QNX CAR Platform can do out of the box, while the Bentley demonstrates what the platform lets you do once you add your imagination to mix. One platform, many possibilities.

Enough talk; time to look at the car. And let's start with the exterior, because wow:



The awesome (and full HD) center stack
And now let's move to the interior, where the first thing you see is a gorgeous center stack. This immense touchscreen features a gracefully curved surface, full HD graphics, and TI’s optical touch input technology, which allows a physical control knob to be mounted directly on the screen — a feature that’s cool and useful. The center stack supports a variety of applications, including a 3D navigation system from Elektrobit that makes full use of the display:



At 17 inches, the display is big enough to display other functions, such as the car’s media player or virtual mechanic, and still have plenty of room for navigation:



The awesome (and very configurable) digital instrument cluster
The instrument cluster is implemented entirely in software, though you would hardly know it — the virtual gauges are impressively realistic. More impressive still is the cluster’s ability to morph itself on the fly. Put the car in Drive, and the cluster will display a tach, gas gauge, temperature gauge, and turn-by-turn directions — the cluster pulls these directions from the center stack’s navigation system. Put the car in Reverse, and the cluster will display a video feed from the car’s backup camera. You can also have the cluster display the current weather and current sound track:



The awesome (and just plain fun) web app
The web app works with any web browser and allows the driver to view data that the car publishes to the cloud, such as fluid levels, tire pressure, brake wear, and the current track being played by the infotainment system. It even allows the driver to remotely start or stop the engine, open or close windows, and so on:



The awesome (and nicely integrated) smartphone support
The Bentley also showcases how the QNX CAR Platform enables advanced integration with popular smartphones. For instance, the car can communicate with a smartphone to stream music, or to provide notifications of incoming email, news feeds, and other real-time information — all displayed in a manner appropriate to the automotive context. Here's an example:



The awesome everything else
I’ve only scratched the surface of what the car can do. For instance, it also provides:

• Advanced voice rec — Just say “Hello Bentley,” and the car’s voice recognition system immediately comes to life and begins to interact with you — in a British accent, of course.
   
• Advanced multimedia system — Includes support for Internet radio.
   
• Video conferencing with realistic telepresence — Separate cameras for the driver and passenger provide independent video streams, while fullband voice technology from QNX offers expanded bandwidth for greater telepresence.
   
• LTE connectivity — The car features an LTE radio modem, as well as a Wi-Fi hotspot for devices you bring into the car.

Moving pictures
Okay, time for some video. Here's a fun look at the making of the car:



And here's a run-through of the car's many capabilities, filmed by our friends at TI during 2013 CES:

What’s HTML5 got to do with automotive?

There’s been a lot of noise lately about HTML5. A September 2011 report by binvisions shows that search engines and social media web sites are leading the way toward adoption: Google, Facebook, YouTube, Wikipedia, Twitter, and plenty more have already transitioned to HTML5. Some are taking it even further: Facebook has an HTML5 Resource Center for developers and the Financial Times has a mobile HTML5 version of their website.

It won’t be long before HTML5 is ubiquitous. We think automakers should (and will) use it. 

To elucidate the technology and its relevance, we’ve created a series of educational videos on the topic. Here is the first in that series. Interviews with partners, customers, and industry gurus will soon follow. 

This simple overview is the first in a series from QNX on HTML5. (Personally I like the ending the best.)

Is this the most jazzed-up Jeep ever to hit CES?

The fourth installment in the CES Cars of Fame series. Our inductee for this week: a Jeep that gets personal.

Paul Leroux

It might not be as hip as the Prius or as fast as the Porsche. But it's fun, practical, and flexible. Better yet, you can drive it just about anywhere. Which makes it the perfect vehicle to demonstrate the latest features of the QNX CAR Platform for Infotainment.

It's called the QNX reference vehicle, and it's been to CES in Las Vegas, as well as to Detroit, New York City, and lots of places in between. It's our go-to vehicle for whenever we want to hit the road and showcase our latest infotainment technology. It even made a guest appearance at IBM's recent Information On Demand 2013 Big Data conference, where it demonstrated the power of connecting cars to the cloud.

The reference vehicle, which is based on a Jeep Wrangler, serves a different purpose than our technology concept cars. Those vehicles take the QNX CAR Platform as a starting point to demonstrate how the platform can help automakers hit new levels of innovation. The reference vehicle plays a more modest, but equally important, role: to show what our the platform can do out of the box.

For instance, we updated the Jeep recently to show how version 2.1 of the QNX CAR Platform will allow developers to blend a variety of application and HMI technologies on the same display. In this case, the Jeep's head unit is running a mix of native, HTML5, and Android apps on an HMI built with the Qt application framework:



Getting personal
We also use the Jeep to demonstrate the platform's support for customization and personalization. For instance, here is the first demonstration instrument cluster we created specifically for the Jeep:



And here's a more recent version:



These clusters may look very different, but they share the same underlying features, such as the ability to display turn-by-turn directions, weather updates, and other information provided by the head unit.

Keeping with the theme of personalization, the Jeep also demonstrates how the QNX CAR Platform allows developers to create re-skinnable HMIs. Here, for example, is a radio app in one skin:



And here's the same app in a different skin:



This re-skinnability isn't just cool; it also demonstrates how the QNX CAR Platform can help automotive developers create a single underlying code base and re-use it across multiple vehicle lines. Good, that.

Getting complementary
The Jeep is also the perfect vehicle to showcase the ecosystem of complementary apps and services integrated with the QNX CAR Platform, such as the (very cool) street director navigation system from Elektrobit:



To return to the question, is this really the most jazzed-up Jeep to hit CES? Well, it will be making a return trip to CES in just a few weeks, with a whole new software build. So if you're in town, drop by and let us know what you think.

First impressions are the most lasting

Lynn Gayowski

Preparations for 2015 CES in January are in full swing at QNX Software Systems, both in and out of the garage. Thus, with fond memories in mind, the time has come to graduate our 2014 technology concept car, based on a Mercedes-Benz CLA45 AMG, to a CES Car of Fame. The Mercedes will always hold a special place in my heart, as it was the first technology concept car I got to experience hands-on since joining the QNX team.

If I were to describe this concept car with one word, I would choose "user-centric". (I love how hyphens can really help in these succinct situations.) We designed the infotainment system and digital instrument cluster with a vision to help drivers interact in new and seamless ways with their vehicles. This concept car is a great example of how QNX technology can enable a more natural user experience.

As we hum a few bars of Sarah McLachlan's classic I Will Remember You, let's look back at some highlights.

The first thing that catches your eye is the matte exterior and stylish lines, exuding just a soupçon of James Bond:



But let's get to the technology. At 21" by 7" the touch screen is a showstopper. It brings a rich, graphical interface to both driver and passenger. This is where you can really see the user-centric design, with options to control the infotainment system with the touch screen, physical buttons, a jog wheel, or voice commands:



We really wanted to use the car to highlight the flexibility of the QNX CAR Platform and how customers can easily modify features using the platform's pre-integrated technologies. A great example of this is the car's navigation system. The car actually has 4 different navigation solutions installed, demonstrating how automakers can choose a solution best suited for a particular geography or language. EB Street Director is featured in this photo:



The infotainment system may wow you, but don't forget about the cluster. The Mercedes has a dynamically reconfigurable digital instrument cluster that can display turn-by-turn directions, notifications of incoming phone calls, video from the car's front and rear cameras, as well as a tachometer, speedometer, and other virtual instruments, at a full 60 frames per second. The cluster can even notify you of incoming text messages on your phone. Simply push a steering-wheel button, and the system will read the message aloud, so you can keep your eyes on the road.



Another cool feature is the cluster's "virtual mechanic" which lets you access vehicle info like tire pressure, brake wear, and fuel, oil, and windshield fluid levels:



What car of the future would be complete without connectivity? A custom "key fob" app allows you to remotely access system maintenance information, control the media player, locate the car on a map, and perform a number of actions like starting the car and opening window. This cross-platform HTML5 app can run on any smartphone or tablet:



As an overall view of the Mercedes, one of my favourite pieces is this video by Sami Haj-Assaad of AutoGuide, where he takes a look at the design and features of the car. His closing quote really sums up the innovation showcased: "The infotainment industry is going through a huge upgrade, with QNX leading the charge."



I hope you enjoyed the 2014 QNX technology concept car. Watch for the reveal of our 2015 technology concept car January 6 at CES in Las Vegas!

Seamless connectivity is for more than online junkies

As much as I’m not always enamored with sitting behind a computer all day, I find being off the grid annoying. Remember this email joke?

You know you’re an online junkie when you:
• wake up at 3:00 am to go to the bathroom and stop to check your email on the way back to bed
• rarely communicate with your mother because she doesn’t have email
• check your inbox. It says ‘no new messages,’ so you check it again 

Even though this joke circulated several years ago, it still strikes a chord. The big difference now is that there’s no longer a subculture of ‘online junkies.’ From the time we wake up in the morning to the time we go to bed, we all want to be connected — and that includes when we get behind the wheel. So to this joke I would add:

• resent driving because it means going off the grid

At QNX, we’re working toward a seamless experience where people can enjoy the same connectivity whether they’re texting their spouse from the mall or checking traffic reports while driving down the highway. See what I mean:



For more information about the technology described in this video, visit the QNX website.
 

Meet Justin Moon, product manager turned concept designer

We recently met Mark and Jon from the QNX concept development team. This week we meet up with Justin Moon, who is on secondment from his product management job to the team behind the cars. Justin works on a variety of things, from concept design to realization to system architecture and a host of other things that change daily – which is exactly how he likes it.

Justin has been working with QNX concept cars from the very beginning, something you can tell right away when speaking with him. Couple his love of cars and tech with an atmosphere of fun, variety and exemplary teamwork and - well, they may have trouble getting him off secondment!

Have an auto question for QNX? Have it answered in a LIVE Twitter session

Have a question that you have been dying to ask us? Well here’s your chance. Leading up to CES 2013 we will hold a series of LIVE Twitter sessions with our automotive experts on topics from the connected car and beyond, and we want to hear from you! In January, we’re even going to give you the opportunity to ask about the new technology concept car that we’ll be unveiling at CES 2013 — more to come on that later.

Each session will have a specific topic and QNX automotive expert but the questions they answer will be up to you. We’re kicking things off on Wednesday,  December 12 at 1 pm ET with Andy Gryc, product marketing manager on the topic of the connected car landscape – past, present and future. In this session, Andy will look at what can be done today and what the future may bring for consumers and the connected car.

Additional topics and experts include:

• Tuesday, December 18 at 1 pm ET: Andrew Poliak, director, business development, automotive - Automotive technology around the world - a look at the cars and technology features around the world.
• Thursday, January 3 at 1 pm ET: Linda Campbell, director, strategic alliances - Whose technology is in my car? A look at the partner technologies and capabilities found in the cars of today and tomorrow.
• Friday, January 18 at 1 pm ET: Mark Rigley, director of the concept development team answers questions about the new QNX technology concept car unveiled at CES 2013.

You can submit your questions now or day-of by sending a tweet to @QNX_Auto and using the hashtag #QNXLive. If your question is selected, we’ll be sure to give you a shout-out in addition to answering your question.

So get your questions ready and stay tuned to @QNX_Auto for our upcoming live Twitter sessions!

Oh, and in case you're wondering who I am and what I'm doing here .... I'm the social media marketing manager at QNX, and I look forward to seeing your questions - and hearing our experts' answers.

A Porsche you could talk to

The third installment in the CES Cars of Fame series. Our inductee for this week: a very connected Porsche 911.

Paul Leroux

I have a confession to make. The day before QNX Software Systems unveiled this technology concept at car at 2012 CES, I leaked the news on the On Q blog. Mind you, the leak was unintentional. I had been editing a post that described the car and, instead of hitting Save, I hit Publish by mistake. Dumb, I know.

I immediately took down the post and informed my colleagues of the error. Fortunately, my RSS feed didn't give me away, and the launch, which had been strictly under wraps, went ahead as planned. But boy, did I feel stupid.

Now that I've got that off my chest, let's see what the hubbub was about. The car, based on a Porsche 911 Carrera, came equipped with an array of features built by the QNX concept team, including one-touch smartphone pairing, high-definition hands-free calls, rear-seat entertainment, and a digital instrument cluster.

So, you ready for a tour?

The car
Let's start with the exterior. Because man, what an exterior:



The instrument cluster
Once you got behind the wheel, the first thing you saw was the instrument cluster. But
this was no ordinary cluster. It could dynamically reconfigure itself — in response to voice commands, no less. It could even communicate with the navigation system to display turn-by-turn directions. And it was designed to honor the look-and-feel of the stock 911 cluster:



The head unit
To your right, you could see the head unit. Here is the unit's main screen, from which you could access all of the system's key functions:



And here's another screen, showing the system's media player:



The front-seat control of backseat infotainment
The Porsche also showcased how a head unit could offer front-seat control of backseat entertainment — perfect for when you need to control what your kids are watching or listening to:



The voice recognition
The Porsche was outfitted with cloud-based voice recognition, which let you enter navigation destinations naturally, without having to use artificial grammars. Check out this Engadget clip, taken at an AT&T event in New York City:



The car also included features that neither words nor pictures can capture adequately. But let me try, anyway:

One-touch Bluetooth pairing — Allowed you to pair a phone to the car simply by touching the phone to an NFC reader embedded in the center console; no complicated menus to wade through.

Text-to-speech integration — Could read aloud incoming emails, text messages, and BBM messages.

High-definition voice technology — Used 48KHz full stereo bandwidth for clear, high-fidelity hands-free calls.

The car also ran a variety of apps, including TCS hybrid navigation, Vlingo voice-to-text, Poynt virtual assistant, Weather Network, and streaming Internet radio from Pandora, Nobex, Slacker, and TuneIn.

The point
The point of this car wasn't simply to be cool, but to demonstrate what's possible in next-gen infotainment systems. More specifically, it was designed to showcase the capabilities of the QNX CAR Platform for Infotainment. In fact, it did such a good job on that count that the platform took home the 2012 CES Best of Show award, in the car tech category:

Beyond the dashboard: discover how QNX touches your everyday life

QNX technology is in cars — lots of them. But it’s also in everything from planes and trains to smart phones, smart buildings, and smart vacuum cleaners. If you're interested, I happen to have an infographic handy...

I was a lost and lonely soul. Friends would cut phone calls short, strangers would move away from me on the bus, and acquaintances at cocktail parties would excuse themselves, promising to come right back — they never came back. I was in denial for a long time, but slowly and painfully, I came to the realization that I had to take ownership of this problem. Because it was my fault.

To by specific, it was my motor mouth. Whenever someone asked what I did for a living, I’d say I worked for QNX. That, of course, wasn’t a problem. But when they asked what QNX did, I would hold forth on microkernel OS architectures, user-space device drivers, resource manager frameworks, and graphical composition managers, not to mention asynchronous messaging, priority inheritance, and time partitioning. After all, who doesn't want to learn more about time partitioning?

Well, as I subsequently learned, there’s a time and place for everything. And while my passion about QNX technology was well-placed, my timing was lousy. People weren’t asking for a deep dive; they just wanted to understand QNX’s role in the scheme of things.

As it turns out, QNX plays a huge role, and in very many things. I’ve been working at QNX Software Systems for 25 years, and I am still gobsmacked by the sheer variety of uses that QNX technology is put to. I'm especially impressed by the crossover effect. For instance, what we learn in nuclear plants helps us offer a better OS for safety systems in cars. And what we learn in smartphones makes us a better platform supplier for companies building infotainment systems.

All of which to say, the next time someone asks me what QNX does, I will avoid the deep dive and show them this infographic instead. Of course, if they subsequently ask *how* QNX does all this, I will have a well-practiced answer. :-)

Did I mention? You can download a high-res JPEG of this infographic from our Flickr account and a PDF version from the QNX website.



Stay tuned for 2015 CES, where we will introduce even more ways QNX can make a difference, especially in how people design and drive cars.

And lest I forget, special thanks to my colleague Varghese at BlackBerry India for conceiving this infographic, and for the QNX employees who provided their invaluable input.

Cyber security and connected cars

What does cyber security mean, what does it affect, why is it becoming critical, and what can you do about it? Those were some of the questions I addressed in a recent webcast on automotive cyber security, hosted by SAE International. I represented the software side of things and was accompanied by my hardware colleagues Richard Soja and Jeffrey Kelley, who work at Freescale and Infineon respectively.

I’ve hosted webinars on a variety of automotive and embedded software topics, but none with such an impressive range of participants. We had people from government organizations of several countries, not to mention automakers, tier 1 and tier 2 auto suppliers, telematics companies, mobile developers, concerned individuals, and even utility companies. And the range of questions and comments was equally diverse — from specific insights about elliptical encryption to sweeping “how does this affect society” musings.

My key takeaway: QNX isn’t alone in its concern for automotive cyber security. We have years of experience in building secure trusted systems and we’re excited to help customers build tomorrow’s secure cars. Nice thing is, the rest of the world is starting to get on board as well.

If you're interested, you can download the archived version of the webinar.

Pimp your ride with augmented reality — Part II

Last week, I introduced you to some cool examples of augmented reality, or AR, and stated that AR can help drivers deal with the burgeoning amount of information in the car.

Now that we’ve covered the basics, let’s look at some use-cases for both drivers and passengers. Remember, though, that these examples are just a taste — the possibilities for integrating AR into the car are virtually endless.


AR for the driver
When it comes to drivers, AR will focus on providing information while reducing distraction. Already, some vehicles use AR to overlay the vehicle trajectory onto a backup camera display, allowing the driver to gauge where the car is headed. Some luxury cars go one step further and overlay lane markings or hazards in the vehicle display.

Expect even more functionality in the future. In the case of a backup camera, the display might take advantage of 3D technology, allowing you to see, for example, that a skateboard is closer than the post you are backing towards. And then there is GM's prototype heads-up system, which, in dark or foggy conditions, can project lane edges onto the windshield or highlight people crossing the road up ahead:



AR can be extremely powerful while keeping distraction to a minimum. Take destination search, for example. You could issue the verbal command, “Take me to a Starbucks on my route. I want to see their cool AR cups”. The nav system could then overlay a subtle route guidance over the road with a small Starbucks logo that gets bigger as you approach your destination. The logo could then hover over the building when you arrive.

You'll no longer have to wonder if your destination is on the right or left, or if your nav system is correct when it says, “You have arrived at your destination.” The answer will be right in front of you.

AR for the passenger
So what about the passenger? Well, you could easily apply AR to side windows and allow passengers to learn more about the world around them, a la Wikitude. Take, for example, this recent video from Toyota, which represents one of the best examples of how AR could make long road trips less tedious and more enjoyable:


 

QNX-powered OnStar FMV drives home with CES Innovation award

Paul Leroux

This just in: The OnStar FMV aftermarket mirror, which brings the safety and security features of OnStar to non-GM vehicles, has won a coveted CES Innovations Design and Engineering Award.

To clinch this award, a product must impress an independent panel of industrial designers, engineers, and trade journalists. Speaking of impressions, it seems that OnStar FMV also made a hit with the folks at CNET, because they've chosen it as one of their Top Holiday Shopping Picks for 2011.

As you may have guessed, OnStar FMV uses QNX Neutrino as its OS platform. It also uses the QNX acoustic processing suite, which filters out noise and echo to make hands-free conversations clear and easy to follow. The suite includes cool features like bandwidth extension, which extends the narrow-band hands-free signal frequency range to deliver speech that is warm and natural, as well as intelligible.

Have time for a video? If so, here's a fun look at FMV's features, including stolen vehicle recovery, automatic crash response, turn-by-turn navigation, hands-free calling, and one-touch emergency calling:


 

What if…

Imagine if your car could help you become more connected to friends and family — and to the road ahead. Enter a new video that peers into the not-so-distant future.

It blows my mind, but some people still see connectivity in the car as the enemy. They think that, the more connected the car, the more distracting and dangerous it will be. But you know what? Responding to their concerns is easy. I simply ask them what if.

For instance, what if connectivity helped you drive with greater situational awareness? What if it helped you sidestep traffic jams and axle-busting pot holes? What if it helped you detect a stop sign hidden behind a tree? And what if it helped you become more connected to the people important to you, as well as to the road and the cars around you?

When we talk connectivity at QNX, that’s the kind of connectivity we envision. It isn’t just about Bluetooth or Wi-Fi or LTE — that’s only the plumbing. Rather, it’s about keeping you in tune and in sync with your car, your environment, your business, your friends. Your life.

More QNX-powered cars and infotainment systems from 2011 CES

The second installment in our CES Cars of Fame series. Today, we look at several systems from the 2011 CES event, starting with this week's inductee, a BMW Z4.

Paul Leroux

I've led you astray — sort of. Last week I stated that the LTE Connected Car, the first QNX-powered technology concept car, appeared at 2011 CES. But I didn't mention that QNX technology was at the core of several other innovative vehicles and infotainment systems at CES that year.

So let me set the record straight. And the best place to start is the QNX booth at 2011 CES, where a BMW Z4 roadster was the front-and-center attraction.

BMW Z4 Roadster with ConnectedDrive
The Z4 wasn't a technology concept car, but a true production car straight off the dealer lot. It was equipped with the QNX-based BMW ConnectedDrive system, which offers real-time traffic information, automatic emergency calling, and a text-to-speech feature that can read aloud emails, appointments, text messages, and other information from Bluetooth smartphones. It's a cool system right at home in this equally cool cockpit:



Heck, the whole car was cool, from the wheels up:



Audi A8 with Google Earth
Mind you, the coolness didn't stop at the QNX booth. Just down the hall, Audi showcased an A8 sedan equipped with the QNX-based 3G MMI infotainment system, featuring Google Earth. This same model drove home with the 2011 Edmunds Breakthrough Technology award a short while later.

I don't have any photos of the Audi from the CES show floor, but if you head over to the On Q blog, you can see some snaps from an automotive event that QNX hosted in Stuttgart two months earlier. The photos highlight the A8's innovative touchpad, which lets you input destination names by tracing them with your finger.

Toyota Entune infotainment system
And now to another award-winning QNX-based system. Toyota Entune embraces a simple, yet hard-to-achieve concept: help drivers interact with mobile content and applications in a non-distracting, handsfree fashion. For instance, if you are searching for a nearby restaurant, Entune lets you ask for it in a conversational fashion; no need for specific voice commands.

You could tell the judges for the CNET Best of CES awards were impressed, because they awarded Entune first prize, in the Car Tech category — the first of three QNX-powered systems to do. QNX Software Systems went on to win in 2011 for its QNX CAR Platform and then Chevy won in 2012 for its MyLink system. Not too shabby.

A cluster of clusters
We've looked at just three of the many QNX-based automotive systems showcased at 2011 CES. For instance, QNX also demonstrated digital instrument clusters built by Visteon for the Land Rover Range Rover and for the Jaguar XJ sedan, below:



Freescale, NVIDIA, TeleNav, and Texas Instruments also got into the act, demonstrating QNX systems in their booths and meeting areas.

Do you have any memories of 2011 CES? I'd love to hear them.

Listen to the music

The audio CD is on its last track... Internet radio, anyone?

I don’t think anyone will disagree with me when I say that music still represents the most important element in an infotainment system. Just look at the sound system capabilities in new cars. Base systems today have at least 6 speakers, while systems from luxury brands like Audi and BMW boast up to 16 speakers and almost 1000 watts of amplification.

For nearly as long as I can remember, cars have come with CD players. For many years they’ve provided a simple way to take your music on the road. But nothing lasts forever.

Earlier this year, Ford announced it would discontinue CD players in many of its vehicle models. Some industry pundits have predicted that CD players will have no place in cars in model year 2015 and beyond. A few weeks ago, Side-Line Music Magazine reported that major labels plan to abandon the CD format as early as 2012. This revelation has created a flurry of activity on the Net, but the labels have yet to confirm it’s true.

Steady decline
The fact is, CD sales have declined steadily for the last several years, down 16 percent in 2010 alone. Digital downloads (the legal kind), on the other hand, have been growing quickly and are expected to exceed CD sales for the first time in 2012.

Where does that leave us in the car? Obviously, media device integration will be key in the coming years. QNX Software Systems has long supported Apple iPod integration and supported Microsoft’s ill-fated Zune for a while. USB connectivity is a given, and soon you’ll be able to stream music from your phone.

Radio redefined

The QNX-powered Toyota Entune system 
supports both Pandora and iHeartRadio.

But what’s more exciting is how radio is evolving in the vehicle. Along with the steering wheel, radio has been a staple of car pretty much since day one. As the connected vehicle moves to the mainstream, internet radio will become a huge part of the automotive experience.

Companies like Slacker extend the concept of radio beyond audio to include artist bios, album art, photos, reviews, and more. Pandora, through its work with the Music Genome Project, expands the musical experience by playing songs it predicts you will appreciate. iHeartRadio aggregates American radio stations for replay throughout the US. TuneIn takes it one further with a global view. Driving down highway 101 in California, you’ll be able to tune in all your favorites from around the world.

Beyond entertainment
These services are changing the way people consume music. Today, I rely on my car radio not only to entertain but also to educate by constantly exposing me to new artists and content. Internet radio in the car will expand my horizons even further. And as online music stores like 7Digital integrate their service with the internet radio stations, I’ll be able to download the song I just heard at the push of a button. Not good for CD sales, but it seems that’s the way of the future anyway.

We are, of course, working with the leaders in internet radio and online music services to bring them to a car near you.
 

Pimp your ride with augmented reality — Part I

The use of electronics is exploding in automotive. Just last week, Intel proclaimed that the connected car “is the third-fastest growing technological device, following smartphones and tablets.”

Ten years ago, you’d be hard-pressed to find a 32-bit processor in your car. Now, some cars have 4 or more 32 bitters: one in the radio, another in the telematics module, yet another in the center display, and still another in the rear-seat system.

Heck, in newer cars, you’ll even find one in the digital instrument cluster — the QNX-powered cluster in the Range Rover, for example. Expect to see a similar demand for more compute power in engine control units, drive-by-wire systems, and heads-up displays.


The Range Rover cluster displays virtual speedometers and gauges, as well as warnings, suspension settings, and other info, all on a dynamically configurable display.

What do most of these systems have in common? The need to process tons of information, from both inside and outside of the vehicle, and to present key elements of that data in a safe, contextually relevant, and easy-to-digest fashion.

The next generation of these systems will be built on the following principles:

• Fully integrated cockpits — Vehicle manufacturers see system consolidation as a way to cut costs and reduce complexity, as well as to share information between vehicle systems. For instance, your heads-up display could discreetly let you know who is calling you, without forcing you to take your eyes off of the road. And it could do this even if the smarts integrating your phone and your car reside in another cockpit component — the telematics module, say.
   
• Augmented reality — With all of the data being generated from phones, cloud content services and, perhaps more importantly, the vehicle itself, presenting the right information at the right time in a safe way will become a major challenge. This is where augmented reality comes in.

Augmented reality is a cool use of cameras, GPS, and data to create smart applications that overlay a virtual world on top of the real world. Here are some of my favorite examples:

AR Starbucks cups — Use your phone to make your coffee cup come alive:



AR Starwars — Blast the rebel alliance squirrels!



AR postage stamp — Add a new dimension (literally) to an everyday object:



And here are a couple more for good measure:

AR ray gun — Blast aliens around the house!

Wikitude AR web browser — Explore the world around you while overlaying social networks, images, video, reviews, statistics, etc.

Stay tuned for my next post, where I will explore how AR could enhance the driving experience for both drivers and passengers — Andrew.