While I was out flying today the discussion moved to how things should work. As I posted earlier, the initial discussion was about autopilot operation. It later turned to meetings and how they will change in the future. I have talked about the phone as the primary computing device. I want to outline how this will merge with the future meeting room. You are at your desk working on material for the meeting when the clock becomes your enemy and it is time to go. You are able to work right up to the last minute because your work will move with you. You stand up and the screen on your desk goes dark. You walk to the boardroom and sit down. In front of you a screen, keyboard and mouse become active. You are back where you were. There is one addition. The conference room is on its own subnet. When you sat down several things happened. Inductive circuitry in the chair is charging your phone. A short range link has connected the screen, keyboard, and mouse. The room is on its own small subnet. as you sit down you are connected and contact information and picture are collected. If you are a company member you are connected back to the main network. If you are a visitor it is a guest network which allows internet access but keeps the internal network isolated. On your screen you see a graphic of the meeting room table. At each location is a picture along with the name of the person sitting at that position. A click on the image reveals the information on a standard business card. During the meeting Bill asks if you have received the latest proposal from legal. He needs to see it when you are done. You say you have received it and have finished marking it up. You drag it to Bill’s image on the conference room graphic and a copy is sent to Bill. Now it’s your turn to present. Fortunately you ready. A simple click and your presentation is on the large display. A click on your tablet brings up the presentation complete with speaker notes. As you stand up the screen on the meeting room table goes blank and the phone isn’t being charged but you are still on the meeting room network and your presentation is still displayed on the large screen. You move seamlessly between devices and use the one best suited for the moment.

A few days later there is a meeting of a different kind. It’s a late night conference call. Hey, that comes with being part of a central support organization for a company with operations in China. You sit down at a desk and start the video call. Like the boardroom example you are able to transfer files by dragging and dropping them to the picture of someone on the call. This scenario is pretty much here today. What needs to be done is to make the user interface more transparent when being used but the conference call scenario is pretty much here. With cameras now standard on both PC’s and tablets expect video conferencing to increase a lot over the next two years. One new addition will be the capability to seamlessly transfer the call from device to device. A call might be started on your phone. as you walk into your office it would transfer to the large screen on your desk. A personal call might start out on your TV but be transferred to your phone as you head out. In your car you wouldn’t have video but that would be on your phone when you got to your destination.

 

 

I’m back home and connected. Yeah! My kids are happy since World of Warcraft now works well. I’m trying to catch up and realized I haven’t posted in several days. Next week won’t be any better since I will be heading to Houston for a behind the scenes tour of Mission Control. I hope that trip is as much fun as I expect it will be.

Now to the techie stuff. I was flying today and the conversation turned to how things should work vs. how they really work. Of course the initial topic was about flying. I was working through approach procedures using a new autopilot. I fly a Cirrus SR22 equipped with Avidyne R9 avionics. Recently the autopilot was upgraded from the STEC 55X to the Avidyne DFC-100. This is a big upgrade. The STEC understood rate of turn (from a turn coordinator), altitude (air pressure sensor), course error (from Horizontal Situation Indicator), and GPS course. The new autopilot receives input from the GPS, Flight Management System and the Air Data Attitude Heading Reference System. In other words it knows just about everything about the airplane and its condition. It even knows flap position and engine power. The end result is a vastly superior autopilot. Sequencing is automatic (most times – see below). You can put in a flight profile and the plane will fly it including climbs and descents. The operation is very intuitive and a great example of intelligent user interface design. If you are climbing at a fixed IAS (Indicated AirSpeed) and set up to lock onto a fixed altitude the IAS button is green to show it is active and the ALT button is blue to show it is enabled but not locked. When you get to the desired altitude the ALT light blinks green and then goes steady green when locked onto the desired altitude. I could go on and on about how great this is and if you have questions just ask.

Now to more specifics about interface design. When you use the DFC-100 autopilot to fly an instrument landing system, ILS, approach, it is very automatic. If you punch VNAV, vertical navigation, you can  have the autopilot fly the entire procedure including the appropriate altitudes. When the radio signal of the ILS is received and verified correct (all automatic) the system shifts to using the electronic ILS pathway to the runway. So far everything has been very automatic. If you exit the clouds and see the runway you disconnect the autopilot and land. The problem comes when the clouds are too low to see the runway even when you are close and down low. This is a very dangerous time. At the critical point the plane is 200′ above the ground and there is little margin for error. If you don’t see the ground you execute the missed approach. This is where the great user interface breaks down. If you do nothing the autopilot will fly the plane into the ground. In order to have it fly the missed approach the following must happen. After the final approach fix, but only after, you must press a button labeled Enable Missed Approach. At the decision height when you are 200′ above the ground you must either disconnect the autopilot and start the missed approach procedure manually or shift from ILS to FMS as the navigation source and press the VNAV button. I can hear people, including pilots, asking me what the big deal is. The big deal is that this is when you really want the automatic systems looking over your shoulder and helping out. If you forget to shift from ILS to FMS the plane will want to fly into the ground. That’s a very bad thing. The system is still great. Even at this moment it is much better than the old system. I am not saying I would want to go back. I am saying it could be better and that this operation doesn’t fit with how seamless the autopilot’s operation usually is. What the system should do is automatically arm the missed approach. I see no reason for this to be a required manual operation with the potential to be forgotten. The pilot should select the decision height at which the missed approach will begin to be executed. When that point is reach, if the autopilot has not been disconnected, the autopilot should start flying the missed approach including VNAV functionality. That includes shifting the navigation source from ILS to FMS automatically.  The result would be increased safety since the system wouldn’t be requiring command input from the pilot at a critical moment.

The discussion above relates to what I have been covering in this blog. As computing systems improve and move into every area of our lives, issues like the one above will pop up. Everything about the DFC-100 is vastly superior to the old STEC. The issue is consistency of use. As our computing systems get better and better user interfaces, minor inconsistencies will appear to us as big annoyances. Look at the iPad. If you think of it as an eBook reader that lets you view mail and surf the web it is an awesome device. If you look at it as a fun device with simple apps and games it is awesome. As soon as you want it to be your main computer, things like the lack of a user accessible directory structure become big. Compared to the old Newton or the PDA, the iPad and the iPhone are major advances. However, with this new capability comes raised expectations. Developers don’t get to do great things and then sit back. As soon as users get comfortable with the new, next great thing they begin to find annoyances. One of Apple’s strengths has been minimizing these annoyances but even on the best devices they are there. Consistency of user experience is a big deal. Getting there is tough. My point is that small details matter. How the icons look, how smooth the scrolling is, the animation when actions are taken are all small things that matter. One of the reasons for the success of the iPad and iPhone has been this consistency and sweating the details when it comes to the user interface. As we merge devices and functions in the post PC world it will be critical that these disruptions, the non-transparent use scenarios be identified and fixed.

I thought about making the title of this post “I’m Right – They’re Wrong.” While I like the cloud for data everywhere and for syncing of data, I don’t believe in data ONLY in the cloud. There has been a lot of press around putting everything in the cloud. The Chromebook is one attempt at this. On the surface, my techie side gets excited. I hear cheap, long battery life, one data set and a unified experience across devices. The major thing I hear is low upkeep. Someone else does most of the application updates and makes sure things work. This last part, however, sounded hauntingly familiar. Then it hit me. This was the promise of thin clients. A long time ago in a different computing world, thin clients were going to save companies lots of money. The clients themselves would be cheaper. Falling PC prices killed that as a major selling point. The second thing was ease and consistency of software maintenance. The problem was that the world went mobile. People couldn’t afford to lose software access when they weren’t on the corporate network. In the end thin clients failed. Fast forward to today. The same issues apply to the Chromebook. Why get a Chromebook when a netbook can do so much more? Then there is the issue of connectivity. What happens when there isn’t a WiFi hotspot around? Are you thinking 3/4G? Think again. Look at today’s data plans and their capped data. Most people can’t afford to have everything they type, every song they play, every picture they look at and every video clip they show go over the network. Local storage can solve some of this but then you have independent data and the programs to access that data on the local machine. In other words you are back to managing a PC again.

Currently I am visiting my sister in Mobile, AL. I realized I needed to freshen up my blog and waiting till I got back home would be too long. No problem I thought. I have my iPad with me and it will be a chance to learn the basics of Blogsy. That’s what I’m doing now but it has been an enlightening experience and is the genesis of this post. What you need to know is that my sister’s house lacks WiFi. Since she and her husband spend a lot of time traveling in their RV, they use a Verizon 4G modem plugged into their laptop. That works for them but it doesn’t help me unless I go sit on my brother-in-law’s laptop. Of course there’s no need for that since my iPad has 3G. Oops! One big problem – the connection is unreliable. Here I am in Mobile, AL, a few miles from their regional airport and I can’t get a reliable data connection. I could launch into an AT&T tirade but that would miss the bigger picture. Mobile, AL is a major city. If I have problems here then what about more remote places? What about other countries? What if I were using a Chromebook? Right now I am writing this post. I will upload it when I have a better connection. I just can’t see buying into a usage model that demands 24/7 connectivity. For that reason I have no desire for a Chromebook. The Chromebook will fail.

Transparency of use is still coming but it will happen in a way that takes into account the issues I have just raised. Apple’s iCloud will sync data and leave a copy on each device. Microsoft Mesh does the same. I still believe that a modified version of this together with the Chromebook approach will win in the end. The difference will be that the modified Chromebook (phonebook?, Plattbook?, iBook?) won’t connect to the internet directly but will be a peripheral device for the phone. Your phone will be your wallet and as such always with you. It will also be your primary data device. It will sync with other devices through the cloud and be backed up to the cloud but interactive data access will be to the phone.

Firemint has announced a dual screen capability for Real Racing 2 HD which uses AirPlay mirroring in iOS5 to show a race car on your TV (via Apple TV) while status information is on your iPad. The iPad acts as the controller. This is a bit similar to what Nintendo is showing at E3 for their Wii U. However, what I don’t see is multiplayer. Also, the iPad is running the game. Apple TV is just acting as a display device. This isn’t as complete as where Nintendo is heading but I see no reason it can’t be. Apple just has to make the Apple TV a gaming platform. Come on Apple. The hooks are there.

At WWDC Apple announced an improved AirPlay in iOS5. I have broken this out for a separate post because it has gotten little attention from the mainstream press and has huge near and long term implications. The key new feature to focus on is AirPlay mirroring. In the near term this is all about corporate penetration. Mirroring works on the iPad 2 and allows you to display the screen on a separate device; for example a TV with Apple TV attached. This is another step towards using the iPad as a presentation device. All that is needed is a wireless receiver that can be hooked to the projectors now standard in corporate meeting rooms. That would allow cordless mobility using the iPad as a small, easy to hold, presentation device. There is a lot of near term potential here. This is about way more than a few extra iPad sales. Apple has always been viewed as a consumer company. The iPad is changing that and the result is big. RIM had the iPhone locked out of the corporate market. Recent security improvements on the iPhone together with the iPad being adopted in the corporate market has changed that. The result is that RINM is losing its hold on the corporate world. Driving the iPad deeper into the corporate world will extend this and prevent the Playbook from getting traction. The iPad has the potential to be the de facto corporate presentation device. Apple just needs to listen to me and make the wireless battery powered AirPlay display adapter. Throw in transparent collaborative syncing of files and corporate presentations just got a lot easier and slicker.

In the long term AirPlay mirroring takes on even greater importance in an entirely different way. First, you have to move AirPlay mirroring to the phone. Then add in a data link over Bluetooth. What you now have is the ability to merge the phone completely into the automobile. This will take a lot of work to be done in a way that is clean and aids rather than distracts the driver. As a simple example, however, imagine playing movies stored on your phone on a display in the car. Another example would be using the GPS and navigation software in your phone to display a map and directions on the display in your car along with voice guidance through the car’s audio system. Commands would be given through controls on the steering wheel and voice commands. This is a small but important step towards making the phone the dominant computing platform by a wide margin.

At WWDC, Apple announced iMessage. This is a direct attack on BBM. BBM has been a cornerstone RIM product. BBM has been about what makes a Blackberry different. Ouch! At every turn Blackberry seems to lose relevancy and it’s ecosystem gets passed. The Playbook is getting a lot of ad time right now but the Samsung Galaxy Tab 10.1 is just about to hit stores and it will be a much better tablet for those who eschew the Apple ecosystem. I hate to keep repeating myself but I see little from RIM to give me hope. All I see is a painful decay. In and of itself iMessage is just another small evolutionary step towards convergence and transparency similar to the nice moves Microsoft made in Mango. For RIM it is another big blow.

I didn’t publish anything Monday or Tuesday. I was busy digesting what was coming out of WWDC and E3. I won’t regurgitate the standard stuff covered better by sites such as Engadget. Rather I want to comment on what people missed or only put down as a footnote. However, I do need to go through a few big items. First, WWDC is notable for no new hardware and few surprises. Little made me go WOW! The cloud is taking on more importance. However, a lot of this has already been done by Microsoft and Google. What Apple brings, get ready for it, is better transparency of use. If you are willing to buy into the Apple ecosystem then you get data transparency in return. The same goes for Microsoft and Google but the Apple approach is more automatic and, here is that word I overuse, transparent. This is an ecosystem war. Who gets left out? Well, I’n not buying any stock in RIM.

Everyone is talking about what the cloud will do. Here is what it won’t do. Right now no one has it syncing apps or present device status. That means when you move from one device to another you don’t just pick up where you left off. Your data will be there but you will have to open an appropriate application and load the data. If you don’t have an appropriate application installed, for example Excel, then well… it won’t be installed. So, all of the new stuff  coming out is a step in the right direction but just a step.

I liked Apple’s Match announcement but it just highlights the bandwidth limitations that make a pure cloud existence less than thrilling. The bandwidth issue is one of many reasons I am less than thrilled with Google’s Chromebook concept. Also, you will have to be careful with iCloud to make sure you really have your photos backed up since they only remain in the cloud for 30 days. In the end the cloud is great for syncing and sharing but i don’t want it to be my only data storage location.

As far as E3 is concerned there was the usual plethora of game announcements. On the hardware front Nintendo showed an early version of the Wii U complete with graphics generated on Xbox 360 and PS3. Yes, you read that correctly. Some of the example graphics were actually generated on competitor’s platforms. What’s notable about the Wii U isn’t the fact that it has a faster processor or 1080p graphics. The big deal is the new touch screen controller. It lets you play without using the TV set or if you do use the TV, have a second display. Wait, isn’t this just like what I was suggesting for Apple? Oh yeah, the Nintendo controller includes accelerometers and gyros just like an iPhone. Nintendo is on the right tract. However, Apple, Google and Microsoft are all coming from stronger positions if they will just see it and actually attack this space.

I have discussed the need for wireless charging on several occasions and mentioned a new ultrasonic technique here. One issue with the ultrasonic method is inefficient penetration of materials. For example, a simple mobile phone case has the potential to prevent charging. My version of transparency demands that the user have to do nothing to connect. It needs to occur well ummm…. transparently. I mentioned the problem with inductive charging being range and the need for a one meter range. Well, I was mistaken about the limitations of inductive charging. In fact, mistaken is an understatement. Back in 2007, Karalis, Joannopoulos, and Soljac published “Efficient wireless non-radiative mid-range energy transfer” in Annals of Physics. Apple was more observant than I am and picked up on this. The result is their patent “Wireless Power Utilization in a Local Computing Environment.” It describes wireless charging over about a one meter range. The near term impacts of this are small but the long range impact will almost certainly be huge. This isn’t a one off patent from Apple. They have already been looking at more typical very short range inductive charging solutions. For example patent 7352567, “Methods and apparatuses for docking a portable electronic device that has a planar like configuration and that operates in multiple orientations”, describes a wireless charging and data connection base for the iPad. It’s interesting for also including a wireless data connection in the base.

In terms of long range potential, imagine having your phone charged while you drive your car or while you sit at your desk at work or when you sit in your recliner at home watching TV. Freeing the phone from its battery limitations opens it up to become your primary computing device where you are able to rely on it always being there. This is huge. Google, Apple and Microsoft are all working on syncing through the cloud. However, that only goes so far. They are syncing data and not applications. Also, it will be a long time before truly high speed wireless data is everywhere.

Pioneer announced the AppRadio a few weeks back . You can read about it here. I got excited at first. I thought they had really integrated the iPhone into the radio. Instead it runs its own apps. I want it to display my iPhone on a screen in my car so that I run the apps on my iPhone. I don’t need yet another device to get apps for. I want to run the ones I already have on my iPhone.  I was kind to Mulally in my last post. That’s because I feel he is pushing Ford in the right direction. Still, will someone please “get it” that the phone is primary and the car should include an interface to the phone rather than duplicating the smartphone’s functionality?

Lately I’ve watch a number of interviews with Ford CEO Alan Mulally. I find a lot to like in this guy. He puts forth a good image for Ford. Moreover there seems to be substance to back up the talk. When you look at Ford you see a company on the upswing. Quality has improved to where it competes with the best out there. Furthermore I sense a spirit in the company which wants to lead rather than follow.  I don’t always agree with what’s being done but I admire the attempt. A good example is the use of Microsoft’s Sync product. It’s flawed. I have concerns because it is from Microsoft. Then again I would have concerns if it was from Apple.  It does NOT do what I think it should. Mulally seems to understand this. Here is a good interview that speaks to convergence and transparency.

Pay particular attention to the 7:40 and 10:10 time points. Mulally mentions making the digital life in the home merge with the digital life in the car. I like this guy. He accepts criticism of Sync but stands by it as the right direction even if presently flawed. I like a guy willing to believe in a direction and work to perfect it even if the initial attempt isn’t what it should be.