October 12, 2009

Microsoft screwup puts T-Mobile users in Danger

A Microsoft subsidiary just lost the data for thousands of mobile users, which may end up killing the T-Mobile Sidekick -- not a smooth move by a company trying to win back our trust

Leave it to Microsoft to kick itself in the gonads just days before a huge product launch. This particular incident doesn't even involve Windows or any Microsoft product, but a subsidiary that probably few people associate with Redmond.

Some background: As any T-Mobile Sidekick user will tell you, for the past week they've been unable to get their e-mail or other data because of an outage at Danger, the company that (allegedly) manages the Sidekick database. On Saturday T-Mobile admitted what no Sidekick user wanted to hear: Danger had lost the data.

[ Are you ready for Redmond's next raid? Don't say Cringely didn't warn you in "Windows 7: The hypeman cometh" | Stay up to date on Robert X. Cringely's musings and observations with InfoWorld's Notes from the Underground newsletter. ]

No real-time disaster recovery, no backups, no nuthin'. All of its users' e-mails, contacts, photos, videos, and so on had shuffled off their mortal coil and were now residing in Data Valhalla, never to return.

T-Mobile delivered the bad news in a letter to Sidekick users on its support forum:

Regrettably, based on Microsoft/Danger's latest recovery assessment of their systems, we must now inform you that personal information stored on your device - such as contacts, calendar entries, to-do lists or photos - that is no longer on your Sidekick almost certainly has been lost as a result of a server failure at Microsoft/Danger. That said, our teams continue to work around-the-clock in hopes of discovering some way to recover this information. However, the likelihood of a successful outcome is extremely low.

What does this have to do with Microsoft? In April 2008, Danger was acquired by the Redmond giant, presumably to help them develop smartphone software that was less lame than Windows Mobile. (Because it's not possible to make something that's more lame, IMHO.)

The obvious question: What were they thinking? Letting Microsoft acquire a company called Danger is like buying a pit bull named "Killer" and letting him sleep in the henhouse. It's only a matter of time before you've got blood and feathers everywhere.

White Paper

D2D Virtual Tape Library Replication Primer

This whitepaper explains the terminology and concepts behind Data Replication technologies and establishes some sizing rules through worked examples. Learn the new paradigm in disaster tolerance—protect data anywhere.

Download now »

White Paper

An Alternative to Virtualization for Datacenter Cost Savings

Server virtualization is a popular option for dealing with mounting datacenter costs. Another equally promising approach is the use of an Application Delivery Controller. Citrix NetScaler provides a low-cost way for organizations to reduce their server count and accrue cost savings from a reduction in space, cooling, power and personnel.

Download now »

White Paper

Why Your Firewall, VPN, and IEEE 802.11i Aren't Enough to Protect Your Network

The emergence of WLANs has created a new breed of security threats to enterprise networks.

Included in HP ProCurve WLAN solutions is security technology that alleviates threats from WLANs through:
* Monitoring wireless activity inside and out of the enterprise
* Classifying WLAN transmissions into harmful and harmless
* Preventing transmissions that pose a security threat to the enterprise network
* Locating participating devices for physical remediation

Download now »

White Paper

Bringing the Edge to the Data Center

Effectively address data protection challenges, implementing solutions that help store and protect business–critical data while cutting costs and improving efficiency and reliability.

Download now »
CodeZombie 12-Oct-09 10:01am
1 reply
Wow! I've heard of some boneheaded moves before but this pretty much takes the proverbial cake. And who the hell names their company "Danger" anyways? Reminds me of that car oil commercial with the stunt driver named "Danger" whose car goes about halfway up the ramp before it gets gallons of sludge dumped on it. Geez, and we're not anywhere near April Fools Day.
EirikThorvalsson 12-Oct-09 11:44pm
Speaking of cars, what happened to the car company that named models Tornado, Avalanche, Syclone, Typhoon.... Eirík Þorvaldsson
etsuhemp 12-Oct-09 10:53am
"Letting Microsoft acquire a company called Danger is like buying a pit bull named 'Killer' and letting him sleep in the henhouse. It's only a matter of time before you've got blood and feathers everywhere." Cringely's wordsmithing reads like geek poetry...or a Greek tragi-comedy.
jakmar 12-Oct-09 10:54am
2 replies
Haven't you people been listening to Papa Bill? If we could only increase the cap on H1-B's then he would have been able to find someone qualified to perform that upgrade, since there are no qualified Americans!
rcprimak 12-Oct-09 10:54pm
Hitachi is not an American Company. They are Japanese.
mysticturner 13-Oct-09 6:35am
Maybe if Papa Bill would stop destroying morale by replacing Americans with h-1b workers then his staff would care enough to take the backup.
chanur 12-Oct-09 10:58am
1 reply
Normally I don't believe in over dramatic headlines or sub headings, but in this case it should read "A Microsoft subsidiary just lost the data for hundreds of thousands of mobile users, which may end up killing the T-Mobile Sidekick -- not a smooth move by a company trying to win back our trust"
MAS 12-Oct-09 11:50am
I agree! Why not a headline like:

"Danger Inc., a company founded by Apple and Philips Executives, ...

garyisabusyguy 12-Oct-09 11:21am
Ok, ok, MSoft demonstrated a complete lack of understanding of datacenter operations, not the best way to convince your customers to move to their server products... But, I think that this points to an even more disturbing trend in IT and that is a move away from tape backup towards online backup offered by a single solution. We have all been in the demo where they talk about high-speed disk for online systema nd slower storage for on-line backup. They talk like you can run on this system, like forever and the idea of rolling stuff off to tape is mentioned as an afterthought. So, if your online backup is on the same system as your SAN, apparently, you could be in the same world of hurt as MSoft. So,we put the SAN salespeople on the firing line right behind MSoft operations, but I still want to know... Where is my multi-tera-byte tape that can handle multiple streaming fibre channel (or 10GigE) connections and put my whole SAN to disk in a matter of minutes? Even a few hours would be a dream. Why aren't the SAN vendors selling these products and why do they hock online backup as a reliable solution?
Loerps 12-Oct-09 11:46am
1 reply
Apple just boght an online maps company called Placebase, perhaps to compete with Google Maps. Are you saying that if Placebase does something stupid now that this could jeopardize the release of the next Apple OS?

Sounds like a bit of a stretch to me.

willicueva 13-Oct-09 1:32am
In this case, apüple would not be keeping my Data on their servers. If the iPhone were holding my Data on an Apple server without the posibility of my backing up my software locally - THEN it might jeopardize the release of the next iPhone.
mulithats 12-Oct-09 11:52am
Backup 101: 1. Multiple copies of all data. 2. Each copy must be on physically separate hardware and/or media. Otherwise, it does NOT count as a separate copy. 3. Test restoration from all backups on a regular, repeating schedule. 4. At least one backup is off site at all times. How hard is that?
MAS 12-Oct-09 11:53am
1 reply
While the fact that T-Mo/Danger/MS screwed-up is bad enough:

Who, in their right mind, doesn't back up their own data?

rcprimak 12-Oct-09 10:56pm
If you mean synching the T-Mobile devices to our personal computers, by design we cannot do that. We are at T-Mobile's mercy.
Gray_Hair 12-Oct-09 12:09pm
1 reply

For scale of bone-headedness this is hard to top, but for scope of bone-headedness, I still gag thinking about TJ-Maxx making it a standard install to put credit card processing cash registers on an UNSECURED wireless LAN.

rcprimak 12-Oct-09 10:57pm
And they were not the only retailer caught with their pants down, so to speak ;).
lcarliner 12-Oct-09 12:46pm
As far as Windows Mobile is concerned, when Microsoft adopted the name Vista for the Longhorn product, my "brilliant" naming scheme was upended. I had suggested: Shorthorn Lite for the starter third-world edition, Shorthorn for Home Basic, Longhorn for Home Premium, Longhorn Fatted Prime for the Ultimate edition, Longhorn Utility for the Business Edition, a...n...d f..i..n..a..l..l..y for the Windows Mobile, SHOEHORN!!!
shamunda 12-Oct-09 12:52pm
Well actually this won't put a dent on Windows 7 launch, neighter shed darkness or light on Windows 7. So if you're trying to expand a bleak picture MS with relation to the W& launch, try again...Or at least try a bit harder. This won't be on anyones radar other than those that have been using the sidekick service, and even then those users won't be thinking about this during the W7's launch in any way, shape, or form. Guaranteed. Is this anything to worry about? Not in the least. Ask yourself this, if you're not using sidekick or storing anything in the cloud at this moment, does this information really bother you? To the average person that will be using information services to either store, read from, or do whatever... The history of this particular event won't even scratch the surface, let alone anything else. All cloud services will at one point have some issue, ALL of them, some more severe than others. Take Google for example. They too have issues with their online apps, but when was the last time that you said you're not using them again?
BK 12-Oct-09 1:20pm
1 reply
While it's easy to jump on Microsoft, are we going to give the hardware vendors a pass again? While backups of critical data are a must and there is no excuse for not having them, Hitachi should be able to upgrade their products without failures. As someone who has been through a few whiskey tango foxtrot moments with SAN manufacturers, I have little faith in the no downtime, no data loss statements. I think Garyisabusyman and MAS make great points. Not to mention how hard it is to get a budget for backups and with today's storage requirements it just gets harder. What expectations did these phone users have that their data was being backed up? Any SLA? Even if I had a sidekick, I would not be affected cause I back up my own data. And once again, no one jumping on Hitachi for not doing a backup themselves before they ran their updates?
rcprimak 12-Oct-09 11:03pm
Again, backing up your own data from these devices is by design not possible. There's no way to synch up with a personal computer. The only backup is through T-Mobile's in the cloud methods.
RamboTribble 12-Oct-09 4:16pm
1 reply
I wonder if the backhanded beneficiary of this might not be IBM's new cloud initiative. First Google, now Microsoft have given cause for caution. Can Big Blue woo worried enterprise IT execs on claims of reliability? Better yet, can they deliver?
rcprimak 12-Oct-09 11:04pm
No and no. Nobody is going to get this Cloud Computing or Online Backup thingy right anytime soon.
JamesMartin 13-Oct-09 5:29am
1 reply

"...wracking my brain trying to think of a comparable screwup by a major company. I'm coming up empty. How about you? "

I can think of several bigger ones.

Enron, GM, Chrysler, and who was it that bought out a bankrupt company then paid the managers of the bankrupt company millions in bonus with tax payer money. Also how about hiring private investigators to phish reporter phone records. Don't forget the city that threw it's network administrator into jail for doing his job.

Old Geezer 13-Oct-09 8:48am
Agreed that those are bigger screwups....but they were not the fault of IT professionals. Any candidates for a more visible, widespread Richard-Cranium-grade FUBAR?
philc 13-Oct-09 7:07am
1 reply
More than anything, this puts a cloud over "cloud" computing. Who in there right mind would put all their data in a cloud. We all know what clouds do. They disappear the next day. Maybe someday we'll have the option of running our own software on our own computer over the internet, and can use an internet backup as one of the backup levels.
rcprimak 13-Oct-09 9:59am
I would like to relate the story of how I once spent a week putting my data up on Driveway (online backup). Later in the year, the service closed abruptly, leaving me without access to my data. The same could happen with any Cloud Computing service. Always make your backups available locally. If your Windows crashes, you will not be able to get on line anyway. Rollback is preferable to Reinstall and Rebuild. Use Image Backup software, such as Acronis True Image or Norton Ghost for your system, and simple Windows Copy/Paste for small to medium sized files. Or synchronize to yur external drive or Home Server with any of the popular software products made for this purpose. The cost of external Hard Drives is so low now that on line backup is for chumps. But with Mobile Devices and iPods, you often have no other choice. I would not sign a contract with a company which does not allow me to make a local backup of my files and contacts. That includes iTunes Libraries, for which people actually pay good money.
A41202813@GMAIL.COM 13-Oct-09 8:11am
M$, No Money For Multiple Backups ? M$Z, Dollar Symbol Still Bothering You ?
danq 19-Oct-09 10:39am
If, as was said above, users could not back up their own data... then those who accepted this 'service' are equally to blame for their loss. If you are not in control of your data, you have lost control of your data! A while back I was "strongly encouraged" by management to back up via an internet service. I refused for reasons already stated by others, which boil down to: if I cannot see my backups I don't know that they will exist when I need them. That's *when*, not *if*.

Sign up to receive InfoWorld Resource Alerts

Subscribe to the Robert X. Cringely: Notes from the Trenches Newsletter

The one-stop resource center for IT professionals.

©1994-2009 Infoworld, Inc.