The HP Mini 5102 had a broken keyboard

Or to be more exact, at least the unit I got had a broken keyboard controller. This page details my experiences with Hewlett Packard. It's mostly a memory dump, so please forgive any errors in the minor details.

tl;dr?

My HP laptop had a buggy keyboard, and it took them over a month three five months to investigate and fix it.

I wanted a usable small laptop

Perhaps even a netbook, as they're commonly called nowadays.

I went looking around the interwebs for reasonable models. It took a while, but I eventually settled on the HP Mini 5102. "95% size" keyboard, decent screen resolution, enough processing power, and every kind of built-in wireless connection I could ever want. It even had a Linux-based version out, so it was reasonable to expect that mostly everything should work under Linux.

Jul 29 Thu So I ordered an HP Mini 5102

I ordered it from a Finnish dealer, which is less hassle but more expensive. For some reason, a built-in 3G modem seems to bring the price of laptops up by more than 100€ around here. Wonder what's up with that?

Aug 02 Mon And soon I had my laptop in my hands

After the wait over the weekend I had my new laptop in my hands. Before going to work I took the pre-installed Windows 7 for a quick spin to make sure all the hardware works. Or perhaps I should say I had it undertake a painstakingly slow, somewhat circular, motion.

I learned two things:

  1. For some reason they had pre-installed an OS that's way too resource-hungry and so much other software that the system was almost unusably slow, and
  2. Whoever pre-installed it forgot to use about 80% of the hard-disk. Surely I can notice two hundred gigabytes of unpartitioned space, but I wouldn't expect a non-tech-savvy user to ever find their missing gigs.

Then came the evening

It was time to install some usable software on the laptop. I chose Arch Linux because it combines the flexibility of Gentoo with not having to wait for things to compile. After a failed attempt with an installation disk so old it wouldn't find any hardware (why are your default images so old, unetbootin?), and a few rebAoots later, I had a nice Arch system installed.

And that typo wasn't made by me. It was made by my keyboard.

My keyboard has a mind of its own

While installing the system, I had to reboot it a few times, and quite soon I noticed that I was constantly typing "rebAoot" instead of "reboot". First I shrugged them off as not being used to the chicklet type keyboard (which, surprisingly, isn't that bad to type on), but then I realized that that kind of typo is almost impossible to make. But yet, I kept making it.

After trying different ways to make the impossible typo manifest itself I found out exactly how to cause it. Pushing r, e and b at the same time made an extra "A" appear on the screen. Later I would realize that the "A" was actually caused by an F1 keypress, but that's how it appeared on the virtual console.

Soon after that I also found out why I had mysteriously gotten sent back to my home directory a few times — pushing c, d and the spacebar at the same time caused an Enter keypress to be generated. And "cd" by itself, of course, sends the user back to their home directory. This was starting to get annoying.

Now, I wouldn't push three keys at the same time on purpose, but it's very easy to do by accident when I'm typing fast. That's the way I type, and I need my computers to play along.

To make sure it wasn't a software problem, I tried booting back into the pre-installed less-than-usable OS and pushing a few keys at the same time, and indeed the problem was still there. It even happened in the BIOS settings tool! There had to be something physically wrong with the keyboard controller.

Aug 03 Tue Even the Internet is clueless

By the next day I had gotten fed up with my keyboard sabotaging my attempts to use the command line. I googled for every imaginable combination of related keywords but got no viable hits. Not even a single one. Luckily, a co-worker walked up to me, and said:

Co-worker
Hey, what laptop was it that you bought again?
Me
The HP Mini 5102. How come?
Co-worker
Been having any keyboard trouble?
Me
Yeah, how'd you know?

Apparently he had done some research on my laptop after seeing it on the previous day. He had found a single Usenet thread about the laptop having such trouble, posted only a week ago, and on top of that it was in Finnish. It hadn't even occured to me to google in Finnish because that usually yields no useful results when it comes to computers.

This led me to believe that the problem might only affect Finland in some way. Perhaps it was the Scandinavian keyboard module, or maybe the problem was with a certain unlucky lot that had found its way into Finland. Surely if the problem was more widespread, there would've been information available in English as well.

The thread had someone looking for a software solution to the problem, along with people who had the same model but had never ran into the problem. Maybe it was a random fluke and could be fixed by replacing something.

The first phone call

I called up the vendor I had bought the laptop from. They hadn't heard of anyone else having the same problem, which was odd, but they were very helpful. They promised to call the manufacturer to ask if they knew anything, and were very sorry about not being able to get back to me during the same day. It was almost 17:00 so that was understandable. They promised to call me back the next morning.

Aug 04 Wed The next morning

The vendor returned my call quite early and told me that the manufacturer hadn't heard of the problem either, but in their opinion it probably only affected a certain lot and could be fixed by just switching the keyboard itself. The vendor gave me HP's support number and I immediately called them up.

Now, I'm not exactly an expert on laptop keyboards, but when extraneous keypresses are registered when too many keys are pressed at the same time, it sounds like a problem that wouldn't be caused by the keyboard matrix itself, but by the keyboard controller. But I thought I'd give HP a try. They're the ones who make these things, after all.

My first call to HP Support

After the usual exchange of greetings and me spelling out the laptop's serial number, my call to HP's Finnish support line went something like this:

HP Support
Me
So the laptop has a weird keyboard problem where pressing certain three-key combinations cause extraneous keypresses. Have you heard of anything like this?
HP
Yeah, you're probably the guy the vendor called about earlier. It's probably a bad lot. We can either send you a replacement keyboard if you want to replace it yourself, which is faster, or you can of course send your laptop in for service.
Me
I think I can handle switching a keyboard.
HP
All right, I'll put a replacement in the mail. It should arrive by tomorrow. I'll also e-mail you a case number and an instructional video on how to perform the switch.
Me
Great, thanks, bye.

Awesome! A new keyboard by tomorrow. Can't wait.

I decided to reply to the thread to give some hope to the poor person trying to cope with the bug. I told them that HP promised it would be fixed by just switching the keyboard and soon they replied back to me:

That's what they offered me as well, but it didn't work and they even switched the entire PC twice. So I've tried four different keyboards with the same problem, in a short period of time. It's possible they all happened to come from the same lot.

Doesn't HP even bother to test their replacements for the exact problem they're supposed to fix, before sending them out?

Aug 05 Thu Assembly 2010

Assembly is a yearly (nowadays-less-of-a) demoscene event that spans from Thursday to Sunday. The quality of the event itself has gone down as the amount of gamers attending has increased, but it's still a great place to meet up with friends.

Since next-day packages usually arrive by 14:00, and there's no point in going to ASM too early just to stand in line for an hour to get in, I decided to wait until the evening to leave.

The keyboard never came. Neither did the e-mail they promised to send. Luckily the very friendly vendor had also sent me instructions for switching the keyboard — they were quite straightforward, but still a nice thing to have.

Aug 11 Wed HP had already forgotten about me

After returning from a great four days at ASM, I came home to find that I still had no replacement keyboard. Also, I was to work full days (that mostly consisted of meetings) in Helsinki for a few days, so I didn't remember/get a chance to call HP until the next Wednesday, which was about a week from when they promised to send me my keyboard.

During a break, I called HP up again:

HP Support
Me
Hi, so you promised to send me a replacement keyboard for my laptop, and it was due about a week ago. Still haven't gotten it.
HP
Oh, that is unfortunate. What is your case number or serial number?
Me
I don't have the serial number with me right now and you never gave me a case number.
HP
That's too bad, we kind of need one of them to open the support system up.
Me
Seriously? Can't you look me up by name?
HP
Well, I could try...
Me
It's Matti Virkkunen. And I live in Lahti, Finland.
HP
No, there's no-one with that name here. In fact I've got no-one named Virkkunen living in Lahti.
Me
How is that possible? I talked to you just last week.
HP
I'm sorry, but there's nothing I can really do. You'll need to call back when you have your serial number at hand.
Me
What are your service hours?
HP
Nine till five. And... that's about ten minutes from now.
Me
*sigh* I guess I'll call you tomorrow then.

Aug 12 Thu The next day

Finally a day which I didn't have to spend sitting in a meeting, so I decided I'd call HP early.

HP Support(?)
Indian guy
(In English) Hello, this is HP central board, the Finnish support is very busy. Please call later.
Me
Oh? Well, I can do this in English if necessary.
Indian guy
No, no, I cannot help with support. This is central board.
Me
So you can't do anything for me?
Indian guy
No.
Me
Well, bye bye then, I guess.

Gee. I didn't have much anything else to do, so I called them back just a few minutes after.

HP Support
HP
HP Support, how may I help you?
Me
Have laptop with broken keyboard. Was supposed to receive replacement. Didn't show up. You have your thing ready so I can spell out my serial number?
HP
Go ahead.
Me
1234567ABC
HP
It seems there's a support case for this, but it's still open. That's odd. Let me see what it says. Yes, there are some numbers on it.
Me
...some numbers?
HP
It looks like a bit like a date but I'm not quite sure what it means. Let me go find the person who wrote this, please hold.
Me
All right.
HP
Yes, I'm afraid it's a date. It seems the warehouse is out of replacement parts right now, and this would indicate that they're expecting to receive more on the 30th of this month. I'm very sorry this is taking so long. It's possible that the part will arrive early, though.
Me
So, from overnight to next month? On a single keyboard?
HP
I'm afraid so.
Me
I guess I have no choice but to wait it out. And could you e-mail me my case number because I still don't have it.
HP
We're sorry about the delay. I'll e-mail you your number right away.

It seems that HP's "very busy" means a five minute wait in line at maximum, and that their support techs don't know how to write case details clearly enough for other people to understand.

Aug 13 Fri Suddenly, UPS.

The very next day I get a call from the UPS guy.

UPS Guy
UPS
I have a package for you at (address), are you available to receive it right now?
Me
I'm currently at work, so could you bring it here? By the way, who is it from?
UPS
I don't really know. The sender just says "DHL" which is a bit weird because we're supposed to be competitors. Oh, and it's apparently from The Netherlands.
Me
So I'm getting a DHL package via UPS from The Netherlands? What's in it?
UPS
It just says "electronic equipment".
Me
All right, bring it here.

I wasn't really expecting the keyboard yet, and the UPS person sounded very uncertain about the nature of the package. But when I got it, it was indeed the keyboard. And there was much rejoicing.

Curiously the package was addressed to a Mr. Virkkonen, while my last name is Virkkunen. Apparently the first person who talked to me had typo'd my name. That's probably why they couldn't find me by my name. And since my e-mail address also contains my name, it was also why none of their e-mails were reaching me.

My brand-new laptop, now with a newer keyboard

When I got home from work, I installed the keyboard and tried it out. I wasn't very surprised when the problem persisted. I did notice that the keyboards had different revision(?) numbers. This was starting to look much less like a random manufacturing error.

And it was Friday after 17:00. Damn it.

Aug 16 Mon All the error messages I've ever seen, and then some

On the next Monday I called HP up between meetings. I was well prepared, I even had my serial number written down on a piece of paper.

The first two or so attempts gave me an unusual "Connection error" message. I thought it might just have been bad reception.

Then I got busy tones, three-tone error signals, calls cut short while navigating their touch-tone menu (which I had already memorized; luckily it lets you navigate it fast if you remember the keys to press), and it eventually settled on hanging up on me just after "Please wait, your call is being connected". After about ten tries I gave up.

Later on the same day I had some time while sitting on the train, and I decided to try again. After seven or so attempts, I finally got through to a human:

HP Support
Me
Just one thing, have you been having trouble with your phones today?
HP
Well... yes. Calls keep getting cut, and we can't dial out at all.
Me
Great. Let's do this fast, then. My serial number is 1234567ABC.
HP
All right.
Me
First of all, my name is Virkkunen, not Virkkonen. Fix that. And the same typo in my e-mail address too. That's why your mails haven't been getting through. Now, you suggested switching the keyboard would fix the problem. It didn't.
HP
Let me just look it up... I guess there's nothing we can do except switch the entire system board. You'll have to send it in for service.
Me
Okay. I'm running out of battery here, so if the call gets cut could you just e-mail me the instructions? Make sure you corrected the typo in the address.
HP
Good, I was going to e-mail you them anyways.

We talked for a while about the details and then the call got cut short. And it wasn't my battery running out that caused it.

Shortly thereafter, while still on the train, I received an e-mail asking me to try if the problem happens in Windows Safe Mode. I immediately replied and said that the problem also occurs under Linux, which I had already told them and which should be recorded in the case details.

I got a reply to the mail in the night about four hours later. It was from my friendly local Mailer Daemon. Apparently their phones weren't the only thing with reliability problems.

Aug 17 Tue HP warranty service

Nevertheless, the next day e-mail started pouring in about HP's warranty service and pick-up instructions. UPS was to show up the next day to pick up the laptop. All I needed to do was be home and hand the machine over to the UPS guy, who would even package it for me. At least they make their returns easy for their customers.

Then again, as I'd come to expect, their messages and service weren't entirely without problem.

  1. The e-mails were still addressed to the mysterious Mr. Virkkonen. At least they'd fixed the typo in my e-mail address because now I was actually receiving their messages, but they could've done the same to my name as well.
  2. The link to their support page was broken. Their token replacer had forgotten to substitute in one of their various IDs. Luckily the link was easy to fix by hand.
  3. The problem description on their support page read, and I quote: "Keyboard is not function". I really hope their support techs have more information at their disposal than just that.
  4. UPS's pickup time was "from 8 to 18". Nice time window. Especially for people who need to do something else besides sit home all day long waiting for the UPS guy. Of course they allow you to re-schedule, but probably not within the same day.

Because the reliability of their support techs didn't really convince me, I didn't have high hopes for their service techs either. So I wrote them a letter:

Also included were my contact information and a link that points to a unique location on an HTTP server, which I redacted from the online version. The link points to a page that just says "Thank you", and its purpose is to log if any of them has shown any interest in the contents of the letter.

I truly hope it gets read and they test the system before sending it back, which for some reason doesn't seem to be standard practice for HP.

After printing out my letter, I proceeded to take backups and wipe personal data from the laptop which I'd already started using, while getting thrown back into my home directory multiple times due to the c+d+spacebar bug. After my backup tool (commonly known as dd if=/dev/sda7 | gzip > /mnt/nfs/backup.gz) was done backing up anything I might need, I folded my letter neatly in half and taped it onto the keyboard. At least that way there was no way they were going to completely ignore it.

I didn't bother to remove GRUB because it boots into Windows just fine, although I did forget that the menu entry was called "Faildows". Heh. I hope that doesn't confuse them too much.

Aug 18 Wed The pickup

The UPS guy showed up at around 13:00, neatly right in the middle of his time window, and I handed the laptop over to him, and he handed me a small slip for tracking.

Now all there was left was to wait for my laptop to reach Bydgoszcz (that's not a typo), Poland and for HP to take a look at it. And hopefully my letter as well.

Aug 20 Fri First word from HP service

I checked HP's support website to see if they'd started working on my laptop, and got "Unable to retrieve the required data, please try later". I really hope their system hasn't forgotten about me again.

Then, at around midnight, I got an e-mail from HP.

Dear VIRKKONEN MATTI     (*sigh*)

Unfortunately there is a delay in processing your device, because the components required for repair are not available.

We're sorry, and are doing our best to rectify the problem as soon as possible. We will e-mail you again once we know the return date for your device.

I think HP should really start readily stocking more parts for their products.

The link I put in my letter hasn't been visited by anyone yet either. I wonder if they've read it.

Aug 25 Wed Case status update

It seems HP finally got around to updating the case status on its support website. The "Solution description" now reads "Wrong/missing part: Please Specify in Comments". Not much of a solution if you ask me.

No description in the comments either.

...now, a while later, the status reads "Your unit has been repaired, and will be returned" and there's a return shipment date! No e-mail or any other notification though. Maybe they'll send one when they have a tracking code for me.

I can barely contain my excitement.

Aug 25 Wed They're sending my laptop back!

It's 23:35 and I just received this:

Dear VIRKKONEN MATTI

We hereby notify you that the HP service center has shipped your device back today and it's expected to arrive on 26/08/2010. There is a letter attached to the device that details the repairs made.

Did they really fix it? Did they test it? Did they read my letter? (No pingback, so either they discarded it or just don't visit random URLs printed on letters)

...will they ever stop calling me Virkkonen?

We'll soon find out.

Unfortunately I probably won't be able to receive it tomorrow because it's Helsinki and meetings all day long once again. Meh.

Aug 26 Thu UPS just came by

The UPS guy was nice enough to go off route to deliver me my laptop because I wasn't home at my designated delivery time. I caught him just as I was going back to the office — and got my laptop back.

It was packed in a ginormous return package, however the letter the service centre had promised to attach to it was nowhere to be found, so no explanation as to what they had actually done to it.

So, I booted it up and was greeted by Grub. At least they hadn't wiped the hard-drive. The built-in Windows 7 slowly came to life, as I had kindly set it up to do so for the service personnel. I opened up Notepad, pushed c, d and space at the same time and...

...got an extra Enter keypress. Same thing with the other combinations I'd found. HP hadn't fixed my laptop.

HP, (屮゜Д゜)屮 WHY U DO DIS?!

More so, they hadn't tested it before sending it back either, or if they had, at least they forgot to attach a note saying "hi, we looked at your PC and decided not to fix it".

I immediately called them up:

HP Support (at about 16:00)
Me
Hi, it's me. Once again. I bought a laptop from you, it had a hardware problem so I sent it in for service. It just came back and it still has the same problem. What gives?
HP
Oh, I can't really say anything off the bat, do you have a serial number or--
Me
Yes, I have my serial number. It's 1234567ABC. But just one thing, don't you test these things before sending them back after repair?
HP
So it has some keyboard trouble? I don't quite understand the description of the problem...
Me
Yes. (I explain the problem yet again).
HP
Has it been to warranty service?
Me
Yes. I switched the keyboard once because you told me that'd fix it. That did nothing, and now I just got it back from your warranty service. Of course, I can't tell whether they actually did anything to it without opening it up since your service people forgot to attach the note they were supposed to send with it.
HP
Maybe I've got the wrong case open, let me try another one... yes, it says there's a "wrong or missing part".
Me
Well, yeah, that's what it says. Don't know what it means though.
HP
Did you get any message from the service center via e-mail?
Me
No e-mail, but your support site says "Please Specify in Comments" in the solution field, and there's no comment.
HP
Please hold for a minute, I'll ask the person responsible.
(long pause)
HP
Can we call you back in 45 minutes? This case seems really weird.
Me
By the way, what's my name according to your system?
HP
It's Virkkonen.
Me
It's Virkkunen. With a U. I've told you about three times to fix it.
HP
All right. Your e-mail address already seems to have the correct name. Let's hope we can contact you with the correct name in the future. We'll call you back within the hour.
Me
Okay. I'll wait for your call.

I can hardly wait.

Also, one thing I haven't mentioned, is that HP's phone support line is really, really quiet. I don't think I have bad hearing, but it's really hard to hear even in the quiet of my own home without setting my phone on speaker and cranking up the volume. I guess it's one of those things that start annoying you only when you've called them twenty five or so times.

Oh, and the laptop was also clean. Like brand-new clean.And I'm pretty sure it's the same unit, it's got the same serial number and HDD and all. I'd like some of their cleaning stuff because the back of the screen is a material I can only describe as matte-fingerprint-magnet.

Summary of things HP has done to my laptop so far:

  1. Shipped it to Bydgoszcz, Poland and back via UPS
  2. Not fixed my keyboard problem
  3. Cleaned it up

I was somewhat surprised when they actually called within the time frame they promised:

HP Support (at about 16:40)
HP
Hi, this is HP. I understand you had some keyboard problems?
Me
Yeah, I do.
HP
Okay. We're sending a technician over to take a look at the machine. He should be there by tomorrow or the day after.
Me
Wait, really? I'll be at work though.
HP
That's all right. He'll call you so you can agree on a time that's okay for you, but he'll be there tomorrow or on Monday. I hope he can come up with a solution for your problem.
Me
Oh, well, all right. Thanks.

Whoa. I think they're finally starting to take this seriously. I doubt a laptop bought from a random retailer comes with on-site support by default. The technician won't be able to do anything about something that's obviously a hardware flaw (or even a design flaw) though, but if I get to talk to someone, I'll hopefully be able to get them to understand what's wrong exactly.

Aug 27 Fri HP says my case is closed

...or at least judging by the case number, the case where they shipped my laptop to Poland and back is. However, their e-mail about it also says the following:

This notification also confirms that any material that may be related to your case has also been ordered.

Material? Parts for the repair? Ordered?

...a day after I already got my laptop back?

Well, after I scrolled down to read the English version of their message (Finnish seems to come first because I'm in Finland, but their messages are sometimes in more than one language), and that reads:

Please note that if materials are being posted to you, this closure notification confirms that these materials have been ordered.

I guess their template also takes into account the case where they're just sending replacement parts out to people. It wouldn't hurt to make the Finnish translation a bit clearer, though.

Aug 30 Mon I might've been hasty in thinking they're taking this seriously

It was nearing 16:00 on the Monday on which the on-site support tech was supposed to come by, and there was no sign of them.

So I decided to call HP up once again:

HP Support (at about 16:00)
HP
Welcome to HP support! Unfortunately all the support lines are currently very busy. Please hold in line.
(I hold for seven minutes while listening to Vivaldi that sounded like it was coming from an old vinyl record, piped through a noisy old radio receiver)
HP
HP support
Me
Hi, it's me again. My serial number is 1234567ABC. Could you tell me what the status for my case is?
HP
Please hold while I check the status.
Me
All right.
(pause)
HP
Please hold while I check the status.
Me
O... kay?
(pause)
HP
Right, it seems we're having trouble sourcing some of the required parts.
Me
And you didn't think it would be nice to send me a note saying that you're going to be late?
HP
I think we just found out about that ourselves just now. We're expecting to have the parts by Wednesday and the technician will contact you after that.
Me
When is "after that" exactly?
HP
The technician should call you on Thursday or Friday.
Me
At what time?
HP
Probably during the working day.
Me
And what time is that for you?
HP
I guess it's eight to four...
Me
All right, I'll call you if I haven't heard from you until 16:00 on Friday, then. Thanks, bye.

I can't currently think of a comment. I'll write something when I can think of something.

Sep 03 Fri I got a call from HP's on-site guy

I got a call that rang for some 10 seconds (and ended before I could even find my phone) from a number I didn't quite recognize, so I looked it up and it was some IT service company called "Atea Finland". I figured it must be HP's supplier for on-site services so I called them back.

Technician (at about 13:00)
Me
Hi. I saw you tried to call me just now.
Atea
Yes. We do on-site support for HP and I heard you have a problem with a laptop.
Me
That's correct.
Atea
So I understand you had some kind of keyboard problem?
Me
Don't the case details explain the problem...? (I explain the problem for the 8th or so time)
Atea
All right. HP sent me a replacement keyboard for you, that should fix it.
Me
A replacement keyboard? I already tried replacing the keyboard and it didn't fix it.
Atea
Oh, so HP already sent you a keyboard and you replaced it? Let me check again, at least the box they sent me looked like a keyboard... yes, it says keyboard on it all right.
Me
Well, you can replace the keyboard again if you want to, but I doubt it'll do anything... it's more likely there's something wrong with the keyboard controller than the mechanics of the keyboard itself. The keyboard module didn't seem to have much any electronics on it anyways.
Atea
Hm, I guess replacing the keyboard won't do much good then. I'll order a replacement system board, that should fix it.
Me
I think they already tried that as well. At the warranty service.
Atea
Really? Are you sure they did anything to it? Did they ship it to some other country?
Me
They sent my laptop to Poland and back and at least they said they would switch the mainboard. Not that I have any way of knowing for sure because they forgot to attach the note about what they did to it. And I didn't really feel like opening the thing up to take note of serial numbers or anything.
Atea
Well, I wouldn't trust the warranty service too much. Sometimes they don't do anything, and the notes can get lost along the way. So what was the original problem with the laptop again?
Me
The keyboard problem is the original problem. And HP itself didn't seem to know whether they'd done anything to it or not either, when I called them for about the 9th time. They've been trying to fix this for a month or so.
Atea
Oh, so it's one of these cases again. I think I'll just call HP and ask about it. They'll probably tell me to switch the main board, and it'll hopefully only take until next Monday to get the required part. I'll call you back afterwards.
Me
So when exactly are you going to be doing what? I'm sorry for setting time limits but this far HP has been late with everything they've done and I'd like to know when I should call again if nothing seems to happen.
Atea
I'll call them right now and call you back afterwards, and I'll hopefully get the parts on Monday.
Me
Ok, thanks, I'll wait for your call.

And indeed the tech called back about half an hour later:

Technician (at about 13:30)
Atea
Hi, so, it took them a while to find out whether they'd actually done anything to the laptop, and their best guess as to what to do is sending me a replacement motherboard.
Me
So they didn't know if they'd already replaced it?
Atea
The warranty service does tend to forget to do things or to test things at times, so we can't really know.
Me
And I even left them a note on how to test it... and when I called them they didn't really seem to know whether they'd done anything to it either.
Atea
Yeah, and it took a while to get through to their support too. I called them about three times.
Me
What, you're just calling their regular support line?
Atea
I don't know if it's the same one but they do hold you in line a lot. So, is it all right for me to come on Monday to switch the main board?
Me
Yeah, assuming you really do get the parts.
Atea
What do you mean?
Me
Well, this far HP has been late with every parts delivery they've done for me.
Atea
Heh, well, let's hope for the best. They did say they have parts available in their warehouse though. The overnight delivery usually makes sure the parts come in by 8 in the morning so we'll know first thing on Monday. I'll call you then.
Me
All right, thanks, bye.

Well, at least I'll get to see if switching the motherboard does anything with my own eyes. Giving the warranty service the benefit of the doubt though it's probably not going to do anything. We'll see on Monday. Hopefully.

In addition I find it quite weird that they don't have a priority support line for their on-site people. It would sure suck to hang on the phone at customer premises for 20 minutes because their normal support line is clogged up with lusers who can't figure out how to double click.

Sep 06 Mon Somebody really should inform HP about the Industrial Revolution

You know, things like mass production and such.

The on-site guy called again and apparently there was no parts delivery at the time he said 90% of them usually come in. I'm starting to think every time HP needs parts for a repair, some guy in a dark corner of a HP manufacturing plant assembles the part by hand. That's got to be the reason it takes so long to source parts for a repair.

However!

At about 15:00, the on-site guy called again. They'd managed to deliver him the motherboard!

...unfortunately it was too late for him to come over anymore, so we agreed on the next morning. Apparently switching a laptop motherboard takes about an hour to an hour and a half.

Sep 07 Tue HP's on-site guy finally came

HP finally managed to deliver the replacement motherboard to the on-site guy, so he came over. At least I can say their on-site guy was a nice and resourceful person. Perhaps that's only because they outsource their on-site support to another company.

It took him about an hour or so to take the entire thing apart, move parts from the old motherboard to the new one and then put it all together again. I've never taken a small laptop apart and it sure had a lot of parts to remove. It seems HP doesn't hand out instructions for taking their laptops apart, so he kind of went by trial and error. I know from personal experience that small devices aren't the easiest thing to take apart without breaking something (curse you, plastic snap-on tabs!) Really makes me think why HP can't just replace the entire system and then fix it on their own time.

We talked about how all manufacturers tend to have these cases that just keep going on and on lately, not just HP. Apparently Lenovo is pretty reliable, though, and I would've gotten a Lenovo (shut up, plash) if only their keyboards didn't tend to have some buttons backwards by design. I also heard HP had asked for another on-site guy from another town to do the repair as well, for some reason I can't fathom, but they had then agreed that one person is enough for a simple motherboard switch.

So after replacing the motherboard, and running some HP tools on it (probably to update the warranty information and such, but the software had trouble recognizing the laptop because it was too new or something), we booted it up, tested it, and... as I had expected, the problem was still there. I showed the guy a few key combinations that did weird things, and then demonstrated how the same doesn't happen with an external keyboard. We reached the consensus that the problem was probably a design flaw, and not fixable.

The guy did go on about how "normal users would never run into that" and such, but I had indeed ran into it. Maybe it's my typing style. However my philosophy is "the computer should work the way I want it to, not vice-versa" and that's not about to change. So anyways, the whole thing was just a big waste of time, just as I thought. Sorry for wasting your time, on-site guy.

We agreed he'd contact HP and explain the situation, and that either he or HP directly would call me back later. Hopefully this time I don't have to call HP myself, because unlike HP themselves, this guy seemed reliable.

Back to waiting. Once again.

Sep 11 Sat I made an interesting discovery

Well, actually I made it some time earlier but didn't get around to writing about it before now. Namely, I discovered this in the recycle bin in the pre-installed Windows OS:

I certainly don't remember creating such a file, and the timestamp of the file puts its creation during the time my laptop was in the warranty service. It would seem that the service techs did really test my laptop, and judging by the contents of the file were able to reproduce the problem quite fine. They even seem to have found a whole bunch of new broken key combinations I didn't even know about!

I don't know what's worse, not testing a device at all, or testing it and sending it back while it's still obviously not working.

Sep 16 Thu A replacement!? What is this silliness!

I didn't hear back from HP or the on-site guy for over a week so I thought I'd call them back. Didn't want to wait over the weekend once again.

HP Support
Me
(I explain the whole situation right from the beginning) ...and then the on-site guy promised you or him would contact me, but I haven't heard anything. Could you open up my case to see what the status is?
HP
It seems you have a bunch of old support cases here, let me just check those... (mumbles a whole lot of numbers) So, I've got 4625092095 here.
Me
I have no idea what that's supposed to mean.
HP
It's the support case number.
Me
I guess I got e-mail about those at one point.
HP
One of your old problems seems to be some kind of three-key keyboard problem.
Me
Yeah. And that's my current problem as well. It's the only problem I've ever had and still have with this laptop.
HP
Oh, the problem is still there? Even though pretty much everything that can be exchanged has been exchanged?
Me
Yeah, still there.
HP
And when did you buy the laptop?
Me
At the beginning of last month.
HP
All right. Looking at all this I think it would be best if we just replaced the entire unit. I hope I can get this to fly with the big-wigs over at management. If you've really been struggling with the same problem for almost two months now, it doesn't quite reflect our company vision. So I'm opening a request to replace the entire product. I'll put "multiple problems" as the reason so no-one'll start trying to be smart about the reason. I'll also write down all these case numbers to expedite it...
Me
All right. I don't really know if the on-site guy already started some kind of process with you as he said he would, but since I didn't hear back from anyone for over a week I thought I'd call you back.
HP
Okay, that's good. I'm sure you've already tried to re-install the OS and all that?
Me
It's not a software problem, I'm sure of that.
HP
I still have to ask.
Me
Well, it occurs in at least three OSs, and even in the BIOS tool.
HP
I'll write that down as well. Long history of problems, customer completely unable to use product, consider replacing entire product. I'll try to get this under the 30-day DoA warranty.
Me
I'm sorry, I can barely hear you. What did you say about 30 days? (Did I mention their support line is really, really quiet?
HP
(All of a sudden, much clearer) I said I'm trying to get this under the 30 day DoA warranty, even though it's been over 30 days since you bought it.
Me
...well it better be under that warranty since I first called you about this problem about two days after I bought the thing. It's only been over 30 days because you're taking ages to do anything.
HP
Yes, I agree with that and I'm very sorry it's taking so long. Here's a case number for this new case for your reference: (yet another series of digits). By the way... it seems that your contact name is Virkkonen, while the name in your e-mail address is Virkkunen. Which one is correct?
Me
The one with the U. As in "universe". I've told you to correct this about four times by now, you know... at least you got the e-mail correct since now I'm actually getting the e-mails, unlike at first.
HP
Okay. It's just that this system doesn't make editing someone's contact details very easy. So, the way this works is that if the replacement request goes through, you can exchange the laptop at a reseller.
Me
Does it have to be the place I bought it from?
HP
That's how it usually works.
Me
All right, I guess I'll have to contact the web shop I bought it from then.
HP
Please wait until the request goes through though. Oh, have you already sent us the receipt from when you bought it? That would really help with the request.
Me
No, I haven't, but I have it in my inbox. What address do I send it to?
HP
I'll send you an e-mail and you can send the receipt as a reply.
Me
All right.
HP
We hope we'll be able to get back to you today or tomorrow. I don't know how long it'll take, because we only have one person handling this kind of cases, and he might be busy. I'll put the thing forwards as soon as I get the receipt.
Me
Okay, I just sent it to you, it should arrive in just a minute.
HP
It'll probably take a while for it to go through all the servers on its way back here. I'll personally follow this case and see that it goes through. I even wrote the thing down on paper so it's not just on the computer anymore. I hope we'll be able to contact you with more details as soon as possible. It'll probably be tomorrow or very early next week.
Me
All right, thanks, bye.

Well, I can say this person was much more understanding and helpful than the ones before. Shame he didn't mention his name so I could thank him personally.

It seems that a product exchange is a really big deal for HP, and requires a very good reason for it to be done.

"Customer completely unable to use product", heh... well, while maybe exaggerated, at least that has some impact to it. It's true it's really hard to use, though.

Sep 17 Fri Well, that was (relatively) fast

HP sent me a document that says I'm entitled to exchange my laptop for a new one at the reseller that sold it to me. Yay!

...I'm still in doubt that it'll do any good though.

Sep 18 Sat Product return, take two

I put the laptop in the mail today. Even the retailer makes their product returns easy — all I needed to do was walk to the post office and say I'm returning something to the company in question. Some kind of database kinda thing takes care of the rest.

Sep 21 Tue Package tracking!

I got a tracking code for my return just like any package, and I checked in on it, and it shows it was delivered to the recipient at 09:13 this morning. I'm writing this in the wee hours, and I think it's safe to say I didn't get any reply from the retailer during Tuesday.

Hopefully they send me a tracking code for the replacement so I can get back to smashing F5.

Sep 24 Fri The retailer is sending me back a laptop

To be exact, they're sending me back a different model. Apparently the Mini 5102 is not available anymore (gee, that model didn't last long). Instead they're sending me a Mini 5103, which is pretty much the same computer except with an Intel Atom N550 instead of the N450. Unlike the older one, the N550 is a true dual-core processor that came out a month or two ago.

A slightly newer model might even have a chance of having a working keyboard controller. The chipset seems to be the same one though so I'm not getting my hopes all the way up yet. However if the keyboard does work, it's a win-win situation for me!

The retailer said they're sending me the new laptop as soon as they become available next week, and predicted that it'd be delivered before the end of next week. So it's back to waiting for me, but this time with a positive attitude.

In somewhat-related news, it seems I've racked up a relatively large phone bill thanks to HP... it's not a lot, because I rarely talk that much, but it still shows.

Oct 04 Mon Sure is taking while

The week the retailer expected to deliver my new laptop is now over. Currently considering calling them tomorrow to find out if it's the importer or HP that's failing.

Oct 05 Tue Found out why it's taking a while

I got no information about my replacement laptop during Monday, so I decided to call the retailer up once again.

It turned out the importer had updated its expected availability date... from last week to the 21st of this month. The guy who had been taking care of my case at the retailer has apparently been on sick leave for the last week or so, so he wasn't able to send me a note about the delay.

...however the retailer decided to check on another importer, which seemed to have a whopping three units of the laptop I was supposed to receive. They said they'd call them to find out if they're still available, and then call me back.

Five minutes pass...

And as it turns out, the importer had one single unit left, and they're sending it to me. Hooray!

Oct 06 Wed The all-new HP Mini 5103 is here!

And it boasts the following great new features:

  1. A true multi-core processor!
  2. Back-of-screen finish that's matte, but not fingerprint-magnet!
  3. Pre-installed crappy HP software that takes even longer to initialize, and
  4. A modern keyboard that generates extra keypresses when you press many keys at the same time.

Hey! That last one's not really new, now is it!

Yes, the HP Mini 5103 came with the exact same keyboard problem as the previous model. I guess it was only to be expected, since essentially all that changed on the motherboard was the processor.

HP Support (at around 14:00)
Me
Hi. (Quick summary of everything) ...and I just got the new laptop, and it's still got the same problem. What gives?
HP
Oh, you had a keyboard problem, right? I think I remember you.
Me
Yes, I had a keyboard problem and I still have one.
HP
Could you give me your serial number?
Me
The new one or the old one?
HP
The new one, please.
Me
ASD7654321
HP
So the new one is a Mini 5103, right?
Me
Yes.
HP
And you still have a problem even after you got a different kind of laptop?
Me
Yeah, the exactly same problem.
HP
Could you hold for a moment? I'll go ask around about this.
Me
OK.
(Cue scratchy and noisy muzak; this time it wasn't even Vivaldi)
HP
Thank you for holding. I'll have to look into this more closely. Can I call you back sometime later today?
Me
Sure.

And a couple of hours later:

HP Support (at around 16:00)
HP
Hi. We're not really sure as to what we should do about this right now. We're elevating this case, so that we can get some higher-ups to take a look at it.
Me
And how long is this going to take?
HP
I'm not sure. We can hopefully get back to you by the end of this week.
Me
Hopefully? I've been waiting for over two months, you know.
HP
We'll try our best to see to this as soon as possible.
Me
You go do that. Bye.

And once again I wait for HP to make their move.

Expected outcome: Me calling them again on Friday next week to find out why they haven't contacted me yet.

Double facepalm

Oct 10 Sun HP's support website is also broken

Once again I got a link to some kind of support website where I'm supposed to be able to track the progress of my case with HP. However it seems to be a different website than the one before. And this time it requires you to register to do anything.

First time I tried to register I got the following:

HP Passport is temporarily unavailable due to technical difficulties. Please try again later.

Gee, thanks. You decided that people need to register for no real reason, and it doesn't even work properly.

After a few retries I got through to the next step, where I had to separately prohibit them from sending me spam by e-mail, snailmail and phone. Also I registered as a representative of "I'm not a company :V, Ltd." because their registration form wouldn't let me register without entering company details as well.

The next step gave me just this, on an empty page:

Invalid path /hppcf/dologin was requested

Regardless, it seemed to log me in. However upon getting to the page I first went to, I got:

Street address 1' field is not valid - please provide a valid address under the Business Contact section.
'City' field is not valid - please provide a valid address under the Business Contact section.

Couldn't they have told me that when I was registering? Obviously I had filled the fields with garbage because I'm not a company. It offered a friendly link to edit the details, but it'd forgotten everything I had entered. It seems every time you edit your profile, you need to start over.

When I finally got past all the error messages, the information available was much more detailed than I'd seen before. It read:

Problem subject: +358/FI/FI/06.10.2010/NBD/ELEVATION/5103/problems with keyboardcontroller/JJ

Problem description:
*** Issue: unit makes extra fourth mark when 3 keys are pressed
*** History: old cases are with his old machine, 5102,
    but this new one has exactly the same problem
- 12345678 keyboard changed as cru -> no go
- 12345679 PUMA repair sysbo changed -> no go
- 12345670 RE-REPAIR ONSITE keyboard, sysbo and cpu changed -> no go
*** Tests done: does same in Windows and Linux
- BIOS updated to newest one
*** Diagnosis: elevation
*** Tech. Agree: elevation

Finally it seems that at least someone at HP understand what's wrong with the machine. I'm eager to see what they come up with.

Oct 13 Wed "Sure I remember you"

HP had once again taken over a week to get back to me, so:

HP Support (at around 16:00)
Me
Hi. It's Matti Virkkunen again. Let me get you my case number... unless you already know what it's about, of course.
HP
Oh, sure I remember you. I was going to call you today.
Me
Is that so.
HP
Yes. I talked with the level two guys again, and they want to try replacing the motherboard once again before elevating it to an even higher level. We'll have an on-site tech call you tomorrow.
Me
Do you know about the tech's schedule? I'm quite busy this week.
HP
We don't know about their schedules, but they'll call you tomorrow morning so you can agree on a time.
Me
Time to replace the motherboard again even though it's not going to do any good, eh?
HP
Heh.

It's on-site guy time again! I really hope I can fit him between all the other appointments and work I have this week... It would be really funny if it was the same guy again, who spent 1.5 hours switching a motherboard which ended up not doing anything.

Oct 15 Fri Hewlett Packard - where no-show is the standard

It seems HP's perception of "in the morning" is slightly different from mine, as I hadn't heard anything from anyone before noon on Friday. After talking to one of their English-speaking guys once again (who this time at least pretended to be helpful, but eventually said that he can't actually help me with anything), I got through to a real support tech:

HP Support (at around noon)
Me
Hi. It's me again. You told me two days ago you'd have your on-site guy call me "in the morning", and I think we've already ran out of mornings this week.
HP
We've sent the request to our subcontractor that does on-site support.
Me
Is that so?
HP
Yes. We sent the request on Wednesday. It's odd they haven't contacted you yet.
Me
There's just one thing that's really bothering me. How is it possible that each and every time you've promised to do something by a certain date, you've been late? Whether it's calling me back or sending me something, you're always late, sometimes by a day, sometimes by a week. And thanks to that, this whole thing has taken over, what, two and a half months now. I think there's something seriously wrong with your support process. I understand that some delays are unavoidable, but in those cases you should give people a call before they have to call you. That's not too much to ask, is it?
HP
That is a really good question.
Me
You wouldn't happen to have a really good answer for me?
HP
No, unfortunately not.
Me
Uh-huh.
HP
We'll have the technician contact you during today. For sure this time.
Me
And what does "during today" mean, time-of-day-wise?
HP
I think that would be before 4 o'clock.
Me
All right, I'll call you back at four if I haven't heard from anyone.
HP
All right.

And wouldn't you know

Raising my voice just a little bit got me a call from the technician just half an hour later. Oddly, the tech was from a company called "Fix-Forum" this time, which was different from before.

On-site guy
Fix-Forum
Hello. I'm working for HP support, and I heard that you have some problems with your laptop.
Me
Yes, that'd be correct.
Fix-Forum
Okay. Do you work with the laptop a lot? Is it possible for me to come over and pick it up, perhaps work on it over the weekend and return it to you? Or would that be too much trouble?
Me
That's fine. I haven't started using it because it has the same problem as the one before. I'm at work, so when is the latest you can come over to pick it up?
Fix-Forum
I'm nearby, so I can be there in 15 minutes, or come over at, say, 4 o'clock to pick it up.
Me
Four would be great. Thanks, bye.

And surely, he did show up at about 4 o'clock that day.

(IRL) On-site guy
Me
So, would you like me to pack it up for you? I still have the box.
Fix-Forum
Just the laptop and PSU is fine. And would you mind you telling me what the problem is exactly? (Do they seriously not give their techs any details before sending them over?)
Me
I can show you. I'll demonstrate with the BIOS tool because the pre-installed OS takes eons to start up. (I fire up the BIOS tool and show him how C+D+spacebar does the same thing as pressing Enter) And there are dozens of other key combinations that do weird stuff as well.
Fix-Forum
So this only happens in the BIOS?
Me
No, it happens in the BIOS, on Windows and on Linux. It's not really software-related. I think the keyboard controller is just not working properly.
Fix-Forum
Understood. So if I was to press them in Word, would it also do the same?
(Now, I think that when someone mentions MS Office as the first example of a text editor they can come up with, it either means that they're not very tech-savvy or that they think whoever they're talking with is not very tech-savvy. And I don't like either possibility.)
Me
...yes, as it is likely a hardware problem, it would do the same in "Word". And it's a big annoyance. Of course I don't press three letters at the same time on purpose, but, for example, the C+D+spacebar thing is really annoying when doing something on the command line.
Fix-Forum
So the problem only occurs on Linux?
Me
...no, it's not software related. It occurs on at least two OSs and the BIOS tool, like I just showed you. Are you sure you remember how to test it? I got some instructions I could print for you.
Fix-Forum
I think I can remember how. Let's hope switching the motherboard fixes it.
Me
I doubt it will. This is the third motherboard with the same problem. It'll likely just be a waste of time, but HP still wants to do it.
Fix-Forum
All right. I'll see if I can get this back to you during today.

The on-site guy gave me a slip of paper as proof of having the laptop picked up by them. It was indeed dated on Wednesday, so I guess HP wasn't lying about having sent them the request on Wednesday. I wonder if I should assume that "HP Gold Preferred Partners" are just as unreliable as HP itself.

After about three hours or so, I got a call back from the on-site guy. He had switched the motherboard and (unsurprisingly) it hadn't fixed the problem. At least this one was nice enough to test it for me. He returned me my laptop in the same evening, which was unfortunately after HP's support line had already closed for the week, so I had no choice but to wait until Monday to call them again.

Oct 18 Mon This time they didn't even give me a date

I called HP, explained what had happened, and they said they'd "elevate" the case, after which it would "move on at its own pace", which is HP speak for "we don't know how long it's going to take".

They promised to have the guy handling the case call me soon (I got some other guy talking to me), but haven't heard back from them since (I'm writing this early Saturday morning). I guess I'll try to call them next monday.

Oct 23 Sat What's up with their pre-installed OSs?

Even though I didn't want to start using the new laptop because it was still broken, I took it for a quick spin to do some web browsing which Windows can handle decently. At least with the better processor, it seems to run almost comfortably.

However I quickly noticed that the wired network card didn't work right away. The drivers were missing. I thought "pre-installed" meant "ready to use".

First 200GB of unpartitioned space, now missing drivers? Do they expect that the kind of lusers they market these things to would know to go looking for missing HDD space or drivers?

Oct 25 Mon I hope this happens only once in three months

I wasn't sure if I understood what HP's "soon" means when they're supposed to contact someone "soon", so:

HP support (8:20)
Me
Morning, it's me again. Want my case number so we can get started up?
HP
Our system is currently down. Can't do anything. Could you call us again in a couple of hours? Hopefully it will be up by then.

I guess I'll do that.

Three hours later, their support was still down. Apparently it's a global problem now. Maybe they're running their support software on HP Mini laptops and the keyboard problem is preventing them from doing anything.

And in the end, their support system was down for the entire day. And from what I gathered, it wasn't just the Finnish support. Way to go, HP support... support!

I also received this:

Hello Matti,

You are receiving this one-time communication in reference to your recent HP support case 123456789012 on 10/06/2010. As an added service to you, we would like to continue supporting your HP products. With your permission, we will automatically notify you via email when there is a product update (driver download, patch, advisory, etc.) to help you keep your products up-to-date.

(Lots of links to subscribe to more spam about updates that are installed automatically by Windows Update anyway)

Took them a while, seeing that the support case was opened three weeks ago. Or maybe they only send that to people whose support cases have been open for ridiculously long. I gave them my main private e-mail address, too, because it's easier to say over the phone, and now they're spamming it. Thanks, HP.

Oct 27 Wed Deadlines? We don't give no deadlines!

Perhaps two days is enough for them to fix their support system?

HP support
Me
Hi, is your support system up now? Ready for me to spell out my case number?
HP
Actually, I remember you. I'm taking care of your case, and it's now at the level two guys in India.
Me
You told me last Monday... that is, Monday last week you'd call me back. How long is that going to take?
HP
I wasn't the one who you talked to back then, but I sent messages asking about it to the guys in India before the weekend and a couple of days ago, but they haven't responded yet.
Me
And how long is it going to take?
HP
I have no way of knowing that.
Me
See, that's not really acceptable. I work in IT myself and if a customer asks us to fix a fault we've made, they will invariably want to know a deadline. You know, a date. I can't just tell them that we'll do it when we feel like it. It doesn't work like that. You need to be able to give me some kind of estimate as to when you'll be able to do something.
HP
Unfortunately I have no way of knowing how long the level two guys are going to take.
Me
Could I perhaps speak to someone who does know?
HP
The only way of communicating with them we have is e-mail.
Me
Which isn't getting any replies.
HP
Unfortunately it's the only thing we have.
Me
Uh-huh. Could I at least get some kind of status report? It doesn't have to be a final verdict or anything, no decisions need to be made, but I'd at least like to know where we currently stand
HP
I can ask them from one by e-mail and forward it to you.
Me
All right, let's do that. Thanks, bye.

Maybe I should try calling them when their support line is busy, and when the unhelpful Indian guy answers, ask him to walk the phone over to the level two guy. I wonder if that'd work...?

Oct 29 Fri The Indian guys have a verdict

I called HP up once again and they told me they were just about to e-mail me about what the Indian guys have concluded. Real smug, HP, doesn't sound like you're playing for time at all.

I'll post the e-mail here once I get it (taking them a while).

An hour or so later, I finally got the following:

Hi Matti,

I received a message this morning from the higher level support. They've tested for the problem using the same kind of machines and HP's own Windows image, and haven't been able to reproduce the problem. Therefore they would like to get your specific machine for testing at our Finnish partner, so that we can reproduce the problem on our end as well.

Please notify me by e-mail if this is all right, and we'll get on with it.

Regards,

HP Technical Support

!?

What, now they can't reproduce it!? I can think of three possible reasons:

  1. They're testing it wrong (possible)
  2. They're not testing with the same type of hardware, e.g. different model, keyboard layout, etc. (likely)
  3. The problem really does only occur on random units (unlikely)

Could it really be that the problem only occurs with, for example, the Scandinavian keyboard layout? It's something I suspected right from the beginning, when the only information available about the problem seemed to be in Finnish. I'm pretty sure the people in India wouldn't have Scandinavian keyboards at hand to test on (and I doubt they would have figured out to do that either).

At least they're not closing the entire thing as a "WORKSFORME". It remains to see what they say about my laptop when they see it. Should probably include that letter about how to test it this time as well, just in case.

Nov 01 Mon We've now passed the three month milestone

Yet, the end of my journey with HP doesn't seem to be nearing its end.

I replied to their e-mail about picking up my laptop (for the third or fourth or so time thus far) almost right after receiving it, but haven't gotten a reply yet.

Nov 02 Tue I'm not going to let them take over a week this time

Two days should be far enough to respond to an e-mail one is expecting (what with their people claiming that they're "personally looking after this case" and all), so I sent HP this:

Hi,

When were you planning to respond to this message? Do I have to call you again? I might have to start invoicing you for my used minutes.

(attached previous message)

Childish? Maybe. But hey, they're asking for it.

Nov 03 Wed Definitely not going to let them take over a week this time

HP informed me that the "higher level support people" have been informed of the fact that I'm willing to send my laptop in once again for testing. They're still refusing to give me a date, though.

Nov 08 Mon The Finnish support is connected to India is connected to...

I had another brief exchange of e-mails with the Finnish support involving the word now in bold, among other things.

Finally, they informed me that the higher level support (probably in India) had informed them that they had contacted the Finnish office (presumably another one) who had then informed them that they've promised to contact me, no later than tomorrow. A bit of a mouthful, eh?

So, it would seem that HP's Finnish support works something like this:

Map of HP's support procedure

I can definitely see some room for improvement in their procedures.

Nov 10 Wed Oh, HP... what am I to do with you

Well, it's now Wednesday and whatever entity is supposed to contact me next still hasn't contacted me yet.

I called them yesterday at about 16:40, but that took me nowhere:

HP support
Me
Hi, somebody from you was supposed to contact me today and today's almost over.
HP
Were you the one with the 5103 and a keyboard problem?
Me
Yes, that would be me.
HP
We haven't heard back from the higher level support yet, so there's not much we can do.
Me
But your e-mail said that they were supposed to contact me today.
HP
(Long silence)
*click*
"Call disconnected"

Now they don't even want to talk to me anymore. I waited a while hoping they'd call back, but that never happened. And when I tried calling them I was connected to another Indian person who explained that the Finnish support was very busy and asked me to call again tomorrow.

At that point I felt (for the first time, mind you) really pissed off, so I replied to their previous e-mail with this:

Hello,

I consider myself a very patient person, but now it really seems like this isn't going anywhere. You've broken your promises about deadlines and such so many times that I'm running out of fingers to count them with, and I've had to call you asking about them many dozens of times. Last time you hung up on me - I truly hope that it was a technical failure. You never called me back, though, and when I tried to call you I (once again) got some Indian person who politely informed me in English that they can't help me with anything (what's the point of connecting me to people who can't do anything anyway?)

Besides it has taken you over three months to sort out this one thing.

What's your procedure on reimbursing people on their expenses and time caused by your mistakes? At the very least paying my phone bills should be an obvious thing to do. Also, in this case, I think it would be a good idea to reimburse at least a part of the product's price, whether you eventually get it fixed or exchanged to an equivalent one or not.

I am waiting for your hopefully swift reply.

And I got a reply the next day:

Hello,

I am sorry for the delay. We are completely dependent on information from the higher level support currently and I am unable to do anything about it right now. This morning I got a message that said that they have discussed the matter with the Finnish office, and they've started investigating it. I can't give you an exact date, because I don't have one, and they're refusing to give it to me despite asking for it numerous times.

Unfortunately I can't say anything about reimbursing expenses or time. You should contact our customer feedback people about that. You can reach them by e-mail at (Address)

It's unfortunate the lower level support has to deal with all this crap, even though they can't do anything about it. They're refusing to let me talk directly to any other people though, so I guess it can't be helped.

And then again, it is their job.

Currently considering whether to ask their customer support people about reimbursement. The least the tech person could've done is CC the thing to them as well, but I guess they're leaving it up to me to keep things going once again.

Nov 12 Fri Laptop pick-up, for the fourth time

HP is supposed to pick up my laptop some time next week. I might have given them a bit too much freedom by saying any day is okay, but ah well...

Maybe the fourth time is a charm?

Nov 14 Sun My first e-mail to HP customer feedback

I just forwarded the e-mail conversation I had with HP's support people to their customer feedback, highlighting the fact that it's time to start thinking about reimbursement.

We'll see how that goes.

Nov 15 Mon Pretty much what I expected

HP Customer Feedback got back to me and offered to either refund the product, or replace it with another model. The other model they offered me was a slightly more expensive ProBook, but it wasn't exactly netbook size, so I turned it down. I already have a huge laptop. Not exactly the kind of reimbursement I was looking for, but I'm sure a lot of people would have been very happy to take the more expensive model. All in all, HP's customer feedback people were swift to reply and nice.

...very much unlike their tech support.

I told them I'll rather keep to the investigate-and-repair option for now. I still want to know what they come up with in the end.

Nov 19 Fri Laptop pick-up, now for real

My e-mails to HP support have gone unaswered for a week, but just now, out of the blue, I got a phone call from Itella Logistics about "the pick-up on Monday". They didn't exactly mention what they're going to pick up, though. I hope it's the laptop they're talking about, since otherwise I won't know what to give them...

(HP did eventually e-mail me about the thing — an hour later)

Nov 22 Mon Itella!

Itella (that's Finnish for the postal service (no, it's not actually)) came around to take my laptop to HP, once again. Was most uneventful.

I attached an abridged version of my earlier letter with just the instructions on how to test the thing, plus a request in bold to keep me in the loop.

Dec 01 Wed HP is not keeping me in the loop

The last week was also most uneventful, as has been the first part of this week. No word from HP, even though I even sent them an e-mail asking if they've made any progress.

In related news, the four month mark draws near.

I might have to call them again.

*sigh*

Dec 02 Thu I thought they weren't supposed to give these out

I got bored waiting for HP to do something, so I called them once again... and managed to get them to give me an e-mail address for a level three support person. Whoa! (And how many levels do they have anyways?)

I promptly sent them an e-mail asking for progress, and immediately received a reply:

Dear Sender,

Greetings!

I am on Vacation today & tomorrow the 1st & 2nd of Dec 2010.

During this time I will have limited or no access to my email.

Please expect a delayed response..

Rgds,
(Indian Person)

Wouldn't be surprised if that last line was also part of their non-vacation signature. I hope my e-mail won't be buried under too many other mails when they, hopefully, get to reading their mail tomorrow.

Dec 06 Mon Oh, you have got to be kidding me

Anupama (the Indian Person from last time, might as well start calling them by name, because there's now more than one involved) didn't seem to feel like replying to my e-mail, so I sent them another e-mail urging them to reply (seeing that the whole thing has already taken over four months). Once again, I immediately got a reply:

Dear Sender,

Greetings!

I am on training this week from the 6th to 10th Dec 2010.

During this time I will have limited or no access to my email.

Please expect a delayed response.

In case of emergency,please contact Sinu at : (e-mail address)

Rgds,
Anupama (Surname)
Technical Solution’s Consultant – GCC TSG

Does this person ever work? And couldn't they have set up a shared e-mail address for all these people? I'd imagine, or at least hope that, they're working as a team.

I'm hereby designating my laptop problem as an emergency and forwarding the e-mail to "Sinu".

Dec 07 Tue Intriguing. Most intriguing.

I got a reply from Sinu! I think I might like this guy more than the other one. The reply read:

Hi,

Engineering team is still working on the Bios

Regards

Sinu

Now this is starting to get intriguing. What on earth could an engineering team be doing with the BIOS? I sent them a reply asking for clarification and schedule. I trust Sinu not to let me down!

Holy...

And indeed, he didn't:

Hi Matti,

The engineering is working on the Bios fix ,unfortunately I do not have access to the ETA for the Bios fix . we would check with the team and update you ASAP

Regards
Sinu

!?!?

Whoa. To say that I'm flabbergasted would be an understatement. Is HP actually going to fix this?

This is truly a completely unexpected, but indeed positive development. I know what releasing an official fix entails for a big company like HP, and I'm very surprised that they would do this seemingly "for just me". I guess it's going to be part of their usual BIOS patch release cycle.

Dec 17 Fri Sinu..? Sinuuuuuuuuu!

Sinu has stopped replying to my e-mails. I hope he's all right.

Dec 21 Tue Beta!

I sent both the people another e-mail urging them to at least give me a reply, and the following conversation with Anupama (I guess they're finally back at work) took place:

Hi,

I am trying to send you the beta Bios but the mail bounced back, please send me an e-mail where I can send an attachment .


Hi,

I guess it might be Gmail's anti-virus not letting the file through. Could you try sending it as a password-protected ZIP file? Those usually get through.

Also, I don't have any machine to try it on right now, as you (or well, the Finnish HP support) asked to have it for investigation. They got it picked up about a month ago but haven't sent it back.

- Matti


Hi,
No worries then I have sent the file to the engineer who has you unit capture too, Will keep you posted about the test results.

Rgds,
Anu

It seems they have everything under control afterall! I knew I could trust these people.

I'm a bit worried about Sinu though, since he was so prompt to reply before. Maybe he just forgot to put his out-of-office reply on.

Dec 30 Thu India is M.I.A. once again

I haven't heard anything from either Sinu or Anupama for a week now. I wonder if they have christmas holidays in India?

(5 minutes later)

It would seem they do:

Greetings!

I am on Vacation from 22nd Dec 2010 till the 3rd Jan 2011.

During this time I will have limited or no access to my email.

Please expect a delayed response.

I hope at least Sinu answers my CC...

Jan 07 Thu Five month mark, and different definitions of "soon"

It's now been some two or three weeks since they told me they'd have the BIOS patch tested, but still no results. Last time they told me they would have it done "soon"... and that was last Monday. Maybe they're still on christmas holidays.

I sent them an e-mail asking them, among other things, to stop using vague words such as "soon" and instead specify clear a deadline (as in a date). And let the Indian people know as well that we've gone past the five month mark. I feel a bit better now.

Jan 10 Sun "There has been some issue"

After the weekend, I got the following reply:

Hi,
Apologies about the delay , but there has been some issue with the Bios package that was provided by the Bios team& our engineer was unable to update. We have informed the Bios team& are waiting for the updated package.

Rgds, ANu

Jan 11 Mon Is it finally over?

I got around to replying to their e-mail and asked for an ETA, which I thought would be in vain since they'd never given me an ETA for anything, but instead I got this reply (in less than a minute, too!):

Hi,
The issue is resolved with the new Bios, I will be requesting the engineer to ship your unit back.

Rgds,
Anu

Whoa! I can hardly wait to get my laptop back (for the fourth time or so).

Jan 13 Wed I got my laptop back, and...

ヽ(^▽^ )ノ It works! ヽ( ^▽^)ノ

Yes. HP actually fixed my laptop's broken keyboard controller. Via a BIOS update. Hooray for reprogrammable hardware!

Every key combination seems to work properly now, under all OSs (so it's not just a lame driver hack under Windows). I have to admit that once HP finally believed that there was a problem, the Indian people were rather quick to fix it. This is a lot more than I expected, and I'm extremely happy with the result. Emphasis on "with the result".

However

And that's a big however at that. What it took from both HP and me to get here is a whole different story.

  1. The whole process took more than five months.
  2. About four months of that were spent trying to convince HP that there was actually something wrong...
  3. ...and then trying each simple fix on their undoubtedly generic checklist at least three times, in vain.
  4. Almost every time HP promised to deliver something on a certain date, they were late.
  5. Almost every time HP promised to contact me on a certain date (or "soon"), I ended up calling them instead because they didn't.
  6. In the end I ended up calling HP probably over 30 times...
  7. ...including the calls that got transferred to an Indian person who just couldn't help me with anything.
  8. I had to send HP at least 25 e-mails. Most of these were pleading them to reply to my previous one.

Of course, that's the very short summary. For the whole story with all the nasty details and other annoyances, you'll have to read the entire page.

What next?

It seems HP hasn't posted the BIOS update on their website yet. Hopefully that's just due to lack of testing at this point, because I know a few other people who have the same problem and would be interested in the patch. I sent the Indian people a thank you e-mail (they were relatively co-operative after all), and asked them whether/when it would be available.

Soon, I'll be asking for compensation for at least the numerous phone calls I had to make, and hopefully I can get something for all the time I spent hand-holding them as well.

In the same e-mail, I'll be sending HP a link to this page. And hope that they read it. And really, really hope that they come up with a good reply.

Dear HP,

The one question I'd like you to answer is: Why?. Why would it take over four months trying fixes that don't work over and over again and dozens of phone calls to convince you that there is something wrong? I can't believe this is how it's supposed to be done. Please, tell me why it took you over five months to fix this.

In the case you come up with a good reply, I'm reserving the space below for you. Give it your best!

HP's reply

Greetings again,

You have sure written a long and detailed history of the events. I can only wonder how this could have taken so much time.
Of course we could have cut it short earlier when we talked and I offered alternative solutions for the problem, which would have made the blog a little neater and shorter.

I have to admit and I apologize that it took so long to solve this problem. Solving software problems like this is not always easy, and it can also take a long time. That was a known fact at the point where you decided to wait for the technical support's solution to the problem. Everybody tries their best in order to find a solution. I do however understand that time feels slow when you are waiting for something.

The people at tech support follow their set script and surely everything isn't always easy and smooth and the same questions will eventually get asked over and over. The fact that the same case can move from person to person depending on how the phone calls are switched also makes handling more difficult. I am sorry for the difficulties you've had with our support. We will go through this case according to your blog with the support service organization so that we can avoid the same problems in the future, or at least most of them.

As a small compensation, I could order you the Carepack extended service for this machine, as an on-site service. The value of the package is about 80€, so it should cover quite a bit of phone expenses

UQ992E
Electronic HP Care Pack Next Business Day Hardware Support - Extended Service Agreement - parts and labor - 3 years - on-site - 9x5 - STP

Rgds,

HP Enterprise Business CRT

HP's reply was swift, and... pretty much what I expected. It was their usual friendly and apologetic reply, with an offer for something that'll both likely cost them nothing and likely not benefit me in any way. To be quite honest, I'd rather not have any more dealings with their tech support for the time being.

So I replied with the following:

Hi,

Returning the product or exchanging it for another model would surely have been a solution, but I was not going to give in after already spending several months on the case. Besides, the model you offered didn't quite meet my needs.

About your offer for compensation... if I'm completely frank with you (and this should be obvious), I would rather not deal with your tech support anymore. Therefore offering me more support is somewhat absurd. Could you perhaps think about this a little more, and come up with a better suggestion.

To which they replied by saying:

Hi,

A compensation with another product that costs about 100 €uro is also possible, as an alternative for the extended warranty.
I can also reimburse your phone bills if you can provide us with a detailed bill from your operator. I do believe that the product offer is better, though.
I can't promise you a different, separate, monetary compensation.

Now, this one sounds more reasonable.

However, now I have a dilemma. What can one get from HP for 100EUR? I guess I'll have to go take a look at their online store.

I'll try to avoid anything with a keyboard on it, though.

Jan 16 Sat About the BIOS update

During the five months I ran into quite a few other people with the same keyboard problem, on older and newer models in the 510x family, so I asked the Indian people whether the update would be generally available.

Their answer? For the 5103, perhaps eventually (I guess it's not worth thorougly testing the BIOS update just for this). For older models, no.

...unless somebody else asks them to fix their laptop. If you have a HP Mini laptop and are experiencing this problem, and are feeling adventurous, please don't hesitate to call HP about it. If you explain the problem well enough and immediately ask for "elevation" they might even do it in less than five months.

Jan 26 Tue It's over.

After some setbacks with product availability, the HP support person eventually found some nice (free) stuff for me, and I'm now considering this case closed.

It has been fun, HP, but I'm afraid we must now go our separate ways.

Farewell.

- Matti Virkkunen (@mvirkkunen, Lumpio-@IRCNet)