Azure + Hadoop = Clumsy and Expensive?

So, I decided to teach myself a little bit about Hadoop and running it on Azure, using some ‘hello world’ code found here and here, just a kick the tires kind of thing.

The first thing I noticed was how difficult it was to do something this basic.  Configuring accounts and objects and tying them together took quite a bit of time (the username is ‘admin’ BTW, this isn’t obvious anywhere), really more complicated than it really should be.

It also didn’t work, not quite.  The Hive queries wouldn’t work as is, and it isn’t idempotent, so there was a lot of back and forth, until I finally quit, after maybe an hour.

Then, the next day, I looked in my portal and discovered that I had been billed $35 for 370 hours worth of HDInsight work.  Huh?  WTF?

I have no idea how, what, or why, but I really didn’t do much, and certainly not enough to warrant those numbers, so as often happens when you build something in Azure and discover the ‘hidden’ charges that rack up quickly, I just deleted objects.  I’ve never really had this issue with Amazon stuff.

YMMV, but this worries me about the Windows 10 IoT stuff I am piloting.

posted on Friday, May 29, 2015 10:00 AM Print
No comments posted yet.

Post Comment

Title *
Name *
Comment *  
Please add 7 and 2 and type the answer here: