big data, big data / process indices, my cluster's gotta

[rone]

Big Data is big.  You just won't believe how vastly, hugely, mind-bogglingly big it is.  I mean, you may think it's a lot of porn sitting on your laptop, but that's that's just peanuts to Big Data.

The more i learn about Hadoop, the more stunning it is that billion-dollar companies have entrusted their production data to this jury-rigged, half-assed, immature technology.  Desperation is never pretty.

Comments

[prock.livejournal.com]

Who knew that log parsers would be the technology of the decade?

[mangosteen]

I'm fond of saying "If people knew how the Internet was put together, no one would ever use it for anything."

[dr-memory.livejournal.com]

Quoth myself, a year or so back:

"I'd like to thank the Apache Foundation for creating a multi-billion dollar market for companies whose entire business plan is 'make Hadoop's startup scripts suck 15% less."

And now you work for one of those companies. :)

But yeah, hadoop is like an onion: the more layers you peel off, the stinkier it gets.

[ronebofh.livejournal.com]

Hey, what we do is make Hadoop's foundation suck 75% less. But then our startup scripts are differently crappy.

Hadoop is less like an onion and more like a Mr. Potato Head; it contains valuable parts, but implementing them is flimsy and the results are hideous anyway.