Introduction to Big Data - ThoughtWorks

Introduction to Big Data
7 February 2012
John Spens
1

What makes data ‘Big?’
! Size, of course
! Rate of change
! Range of sources
2

The information pyramid
Insight
Knowledge
Information
Data
3
3

Exploiting Big Data
! Recognizing patterns of
behavior
! Achieving a holistic view of
complex systems
! Understanding the impact
of our decisions
Telemetry
4

The Big Data conundrum
! Over the past few years, the use of Big Data has moved deeper and
deeper into the IT mainstream
! However, in a recent article, Gartner predicted that, “…Through
2015, 85% of Fortune 500 companies will still be unable to exploit
‘Big Data’ for competitive purposes”
5

Big Data challenges
! Technologically challenging
! Involves deeper, organizational change
6

Key take-aways
! Big Data can provide tremendous value, but
! Establish your expectations first
! Be ready to adapt to change
! Think before you buy
7

Thank You
John Spens
ThoughtWorks, Inc.
jspens@thoughtworks.com
8
8

Credits
! Laney, Doug. “3D Data Management: Controlling Data Volume, Velocity,
and Variety” Application Delivery Strategies, META Group, February 2001
! Prentice, Steve. “Predicts 2012: Information Infrastructure and Big Data”,
Gartner, November 2011
! Marz, Nathan Ritchie, Samuel E. Big Data: Principles and Best Practices of
scalable real-time systems, Manning Publications, 2011.
9