@ThingsExpo Authors: Liz McMillan, Zakia Bouachraoui, Elizabeth White, Pat Romanski, Yeshim Deniz

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo

@ThingsExpo: Article

Big Data, IoT, and Russian Nesting Dolls | @ThingsExpo #IoT #M2M #BigData

IoT is a huge contributor to the world of Big Data, but it doesn’t change the risks and challenges surrounding Big Data

Big Data, IoT and Russian Nesting Dolls

I recently spent the weekend up in the lakes region of New Hampshire, and made the rounds of all the various country stores and craft shops that are a staple of the area. In one shop, I noticed something I hadn't seen in a long time: a large set of Russian nesting dolls. The quality, craftsmanship, and level of detail were impressive. As I removed the cover on the first intricately painted doll, nestled inside was the next, slightly smaller one, a duplicate of the outer doll, with all of the same detail on a slightly smaller scale. As I continued opening each successive doll, revealing the next smaller duplicate, I started looking for discrepancies, loss of detail in the duplication as I dove recursively into smaller and smaller dolls. The quality and attention to detail, even at the smallest level, remained for each of the dolls. Each doll was a representation of information, just on different levels and scales.

Internet of Things, small data inside the Big Data
We can't seem to have a technology discussion without the topic of the Internet of Things (IoT) entering the conversation. These ‘Things' can be anything, from a small wearable wristband to large items such as your car or house. The data transmitted by these devices, small intricate details, are sent to the cloud somewhere. Imagine for a moment, combining these pieces of data, all relating to an aspect of you. The combined data forms larger perspectives - a bigger ‘doll,' still containing the small ‘dolls' of data within. Then your data ‘doll' gets combined with your neighbors, forming another larger one. We can continue growing and expanding upwards, creating representations of information about you, your home, your neighborhood, your town, at different levels and different scales. Imagine being able to move up and down those perspectives as easily as opening up Russian nesting dolls.

Are we there yet? To gain some perspective, Gartner predicts that there will be 4.9 billion (with a B) connected ‘Things' by the end of this year, up 30% from last year. They further predict that the number of ‘Things' will exceed 25 billion in another 5 years. No matter how you view it, that's a lot of devices and data going off into the cloud. The Internet of Things is, and will be, a huge contributor to the whole concept of Big Data. The real question is: Can this data, and the combining together of data to form bigger views and perspective, work to provide real value to the business? Or, is it going to result in just huge piles of information for information sake?

It still all comes down to understanding the data
While the Internet of Things is and will be a huge contributor to the world of Big Data, it doesn't fundamentally change the risks and challenges surrounding Big Data. Data without an understanding of the meaning is just taking up storage space. A corollary to that is combining different aspects from various Internet of Things devices, without understanding if there is a meaningful and useful relationship that could result in false correlations or misleading perspectives being displayed by your ‘data dolls.' (As I have mentioned in other blogs, www.tylervigen.com contains many entertaining examples of false correlations.) The proper understanding requires a combination of business and technical skillsets. An understanding of the business is always key, but not enough with these potential huge volumes of data. Proper analysis and correlation of information requires deep technical skills in computer science, communication, and statistics.

No technology negates the need for good planning and design. The Internet of Things provides us with all types of structured and unstructured data, and there are lots of powerful analytic tools available to work with that data. In order to obtain true business value, one must still plan and design how to leverage and balance all the information and its analysis. They must provide the appropriate resources working with the business to ensure there is the correct understanding of the data that is available, combining the information to form larger perspectives. Those that succeed will be able to build useful sets of nested data, providing business value as you move up and down those perspectives, and providing valuable business information at all levels by leveraging those perspectives.

This post is sponsored by SAS and Big Data Forum.

More Stories By Ed Featherston

Ed Featherston is VP, Principal Architect at Cloud Technology Partners. He brings 35 years of technology experience in designing, building, and implementing large complex solutions. He has significant expertise in systems integration, Internet/intranet, and cloud technologies. He has delivered projects in various industries, including financial services, pharmacy, government and retail.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

IoT & Smart Cities Stories
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Early Bird Registration Discount Expires on August 31, 2018 Conference Registration Link ▸ HERE. Pick from all 200 sessions in all 10 tracks, plus 22 Keynotes & General Sessions! Lunch is served two days. EXPIRES AUGUST 31, 2018. Ticket prices: ($1,295-Aug 31) ($1,495-Oct 31) ($1,995-Nov 12) ($2,500-Walk-in)
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...