Welcome!

@ThingsExpo Authors: Elizabeth White, Zakia Bouachraoui, Yeshim Deniz, Liz McMillan, Carmen Gonzalez

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo

@ThingsExpo: Article

Big Data, IoT, and Russian Nesting Dolls | @ThingsExpo #IoT #M2M #BigData

IoT is a huge contributor to the world of Big Data, but it doesn’t change the risks and challenges surrounding Big Data

Big Data, IoT and Russian Nesting Dolls

I recently spent the weekend up in the lakes region of New Hampshire, and made the rounds of all the various country stores and craft shops that are a staple of the area. In one shop, I noticed something I hadn't seen in a long time: a large set of Russian nesting dolls. The quality, craftsmanship, and level of detail were impressive. As I removed the cover on the first intricately painted doll, nestled inside was the next, slightly smaller one, a duplicate of the outer doll, with all of the same detail on a slightly smaller scale. As I continued opening each successive doll, revealing the next smaller duplicate, I started looking for discrepancies, loss of detail in the duplication as I dove recursively into smaller and smaller dolls. The quality and attention to detail, even at the smallest level, remained for each of the dolls. Each doll was a representation of information, just on different levels and scales.

Internet of Things, small data inside the Big Data
We can't seem to have a technology discussion without the topic of the Internet of Things (IoT) entering the conversation. These ‘Things' can be anything, from a small wearable wristband to large items such as your car or house. The data transmitted by these devices, small intricate details, are sent to the cloud somewhere. Imagine for a moment, combining these pieces of data, all relating to an aspect of you. The combined data forms larger perspectives - a bigger ‘doll,' still containing the small ‘dolls' of data within. Then your data ‘doll' gets combined with your neighbors, forming another larger one. We can continue growing and expanding upwards, creating representations of information about you, your home, your neighborhood, your town, at different levels and different scales. Imagine being able to move up and down those perspectives as easily as opening up Russian nesting dolls.

Are we there yet? To gain some perspective, Gartner predicts that there will be 4.9 billion (with a B) connected ‘Things' by the end of this year, up 30% from last year. They further predict that the number of ‘Things' will exceed 25 billion in another 5 years. No matter how you view it, that's a lot of devices and data going off into the cloud. The Internet of Things is, and will be, a huge contributor to the whole concept of Big Data. The real question is: Can this data, and the combining together of data to form bigger views and perspective, work to provide real value to the business? Or, is it going to result in just huge piles of information for information sake?

It still all comes down to understanding the data
While the Internet of Things is and will be a huge contributor to the world of Big Data, it doesn't fundamentally change the risks and challenges surrounding Big Data. Data without an understanding of the meaning is just taking up storage space. A corollary to that is combining different aspects from various Internet of Things devices, without understanding if there is a meaningful and useful relationship that could result in false correlations or misleading perspectives being displayed by your ‘data dolls.' (As I have mentioned in other blogs, www.tylervigen.com contains many entertaining examples of false correlations.) The proper understanding requires a combination of business and technical skillsets. An understanding of the business is always key, but not enough with these potential huge volumes of data. Proper analysis and correlation of information requires deep technical skills in computer science, communication, and statistics.

No technology negates the need for good planning and design. The Internet of Things provides us with all types of structured and unstructured data, and there are lots of powerful analytic tools available to work with that data. In order to obtain true business value, one must still plan and design how to leverage and balance all the information and its analysis. They must provide the appropriate resources working with the business to ensure there is the correct understanding of the data that is available, combining the information to form larger perspectives. Those that succeed will be able to build useful sets of nested data, providing business value as you move up and down those perspectives, and providing valuable business information at all levels by leveraging those perspectives.

This post is sponsored by SAS and Big Data Forum.

More Stories By Ed Featherston

Ed Featherston is VP, Principal Architect at Cloud Technology Partners. He brings 35 years of technology experience in designing, building, and implementing large complex solutions. He has significant expertise in systems integration, Internet/intranet, and cloud technologies. He has delivered projects in various industries, including financial services, pharmacy, government and retail.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (November 12-13, 2018, New York City) today announced the outline and schedule of the track. "The track has been designed in experience/degree order," said Schmarzo. "So, that folks who attend the entire track can leave the conference with some of the skills necessary to get their work done when they get back to their offices. It actually ties back to some work that I'm doing at the University of San...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
If a machine can invent, does this mean the end of the patent system as we know it? The patent system, both in the US and Europe, allows companies to protect their inventions and helps foster innovation. However, Artificial Intelligence (AI) could be set to disrupt the patent system as we know it. This talk will examine how AI may change the patent landscape in the years to come. Furthermore, ways in which companies can best protect their AI related inventions will be examined from both a US and...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Chris Matthieu is the President & CEO of Computes, inc. He brings 30 years of experience in development and launches of disruptive technologies to create new market opportunities as well as enhance enterprise product portfolios with emerging technologies. His most recent venture was Octoblu, a cross-protocol Internet of Things (IoT) mesh network platform, acquired by Citrix. Prior to co-founding Octoblu, Chris was founder of Nodester, an open-source Node.JS PaaS which was acquired by AppFog and ...
The deluge of IoT sensor data collected from connected devices and the powerful AI required to make that data actionable are giving rise to a hybrid ecosystem in which cloud, on-prem and edge processes become interweaved. Attendees will learn how emerging composable infrastructure solutions deliver the adaptive architecture needed to manage this new data reality. Machine learning algorithms can better anticipate data storms and automate resources to support surges, including fully scalable GPU-c...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...