@ThingsExpo Authors: Liz McMillan, Zakia Bouachraoui, Elizabeth White, Pat Romanski, Yeshim Deniz

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo, @DevOpsSummit

@ThingsExpo: Blog Post

Internet of Things System Monitoring By @HoardingInfo | @ThingsExpo [#IoT]

As the Connected life evolves, it is estimated that by 2020, there will be around 50 billion devices connected to the web

Machine Data for End-to-End loT System Monitoring
By Chris Riley

The Internet of Things (IoT) is really the morphing of physical devices into a software world. This means a lot of the same things you would do with applications and servers, you can now do with devices, including leveraging data to respond faster to issues, track trends, and improve your roadmap.

The Internet of Things, Internet of Everything, Machine-to-Machine (M2M), Smart Systems etc. all refer to devices or gadgets that are intelligently connected to their users and the web, in order to provide additional value. And these devices are data hogs. They leverage an array of data gathering components: embedded sensors, actuators, etc. that generate mounds of useful information. Which means there is a huge opportunity to use this data to improve future versions, and respond to the experience and needs of users.

IoT devices are all around us. As the ‘Connected life' evolves, it is estimated that by 2020, there will be around 50 billion devices connected to the web. A few early adopter examples are devices that control house lighting (Philip's hue), locate missing keys (Cobra Tag), sense air quality (air quality egg), and auto-diagnose vehicles (Delphi Connect).

And, when you bring these devices together with a log analysis platform, organizations can easily collect, analyze and understand device activity and performance via the machine data.

Leveraging Machine Data for End-to-End IoT System Monitoring
Logs play an important role
in troubleshooting, debugging, monitoring, maintaining, and securing systems. When it comes to IoT, the connected devices are expected to work with little human intervention. But this means that there is very little opportunity to learn about the device adoption, performance and user experience without automatically collecting it.

The machine data in the form of application logs, configuration files, message queues, logging API, SCADA data, audit logs, syslog etc. can be collected in a very similar way to how it is done with server logs because most IoT devices are running a form of Linux. Common log analysis agents, such as  the Logentries agent, can be installed directly on the device, and ship with each unit. If there is a special and/or limited embedded OS, it is very easy to create separate application logging processes, which store logs in local ram until they can be transmitted to the log platform via REST API.

Use Cases:  How IoT Data Is Changing The World
There is no need to wait for the future. Examples of devices, and the ways their log data are providing better solutions for the market, are everywhere.

Patient health can be monitored using a simple wearable device. An example are devices designed to maintain elderly user freedom and independence, while providing peace of mind to family members and caregivers. The device sends individual eating and medicine habit data to a cloud analytics platform. The system unobtrusively learns a person's routine over time, and alerts family and friends of changes that may indicate a problem. It also allows the cloud platform to be aware of the device availability and function, making sure it continues to work as expected, and alerts users and the manufacturer when it is not.

Smart Cities
Solar-powered and WiFi connected trash compactors are used for smart detecting of rubbish levels. They provide great value to cities when planning for future needs, and improving waste collection efficiencies. Waste management facilities use historical data to plan collection activities and adjust accordingly. They also want to make sure that all the devices are responsive, as a missed reading could mean missed pickup, or a neglected bin altogether.

Home Automation
The popular Nest thermostat helps monitor and control home temperature. The sensors sense the presence of an individuals home temperature, humidity, current weather conditions, etc. This data is collected and used to learn the daily routine of users and their temperature preferences. Nest uses the data to enhance the accuracy of the training algorithms. They also leverage AC and Furnace details to help users troubleshoot complex problems over the phone with trained HVAC support personnel.

There are a variety of in-vehicle technologies for monitoring, navigation and remote diagnostics. These tools can be used to estimate destination arrivals which help optimize routes. They can also report on weather conditions and other factors such as engine trouble, that might delay a shipment. The data is critical not only for optimization, but also important for litigation such as in accidents, or to make sure that delivery times are within promised windows. We are developing the logistics market's version of the SLA.

At the very least, every device is going to be connected via bluetooth with your phone. But more likely connect to the web directly via their own cellular and WiFi modems. And the users of these devices are going to expect that it is responsive to their needs, any issues are addressed quickly, and updated when there are new fixes and functionality available. The only way to give these users what they want, and get a clear picture on how devices are being used is strong log data, and strong analysis behind that data.

Any more physical devices are just software applications. The devices themselves have robust components all controlled by a complete suite of operating system, applications, cloud synchronization etc. And this is where the data from the devices can be utilized in a similar way you would any other web application.

By looking at system logs, configuration files, or even analyzing battery degradation over time, you have a clear picture of what the devices are doing out in the wild. You can keep users current with updates, and bug fixes. And finally you can enhance your roadmap with real-time data.

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

IoT & Smart Cities Stories
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Early Bird Registration Discount Expires on August 31, 2018 Conference Registration Link ▸ HERE. Pick from all 200 sessions in all 10 tracks, plus 22 Keynotes & General Sessions! Lunch is served two days. EXPIRES AUGUST 31, 2018. Ticket prices: ($1,295-Aug 31) ($1,495-Oct 31) ($1,995-Nov 12) ($2,500-Walk-in)
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...