Welcome!

@ThingsExpo Authors: Liz McMillan, Elizabeth White, Pat Romanski, Yeshim Deniz, Kevin Benedict

Related Topics: @ThingsExpo, Open Source Cloud, @DXWorldExpo

@ThingsExpo: Blog Post

IoT Network Visibility | @ThingsExpo @SolarWinds #IoT #IIoT #M2M #API

Accelerating complexity is just one challenge in how hybrid IT is affecting IT departments

Why Network Visibility Beyond the Firewall Is Critical in the IoT Era

In the hybrid IT era, complexity is the name of the game. In fact, according to the recent SolarWinds IT Trends Report 2017, IT professionals report the number one challenge of hybrid IT is increased infrastructure complexity. Accelerating complexity is just one challenge in how hybrid IT is affecting IT departments. Internet of things (IoT) implementations are a great example of one more unexpected, emerging technology IT teams must address.

In the report, IT professionals reported the second greatest challenge of hybrid IT is lack of control and visibility into the performance of cloud-based applications and infrastructure. Most IoT devices connect to cloud back ends or edge/fog-distributed endpoints, rather than traditional data centers. Distributed workloads by their nature put admins in a bind, and the multiplicative nature of IoT devices makes the visibility challenge even more difficult. But this isn't all doom and gloom. The path to managing these complexities is found by exploring the ways IoT use cases play out in different implementations, and identifying solutions for IT professionals to better manage the hybrid IT and IoT convergence.

IoT in Practice
To best understand how to manage complexity and gain visibility beyond the firewall in the IoT era, consider common IoT scenarios in hybrid IT organizations.

Cloud-Based IoT
In this scenario, the back end of the IoT infrastructure is in the public cloud. Potentially millions of distributed devices and multiple clustered workload systems are all reporting data back to the cloud, making cloud monitoring extremely critical. IT professionals managing these cloud-based IoT implementations must be able to view the entire network path to ensure end-user performance, or at least synthetic application performance (if the end user is an IoT bot). This can be difficult because the traffic is completely outside of the firewall. Instrumenting the end-user experience is key to troubleshooting issues, and monitoring cloud infrastructure and cloud components of the application at the same time is necessary.

On-Premises IoT
A great example of this scenario would be industrial IoT, where there are multiple IoT devices but production data is captured in the organization's data center. In this case, the IoT devices create massive amounts of data on-premises, effectively creating the complexity of analyzing a multi-tiered Big Data application. Massive processing and storage is required - perhaps Hadoop® and MapReduce are at play - as well as streaming analytics and transformation. And then, of course, there are security considerations, reporting or regulatory requirements that stem from allowing IoT devices to connect with the data delivery network. For example, are there considerations for new protocols like MQ Telemetry Transport Protocol (MQTT) access instead of HTTP and managing Transport Layer Security (TLS) traffic through the firewall?

All of this can place a significant inbound traffic burden on the on-premises data center, a relative tidal wave from the outside world into the on-premises system via firewalls. An added wrinkle is open source. Many IoT solutions and enabling technologies are based on open source, publicly available projects. Too often, developers in a hurry to get to market are quick to download a package off of GitHub without vetting for security. IT professionals and security managers must ensure control and some method of codebase oversight over these new application delivery stack elements to secure the code accessing our networks.

Edge-Based IoT
This is also known as fog-based IoT - computing at the edge. Here, distributed data collection and processing facilities distill data in the field rather than sending in built-to-cloud or on-premises repositories. For example, a municipal government may have sensors watching traffic patterns to optimize traffic light signaling strategies. In their model, processing IoT data in the field is more cost effective, even if it requires distributed compute resources located offsite. However, those distributed elements must still be managed, their network traffic assured, and performance monitored just as if they were safely back home in a rack, but with the challenge of remote access and latency.

Best Practices for Managing IoT Complexity and Visibility
Regardless of whether an IoT implementation is cloud-based, on-premises, or on the edge, there are common practices that should be followed in order to conquer complexity and visibility issues:

  1. The most powerful tool for hybrid IT gives a single view. Troubleshooting across the boundaries of hybrid IT can have massive positive effects on productivity. At the end of the day, successful management of IoT requires cross-environment visibility.
  2. Education and skill-building should be ongoing. IT departments should work with the business to ensure some budget is allocated to education, personal development training, conference passes, and certifications for IT professionals. Investing in the IT team can pay some of the greatest dividends in terms of being able to manage complexity, especially considering that nearly half of today's IT professionals say IT professionals entering the workforce now do not possess the skills necessary to manage hybrid IT environments. Create the skills on teams now instead of waiting for them to come in the future.
  3. Geek out on data. IT professionals should think about how to unlock their inner data scientists. Rather than just pushing data around, it's important for today's IT professionals to bring operations data and hybrid IT data into the lab and experiment with it. Doing this will likely uncover new insights that can help identify performance issues associated with IoT.

Perhaps one day, there will just be cloud, but in no case is that tomorrow. Hybrid IT will only become more complex and difficult to manage at least for the next few years. A little motivational alarm is okay, as long as IT professionals don't get discouraged and continue close skills gaps. IT professionals who take necessary steps today to improve their environments - regardless of IoT scenario - may experience the empowerment that comes with full visibility across on-premises, to the cloud and beyond, wherever workloads may lie.

More Stories By Patrick Hubbard

Patrick Hubbard is a head geek and senior technical product marketing manager at SolarWinds, with 20 years of technical expertise and IT customer perspective. His networking management experience includes work with campus, data center, high availability and disaster recovery, and storage networks, and with VoIP, telepresence and VDI in both Fortune 500 companies and startups in the high tech, transportation, financial services and telecom industries.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settl...
In his session at @ThingsExpo, Dr. Robert Cohen, an economist and senior fellow at the Economic Strategy Institute, presented the findings of a series of six detailed case studies of how large corporations are implementing IoT. The session explored how IoT has improved their economic performance, had major impacts on business models and resulted in impressive ROIs. The companies covered span manufacturing and services firms. He also explored servicification, how manufacturing firms shift from se...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
IoT is at the core or many Digital Transformation initiatives with the goal of re-inventing a company's business model. We all agree that collecting relevant IoT data will result in massive amounts of data needing to be stored. However, with the rapid development of IoT devices and ongoing business model transformation, we are not able to predict the volume and growth of IoT data. And with the lack of IoT history, traditional methods of IT and infrastructure planning based on the past do not app...
DXWorldEXPO LLC announced today that the upcoming DXWorldEXPO | CloudEXPO New York event will feature 10 companies from Poland to participate at the "Poland Digital Transformation Pavilion" on November 12-13, 2018.
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smart...