Welcome!

@ThingsExpo Authors: John Basso, AppDynamics Blog, William Schmarzo, Shelly Palmer, Liz McMillan

Related Topics: @ThingsExpo, Java IoT, Mobile IoT, Linux Containers, Agile Computing, @BigDataExpo

@ThingsExpo: Article

Microsoft Product Mapping for the Internet of Things

The market potential for IoT is in the trillions of dollars globally per year and growing

As suggested by numerous reports and white papers by both big players and analysts, the market potential for IoT is in the trillions of dollars globally per year and growing. Microsoft has rightly adopted the enablement of IoT with appropriate platform and tools. The Microsoft Azure Intelligent Systems Service helps enterprises embrace the Internet of Things (IoT) by securely connecting, managing and capturing machine-generated data from a variety of sensors and devices. While some of these services are still under limited public preview gaining appropriate expertise will help in meeting the challenges faced by new era of Ambient Intelligence.

Microsoft's Big Push on Machine Learning
The next big thing in computing is derived out of using Machine Learning techniques. Microsoft has come up with some important announcements recently.

The following announcements were made by Microsoft CEO in a recent customer event in San Francisco on April 15.

  • Limited public preview of the Microsoft Azure Intelligent Systems Service. This new Azure service helps customers embrace the Internet of Things and securely connect to, manage and capture machine-generated data from sensors and devices, regardless of operating system.
  • Launch of SQL Server 2014. The latest version of the world's most widely deployed database delivers real-time performance with built-in in-memory technology and public cloud scale and disaster recovery with Microsoft Azure.

While these services are still under public beta and will take mainstream in a short while from now, the following reference architecture will help to make best use of them in the era of internet of things.

Reference Architecture for Internet of Things Intelligence
The following diagram shows a vendor agonistic view of an Intelligent Insight Enabler for Internet Of Things.

Event Producer
This layer represents the raw devices like sensors, machine sources which can generate massive quantities of events. By classical definition events does not mean anything disruptive or useful information always, most of the times they may be just raw messages which will not provide any meaning unless viewed within a context. This layer typically presents at , Ón Premise' mainly in plant floor, hospitals or even in homes.

Event Preprocessor
Events do get generated in massive quantities and most times event information is repetitive and not useful and hence event preprocessing layer will be useful to filter the duplicate and unwanted events and consider relevant events for further processing. Also events do get more significance if they are semantically enriched with context. While a more advanced form of semantic enrichment can happen in the next layer (Event Intelligence Processor), but basic semantic enrichment about the event like, it's location, relationship with other objects of interest will happen in this layer.

Event Intelligence Processor
This is the most important layer in the whole eco system and it typically present in cloud, given its needs to scale rapidly and handle massive quantities of data. It can typically utilize two kinds of processing to produce the intelligence from raw data.

  • In Memory Processor: In memory analytical engine for real time analytics needs.
  • Massively Parallel Processor: Batch engine to analyse even large quantities of data in near real time basis.

Intelligence processor will utilize second level of semantic enrichment which will further annotate the events beyond what is done by the pre processor. Enrichment at this stage will take care correlation among events from disparate sources. Finally the machine learning engine will utilize the past data conditions of the events and come up predictive outcomes which is the ultimate goal of the engine.

Event Insights Consumer
As evident from the name, Intelligence extracted by the Intelligence Processor' will be consumed by this layer using rich visualization features across multiple channels. This layer will also facilitate end user specific views, drill down and other dynamic filtering of intelligence output. It is quite possible that a IoT device could be a consumer of the machine intelligence generated, so that the preventive maintenance of the device can be taken care.

Microsoft Product Mapping For Internet Of things Ambient Intelligence
The following diagram shows the product mapping aligned with Microsoft vision of Internet of Things and associated Ambient Intelligence which can be drawn out of it. The product mapping boxes have been aligned with reference architecture so that a one to one mapping between the building blocks and associated products can be realized.

The following are the brief descriptions of the product mapping and their fitment , a detailed explanation about these products can be obtained from Microsoft web site and documentation.

Event Producer
The Windows Embedded family of operating systems and tools extends the power of Windows and Microsoft technologies, allowing you to create powerful, connected, industry devices and intelligent systems that can transform your business.

Event Preprocessor
Microsoft StreamInsightTM is a powerful platform that you can use to develop and deploy complex event processing (CEP) applications. Its high-throughput stream processing architecture and the Microsoft .NET Framework-based development platform enable you to quickly implement robust and highly efficient event processing applications.

Event Intelligence Processor
SQL Server 2014 delivers mission critical performance across all workloads with in-memory built in, faster insights from any data with familiar tools. It's In Memory analytics can process billion of rows in seconds as per Microsoft data sheet.

HDInsight is a Hadoop-based service from Microsoft that brings a 100 percent Apache Hadoop solution to the cloud. A modern, cloud-based data platform that manages data of any type, whether structured or unstructured, and of any size, HDInsight makes it possible for you to gain the full value of big data.

Polybase is a integration technology between structured data stored in SQL Server and Unstructured data stored in HDinsight HDFS. The Analytics Platform System brings Microsoft's massively parallel processing (MPP) data warehouse technology-the SQL Server Parallel Data Warehouse (PDW)-together with HDInsight, Microsoft's 100% Apache Hadoop distribution, and delivers it as a turnkey appliance. To integrate data from SQL Server PDW with data from Hadoop, APS offers the PolyBase data querying technology.

Though the Polybase technology is part of a platform appliance, it is expected that in a Hybrid Cloud scenario enterprises can always make use of it and this may technology may also be available as part of Azure later.

SQL Server Analysis Services is probably most important part of this whole solution. It is often under looked from its capabilities perspective. However it has got very important algorithms to provide the required Machine Learning Capabilities for Internet Of things domain. The following are the important algorithms that will play a major role in machine learning.

Event Insights Consumer
Microsoft Power BI for Office 365 is a collection of features and services that enable you to visualize data, share discoveries, and collaborate in intuitive new ways. Microsoft Power BI for Office 365 provides an organization-wide self-service business intelligence (BI) infrastructure, and brings Excel workbook sharing, online collaboration, and IT infrastructure together into a holistic offering.

 

Summary
As suggested by numerous reports and white papers by both big players and analysts, the market potential for IoT is in the trillions of dollars globally per year and growing. Microsoft has rightly adopted the enablement of IoT with appropriate platform and tools. The Microsoft Azure Intelligent Systems Service helps enterprises embrace the Internet of Things (IoT) by securely connecting, managing and capturing machine-generated data from a variety of sensors and devices. While some of these services are still under limited public preview gaining appropriate expertise will help in meeting the challenges faced by new era of Ambient Intelligence.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

@ThingsExpo Stories
Big Data, cloud, analytics, contextual information, wearable tech, sensors, mobility, and WebRTC: together, these advances have created a perfect storm of technologies that are disrupting and transforming classic communications models and ecosystems. In his session at @ThingsExpo, Erik Perotti, Senior Manager of New Ventures on Plantronics’ Innovation team, provided an overview of this technological shift, including associated business and consumer communications impacts, and opportunities it ...
SYS-CON Events announced today that 910Telecom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Housed in the classic Denver Gas & Electric Building, 910 15th St., 910Telecom is a carrier-neutral telecom hotel located in the heart of Denver. Adjacent to CenturyLink, AT&T, and Denver Main, 910Telecom offers connectivity to all major carriers, Internet service providers, Internet backbones and ...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, discussed how leveraging the Industrial Internet a...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
The best-practices for building IoT applications with Go Code that attendees can use to build their own IoT applications. In his session at @ThingsExpo, Indraneel Mitra, Senior Solutions Architect & Technology Evangelist at Cognizant, provided valuable information and resources for both novice and experienced developers on how to get started with IoT and Golang in a day. He also provided information on how to use Intel Arduino Kit, Go Robotics API and AWS IoT stack to build an application tha...
Amazon has gradually rolled out parts of its IoT offerings in the last year, but these are just the tip of the iceberg. In addition to optimizing their back-end AWS offerings, Amazon is laying the ground work to be a major force in IoT – especially in the connected home and office. Amazon is extending its reach by building on its dominant Cloud IoT platform, its Dash Button strategy, recently announced Replenishment Services, the Echo/Alexa voice recognition control platform, the 6-7 strategic...
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Verizon Communications Inc. (NYSE, Nasdaq: VZ) and Yahoo! Inc. (Nasdaq: YHOO) have entered into a definitive agreement under which Verizon will acquire Yahoo's operating business for approximately $4.83 billion in cash, subject to customary closing adjustments. Yahoo informs, connects and entertains a global audience of more than 1 billion monthly active users** -- including 600 million monthly active mobile users*** through its search, communications and digital content products. Yahoo also co...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
Basho Technologies has announced the latest release of Basho Riak TS, version 1.3. Riak TS is an enterprise-grade NoSQL database optimized for Internet of Things (IoT). The open source version enables developers to download the software for free and use it in production as well as make contributions to the code and develop applications around Riak TS. Enhancements to Riak TS make it quick, easy and cost-effective to spin up an instance to test new ideas and build IoT applications. In addition to...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...