Welcome!

@ThingsExpo Authors: Yeshim Deniz, Elizabeth White, Rene Buest, Pat Romanski, Liz McMillan

Related Topics: @ThingsExpo, Java IoT, @BigDataExpo

@ThingsExpo: Blog Feed Post

Where Did My Love for Data Start? By @JimKaskade | @CloudExpo [#BigData]

In 1999, Jack Shemer and David Hartke both decided to come out of retirement to help me and my team start a new company

teambynet

Bynet Team Photo (left to right, top to bottom) Top Row:  John WrightJim (Hjerpe) Kaskade, Sumit Sharma, Dennis RussellBob McMillen, Bottom Row: Paul MichelettiLawrence LadaoSerdar YilmazBob MoussaviDoug Hundley.

Jack Shemer & David Hartke – True Legacies
Whenever Jack visited me, he used to leave sticky notes on my desk with nuggets of wisdom. For example, “Keep people you trust close to you.”…or, “Key values for Teradata where: Pride, Enthusiasm, Importance of the Individual, Teamwork and Open Communications, Ethics, Dedication, Quality, Support, Success, and Entrepreneurship.”

In the month of July, 1999, Jack Shemer and David Hartke both decided to come out of retirement to help me and my team start a new company, INCEP (along with a few other veterans of the industry including Art Collmeyer, Bob Adams, and Phil Paul). Little did I know, Jack would not only “give me my wings as a CEO”, but he started a process which ended up transforming me, creating the value system I use today.

“Initial Partner Presentation 1980, prior to Beta test in Dec, 1983″ was the note he wrote on his initial Teradata business plan, which I still have today. Inside was a copy of a less formal “Preliminary Business Plan” dated April, 1980. Jack (CEO) and Phil Neches (CTO) where both on the “payroll” then (with only $175K of seed capital later to be augmented with institutional money from Brentwood Associates run by Tim Pennington and Kip Hagopian).  Co-founders David Hartke (Engineering) and Jerry Modes (Finance) planned on leaving their current day jobs within then next month (after their first true round of financing). With funding they could bring the entire founding team together plus a few project leaders.

Their first milestone was the “demonstration of a complete, working hardware prototype” within 18 months (December 1981). Jack was asking for only $2.5M of initial venture funding to carry the team through milestone 1, and another $3M to get to the “first system ready for shipment to a customer” by December 1982 (month 30). They eventually closed a Series A of $2.6M on July 23, 1980, and subsequently raised $12M in December 1981, $12M in January 1983, and another $40M over three additional rounds in 1984, 85, and 86. Teradata IPO’d August 1987 raising $37.5M of public capital.

YNET
Few people know that the backbone of the Teradata Database Computer (DBC) was originally referred to as the HINET (“High Speed Network”), later renamed to the YNET, and then redesigned as the BYNET.

The DBC1012 was designed to attach to existing mainframe and mini-computers to provide a substantial increase in system throughput, response time, ease of use, and reliability….using a relational model DBMS. The target was to increase throughput by as much as 4 times that of IBM’s IMS, and support two orders of magnitude in data base size and processing power. [Note: I'll compare this approach and the current approach of Hadoop from providers like Hortonworks and Cloudera in a future post.]

The YNET was engineered to interconnect up to 1024 processor modules (Interface Processors or IFPs, and Access Module Processors or AMPs) in a distributed, shared nothing, Massively Parallel Processing (MPP) configuration. The YNET was originally envisioned to support broadcast and sorting, allowing for linear scalability (e.g. performance improvement does not degrade with added process modules). Believe it or not, the system was engineered to scale from 1.5 to 512 MIPS (yes, back in 1980 only 512 MIPS).

Fast forward, in 1990, a team was formed in a joint-development between NCR and Teradata. The project code name was “P90″ and it consisted of an elite team of 100 engineers from Teradata and 100 engineers from NCR, who were placed in an abandoned building in Torrey Pines, San Diego. Our charter was to “kill IBM” by producing the most powerful next-generation database system in the world.

At the time, the YNET still provided for communication among all processors (AMPs, IFPs, and COPs – the COP had the same functions as the IFP, but was used to communicate with network attached DOS-PC/UNIX hosts). The YNET always operated in a broadcast (one-to-all communication) mode and the two YNETs (primary and backup) had a total system bandwidth of 12 MBPS at the time.

It was well understood that Jack Shemer and David Hartke’s invention, the YNET, would easily support 200-300 processors using 80386 Intel CPUs (rated at 4 MIPS each). However, scaling above 512 next-generation processor modules (rated at 100MIPS each) would result in the YNET becoming a bottleneck (the network would become the limiting function of scale).

BYNET
So we embarked on a journey to develop the next-generation YNET that could scale to 4096 high-performance nodes, where we could easily support 10 MBPS  PER PROCESSOR MODULE, linearly scalable up to 4096 processors (vs. 12 MBPS in total on the network). Thus, a 512 node system would support bandwidth up to 10.2 GBPS.

The other breakthrough was creating a network that allowed processors to communicate either point-to-point, multicast, or broadcast. This design leveraged concepts from the Banyan Crossbar Switch, where the network is constructed from the modular switch node building block. In the case of the BYNET, we created a switch node where it was an 8×8 crossbar that can connect any of its eight input ports to its eight output ports simultaneously, arbitrating when conflicts arise. It operates very similar to that of a telephone network.

A sender (one of the many Teradata processors) “dials” a receiver (another processor) by sending a connection request to the network. The request contains an address or “phone number” which is interpreted by the switch nodes. Once the connection goes through, a circuit is established that is held for the duration of the “call”. To support up to 4096 nodes, a folded indirect n-Cube topology was modified. There was no such network topology known at the time like ours, but generally it was in the Banyan class of topologies.

A folded network was chosen to support packaging large networks. Because this was a database machine with large amounts of data being routed between nodes, a circuit switched network (vs. packet switched) was implemented. The BYNET has no single point of failure with redundant paths between every input and output. The BYNET guarantees delivery of every message and ensures that broadcasts get to every target node. So the database isn’t plagued by communication errors or network failures and does not have to pay the price of acknowledgements or other error-detection protocols. This part of the Teradata system was truly disruptive.

Behind me and the team in the above picture is a 256 node Teradata 3700 system, circa 1992.

This is where my love of data started.

[Note: This BYNET team was responsible for the new Teradata 3700 network architecture, BYNET protocol, BYNET switch node, BYNET I/O processor, BYNET Interface Controller Board, BYNET Type-A, B, and C Boards, BYNET CMA/A and CMA/B Backplanes.]

Read the original blog entry...

More Stories By Jim Kaskade

Jim Kaskade currently leads Janrain, the category creator of Consumer Identity & Access Management (CIAM). We believe that your identity is the most important thing you own, and that your identity should not only be easy to use, but it should be safe to use when accessing your digital world. Janrain is an Identity Cloud servicing Global 3000 enterprises providing a consistent, seamless, and safe experience for end-users when they access their digital applications (web, mobile, or IoT).

Prior to Janrain, Jim was the VP & GM of Digital Applications at CSC. This line of business was over $1B in commercial revenue, including both consulting and delivery organizations and is focused on serving Fortune 1000 companies in the United States, Canada, Mexico, Peru, Chile, Argentina, and Brazil. Prior to this, Jim was the VP & GM of Big Data & Analytics at CSC. In his role, he led the fastest growing business at CSC, overseeing the development and implementation of innovative offerings that help clients convert data into revenue. Jim was also the CEO of Infochimps; Entrepreneur-in-Residence at PARC, a Xerox company; SVP, General Manager and Chief of Cloud at SIOS Technology; CEO at StackIQ; CEO of Eyespot; CEO of Integral Semi; and CEO of INCEP Technologies. Jim started his career at Teradata where he spent ten years in enterprise data warehousing, analytical applications, and business intelligence services designed to maximize the intrinsic value of data, servicing fortune 1000 companies in telecom, retail, and financial markets.

@ThingsExpo Stories
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
In his session at Cloud Expo, Alan Winters, an entertainment executive/TV producer turned serial entrepreneur, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to ma...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists looked at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deliver...
In his session at @ThingsExpo, Eric Lachapelle, CEO of the Professional Evaluation and Certification Board (PECB), provided an overview of various initiatives to certify the security of connected devices and future trends in ensuring public trust of IoT. Eric Lachapelle is the Chief Executive Officer of the Professional Evaluation and Certification Board (PECB), an international certification body. His role is to help companies and individuals to achieve professional, accredited and worldwide re...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ara...
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
Artificial intelligence, machine learning, neural networks. We’re in the midst of a wave of excitement around AI such as hasn’t been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. Will this time be different? Most likely. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Furthermore, the funding and research going into AI now comes from a wide range of com...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 21st Int\ernational Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to focus on the core of their ...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...