|
« Issue 5: Spotlighting FPGAs, part 2 of 3 |
Blog Home
| Issue 6: Spotlighting FPGAs, last of 3 »
January 1, 2007
Issue 3: What Is a DWA, Anyway?
Data Warehouse Appliances: definition & evolving place in the market
"It depends on what the meaning of the word 'is' is." - Bill Clinton, President of the USA (1993-2001)
As our first act of commenting on the industry, we'd like to address a topic that has seemingly stirred up quite a bit of emotion and controversy of late: just what IS a Data Warehouse Appliance (or "DWA" for the acronym-inclined)?But first, the punch line: it's not definition of what a DWA is that matters, but - taking things a bit further - what deploying a DWA will mean to customers who use them in their analytics and BI scenarios.
Plenty of opinions to go around In the world of BI and data warehousing, if there's one area that's nearly become an industry segment unto itself these days, it is the field of those industry analysts, pundits and other experts trying to define just what a "Data Warehouse Appliance" really is.It's no wonder. Over the past three-plus years, the Data Warehouse Appliance market has blossomed, indeed. It has become a significant and growing segment of the data warehouse systems market. Since Netezza's initial entry & coining of the terminology for this space in 2002/2003, a number of new entrants (from industry behemoths to the smallest, new start-ups) have tried to stake their claims to it. Enter the industry pundits, to help us all by defining and making sense of things.
A growing market segment that's "here to stay" Claims from long-standing incumbent data warehouse systems providers notwithstanding, I would hazard that in analyzing clippings from before 2002, you would be hard-pressed to find any references to a DWA in the media or analysts' market predictions about the future. Certainly, companies have built systems expressly for use as data warehouses in the past but my searches have not revealed any claims on the notion of an "appliance" in this space before the dawn of the 21st century.Now we have an established and growing market category for data warehouse systems. According to IDC's Dan Vesset, "IDC expects the market for DW appliances to grow at a CAGR of 70% over the next 5 years from the estimated 2005 level of $75 million."
How does Netezza see the definition? Today, with the definition of a data warehouse appliance is seemingly crying out for clarity, with a growing number of vendors' marketing claims making things more hazy. As the pioneer and the recognized global leader in the DWA market with over 75 paying customers under our belt, when it came to defining just what a DWA is we felt, "Who is more qualified than us?" - so we decided to weigh in with our views, as follow.
We define data warehouse appliances as follows:- Purpose-built for performance - from a single vendor; combining server, database, storage and network in an architecturally-integrated system built specifically for high-performance data warehousing. This includes dedicated hardware for processing large data volumes faster than any other data warehouse solution in the market.
- Simple to use - like a kitchen appliance, this should be dramatically easier than traditional systems. Easy to install, deploy and maintain - with installation in hours and the ability to have a large DW up and running in a day or so. No tuning, indexing, partitioning, aggregations, etc. required.
- Low acquisition and ongoing costs - appliances are just less costly to own and maintain - even for a large EDW implementation of 100 terabytes or more.
- Enterprise compatibility - high availability; plug n' play integration; standards-based interfaces; fully integrated with all major Data Integration, Business Intelligence and advanced Data Analytics vendors.
- Low power, cooling and space consumption - delivering high-performance in a compact footprint without blowing your data center's budget for electrical power and without forcing your IT director to implement "skip-a-row" equipment patterns to manage the data center cooling.
|
The key operable point here is that a DWA is fundamentally performance-driven. It allows businesses to have more clarity and more depth of analysis across ALL of their data much faster than they have been able to in the past. The fact that a DWA also delivers simplicity and economy is putting that performance well within reach for most enterprises. Simply put, a true data warehouse appliance will put the high-performance of a super computer into an enterprise's data center at a cost-effective price point. And it will do so with an ease of installation, use and maintenance that will make much more powerful analyses and more rapid development of ideas possible than other systems can provide.
DWA Measures - according to the experts A recent TDWI survey indicated a majority of members surveyed understand that a data warehouse appliance is defined as server hardware and database software built specifically for data warehousing - not just a bundle of commodity hardware and generic software - and that the benefits of this approach are greater performance and lower cost. But there have been many attempts to define and measure the "goodness" of DWAs. The table below contains but a few.Furthermore, Robin Bloor and Philip Howard of the Bloor Group have set off down a path to make the definition and benefits of various DWA approaches more clear - aiming to do so even more completely in early November.
| Source |
Characteristics |
Benefits |
Philip Russom TDWI |
Survey Results:- Server h/w & DBMS s/w built specifically to be a DW platform (53%)
- Any server h/w & DBMS s/w bundled to create a DW platform (14%)
- Either definition (13%)
- Don't know (19%)
|
- Pre-tuned for DW Use
- Fast Query Performance
- Reduced System Integration
- Fast Installation
|
Dan Vesset: IDC |
Two Primary Types for Data Warehouses:- Complete Stack DWA
(combined h/w & DBMS s/w)
- Virtual DWA
(DBMS s/w bundled with clustered commodity h/w)
|
- High Performance & Scalability
- Lower Total Cost of Ownership
- Lower Maintenance Costs
- Highly Scalable Business Analytics Platform
|
Dan Linstedt: TDWI/Myers-Holum (Mar06) & TDWI/Myers-Holum (Sep06) |
Multiple entries, but most recently:- Web-based Thin client GUI admin
- API for reporting, logging, admin, etc.
- Embed s/w at h/w & firmware levels
- Capable of transformation, data mining, loading & reporting
- Notify admins & end-users of suspected security breaches
- Web-enabled firmware updates
- Truly plug & play
- NOT part of a cluster, IS part of grid
- Self-contained
- Nine 9's uptime
- (Near) linear scalability
|
- High availability
- Fast loading
- Compression & Encryption
- Plug & Play MPP units
- SQL query interfaces
- Super fast data access
- Low cost per TB options
- Plug & play fail-over
- Automatic self-updating
- Remote monitoring
- Compliance for data
|
Charles Garry: DMReview |
- Combined price/performance of...processors, open-source software and low cost disk storage in a single cabinet
- Purpose-built with massive #s of CPUs to handle analysis against terabytes of data quickly and simply
|
- Total Cost of Ownership: The Key Differentiator
- Faster time-to-production & time-to-value
- Easier maintenance with "Load and Go" simplicity - with no required physical db design, tuning, hints or indexes
|
Kim Stanick: Baseline Consulting |
- Packaged solution of h/w & s/w that is pre-configured to perform DW workloads consistently well, out of the box
- Acquired as a single unit rather than a collection of components to be assembled
- Communicates via open standards (i.e., ODBC & SQL-92)
- "Pre-integrated high performance": engineered for optimal performance on typical DW workloads
|
- Enables enterprise IT group to offload engineering & tuning burden to the DWA vendor's design
- "Data warehousing hitting its stride" means DWAs appeal to a broader set of companies
- Just like the evolution of the auto: "You can build your own car, but most people don't because they are readily available, affordable and get the basic job done."
|
Mike Schiff: TDWI/MAS Strategies |
- Pre-integrated h/w, DBMS s/w & storage
- Optimized for very rapid query & retrieval
|
- High performance
- Low-cost
- Quick to implement
- Ease of use
- Reduced DBA Support Requirements
- "A proven offering"
|
Why not bundles or "balanced" blade-servers? Simply grouping multiple systems in loose affiliations won't really answer the mail here. The inefficient movement of huge blocks of data for analysis adversely limits performance; and the complexity of managing disparate systems and each of their upgrade and compliance paths alone will make this approach difficult to manage. But so will the fact that the systems will evolve independently and not necessarily in alignment with one another. Unless it is rearchitected to specifically address data warehousing, a "shrink-wrapped" bundling of products from among a major player's broader suite of systems will be similarly performance and operationally limited. And it too will have to deal with the effects of each product's evolution pulling in a different direction.
Where is this all going & why does the DWA definition even matter? The real issue of course, is that, to enterprise customers, the "true definition" of a DWA doesn't really matter at all; what matters is the impact that taking a DWA approach to their data warehousing needs can have on their businesses. What we've seen from customers' use of the NPS product family is that DWAs are changing the way businesses use their warehouse data today and in the near term, including the following - - enabling deep, unconstrained analytics on all of their business data, even in extremely busy mixed-workload scenarios;
- changing the way they think about the staffing to support it and opening up the development of whole new advanced analytics applications;
- changing the way they purchase data warehouse infrastructure; and
- helping mid-tier business solve critical data warehouse needs in compact, fully-contained business solution appliances.
In the longer term, DWAs will fundamentally change the way people operate their businesses. Look for us to provide more on this and other of our views about the future of DWAs in upcoming postings.
Share:
Posted by Phil Francisco at January 1, 2007 1:30 PM
Post a comment
|