Main | May 2008 »
March 23, 2008
Top 5 Reasons Why Data Warehouses Fail
Lack of Executive sponsor
A data warehouse touches so many areas deeply, requires work from so many people and opens so many cans of worms in so many miscoded applications that it requires strong executive leadership to workthrough or workaround the turf battles.
Confusion between Data Warehousing tools and Data Warehouse
Although vendors will tell otherwise Data Warehousing tools are neither necessary nor sufficient to implement a data warehouse. They are in very nice to have category, making the technical details of developing a data warehouse easier and making it less likely to fail due to bad programming for an OTHERWISE sucessful effort. Tools don't turn around a badly understood / designed data warehouse by themselves.
Confusion between OLTP Application and Data Warehouse Development
Although the tools used are same - databases, programming languages, Hardware software and network infrastructure - they are used differently. Every aspect of IT from Hardware / Software infrastructure to Design, Development and QA is done with massive data flows and need for data precision, accuracy and meaning.
Work within Corporate IT Procedures
Big Corporations are setup with inflexable IT procedures, built over years of managing IT design, development and Operations within the company. It is very difficult to get them to think through and realize that some of these don't apply to Data Warehousing. Working around their procedures creates additional cost and risk to the project.
Violate KeepItSimpleS***** Principle
Once the project gets off the ground in a company starved off information for years, there is a tendancy to make the project comprehensive, even working in future requirements and source applications still in design phase. A sucessful data warehouse must have a vision and the ability to reject all requirements that don't fall within that vision. Else the project becomes too vague and too big to succeed.
ZEROTH law of Data warehousing:
Hire the right people. They will take you through ...
Posted by Vijay at 5:45 PM | Comments (2)
March 14, 2008
Data Warehousing and Corporate IT Practices
Big Corporations have streamlined IT practices to enable them to support applications in cost effective manner. many of these make sense for OLTP applications and are most likely designed so. However they will make BI development difficult.
e.g.:
BI tasks are more data intensive per transaction compared to OLTP tasks. A BI developer will need the ability to create tables on the fly, to take subset of data to analyze trends or even issues with data. An OLTP developer will likely not need this ability. Corporate policies that prevent such ability impede on the ability of BI developer to diagnose and fix problems. There are work arounds - but it is never a simple matter to backup a terabyte of data, move it across network, find a machine to handle it, and work off it. No one has such powerful machines laying around just in case....
Posted by Vijay at 4:30 PM | Comments (0)
