BeyeBLOGS | BeyeBLOGS Home | Get Your Own Blog

« BI Visualization Matters | Main | BI Solutions for Small and Medium Sized Business »

April 11, 2010

Metadata Driven ETL

Time for a short posting off the beaten path of my focus for this blog, which is BI for project portfolio performance.

I spent a few hours last week speaking with both Oracle & Microsoft ETL PMs about one my favorite topics in the BIDW world, metadata-driven ETL.

What is metadata-driven ETL? IMO, it is ETL that can be derived partially automatically from an analysis of source & target, preconfigured transformations and historical metadata. The intent is to make ETL generation quicker, easier and more flexible. How often do you find ETL routines that break because something changed on a source?

I found a very nice description of metadata driven ETL here on this blog from Aditi. If you are interested in metdata driven ETL, I highly recommend reading it.

It is nice to see that Microsoft has set-up a council to maintain CodePlex which is where you can find a metadata driven ETL framework for SSIS that I used and participated in when I was a PM @ Microsoft called MDDE. It is on CodePlex and maintained by a former colleague of mine, David Reed. It is a pretty decent (still several shortcomings) framework for metadata driven ETL for SQL Server.

Posted by Mark Kromer at April 11, 2010 5:15 PM

Comments

Blog is very good quality, would maintain the level and comes to the top of google.

Posted by: London escort at May 16, 2011 7:25 PM

I needed to post you the bit of remark to help say thanks yet again with your striking knowledge you've documented at this time. It is quite pretty open-handed with people like you to give unreservedly what exactly some people could possibly have made available as an electronic book to earn some profit for their own end, specifically since you could possibly have tried it if you ever wanted. Those basics in addition served to become a good way to recognize that other people online have similar desire like my own to learn whole lot more in respect of this issue. I am sure there are some more pleasurable times up front for individuals that browse through your blog post.

Posted by: Alegro.pl at May 17, 2011 1:00 PM

Post a comment




Remember Me?