January 29, 2010
QlikView from a PowerPivot standpoint
A week or so Darren Kerfoot of QlikPower, a QlikView consultancy, wrote a thought-provoking blog about "PowerPivot from a QlikView standpoint." Please do read it: I found it nicely balanced. The thought it provoked in me, and which I tweeted, half joking, was that I might blog from the other side of the fence. I was quite surprised by the number who said I should. So here goes ... what does QlikView look like from the PowerPivot standpoint?
I will follow the same headings as Darren uses, to make comparisons more readily, although I should say that perfectly I would structure a full comparison somewhat differently.
I will be quite critical of some aspects of QlikView, but let's be clear from the start. In general I think QlikTech are a very smart company. They have excellent growth and great customer satisfaction. Personally, I think that mostly comes from compelling marketing, an innovative and effective sales process, and excellent customer support; the product is good enough to sustain this. QlikTech are an excellent Microsoft partner and it's good to see their success.
Darren does say that his initial reaction to PowerPivot (on seeing it demonstrated by the ever-admirable Rafal Lukawiecki) was that it was quite familiar to him from his QlikView experience. Our hope, as the PowerPivot product team, is that it will be even more familiar to Excel and SharePoint users. In fact, I might say that the innovative features of PowerPivot are less important than what we haven't invented: there's a great advantage to our Excel-like querying interfaces, our Excel-like syntax for expressions, our use of Pivot Tables for analysis, and our use of the familiar SharePoint document model for publishing and managing analyses, and so on.
Underlying Technology
As Darren says, PowerPivot, under the bonnet, uses an in-memory store. QlikView does too. Then again, so does Tibco Spotfire, IBM TM1, Advizor, PivotLink and Altosoft to name only a few in the BI space. And of course column-stores, such as the Vertipaq technology that PowerPivot uses, are common in the relational database world, while Sybase, Oracle and IBM also have in-memory relational. As QlikView does not use a column store, PowerPivot is really more like those other systems, with QlikView being the exception. The differences are minor for the end user: QlikView appears to compress strings more effectively than PowerPivot, although that can catch you by surprise when the compressed data is uncompressed back into memory; PowerPivot appears to perform much better with calculated columns. I haven't done anything like benchmarking on this - just my own observations from running both on the same box.
Talking of engines, some have been misled to believe that QlikView's supposed "associative analysis" represents some significant engine smarts. I have even heard analysts very misleadingly say that QlikView has "association rules" - implying some kind of data mining, such as Microsoft implements in its Data Mining server and Excel Add-ins. QlikView add to the confusion by talking about an associative "architectural model." However, despite the hype, as Curt Monash points out (or rather, painfully extracted from QlikTech themselves through a long thread of comments) it is not so: "The associative aspect is really more meaningful in describing the end user experience, in that you see visually what is associated and is not associated with any particular selection or drilldown." As Curt says, "Thank you for admitting that clearly!!! It wastes a fair amount of analysts' time when your company pretends otherwise." http://www.dbms2.com/2008/08/04/qliktech-qlikview-update/
So I guess we all look pretty similar. Of course, at Microsoft we think we have some particular smarts in our engine, but in general the data-handling capabilities should be similar. I do hear of QlikView customers having difficulty scaling - it will be interesting to find PowerPivot's limits, too. It's early days for that, of course, but I'm sure we'll find them.
Sample Applications
Darren is right, our sample apps on www.powerpivot.com are pretty familiar. There are a limited number of public data sets out there to share: sports, and so on, are common ground. So many of these sample application sites are similar. Out of context for this post, but still well worth a visit, is the sample page of our friends at Tableau. http://www.tableausoftware.com/learning/examples Now folks, THAT's a set of sample apps!
Slicers
I think Darren's right - QlikView users will see nothing too exciting here. However, our target audience of Excel users (and especially PivotTable users) do like Slicers very much. I think they are pretty basic in the first version - in the future, expect to see an even better experience. Nevertheless, they are a very natural step up from traditional pivot table filters, and provide a nice visual interface for those functions: and they work in Excel services too, bringing browser interaction alive for those users who consume, rather than produce, PowerPivots.
Market Exposure
We have long touted the idea of releasing the PowerPivot add-in as effectively a no-cost download. In fact we were talking about this publicly before QlikTech made their Personal Edition free on the desktop. Maybe they were hoping to pre-empt us? Maybe not. Probably, they just thought it was a good idea.
After all, it is a good idea. For Microsoft, we had already released the Data Mining Add-ins for Excel as a free download, so we knew this model was attractive. For QlikView, it was a good way of heading off complaints about the high cost of ownership. High TCO is still the top complaint I hear about QlikView from their customers, even though their pricing model seems, at first glance, quite modest. However, we see many cases where consulting fees have grown dramatically for QlikView users, who often bought into a story of software that was so easy to use that applications could be built in hours. It can be true in some cases, but there are a helluva lot of QlikView consultants out there, doing very well for themselves, and rather contradicting that myth.
There's a similar story around partnerships. QlikTech have been quick to say "no data warehouse required" and aim to reduce the dependency on the IT department: music to the ears of many business users. Yet you only have to look to QlikView's partnerships to see the weakness in that argument. Some examples:
:: QlikTech Announces Support for HP Neoview: http://www.qlikview.com/Contents.aspx?id=8702 "Robust data warehouse provides a scalable foundation on which QlikView delivers user-driven analysis"
:: QlikTech and Informatica: http://www.qlikview.com/Contents.aspx?id=9270 "The combination of Informatica's robust data integration products ... with QlikView ... enables enterprises to optimize their entire data management process"
:: QlikTech and Kalido: http://www.qlikview.com/Contents.aspx?id=6628 "For QlikTech customers, Kalido provides a robust, enterprise-ready information management capability."
Perhaps QlikTech's marketing team just need a new thesaurus, but it sure looks like there's a problem in the delivery of "robust" solutions that requires data warehouse and data integration partners to solve.
This, ultimately, is the big difference between the market exposure of PowerPivot and the market exposure of QlikView. PowerPivot is one part of a seamless story stretching from robust and scalable enterprise data solutions, such as our Parallel Data Warehouse, through middle-tier applications such as SQL Server Integration Services, down to flexible personal analytics on the desktop with Excel. QlikView, great application though it is, offers only one part of that story: on the one hand it must pull in partnerships for robust enterprise applications, and on the other ... well, even QlikView needs "Export to Excel" to go the last mile in flexibility and agility.
DAX (Data Analysis Expressions)
DAX is a winner. Users can start from simple Excel-like expressions and build-up to really quite sophisticated dimension-navigating, time-aware functions that return in-memory table objects for further, nested, functionality. I wish it was easier at the advanced level, but so far users are really delivering great applications with DAX. There is a contrast with QlikView that Darren does not call out. QlikView requires a LOT of scripting. When QlikTech presented at the Boulder BI Brains Trust last year, this was noted in several tweets during the demo - you really need to know your way around Visual Basic scripts to get the most out of QlikView. This is certainly a problem. I know, because we used a lot of scripting in a previous product on which I worked: SQL Server Integration Services. In fact, I wrote a book just about the use of script in that application. I can tell you - scripting is not for business users.
There is an irony here. As a developer, in some cases, I might actually prefer a script to some of the complex nested expressions that I build in DAX, even with the auto-complete and parentheses-parsing tools we provide. But for business users, that certainly isn't the case. The flow of control needed in scripting is just not how they think: and the advanced Excel user in marketing or finance, is often quite expert at building and debugging complex functions.
Summary
I hope you have found this interesting. Let me re-iterate. QlikView is an excellent application, and QlikTech sell it in a very compelling manner. I don't expect PowerPivot will put a huge dent in that, because it really is the marketing and sales process, rather than the software, that have brought QlikTech their remarkable growth. QlikTech are especially good in small geographies, where their hard-driving, high-octane, hands-on, move-so-fast-they-can't-see-the-problems style works very effectively, especially when they reach business users directly, rather than IT. In the larger, more mature, and better-served US market they still grow strongly, but don't have the same mindshare.
I do expect that PowerPivot will lengthen sales cycles for the QlikView team in many cases. However, I also expect that in many organizations we will co-exist quite happily. Excel power-users will love and use PowerPivot. Users who enjoy QlikView's polished UI and navigation tools, will no doubt still enjoy that experience. These do appear to be two separate groups of users. I find very few Excel power users to be QlikView converts.
Darren is certainly right: interesting times lie ahead!
For more information on QlikView, see http://www.qlikview.com
For more information on PowerPivot, see http://www.powerpivot.com
Posted by Donald Farmer at 5:30 PM | Comments (4)
December 27, 2009
My 10 favourite business intelligence blog posts of 2009
As the year draws to a close, I thought it would be fun to collect my ten favourite blog posts from 2009 on the subject of Business Intelligence. In my daily reading, I bookmark favourite posts, so I thought it would be quite easy for me to narrow down the field. However, I found over 50 posts in my bookmarked list, so I had to read them all again - a very enjoyable task - and I had to think of some criteria.
I found, on reflection, that there are some important aspects of any blog that appeal to me.
Firstly, I value breadth and depth of knowledge. All the posts listed here are by experts. Some are notable for the depth of experience they reveal - Jill Dyche and Evan Levy's posts are fine examples. Others are notable for the writers ability to synthesize a range of experience: I particularly like Scott Davis's post on strategy, and the dissections of licensing and benchmarks by Merv Adrian and Curt Monash, in this regard.
Next, I appreciate blogs that engage the readers, building a sense of community and engagement. Andy Bitterer, Neil Raden and Stephen Few all get that right in there posts.
Finally, I admire bloggers who share their insights and even their materials openly and willingly. Richard Hackathorn on behalf of the Boulder BI Brain Trust, and Mark Madsen, have great sharing posts.
I hope you like the list. By limiting myself to 10 posts, I restricted myself from including many great posts from friends and colleagues. I'll post a similar, but very different, list of top 10 SQL Server posts of 2009 on my SQL Server blog at: http://blogs.technet.com/sqlserverexperts/
And, in early 2010, I will post a "blogroll" of my favourite BI bloggers here to share the love a little.
So, here are my 10 favourite BI blog posts of the last year, in date order...
Andy Bitterer
Setting the Record Straight
December 28th, 2008
http://blogs.gartner.com/andreas_bitterer/2008/12/28/setting-the-record-straight/
I know, I know, this was posted in 2009. However, it just squeezes into one calendar year ago. Besides, the thread continues well into 2009 and good blogs are living documents, not one-off missive to anonymous masses.
It was just great to see a top Gartner analyst engaging like this with the community of customers, vendors and experts. Andy took Talend's Yves de Montcheuil to task over his comments about Gartner's approach to open source. Yves and many others responded and the result was a most engaging, and mostly enlightening, debate.
And, as the saying goes, all's well that ends well, for Talend were able to blog in November that they are, indeed, in the latest Gartner Magic Quadrant for data integration: http://www.talend.com/blog/2009/11/30/gartner-recognizes-open-source-as-enterprise-data-integration/
Neil Raden
March 29, 2009
From 'BI' to 'Business Analytics,' It's All Fluff
http://intelligent-enterprise.informationweek.com/blog/archives/2009/03/_from_bi_to_bus.html
Neil's blog is often pointedly to-the-point. In this post, which engendered both comments and controversy, he takes SAS to task for coining the phrase "business analytics" to position their software. Without taking sides, I can certainly say that, for me, this is great blogging. Neil is incisive in his post, without being mean-spirited.
Scott Davis
March 29, 2009
Beyond the Big Bang: Strategy as Habit
http://circaspecting.typepad.com/circaspecting_musings_on_/2009/03/beyond-the-big-bang-strategy-as-habit.html
Scott, of Eyeris and Lyzasoft, is one of the most thoughtful business leaders I know, in every sense. He thinks deeply about leadership and innovation, and he always thinks of others in a respectful and caring way. All of this comes across in his blog, which I think has some of the best leadership insights I have read all year. This was a typically aware post by Scott, by every post is excellent. (And wasn't March 29 a great day for blogging?)
Mark Madsen
May 22, 2009
Open Source BI in the Real World - MySQL Keynote Slides and Video
http://www.b-eye-network.com/blogs/madsen/archives/2009/05/open_source_bi_1.php
Mark and I share a passion for crafting slide decks that go beyond standard templates and bullet points. Even better, Mark shares many of his decks and presentations online too. In this blog, he writes about and shares a fascinating keynote from the MySQL conference.
Richard Hackathorn
July 10, 2009
Boulder BI Brain Trust
http://boulderbibraintrust.org/cgi-bin/mt/mt-search.cgi?search=birst&IncludeBlogs=1
It's difficult to choose just one post from the Boulder BI Brain Trust, because really it is the concept, and the continuing engagement of so many vendors and experts that makes this blog special. Boulder, for those who don't know is not only where Mork met Mindy, it is also where by happy chance, home to many of the best brains in BI. They meet often on a Friday, hosted by Claudia Imhoff, to see the latest offerings of invited vendors. Richard Hackathorn often writes up the blogs, and captures the sharply critical, but friendly, atmosphere well. Even better - you can follow their immediate reactions on Twitter using the hashtag #BBBT. As they monitor tweets during the vendors discussions, the result is one of the most interactive and entertaining forums for BI in the virtual world.
Evan Levy
July 29, 2009
http://www.evanjlevy.com/2009/07/good-data-warehouse-dbas-are-hard-to-find.html
Good Data Warehouse DBAs are Hard to Find
If I were to award - oh, why not? I hereby award ... Evan Levy as "blogger of the year" in my opinion. It was great to see Evan starting to blog, and he has not disappointed. The sheer practicality and hard-won insights of Evan's posts are hard to beat. As I work so much with DBAs, I found this one, about the role of the data warehouse DBA, immensely useful. DBAs and CTOs in my executive briefings will recognize some of these observations - I shamelessly reuse them, and credit the source, of course.
Curt Monash
August 10, 2009
Sorting out Netezza and Oracle Exadata Data Warehouse Appliance Pricing
http://intelligent-enterprise.informationweek.com/blog/archives/2009/08/sorting_out_net.html
Perhaps it raised more questions than answers, but Curt's post carefully picked through the complexities of the licensing and positioning of two important vendors. I think Curt got as near as possible to the bottom line, and did a great service by synthesizing the breadth and depth of his knowledge for us.
Stephen Few
August 19th, 2009
True Stories about the Benefits of Data Visualization
http://www.perceptualedge.com/blog/?p=601
Stephen's blog ruffles feathers with his bluntness and direct comments on technologies and individuals alike. He certainly ruffles mine: I'm on record on thinking the style mean-spirited, though I would hate to judge the man by the mannerism. Nevertheless, there's no denying Stephen's expertise and knowledge. His most recent book, Now You See It, would be top of my book recommendations from this past year. In this particular blog post, he reaches out his readers, expressing his frustration at the lack of empirical proof that visual analytics have real measurable business results. It's a great post in its simple pragmatism, and engages the community well, as you can see from the comments. Follow Stephen's blog, it will raise your understanding, and your blood pressure!
Jill Dyche
November 10, 2009
They're Baaaack! IT Spending in Retail Returns
http://www.jilldyche.com/2009/11/theyre-baaaack-it-spending-in-retail-returns.html
Jill's blog is often laugh-out-loud funny, but don't let that fool anyone: you'll also find some of the most insightful writing about business intelligence, master data management and data governance. This post was exceptional in its depth and breadth. I have seen books on the business shelves of Hudson's in the airport with less useful information than this one post.
Merv Adrian
December 14, 2009
Oracle's TPC Assertions Don't Help Its Credibility
http://mervadrian.wordpress.com/2009/12/14/oracle’s-tpc-assertions-dont-help-its-credibility/
Merv is a former Forrester analyst who brings great rigour, but also really good writing, to the world of BI blogs. This recent post is a great example of his style - detailed, reflective and forward-looking at once, and enjoyable to read. Merv also engages actively, perceptively, and with great respect with commenters - a model of how to do so.
Posted by Donald Farmer at 8:45 PM | Comments (2)
December 22, 2009
A Christmas Letter
Dear Blogger,
I have been working in Business Intelligence for 8 years. Some of my little colleagues say there is no One Version of the Truth. My manager says, if you read it on B-Eye-Network it is so. Please tell me; is there One Version of the Truth?
Virginia O'Hanlon
Virginia, your little colleagues are wrong. They have been dumbed down by a remarkably dumb age. They think, because their little minds can't handle the truth, that there cannot be any, not even one little version. All minds, Virginia, are little, and RAM upgrades are not available for BI practitioners, nor even for bloggers. In this great universe of ours, Business Intelligence is only capable of grasping that which can be extracted, loaded, transformed, aggregated, mined and visualized, and that is not the whole of truth and knowledge.
Yes, VIRGINIA, there is One Version of the Truth. It exists as certainly as the need to get out next quarter's numbers without arousing the suspicions of the SEC. Alas! How difficult corporate life would be if there were no One Version of the Truth. There would be no knowing if Marketing's "free camo underwear with every order" campaign had actually increased sales among the duck-hunting demographic, or just attracted some very lonely surfers exploring the outer reaches of online shopping. The amicable agreement on metrics which today lightens the business of every organization that has implemented a data warehouse would be extinguished.
Not believe in One Version of the Truth! You might as well not believe in a Balanced Scorecard! You might get your manager to hire analysts to audit your metrics, tracing each data element and its metadata back to its source, but even if they all found different answers what would that prove? Nobody knows what the One Version of the Truth is, but that is no sign that there is no One Version of the Truth. The most real things in our businesses aren't understood by anyone. Did you ever see a Mortgage-Backed Security, or a Collateralized Debt Obligation? Of course not, but that's no proof that they do not exist.
You may slice and dice the raw data to see what the numbers "really" are, but there is a veil covering the unseen world of business metrics that not even the brightest man could tear apart. Codd couldn't model it, nor Tufte visualize.
No One Version of the Truth? It lives, it lives forever. A thousand years from now, Virginia, nay, ten thousand years from now, it will continue to keep us all in work.
Posted by Donald Farmer at 12:45 PM | Comments (0)
