Omniture SiteCatalyst vs. Google Analytics

In all the interactions I have seen regarding this topic, I feel like I am being pitched into a Mac-versus-PC-esqué battle all over again. Being an avid user of both solutions, I feel compelled to set the record straight.

What's all the commotion about?

Some time ago, Google bought the somewhat out-dated Urchin web analytics SBU in order to create a platform for their own Web Analytics offering. Since then, Google developers have made many improvements on the original system. As Google continues to play catch-up with more advanced analytics solutions (the target being the current fore-runner Omniture, Inc.), people have begun to flock to the "free" product offering that Google provides. As such, questions have arisen regarding the viability of the more established solutions such as WebTrends and Coremetrics. Why pay for web analytics services when Google is good enough?

Image from TrendingUpward.net

Today, I hope to set the record straight and clarify some myths and errors that I have seen pervading the Internet space. I'd like to consider myself more of an expert in this area based upon my credentials and experience in using both analytics solutions regularly.

Myth 1: Google Analytics is just as reliable as proprietary tracking solutions

While Google uses Javascript tracking in accordance to the industry standards, there are some major limitations to the tracking functionality they offer. There is a case where one "supposed" SEO expert claimed that Google Analytics was actually more accurate than Omniture SiteCatalyst. I would link to the article, but I do not want to help its search rankings. The article's author, Bart Gibby, claimed that SiteCatalyst data was "bad" simply because he expected that Unique Visitor counts should never exceed Visit counts. While in an ideal world this would be true, the Internet world is anything but ideal. My article on the three building blocks of analytics addresses these concepts and caveats in greater detail.

In comparison against Omniture SiteCatalyst, Google analytics is far more limited in providing accurate tracking capabilities. The standard out-of-the-box implementation provides zero support for browsers that have no javascript support or third-party javascript execution disabled. This translates into fewer actual visitors being tracked.

Myth 2: You can expect 100% accuracy and consistency from your web analytics tracking solutions

As I have detailed in this previous article, you can never expect your web analytics solution to maintain 100% accuracy simply because of the uncontrollable variables that exist in the Internet cloud. Considering the fact that you have little to no control over the client-side javascript execution and data transmission, you can really only control how you implement your tracking solution.

Hitting the target

And now for the comparison showdown between Google Analytics and Omniture's SiteCatalyst:

Pros of Google Analytics

  • Google Analytics is free from a financial perspective; however, the fine print in your agreement provides no guarantee for reliability or even privacy of data. Google apparently uses your web analytics data to optimize its own Search Engine advertising model (see the ongoing debate in the comments below). This creates an obvious conflict of interest and will result in greater costs if you engage in SEM activities.
  • The interface is incredibly intuitive and easy to use. They do not attempt to educate you thoroughly on the ins and outs of all things web analytics, and your experience in their UI is very controlled. This allows for users of all varieties to derive usable information, no matter the skill level.
    UPDATE: Google Analytics offers a limited form of Advanced Segmentation
  • The implementation process is very simple. Copy some code into your site code and you are set to go. This extremely limits the customization possibilities of your reporting, but it is what it is.
  • Some say the lack of real-time reporting is a good thing. I am not sure why that is as I will soon explain, but I list it here because some people consider it an advantage.

Pros of Omniture SiteCatalyst

  • The biggest advantage to Omniture's offering is the extremely customizable implementation of your tracking. Custom success events and variables allow for a virtually unlimited set of options when planning your analytics strategy. The caveat to this feature of course is the increased complexity of implementing this solution.
  • Generally speaking, the level of detail you can obtain in your reports in SiteCatalyst is far superior to Google's offering. SiteCatalyst's Pathing, Segmentation, and Conversion modules are the main aspects of the program that handily trump Google Analytics' meager substitutes. Omniture also is leaps and bounds ahead of Google in the other online business optimization categories, such as Data Warehousing, Discover, and Data Sources, to name only a few. Test & Target alongside Recommendations actually allow for real action to be automatically taken in response to the data you collect!
  • There is no conflict of interest with Omniture and your SEM efforts. You own the data you collect, and it is kept private and confidential.
  • Real-time reporting! I know I listed the opposite as a Pro under Google, but I strongly disagree with that opinion. Many e-Commerce sites need the most recent data fast in order to make critical decisions. Even with my tracking on this site, I consistently look at the real-time data to ensure that I am meeting the day's goals. If I am not, I can take action to improve my statistics before the day is over. Everyone has their own reasons for their own opinions, but I simply cannot fathom why someone would actually want less information from an analytics solution.

The Bottom Line

One can easily see that these two solutions are targeting two separate and distinct markets: small- to mid-level accounts and the hard-core or enterprise accounts. Google Analytics is perfect for those people who are less experienced in web analytics. You really need dedicated web analysts if you want to get the most out of SiteCatalyst. It still surprises me how clients simply purchase Omniture SiteCatalyst because everyone else is doing it. The same could be said for Google Analytics. Simply having web analytics will not be helpful unless you know how to use it (in fact, it could even cause harm if you are not smart about it).

I like to think of it in this way: You do not deliver highly technical reports to the CEO of a company; rather, you give useful yet simple summary overviews. This fits in line with what Google Analytics provides. Down the chain of command, however, you need expert analysis on deep levels of data to identify trends not easily seen from a summary overview. This is where Omniture's products are particularly useful as long as you know what you are doing. The best solution simply depends on your needs.

I still recommend using some sort of web analytics for anyone with a website. Choose the solution that fits your needs best, make a plan, and be prepared to really get some good use out of it (act on your data according to your pre-determined strategy).

Here's another good article on the topic: http://benrobb.com/2007/02/27/google-analytics-vs-omniture-sitecatalyst/

* Note: In the interest of full disclosure, I work as an employee of Omniture, Inc. However, the views represented here in no way reflect the opinions or overall position of the company. *

Your rating: None Average: 4.5 (21 votes)

Comments

Realizing Cost

I have worked with both product and know that Omniture's product suite is a powerful tool, however site catalyst as a stand alone is missing one of the most important elements that every marketer needs which is segementation on the fly and Google Analytics has. The most painful realiziation of SC is that the organization didn't plan out exactly what they really needed and have to plan for another round of  implementation which can get costly. I think it is worth noting that there have been serveral issues with real-time reporting with SC and there have been some serious delays.Although this seems like a great feature I don't think it's an end all be all reason to invest 200K+I appreicate the information you provided.  

The Basic Difference

This is a great explanation of the pros of SiteCatalyst vs. the pros of Google Analytics. In this article http://topcweb.com/content/analytics-packages-omniture-vs-google, it gives you a great understanding of which website analytic method works best for your company.

"In the interest of full disclusure..."

Being that you are an Omniture employee, I find it highly unlikely that this is a totally un-biased comparison.  It would be equivalent to a Microsoft employee writing a Hotmail to GMail comparison.In my personal experience, most companies will *happily* take the freebie version.  The exception would be the mega-websites (ESPN, Amazon, etc).  But for small and medium businesses, Google Analytics is *more* than satisfactory to meet their needs.

to be taken with a grain of salt

I absolutely agree with you there. As much as I try to avoid bias in my analysis, there is always the unconscious leanings that prevent any reviewer from making a completely objective analysis. As I stated in my conclusion, the two analytics solutions definitely seem to target different market segments. Small and medium businesses, generally speaking, can absolutely fulfill virtually all their analytics needs with Google Analytics--or Clicky, or even Woopra, for that matter. On the other hand, once an organization develops a mature analytics unit, these free solutions might not cut the mustard, no matter what size the business is. But your feedback is greatly appreciated, and I will attempt to improve the article so as to give a more fair and balanced view.

"Love like you've never been hurt,
Work like you don't need the money,
Dance like nobody's watching!"

A very good piece of analysis

Hi Eric

Been looking at some articles to the difference btw SC and GA, definitely you have hit some critical points that many people have missed. I have experienced in both SC and GA for some of my clients in Hong Kong, and some of our clients nowadays shift to GA for the sake of $$ issue.

From most of the argument that I have seen from other user decision on shifting from SC to GA, most of them sticked to the point of $ (like my clients). It is true that GA provides a totally free solution and it seems to "serve" the same purpose that SC does; however when it comes to customized reports and Pathing Analysis (I am particularly focused on this part as it brings me the "real picture") of what is it really happening in the website, it is something GA cant be done.

It is so true that GA gives you the web traffic report....so what? Does it give you really what you need to know? If you are looking for something that give you a generic idea of how well your website goes, probably GA fits the job. When it comes to comprehensive analysis and understanding of your visitor, GA still have a lot to catch up.

I am totally agree with your point that the accuracy of GA as some of the user may have disabled their JavaScript as well as the real-time reporting. It may not be the issue for some websites that don't need immediate "Campaign" feedback or results.

Last but not least, I am not sure how well Google Adwords has dominated in the US market, for my clients in Hong Kong and China, we have to also stick on our SEO and PPC management at different search engine like Yahoo and even localized SE like Baidu (I am sure you should be familiar with it), this is something that GA is totally lack of. (probably it is also one of the Pros for the SC ^_^)

Kenneth

Switching from SiteCatalyst to Google Analytics

Thanks for the clear, fair comparison. We've decided to switch from SC to GA for cost-cutting reasons. I think SC was chosen a few years ago bec "everyone else was doing it," but it's been overkill, and I'm confident GA will meet our pretty straightforward needs. Even though you work at Omniture, do you have any advice or resources to help us make this switch?

RE: Switching from SiteCatalyst to Google Analytics

I understand and applaud your decision to more effectively practice web analytics. Unfortunately, making the switch to GA is not incredibly easy as there is no portal/tool to import your old SC data from. I imagine you can reference this manually from an internal database, if you need to access historical data. I haven't seen any online resources that address switching between the solutions, but simple conversion goals are available to you in GA that try to mimic success events in SC, but it is more oriented to hits on a goal landing/success page.

I am not sure how well versed you are in web-analytics, but feel free to check out my general advice on implementing analytics in the following articles: http://www.haiensheng.com/blog/analyzethis/2008/dec/what-expect-your-web... -and- http://www.haiensheng.com/blog/analyzethis/2008/12/31/three-building-blo.... I have also found http://www.kaushik.net/avinash/ to be an invaluable resource for practicing good analytics.

I hope this helps. Please let me know if you have any questions. You can contact me via the Contact Us link or the chat client on the right side of this page called "Wanna Talk?"

For the benefit of full-disclosure, I am currently an Omniture employee. My views in no way reflect the views or opinions of Omniture. There is no official link between my statements and this corporation.

From GoofaSutra @ Twitter

Thanks. That was very helpful. I was wondering about the SEM implications.

Will using GA affect your paid search results?

For Google's FAQ on how GA data is used and data privacy, please see this FAQ:
http://www.google.com/support/analytics/bin/answer.py?hl=en&answer=87515

A few follow up remarks:
- Disclosure: I work for Google, but do not work on the Google Analytics product, sales, service or support team
- I think it is *fantastic* that marketers have a lot of excellent choices in web analytics tools
- I love to see marketers using whatever they're using to be more effective and efficient, and applaud whoever is helping them do so
- @Eric: Thank you for putting out a useful blog for all web analysts and web marketers. In that spirit, may I kindly ask that you please check out the FAQ link above and, if you see fit, offer an update to this particular blog post?

you have the options

When you create account in Google Analytics, you can opt into or out of "Share my Google Analytics data". If you choose to share, there are two options: " Share with other Google products only" and "Share anonymously with Google and others".
 If you opt out, you will not be able to use few minor functions that Google offers. So it's really up to you.
Nothing is 100% free, there's always something behind "free". But 90% free is not bad when it's financaily tight.

RE: Will using GA affect your paid search results?

Thanks for sending me that site information. It appears that Google has updated its privacy policy. However, when I read through the FAQ, the most applicable statement was this:
Will sharing my data directly affect the ranking of my natural search results, ad quality score or ad placement? Your website data will not be used to affect your natural search results, ad quality score or ad placement. Aggregate data across many customers will be used to improve our products and services. (Emphasis added)

This is the tricky line. Essentially all analytics data that Google collects, whether it be anonymous or not, appears to be open for free use in an aggregate sense. This was the point I was trying to make in my article, and I am sorry it was not clear enough. Point #1: You do not own your analytics data when using GA. Point #2: Google can use the aggregate analytics data to optimize their profits in regards to general keyword bids, etc. I don't blame them for this, and I think it is a smart way for Google to make money, but I do believe people should understand the difference.

On a personal note, I truly admire Google's success and innovations, and I hope to see many more good things come from them. If you can direct me to information that directly refutes my claims, I would be happy to take a look.

For the benefit of full-disclosure, I am currently an Omniture employee. My views in no way reflect the views or opinions of Omniture. There is no official link between my statements and this corporation.

Market targets

I had never considered the fundamental differences in the markets Google and Omniture were targeting. I currently use Google Analytics because it is free, but I think I might eventually switch my business over to Omniture SiteCatalyst once we outgrow our needs here.

Share This!