Adobe
Adobe Digital Marketing Blog
  • Digital Marketing
    • Mobile
    • Social Media
    • Digital Advertising
    • Search Engine Marketing
  • Analytics
  • Personalization
  • Industries
    • Financial Services
    • Media & Entertainment
    • Retail & Travel
  • Executive Insights
    • Aseem Chandra
Alerts [Inside Omniture SiteCatalyst] Implementing Twitter Data Tracking in Omniture SiteCatalyst

Integrating Twitter Into Web Analytics [Inside Omniture SiteCatalyst]

Analytics · By Adam Greco On February 23, 2009 · 27 Comments

At last week’s annual Omni­ture Sum­mit, there was a lot of buzz about social media and Twit­ter specif­i­cally.  In my Site­Cat­a­lyst Power User ses­sion, one of the things I cov­ered was an idea about how you can lever­age Omni­ture Site­Cat­a­lyst to mon­i­tor your company’s brand rep­u­ta­tion in tools like Twit­ter.  This con­cept seemed to really res­onate with the Sum­mit audi­ence, so much so, that I was given an oppor­tu­nity to share it at the clos­ing ses­sion.  The fol­low­ing will describe the con­cept in greater detail for those who could not attend my Sum­mit ses­sion.  DISCLAIMER: What I pre­sented is a “proof of con­cept” and is no way a for­mal intro­duc­tion of a new Omni­ture product.

Busi­ness Sce­nario
So this idea started with me think­ing about how cool Twit­ter is and how it could be used for mar­ket­ing pur­poses.  As an Omni­ture Twit­ter ambas­sador (Omni_Man), I see peo­ple talk­ing about Omni­ture all of the time on Twit­ter.  Some­times this chat­ter is pos­i­tive, some­times it is neg­a­tive.  I usu­ally try and send my col­leagues at Omni­ture “tweets” that I think might be rel­e­vant to them, but this can be very time con­sum­ing.  So I said to myself, “Site­Cat­a­lyst has a Data Inser­tion API that is used to inject non-website data into Site­Cat­a­lyst and Twit­ter has an API asso­ci­ated with its search​.twit​ter​.com web­site, so if you put the two together, why couldn’t you pass Twit­ter infor­ma­tion into Site­Cat­a­lyst?”  Doing this would allow you to do many cool things which I will describe below.  I enlisted the help of one of our Omni­ture Con­sult­ing geniuses and within 24 hours, we had a work­ing pro­to­type.  The fol­low­ing exam­ples of this func­tion­al­ity will use Com­cast (who I co-presented with) as an exam­ple, but these rep­re­sent test data and is not meant to imply that Com­cast is using this func­tion­al­ity.  In my ses­sion, I posed the fol­low­ing hypo­thet­i­cal busi­ness sce­nario:  You are the web ana­lyt­ics man­ager at Com­cast and your CMO returns from an exec­u­tive retreat where he/she has learned all about Twit­ter and believes that Com­cast needs to do every­thing it can to mon­i­tor what its cus­tomers are say­ing on social media sites.  The CMO calls an emer­gency “all hands” Marketing/PR meet­ing and demands to know the following:

  1. How often Com­cast is men­tioned on tools like Twitter
  2. If there is ever a spike (pos­i­tive or neg­a­tive) in brand-related terms (in a week, day or even hourly)
  3. Who are the peo­ple most often men­tion­ing Com­cast on social media tools and who are they com­mu­ni­cat­ing with the most?
  4. When are peo­ple on social media tools men­tion­ing key Com­cast product/service fea­tures that Prod­uct Man­agers should know about

So at this point, the CMO turns to you and asks if there is any­thing you could do to help… What would you say?  Not sure?  Let’s tackle them one at a time…

Mon­i­tor­ing Brand Com­ments
As stated ear­lier, the key to this solu­tion is lever­ag­ing the Site­Cat­a­lyst Data Inser­tion API and the Twit­ter API.  For those of you not famil­iar with the Site­Cat­a­lyst Data Inser­tion API, it is used to send data to Site­Cat­a­lyst when a JavaScript tag is not an option.  By com­bin­ing this with the search​.twit​ter​.com API, we can set a Site­Cat­a­lyst Suc­cess Event for every “Brand Tweet” by pump­ing the results of a “Com­cast” Twit­ter search into Site­Cat­a­lyst.  This allows us to see a met­ric chart of “Brand Twit­ter Com­ments” so we can track it by month, week, day or hour.  How­ever, why stop there?  Site­Cat­a­lyst has a built-in Alert fea­ture that allows you to be noti­fied via e-mail or mobile device when a Suc­cess Event met­ric hits a thresh­old or changes more than a spec­i­fied per­cent­age.  Why not take advan­tage of this fea­ture and send your­self (or oth­ers) an Alert when your brand is men­tioned 25% more this hour than last hour or decreases sig­nif­i­cantly day to day?  This would allow you to stay on top of what is going on in Twit­ter with­out hav­ing to con­stantly mon­i­tor Twit­ter every day/hour!  Below is a screen shot where you can see the “Brand Twit­ter Com­ments” Suc­cess Event and an Alert related to it being set:

Who’s Tweet­ing?
The next thing your CMO wanted to know who are the most active Twit­ter users that are tweet­ing about your brand.  Are there some really good brand advo­cates out there?  Are there peo­ple who are repeat­edly bash­ing your brand?  Are any of your employ­ees “going rogue” and con­fus­ing the mar­ket­place with mixed mes­sages?  Again using the API, it is pos­si­ble to extract the Twit­ter user name asso­ci­ated with every tweet.  In our proof of con­cept we did our best to extract the author and the recip­i­ent, with the lat­ter being more dif­fi­cult since there are times when there is no recip­i­ent or mul­ti­ple recip­i­ents (we are still work­ing on this).  How­ever, by plac­ing both in sep­a­rate Con­ver­sion Vari­ables (eVars), we could break­down the “Brand Tweet Com­ments” Suc­cess Event met­ric by author to see who is twit­ter­ing about your brand the most.  We decided to take this one step fur­ther by cre­at­ing a Con­ver­sion Sub­re­la­tion between the author and the recip­i­ent so you could break one down by the other (note that if there is no recip­i­ent we used “[No Recip­i­ent]”).  This allowed us to see who was tweet­ing with each other the most often.  I imag­ine that this could be use­ful to see what types of peo­ple have formed vir­tual com­mu­ni­ties and some com­pa­nies might con­sider con­tact­ing the key mem­bers of this vir­tual com­mu­nity to gather prod­uct feedback/suggestions or to lever­age them for brand pro­mo­tion.  You could also use SAINT Clas­si­fi­ca­tions to group Authors into mean­ing­ful buck­ets once you knew who they were (i.e. Cus­tomers, Ven­dors, etc…).  The fol­low­ing is a screen shot of the sub­re­la­tion report we created:

Min­ing Impor­tant Prod­uct Key­words
The final thing the CMO tasked us with was dis­cov­er­ing when, in addi­tion to our brand name, social media users were men­tion­ing spe­cific key­words that are prod­uct or ser­vice related.  For exam­ple, if some­one “tweets” about Com­cast and in the same tweet men­tions “speed” it is likely that this tweet is related to high-speed inter­net access and could be inter­est­ing to the Inter­net prod­uct man­ager.  Alter­na­tively, if a “tweet” men­tions Com­cast and also men­tions “Tivo” or “DVR” it is likely they are express­ing an opin­ion in the dig­i­tal TV record­ing arena that would inter­est the asso­ci­ated prod­uct man­ager.  So you have mil­lions of oppor­tu­ni­ties to read what your cus­tomers are say­ing, but who wants to scan through all of those “tweets” to find the rel­e­vant ones, espe­cially if this has to be done manually?

This got me think­ing about SiteCatalyst’s search func­tion­al­ity.  If we had all of the “tweets” in Site­Cat­a­lyst, you could per­form a key­word search and let Site­Cat­a­lyst find all of the com­ments that men­tion a spe­cific key­word.  For exam­ple, let’s imag­ine we use the Data Inser­tion API to pass all Com­cast “tweets” to a Con­ver­sion Vari­able (eVar) and then con­duct a search for the phrase “Tivo.”  Site­Cat­a­lyst would iso­late those “tweets” and then you can book­mark that report and sched­ule it to be e-mailed to the appro­pri­ate prod­uct man­agers at what­ever time inter­val you desire (hourly, daily, weekly, monthly, etc…).  This way, no one at your orga­ni­za­tion would ever have to use or look at Twit­ter, but instead, the infor­ma­tion they need to see would be pushed to them auto­mat­i­cally.  Best of all, there is no limit on how many searches and book­marked reports you can cre­ate so you can cre­ate hun­dreds of dif­fer­ent key­word searches and send them to dif­fer­ent groups of peo­ple using Pub­lish­ing Lists.  The fol­low­ing screen shot pro­vides an exam­ple that shows “tweets” hav­ing been sent into Site­Cat­a­lyst and a user enter­ing the phrase “Tivo” in the search box and a high­light­ing of one “tweet” that would be found:

As you can see, if you know a lot about Site­Cat­a­lyst includ­ing API’s, Con­ver­sion Vari­ables, Sub­re­la­tions, Search­ing, Book­marked Reports, etc… you would be able to amaze your CMO by answer­ing all of his/her ques­tions and be a rock star!

Track Mul­ti­ple Brands
Another con­cept related to this that we have explored is the idea of track­ing mul­ti­ple brands.  There is no rea­son why Com­cast, in this exam­ple, could not also cap­ture “tweets” about its com­peti­tors or sub­sidiary brands to see them side by side.  This would require the use of an addi­tional eVar or poten­tially some addi­tional Suc­cess Events, but we got this work­ing in our prototype.

Next Steps
As men­tioned pre­vi­ously, all of this was done as a proof of con­cept, but as you can see, the con­cept has great poten­tial.  We at Omni­ture are going to explore this topic more and hope that you do the same.  We hope to add more infor­ma­tion about this to the Devel­oper Con­nec­tion.  We will also con­tinue to explore new ideas related to this, but I encour­age you to leave com­ments here with your ideas on how this con­cept can be extended.

If you want to learn the imple­men­ta­tion details of this solu­tion, please refer to the fol­low­ing tech­ni­cal blog post: http://​blogs​.omni​ture​.com/​2​0​0​9​/​0​2​/​2​4​/​i​m​p​l​e​m​e​n​t​i​n​g​-​t​w​i​t​t​e​r​-​d​a​t​a​-​t​r​a​c​k​i​n​g​-​i​n​-​o​m​n​i​t​u​r​e​-​s​i​t​e​c​a​t​a​l​y​st/

Have a ques­tion about any­thing related to Omni­ture Site­Cat­a­lyst?  Is there some­thing on your web­site that you would like to report on, but don’t know how?  Do you have any tips or best prac­tices you want to share?  If so, please leave a com­ment here or send me an e-mail at insidesitecatalyst@​omniture.​com and I will do my best to answer it right here on the blog so every­one can learn! (Don’t worry — I won’t use your name or com­pany name!).  If you are on Twit­ter, you can fol­low me at http://​twit​ter​.com/​O​m​n​i​_​man.

Learn more about Omni­ture Consulting
Learn more about Omni­ture University
Tagged with: Education • SiteCatalyst • SiteCatalyst-Advanced • Social Media 
  • http://twitter.com/slicecast James Dut­ton

    Adam,

    Quite inter­est­ing — will you be post­ing sam­ple code to the devel­oper web­site so oth­ers can repli­cate and build on this? Some great proofs of con­cept explored here, with some inter­est­ing ways to have users adopt some of (I must assume from your pre­vi­ous posts) those under used fea­tures of Site Catalyst.

    I’m curi­ous to learn more about how you would plan on address­ing sen­ti­ment, you men­tion “Some­times this chat­ter is pos­i­tive, some­times it is neg­a­tive.” but don’t sug­gest any ways to track and mon­i­tor sen­ti­ment; some­thing that is always top of mind when I am review­ing social media analy­sis tools.

    Cheers, J

  • http://blog.aspenms.com Greg Asman

    Adam,

    Great post and great pre­sen­ta­tion last week. I was hop­ing you might be able to add some addi­tional detail as to what the [No Recip­i­ent] rows mean in the con­text of the reports above.

    They appear to mean that they were gen­eral tweets sent out by the “From” and the oth­ers were either replies to the indi­vid­u­als listed or tweets that included their name. It might be nice to be able to dis­tin­guish between the two.

    Thanks for the clar­i­fi­ca­tion in advance! Great meet­ing you!

    Greg

  • http://www.webanalytics.es/blog pere rovira

    awe­some post, adam! such a sim­ple solu­tion, and yet so pow­er­ful. thanks for let­ting me know, will write about it on the blog this week when i get a chance.

    i guess you could also apply clas­si­fi­ca­tions to the tweets, to see the rel­a­tive impact of the diverse brands of Com­cast, though it could be quite con­sum­ing… actu­ally, now that I think of, it would be really cool if you could make a search on site­cat­a­lyst, and then apply a clas­si­fi­ca­tion to all of the search results.

    cheers
    pere

  • Jor­dan

    So did I mis­un­der­stand at the clos­ing ses­sion that were was a “how-to” com­ing shortly for users to imple­ment? I’ve been sold on the need for this, just need the how-to to implement.

  • http://blogs.omniture.com/author/agreco Adam Greco

    James — Great point. Mea­sur­ing sen­ti­ment would be a more advanced solu­tion, but I could see look­ing for spe­cific key­words and using a VISTA rule. We have dreamed of a SAINT “auto-classification” fea­ture for years but no luck as of yet. There is always SAINT, but that would be some­what unbear­able. Per­haps Omni­ture or part­ner devel­op­ers can solve that one…

    Adam

  • http://blogs.omniture.com/author/agreco Adam Greco

    Greg — In this exam­ple “[No Recip­i­ent} is when a user sim­ply “tweets” with­out tar­get­ing it at some­one spe­cific. We are look­ing into cases where there are mul­ti­ple recip­i­ents, but that is a bit trick­ier. Stay tuned.

    Adam

  • http://blogs.omniture.com/author/agreco Adam Greco

    Jor­dan — The “how-to” is com­ing in the next day or two. Look for a follow-up post by one of our more tech­ni­cal folks…

    Adam

  • http://blogs.omniture.com/author/agreco Adam Greco

    James — Great point. We are look­ing into sen­ti­ment. Our hope is that part­ners help us extend this. An auto-classification fea­ture would be ideal, but has been a long time request. I like the idea of a VISTA rule based upon hun­dreds of keywords…

    Adam

  • http://blogs.omniture.com/author/agreco Adam Greco

    Pere– Another idea would be to use the SAINT API…

    Adam

  • John Nguyen

    We devel­oped a sim­i­lar Twit­ter app over a month ago but found that, unless Omni­ture pro­vides a way in the Data Inser­tion API to flag some­thing as “exter­nal” (this came up in Brett Error’s feed­back ses­sion), you will see an infla­tion in over­all page-views/visits (the Data Inser­tion API requires that you pro­vide a page URL and/or page Name–you can also pro­vide a unique vis­i­tor ID which should pre­vent a huge spike in vis­i­tors but again, page views go up every time).

    If you’re track­ing many keywords/brands, you might see a skew in your traf­fic data. If you’re using cal­cu­lated met­rics, this can throw off your numbers.

    Ide­ally, Omni­ture should pro­vide a way to insert “exter­nal” data which can then be cor­re­lated to things like traf­fic and con­ver­sions. As of right now, if you look at a graph of page views vs. tweets, you’re going to see an increase in traf­fic as the num­ber of tweets go up, which might not nec­es­sar­ily be true!

  • http://blogs.omniture.com/author/bgaines Ben Gaines

    John: You make an excel­lent point. For this exact rea­son, in my post on imple­ment­ing Adam’s Twit­ter track­ing solu­tion, I rec­om­mend using a sep­a­rate report suite to track Twit­ter action. It is down­right inac­cu­rate to lump “tweets” together with the actual page views occur­ring on your site—they should never be mixed under any cir­cum­stances, really (unless you need to inflate your PV/visit/visitor data, I sup­pose). If you haven’t seen it yet, check out my blog post at http://​blogs​.omni​ture​.com/​2​0​0​9​/​0​2​/​2​4​/​i​m​p​l​e​m​e​n​t​i​n​g​-​t​w​i​t​t​e​r​-​d​a​t​a​-​t​r​a​c​k​i​n​g​-​i​n​-​o​m​n​i​t​u​r​e​-​s​i​t​e​c​a​t​a​l​yst.

  • http://www.kineo.com.au Kristi Bar­row

    Adam,

    thanks for the great post. Your descrip­tion of the CMO back from exec­u­tive camp sce­nario was spot on! This hap­pens all the time (twit­ter, face­book and once upon a time Google!) and it’s great to have you guys pro-actively work­ing on solutions.

    I am look­ing for­ward to imple­ment­ing this kind of fea­ture for our clients and will be read­ing with inter­est the imple­men­ta­tion details.

    thanks!
    Kristi

  • http://www.webanalyticsbook.com Sebas­t­ian

    That’s really great stuff! Great job Omniture!!!!

  • http://www.e-inbusiness.co.uk James Gurd

    Hi Adam
    Loved the post, really inter­est­ing read­ing. I’m try­ing to get my head round how our Clients can put together a busi­ness case for social media to demon­strate tan­gi­ble ben­e­fits to the doubters. Track­ing Twit­ter brand activ­ity and user com­ments would be excel­lent.
    Like oth­ers I would wel­come a “how to” guide to digest. I’ve posted a link to this blog on my twit­ter account because it will be of inter­est to a wider audi­ence.
    http://​twit​ter​.com/​e​i​n​b​u​s​i​n​e​s​s​_JG

    thanks
    james

  • http://twitter.com/vanscoy vanscoy

    Ele­gant solu­tion. I love it when plat­forms work together like this. Of course, I’ll tweet this arti­cle. Even bet­ter, I’ll actu­ally bring it up face-to-face to chal­lenge my col­leagues. Thanks, Adam.

  • Praveen Pandey

    Awe­some con­cept, more­over the pre­sen­ta­tion is quite inter­est­ing in the wake of “Social” buzz

  • http://blogs.omniture.com/author/agreco Adam Greco

    James — Be sure to check out the tech­ni­cal how to at: http://​blogs​.omni​ture​.com/​2​0​0​9​/​0​2​/​2​4​/​i​m​p​l​e​m​e​n​t​i​n​g​-​t​w​i​t​t​e​r​-​d​a​t​a​-​t​r​a​c​k​i​n​g​-​i​n​-​o​m​n​i​t​u​r​e​-​s​i​t​e​c​a​t​a​l​yst

  • http://emptymind.org Jason

    I’ve put together a fully con­fig­urable Twitter-Omniture plug-in based on Adam’s design. The plug-in is writ­ten in PHP and comes with a con­fig file that lets eas­ily define your Omni­ture data (con­nect infor­ma­tion, vari­ables used) and your Twit­ter Search criteria.

    http://​emp​ty​mind​.org/​?​p​a​g​e​_​i​d​=69

  • Jim Hazen

    Hi Adam,

    We actu­ally have started this up but won­dered if there was a way to get a time­stamp for the tweets using the API?

  • http://blogs.omniture.com/author/bgaines Ben Gaines

    Jim: Yes, you can time­stamp the tweets if you’re using a sep­a­rate report suite with time­stamp­ing enabled; Client­Care can turn this on for you. Note that time­stamp­ing must be done in a sep­a­rate report suite, as time­stamped hits can­not be mixed with non-timestamped hits.

    This would be done by tak­ing the <pub­lished> ele­ment value out of each entry returned by the Twit­ter Search API and putting it into the <time­stamp> ele­ment in your Omni­ture Data Inser­tion API post.

  • http://www.twiogle.com Twit­ter Search

    thats great that you are talk­ing about the twit­ter api,a good exam­ple of search­ing with the twit­ter api is on twiogle​.com because you can search on twit­ter and google at the same time.

  • http://MLB.com D-Rod

    Adam, the Twit­ter inser­tion API (the one used to post Tweets to Twit­ter from out­side of Twit​ter​.com) allows us to pass a “source”, which is where the Tweet came from. Here at MLB​.com, we have our own Twit­ter app and would love to see how many Tweets are com­ing directly from our app com­pared to all Tweets. I would assume this is some­thing the OMTR Twit­ter API could query no?

  • Rudi Shumpert

    D-Rod,

    The pull from the twit­ter api should be return­ing an ele­ment “source” for each tweet. You could fil­ter out any­thing sent by your api

    –Rudi

  • http://www.rossmonaghan.com/about-me.html SEO Pro­fes­sional

    Adam, any idea as to when this will be inter­grated into Site Cat­a­lyst? Also, would this con­cept expand into other social API plat­forms like Face­book etc.?

  • http://www.KarmaSnack.com Ade­lard Gasana

    I really love omni­ture. It’s really easy to use, and inte­grat­ing it is a sim­ply one, two, three!

  • http://www.tyggzc.com BUNANE

    Interesting!I was hop­ing you might be able to add some addi­tional detail as to what the [No Recip­i­ent] rows mean in the con­text of the reports above.Like it~

  • http://myforexnow.com myforexnow

    Great info, but, is it updated?
    I saw is from 2009.
    Thanks for the articles

  • Follow Adobe Digital Marketing

    Fol­low @AdobeDigMktg
  • Popular Posts

    • Excellent Blog Post — Getting More from your Omniture Implementation.4
    • Tim Tebow and Mobile Marketing in 2012 (Part 1)2
    • Change the Conversation: What does “Efficiency” really mean?2
    • My work, My passion — Customer Analytics1
    Adobe Digital Marketing Blog

    Pages

    • Digital Marketing
    • Analytics
    • Personalization
    • Industries
    • Executive Insights

    The Latest

    • Using Dependent Code: Adding the Twitter Handle Name to Your Referring Traffic
      A common request I hear from customers is the desire to integrate […]

    More

    See how Adobe is changing the world through digital experiences. We are the leader in delivering solutions that let customers produce, distribute, and realize value from great content, whether in media and publishing or digital marketing.
    © 2012 Adobe Systems Incorporated. All Rights Reserved.
    Tweet