Category Archives: tailrank

The Blogosphere RickRoll’d Tailrank 0

This is kind of a funny unintended consequence. It turns out the the blogosphere rickroll’d tailrank. All the bloggers linked to the Rick Roll video which then clustered on Tailrank, creating a recursive Rick Roll. Awesome

Categories: tailrank

Published:
April 2, 2008 – 8:22 am
Author:
By admin

Technorati’s Dropped Index 0

Looks like Technorati is trimming their index back a bit down to content less than six months. We’re in the midst of some economization, performance fixes and retooling that have required taking some data offline. The data is not lost but our priorities are to prefer keeping recent data online. Most people don’t notice We’ll [...]

Categories: google,spinn3r,tailrank,technorati

Published:
November 6, 2007 – 12:43 am
Author:
By admin

Spinn3r Indexing 52T Per Month 2

I looked at our bandwidth numbers and Spinn3r has indexed 52T of raw content per month. That’s 52 TERABYTES people. Nearly 160Mbits continuous IO processed 24/7. A good portion of this is redundant RSS and polled HTML. I’d really love to have the web upgraded to support Delta encoding. This would save a ton of [...]

Categories: spinn3r,tailrank

Published:
October 15, 2007 – 10:23 pm
Author:
By admin

Google Top Blogs Graphed by Rank 1

Looks like there’s a lot of interested in Google Reader blog rank data now that it’s somewhat easy get your hands on. Gabe apparently went through the data and extracted the raw numbers. Techcrunch then ran with it. And of course Scoble jumped on this meme as well. What I find odd is that no [...]

Categories: google,memetrackers,tailrank,weblog

Published:
October 14, 2007 – 10:50 pm
Author:
By admin

Tailrank 2.5 and Constructive Criticism. 0

It’s NICE to get Tailrank 2.5 out the door – but Arrington didn’t like it: So back to the new version…the spam is gone, but the stories are all at least a day old. Burton originally promised this release in early July. It came three months later, which is not unexpected when software is involved. [...]

Categories: tailrank

Published:
October 4, 2007 – 7:13 pm
Author:
By admin

Announcing New Versions of Spinn3r and Tailrank 0

This is a big day for us. We’re announcing new versions of both Tailrank and Spinn3r. The first big announcement is Spinn3r 2.0: After nearly a year in development, I’m pleased to announce the release of Spinn3r 2.0. We’ve also been heads down working on Tailrank as well and are announcing Tailrank 2.5 today as [...]

Categories: crawler,search,spinn3r,startups,tailrank,web2.0

Published:
October 4, 2007 – 11:14 am
Author:
By admin

Engineering Open House At Google – Rumor: Google will Release BigTable/GFS/MapReduce to the Public 2

I was invited to a Google Engineering Open House yesterday and heard more discussions about Google’s infrastructure from Jeff Dean. Not to disappoint, they lifted the kimono a little bit and released some more data points on their impressive infrastructure. For example, Google Translator’s accuracy is improved 0.5% for every doubling in training corpus size. [...]

Categories: search,spinn3r,tailrank

Published:
September 14, 2007 – 6:39 pm
Author:
By admin

Yahoo Acquires BuzzTracker 0

Apparently, Yahoo has acquired BuzzTracker. This makes for the 4th memetracker acquisition including Newroo, The Personal Bee, Blogniscient, and now BuzzTracker. I guess the going price for a memetracker is $5M. Interesting that they only track 100k. Spinn3r/Tailrank is indexing north of 1M. More on that shortly…. Of course you can read the full story [...]

Categories: spinn3r,tailrank

Published:
September 14, 2007 – 4:59 pm
Author:
By admin

Google Cloning Rojo with Google Reader 0

Google is getting closer and closer to cloning Rojo with Google Reader. First they added search and now they’re apparently adding more functionality. The search functionality in particular was interesting because I implemented the first round of Rojo search based on Lucene. An internal presentation leaked onto the web and apparently they’re going to be [...]

Categories: google,rojo,search,startups,tailrank,web2.0

Published:
September 11, 2007 – 12:01 pm
Author:
By admin

POP Takeout Takes Tailrank to the iPhone 0

The guys at POP Takeout have done a cool job porting Tailrank to the iPhone: Sometimes you want a list of what’s hot on the social news sites at a quick glance– an easy-to-access look at the Zeitgeist, if you will. And for those times, there’s POP Takeout, a site Wade M put together and [...]

Categories: memetrackers,spinn3r,tailrank

Published:
September 10, 2007 – 6:40 pm
Author:
By admin