My blogs are registered with Technorati so when I noticed that my blogging tips site here at https://onecoolsite.wordpress.com had not been crawled by Technorati spiders for 15 days, and that some of my posts had not been indexed, I set out to solve the mystery.
As all wordpress.com blogs are equipped with pingomatic this should not be occurring. Immediately, upon publishing a post a ping should be going out automatically. Three of my 3 posts did not appear at Technorati so I pinged them manually but got no results:
I sent in a Technorati support request and received this reply:
“Please accept our apologies for the delay in getting back to you. We are currently experiencing a backlog in Support, but are working hard to address everyone.
Note that in the past, simply pinging Technorati initiated an indexing of a site. This open door policy meant a lot of splogs and non-blogs would enter the system and masquerade as blogs. In order to better filter out spam as well as inadvertent pings to Technorati, we have implemented review measures to evaluate a site prior to indexing it as a blog.
Also your feed only contains summary data and we require a full content feed. For more information on how to configure your blog for better indexing, please see: support.technorati.com/faq/topic/34?replies=7
I think the reason you are losing posts is because we use the feed together with the blog to index your site and you have limited your feed to only two posts. This means if there is a delay in indexing on our side for any reason or if you post more than two posts in a day, we won’t pick up the posts that are no longer on the feed.”
Step 1: Increase the number of items in the RSS feed
Armed with this information regarding the indexing delay and also regarding the number of items in my RSS feed I have increased them from 2 to 10.
Step 2: Set the RSS feed to full
As far as opening the RSS feed to full feed, given the problems with blog scrapers I decided against that. My RSS feeds will remain on “summary”. Consequently, I do expect that from time to time some of my posts will not be indexed by Technorati spiders. I’m willing to accept that because I rarely ever get referrals fro Technorati.
Questions for readers:
- Is your blog registered with Technorati?
- Do you get many Technorati referrals?
- Have you noticed a delay when it comes to Technorati indexing your site?
- How many items do you have your RSS feeds set to access?
- Is your RSS feed set to “full” or to “summary”?
Reference: Technorati Is Indexing Me!
Related posts found in this blog: