b5media.com

Advertise with us

Enjoying this blog? Check out the rest of the Technology Channel Subscribe to this Feed

A Feed Is Born

Tokenizer

by Juned on June 24th, 2007

This is one way of eliminating the information overload. Tokenizer is a shopping search engine that enables punters to look for items sold at Internet stores by using only specific statistics: Tokenizer is unique in that does not depend on RSS feeds of merchants, countries, languages and networks. The search engine specifically mine product name, category, manufacturer, price and other additional information. Tokenizer cannot mine small sites with static content. At present the Tokenizer datamines around 120 major Internet stores in the USA and Canada. Datamining will be expanded to new domains within a few weeks and within a few months it will be finished with the initial analysis of several big Internet stores in Australia, New Zealand, Continental Europe, UK and America.

Being not dependent on RSS feed, site redirection and other kind of affiliate tracking simplifies the shopping experience. I tried it out and it is refreshing in that you get the results without the fluff that usually accompanies a search, which can be irritating. In this sense taking out the RSS makes sense. However, There is a heavy investment in the analysis of big Internet stores before they can be included in the search. I wonder. Can Tokenizer or a version of it be used to offer a similar service to another set of information? Perhaps scientific journals and books? What do you think?

POSTED IN: RSS

1 opinion for Tokenizer

  • Fuad
    Jul 5, 2007 at 8:02 pm

    Thank you!
    I need to categorize (to create an algorithm) huge product list and I am very limited in time… and web site is in production, I need to be very careful…

Have an opinion? Leave a comment: