web2express.org

May 13, 2009

Realtime Web Monitoring

Filed under: Uncategorized — aj @ 9:48 pm

(more info)(Go to Follow Twitter Topics page)

After several months of development, I’m happy to announce twitter digest web site is now available for the public. Web2express.org web site’s default home page is switched to this “Digest” web app.

Thanks to twitter’s api and the api team, the data feed for data mining is just wonderful. Web2express Digest is a real time system that takes in the feeds as they become available, and does some NLP analysis on the tweets using open tools like Open Calais and openNLP.  The results are freely available on http://web2express.org/.  Using this twiiter web app, you can spot   daily hot topics and for each hot topic, quickly find the top contributing twitter users. I hope this real time information will help users to understand the popular topics at any given moment and easily identify who to follow.

I have run the system internally since the beginning of this year. Tweets from millions of users have been analyzed. Each day, large amounts of public tweets pass through the system, from which hot topics are identified by semantic analysis and ranked by popularity. By comparing hot topics in current 24-hour period to the previous 24-hours, new topics are selected.

On top of topic auto-discovery, web2express digest allows everyone to follow and tweet (talk) about the current topics conveniently.Twitter.com has pioneered the way of following people easily by adding interesting people to the following list. I think people have similar needs to follow conversation by topics that they are interested in. This feature of following topics enhances the effectiveness of networking on twitter.

Furthermore, user can create any topic he/she wants to follow. By adding a set of keywords or phrases to a topic, one can pull out more complete list of twitter conversations around the topic. Individuals will find it handy for keep tracking of interests. Companies may use it to effectively monitor conversations concerning their products, brands or competitors.

Please let me know if you have any comment.

AJ Chen

No Comments »

No comments yet.

RSS feed for comments on this post.

Leave a comment

You must be logged in to post a comment.

Powered by WordPress