Top News: Real Time News Scraping and Recommendation System


Top News URL


  1. Implemented a data pipeline which monitors, scrapes and dedupes latest news (MongoDB, Redis, RabbitMQ, TF-IDF)
  2. Built a single-page web application for users to browse news (React, Node.js, RPC, SOA, JWT)
  3. Implemented a click event log processor which collects users’ click logs, then updates a news preference model for each user (NLP)
  4. Designed and built an offline training pipeline for news topic modeling (Tensorflow, DNN, NLP)
  5. Deployed an online classifying service for news topic modeling using the trained model

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Blog at

Up ↑

%d bloggers like this: