3rd February, 2015 (Bitbucket, topic cleanup)

Bitbucket commands Create branch git checkout -b sortByHotTopic Checkout branch git checkout sortByHotTopic Get git log git log Get git status git status git commit git push ---------- Topic cleaning ideas: 1. Fix wordpress tag / 2. Each topic should have several related keywords 3. How to classify a tag with the same name into two different topics - Identify topic words that can have multiple meanings - Put related keywords with the topic - Match related keywords with other tags 4. How to identify new topics with existing matching topics? 5. How to clean up related topics (Uber, UberX, Uber (company)) 6. How to identify / disable meaningless topics (a, the) 7. Suggestions: maybe we save the topics being search and clicked through and to segment hot topics from the cold ones and retire the cold ones. 8. BaseBlogCrawler - crawls the rss blog WordPressCrawler - crawls wordpress blog CommentServiceImpl normalizeTags will find existing tags and calls addTopic function to add new tags if necessary. CommentDaoImplementation addTag function will add a new tag. TopicDaoImpl addTopic function will add a new topic TopicDaoImpl findTopicByTitle function will find an existing topic by Title. BlogJobService importNewBlogEntryJob importAllBlogEntryJob — read RSS and data will be saved into blog_entry database table saveBlogEntryasComment -------------- Database table topic_comments_history (record which topic a comment has) -------------- Pinterest topic classification http://www.ccs.neu.edu/home/amislove/publications/Pinterest-ICWSM.pdf