Horopter log : 23 Oct 2015 10:50 AM IST
Summary: Web scraping is tough for new people.
It took 7 hours to scrape the data from boxoffice .com and the backend process of generating the pattern took another 8 hours since I am quite new to this job. Now I have a set of tables containing the information I need and I am yet to figure out a way to merge the tables and group them by the movies. Once that happens, I can launch the trends. I was mistaken when I was going through the twitteR package. It sure does have a trends option making my analysis a bit easy to go. Furthermore the google trends data is good looking. I am interested in getting data from multiple sources, mostly facebook since it is more intimate than twitter.
Peace
Horopter out.
Summary: Web scraping is tough for new people.
It took 7 hours to scrape the data from boxoffice .com and the backend process of generating the pattern took another 8 hours since I am quite new to this job. Now I have a set of tables containing the information I need and I am yet to figure out a way to merge the tables and group them by the movies. Once that happens, I can launch the trends. I was mistaken when I was going through the twitteR package. It sure does have a trends option making my analysis a bit easy to go. Furthermore the google trends data is good looking. I am interested in getting data from multiple sources, mostly facebook since it is more intimate than twitter.
Peace
Horopter out.
No comments:
Post a Comment