Build a social networking hashtag crawler.

This app will be responsible for fetching all images associated with a hashtag. Images will be grabbed from the following social sites: • Facebook • Flickr • Instagram • Tumblr • Twitter The app will be self-enclosed and will be communicated with through a restful API. The app must be designed for efficiency and to run fast. The app will also periodically re-crawl the social sites grabbing newly created hashtagged images. The following is a scenario for how the app will operate: 1) I add a hashtag to the app with the intention to download and process all images from the above social sites. 2) The app adds the hashtag to a list then processes it when it can. 3) When the time comes to fetch the images it goes through the above social sites indexing information about the images and locally downloads them. 4) I call the restful API to grab information about the hashtag and the images. 5) The app periodically re-crawls all the processed hashtags and fetches new images. The app will run on its own server and will also act as a CDN for the images it fetches. All interactions with the Social Hashtag App must be made through a restful API. A private key must be required to access the API. The restful API must also have a logical versioning system. The app must run like an engine. It must be able to gracefully start, shutdown and restart. Please see attached for more information.