Data Scraping Project - NFL Play by Play Data

We require play-by-play data from 2012 NFL matches listed on [login to view URL] downloaded into csv or excel files. The play-by-play data can be found from a link such as the one below: ## <[login to view URL]@bills#menu=highlights&tab=analyze&analyze=playbyplay> The first number in the url is the ID for the match - it is always in the format Date (YYYYMMDD) followed by a 2-digit number to identify the match. Data needs to be further processable in excel or VBA, so we need everything as strings/numbers rather than images. We would also like additional data collected for each play or presented slightly differently to how it appears on the play-by-play commentary at present. Please see the attached excel file with an example and further details in the detailed description. We want to be able to collect all data for the 2012 season and beyond, so we need a button that will download all data so far this season, which we can then press each Tuesday to download new data from the previous weekend. We will want to test whatever you produce thoroughly for accuracy and reliability before releasing payment, so please be aware it may take a few days before we release funds. ## Deliverables As discussed, we need some additional data not contained within the play-by-play descriptions, and some data presented slightly differently. Specifically, we need the following: 1. Match ID for each game - this should be date (in the same YYYYMMDD format as above) followed by _[AwayTeam]@[HomeTeam] . [AwayTeam ] and [HomeTeam] should be the same 2 or 3 letter abbreviation seen in the main scoreboard at the top of the page. 2. HomeTeam - same format as above 3. Quarter - at the start of each quarter this is listed before the play-by-play continues. 4. Total time remaining - divided into two columns, minutes and seconds. The time remaining in the quarter can be seen in brackets at the start of the play-by-play description. The total minutes remaining is the minute number in brackets, +15 x number of quarters remaining. The seconds remaining is simply the second number in brackets. 5. Very importantly, we need two columns for offense and defense - the team that has the ball is the offense, the team that doesn't is the defense. Ideally, for kick-offs and punts we would like the kicking/punting team listed as defense and the receiving team as offense, but if this is not possible it's not the end of the world. 6. 3 columns for Down, To-Go, and yard line. This can be found at the extreme left of each line of commentary, for example 1-10-BUF 20. The first number is the down, the second number is 'To-Go' and the BUF 20 is the yardline. Ideally we want yardline to be a single number, total yards to opposition end zone. So if the offense is BUF and they are at BUF 20, it means they are in their own half, so we would like to see (100-20)=80 yards to go. However if NE is the offense and they are at BUF 20, they are in the opposition half so have 20 yards to go. An example of how we would like the data to appear in the excel file is shown in the attached file.