Hello
You want to do as follow
Basic Requirement: Application that will crawl a betting web site, find events and extract odds.
Write odds into a format which includes Event Type, Event Title, Event Time, Market Type, Market Title,Team, Bookmaker, Odds, Retrieval Time. This will later be loaded to a DB
Detail: Scraper needs to "discover" events by reading the menu and for each Sport or Event Type, get the Sport Home Page and pull a list of Markets from there.
For Each Market
Config: A config file (CSV) will list each Sport Type and Market Type with a retrieval (Y or N) flag so that the the scraper can be restricted in what it is extracting.
A separate config file will contain the option to add a proxy server to use for connection.
please send me your contact
thanks.