Need to extract data (CSV) from a log in website for contact information. I have authorization for all the data retrevial - yet website is not friendly for parsing lots of data at one time. (approx. 51,000 records). Website has security elements from cookie to gziped content.
I have not found any spider-software that is able to retrieve data effectively.