Last updated: November 03, 2016
The information contained on www.webspidermount.com website (the “Service”) is for general information purposes only.
Aspen Technology Labs, Inc. assumes no responsibility for errors or omissions in the contents on the Service.
In no event shall Aspen Technology Labs, Inc. be liable for any special, direct, indirect, consequential, or incidental damages or any damages whatsoever, whether in an action of contract, negligence or other tort, arising out of or in connection with the use of the Service or the contents of the Service. Aspen Technology Labs, Inc. reserves the right to make additions, deletions, or modification to the contents on the Service at any time without prior notice.
Aspen Technology Labs, Inc. does not warrant that the website is free of viruses or other harmful components.
We noticed you mentioned scraping Indeed.com
Just to confirm: Indeed.com prohibits spidering of its content and they will block anyone trying to scrape it.
Normally, our clients ask us to spider jobs from direct employer websites and ATSes.
In some cases we can spider commercial job boards: if there is a formal agreement between our client and the job board to allow spidering.