Keep your job listings up-to-date with source Employer websites by utilizing Synchronization feature of Job Spider. The tool will make sure only new jobs are added to your system and expire the vacancies removed from source websites.
Incremental scraping
Synchronization feature provides incremental downloads to make sure you don’t overload source websites with excessive requests, but only download new jobs added to system.
Job Spider screenshots:
Activate Synchronization for any scraping package/website:
Set job URL to be a unique identifier:
Resulting scraping sessions list:
Hit “Items” to view jobs downloaded:
Replicating URLs (jobs scraped in earlier sessions) were not downloaded (old status):
Updates to the stored job data:
- New: new jobs scraped during this session
- Deleted: jobs removed from source website
Posting to your job board / database:
Job Spider will synchronize jobs data with your recipient website or database.
Job ID from job board (Received ID) will be received whilst posting and matched to Spider job ID (Entity ID):
Jobs deleted from client source website will be removed from job board.