Job scraping monitoring & reporting

Spidering quality monitoring involves source websites availability and vacancy pages’ changes tracking, reporting and problem-solving.

SpiderMount spidering technology automatically detects and reports a multitude of problems occurring during job scraping, content parsing, and posting.

Once detected, issues are reviewed and fixed by spider support team.

Popular types of issues preventing job from being scraped or posted correctly are:

• source website changed job page format, i.e. design or HTML is changed
• vacancy data structure is changed: i.e. category listing removed or changed
• website is unavailable, i.e. temporary down or moved
• career pages are migrated to new technology
• substantial changes in job numbers
• inability to post job to recipient technology