Job Taxonomy is aimed towards automated industry/category recognition. Job Taxonomy is an online service that analyses jobs content and maps industry sector/category data based on available job information.
New service might be easily integrated into your current job wrapping software. There are two integration options available for the job taxonomy solution from SpiderMount.
Job boards, ATSes, online recruitment services can send jobs XML data to JobTaxonomy API and obtain Industry category IDs mapped to jobs.
SpiderMount job spidering service in combination with JobTaxonomy scrapes jobs from employers’ websites lacking Industry Category listings and automatically defines relevant job industry sector/category with a further update of the scraped data.
We noticed you mentioned scraping Indeed.com
Just to confirm: Indeed.com prohibits spidering of its content and they will block anyone trying to scrape it.
Normally, our clients ask us to spider jobs from direct employer websites and ATSes.
In some cases we can spider commercial job boards: if there is a formal agreement between our client and the job board to allow spidering.