iSpyJobs: Automated Job Directory for the Optical, Audio, Vet, Pharmacy, and Dental Industries

Developed a fully automated job directory with web scraping, geolocation, and API-driven job processing to streamline recruitment for niche healthcare industries.

iSpyJobs

Project Overview

Developed a fully automated job directory with web scraping, geolocation, and API-driven job processing to streamline recruitment for niche healthcare industries.

Job Directory

WordPress

Advanced Custom Fields (ACF)

Custom Post Types (CPTs)

Python

Web Scraping

REST API

Geolocation

Challenges

•Client was manually adding tens of thousands of jobs to a pre-existing system, making it inefficient and time-consuming
•Needed a fresh build that could automate job collection, processing, and updates
•Scraping dynamic websites was complex due to anti-bot protections, requiring real-user emulation
•Some sources needed IP rotation, header randomization, and rate-limiting to prevent blacklisting

Solutions

•Built a custom WordPress theme using CPTs, ACF, and REST API endpoints for structured job data handling
•Developed a Python web scraping system to collect jobs from major industry job boards and company websites
•Automated job updates—new jobs are inserted, changed jobs are updated, and removed jobs are archived
•Implemented geolocation-based search functionality, allowing users to filter jobs and nearby businesses
•Scraped business directories for companies within the industry, enabling users to explore potential employers near them

Results

✓Completely eliminated the need for manual job entry, saving the client thousands of hours
✓Enabled real-time job updates with automated processing and archiving
✓Introduced proximity-based job search, significantly improving the user experience
✓Enhanced industry recruitment by providing a centralized job directory with automatic updates

Project Details

Client