We are looking for an experienced Python developer to build a robust, multi-threaded web scraper and lead aggregation system. The tool needs to extract, validate, and clean company data, tech stack information, and public business contact details across several European registry platforms and directories.

Key Project Requirements:

• Build scraping pipelines using Scrapy, Playwright, or Selenium with headless browser automation.

• Implement intelligent anti-blocking measures: dynamic user-agent rotation, residential proxy handling, and automatic retry logic.

• Parse extracted JSON payloads, validate email formats, and detect underlying CMS frameworks.

• Clean and normalize data before saving it directly to a MySQL database schema.

• Modular, well-documented code that can run headlessly on a Linux server via cron or SSH.

Requirements:

• Strong track record in web scraping, reverse engineering internal APIs, and handling anti-bot systems (Cloudflare, reCAPTCHA).

• Fluent English communication.

• Ready to sign an NDA and start immediately.

Budget & Payment: Fixed price milestone payment (€1,750) released upon successful testing and deployment on our test environment.

Please send a private message