Python Data Collection Script for MQL5

I am looking for someone who can automatically download the complete publicly accessible MT5 CodeBase from MQL5.com.

Source:
https://www.mql5.com/en/code/mt5

I want all entries from page 1 through page 206 to be collected and all available files downloaded.

Important: The downloaded files should not be unnecessarily extracted/decompressed. ZIP files should remain in their original compressed format whenever possible in order to minimize storage size.

For the later transfer of the complete dataset to me, we will use a separate free web-based file transfer/storage solution. We can decide which service to use once the download is completed. The full dataset therefore does not need to be transferred directly through the freelancer platform.

Tasks

• Scan and process all pages from 1 to 206
• Collect all available MT5 CodeBase entries and IDs
• Download all publicly available ZIP/source files
• Automatically skip files that already exist
• Support resuming after interruptions
• Verify ZIP files for corruption
• Generate SHA-256 checksums
• Detect duplicate files
• Filter out MQL4 files
• Properly log HTTP 403, 404, timeouts, connection errors, etc.
• Document missing or removed entries
• Store metadata in JSON, JSONL, or SQLite

Technical Requirements

Preferred:

• Python 3.11+
• httpx, Scrapy, Playwright, or similar
• Controlled request/download speed
• Retry and exponential backoff
• Resume functionality
• Clean error handling
• No CAPTCHA bypass
• No unauthorized proxy networks
• No bypassing of website access restrictions

What I Need at the End

1. The complete available MT5 CodeBase from pages 1–206
2. Files kept compressed as ZIP whenever possible
3. The complete Python source code of the downloader
4. A short installation and usage guide
5. Resume functionality for future runs
6. A report/database containing:
   • Entry ID
   • Title
   • URL
   • Download status
   • Filename
   • File size
   • SHA-256 checksum
   • Error reason
   • Missing or removed entries

The downloader source code is especially important to me, because I want to understand how the process works and be able to repeat or extend it myself later.

Someone experienced with Python, web scraping, and modern AI coding tools should be able to automate most of this relatively quickly. I am not looking for an unnecessarily complex enterprise system, but rather a clean, reliable, and reproducible solution.

After the complete data and source code have been delivered and briefly verified, I will send the agreed payment immediately.

Please provide either a fixed-price.