We are seeking a Web Developer / Data Scraper to build and maintain systems for extracting, processing, and integrating data from web platforms. The ideal candidate will focus on automation, API integration, and developing reliable data collection pipelines.
Key Responsibilities:
Develop and maintain web scraping tools and data extraction systems
Build and integrate APIs for data collection and system connectivity
Design automated workflows for large-scale data gathering and processing
Ensure accuracy, efficiency, and reliability of collected data
Work with structured and unstructured data sources
Maintain and improve existing scraping and automation systems
Handle platform integration with internal tools and databases
Troubleshoot issues related to data pipelines and scraping processes
Key Requirements / Expertise:
Strong experience in web scraping techniques and tools
Proficiency in API development and integration
Solid programming skills (Python preferred)
Familiarity with automation frameworks and scripting
Understanding of HTML, CSS, JavaScript, and web structures
Experience handling large datasets and data cleaning processes
Preferred Qualifications:
Degree in Computer Science, Software Engineering, or related field
Experience with scraping frameworks (e.g., BeautifulSoup, Scrapy, Selenium)
Knowledge of cloud services and data pipelines
Experience building scalable automation systems
Performance Metrics:
Accuracy and completeness of collected data
Efficiency and stability of scraping systems
Speed and reliability of automation workflows
Successful integration with internal platforms and databases