← Állások

Full-Time Data Scraping & Lead Generation Engineer

Költségvetés: - HOURLY / FULL_TIME ⭐ 0.00 (0) Egypt

selenium, scrapy-framework, beautiful-soup, api-integration, data-extraction, data-scraping, data-mining, lead-generation, python

DriveBuy.ai is a fast-growing automotive data platform focused on collecting, processing, and analyzing vehicle market data at scale. We build automated systems that aggregate data from multiple sources to power analytics, lead generation, and market intelligence products. We are looking for a talented, full-time Data Scraping & Lead Generation Engineer to join our team and help us expand and maintain our data acquisition infrastructure. This is a hands-on engineering role for someone who enjoys solving complex data acquisition challenges and working with modern automation technologies. Responsibilities: * Develop and maintain web scraping solutions for multiple websites and data sources. * Build scalable data extraction and transformation pipelines. * Monitor and improve scraper reliability, performance, and data quality. * Handle anti-bot protections, rate limits, and dynamic website structures. * Design systems for lead generation, enrichment, and validation. * Implement automated monitoring, alerting, and recovery mechanisms. * Troubleshoot and resolve scraping and data collection issues. * Collaborate with backend and DevOps teams to deploy and scale solutions. * Create documentation and maintain engineering best practices. Required Skills: * Strong experience with Python. * Experience with scraping frameworks such as Scrapy, Playwright, Selenium, and Requests / BeautifulSoup. * Experience working with APIs and structured data formats like JSON, XML, and CSV. * Strong understanding of HTTP, cookies, sessions, proxies, and browser automation. * Experience handling anti-bot systems and website protection mechanisms. * Knowledge of databases such as PostgreSQL, MySQL, ClickHouse, or MongoDB. * Familiarity with Linux environments and command-line tools. * Ability to write clean, maintainable, and well-documented code. Nice to Have: * Experience with distributed scraping systems. * Experience with cloud platforms such as AWS. * Knowledge of Docker and containerized deployments. * Experience with data enrichment providers and lead-generation platforms. * Familiarity with monitoring and observability tools. * Experience working with large-scale datasets. What We Offer: * Full-time remote position. * Long-term opportunity with a growing product. * Flexible working environment. * Opportunity to work on challenging large-scale data acquisition projects. * Competitive compensation based on experience. * Direct impact on product growth and technical direction.
Megnyitás Upworkön