Scheduled Job to Load Parquet Files into AWS Database
Budżet: $100.0
FIXED /
⭐ 5.00 (27)
United States
amazon-web-services, amazon-s3, amazon-ec2, mysql, sql, python
Preferowane kwalifikacje
- Doświadczenie: Średniozaawansowany
We need a reliable scheduled job to automatically load Parquet files into an AWS database.
Scope
* Pick up and load new Parquet files on a schedule.
* Prevent duplicate processing and handle reruns safely.
* Set up basic email alerts for missing files or failed loads.
* Create 3–4 SQL views for basic reporting.
Details
* Consistent Parquet schema, approximately 50k rows per file.
* AWS environment and database are already available.
* Python, SQL, and AWS data pipeline experience required.
Please briefly describe your proposed solution and relevant experience.
Otwórz na Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Zaloguj