Senior Python Engineer for Data Pipeline
Buget: $30.0
FIXED /
⭐ 5.00 (22)
GBR
python, django-framework, machine-learning, selenium, linux, devops, system-administration
Preferred qualifications
- Experience: Expert
## Senior Python Engineer – Production Data Pipeline & Infrastructure
We are looking for an experienced **Python engineer** to diagnose, fix and improve an existing production data-processing pipeline running on a Linux VPS.
The system is already built and operational. This is **not a rebuild project**. We need someone who can understand the existing architecture, identify reliability and performance issues, and implement practical fixes.
### Current Infrastructure
* Python services and background workers
* Linux VPS
* MySQL / MariaDB
* Large production database
* Data ingestion and processing pipelines
* Multiple processing queues
* Browser-based automation
* Image processing
* Scheduled jobs
* Process monitoring and automatic recovery
* Logging and error handling
### The Work
You will be responsible for investigating issues such as:
* Processes unexpectedly stopping
* Processing queues becoming delayed or stuck
* Memory and resource usage
* Worker stability
* Database and processing bottlenecks
* Inconsistent processing between pipeline stages
* Monitoring and automatic recovery
* Overall production reliability
We want someone who is comfortable connecting to an existing Linux server via SSH, examining logs, processes, database activity and Python code, identifying the actual cause of problems, and implementing reliable fixes.
### Required Experience
Strong practical experience with:
**Python • Linux • MySQL/MariaDB • Background Workers • Data Pipelines • Process Management • Production Debugging • Performance Optimization**
Experience maintaining an existing production system is more important to us than building something new from scratch.
When applying, please briefly describe a similar Python production system or data pipeline you have diagnosed and improved.
There is potential for **ongoing work** maintaining and improving the infrastructure after the initial project.
Deschide pe Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Autentificare