Custom Data Pipeline Engineering

I have an in-house project that needs a fully custom-built data pipeline. The goal is to ingest Parquet files arriving in our file system, apply the required transformations, and move the cleaned data on to our analytics environment... (Budget: ₹12500 - ₹37500 INR, Jobs: Apache Spark, Data Architecture, Data Management, Data Processing, MySQL, PHP, Python, Software Architecture)