Data Engineer: Large-Scale Data Extraction & Structuring (93,000+ Records)
Budget: -
HOURLY / PART_TIME
⭐ 0.00 (1)
BHR
api-integration, data-extraction, python
Preferred qualifications
- Experience: Intermediate
I am looking for an experienced Data Engineer to programmatically retrieve, process, and structure public data from a specific social media account containing approximately 93,600 posts.
The target account functions as a community Q&A and local business directory. Images typically contain community questions or business advertisements, while the comments contain the answers or community feedback.
The Goal:
The final dataset will power an internal analytics platform and search directory. Therefore, the data must be rigorously cleaned, categorized, enriched with metadata, and formatted perfectly into a highly structured JSON or CSV schema. I require a fully automated pipeline to process this volume accurately.
Open job
AI proposal draft
Generate a short cover letter to copy into the offer. Says you are interested and ready to work.
Sign in to generate an AI proposal draft.
Log in