Senior Data Engineer – Data Security & Anonymization (AWS/Spark)
Бюджет: -
HOURLY / PART_TIME
⭐ 5.00 (1)
United States
Предпочитана квалификация
- Опит: Експерт
We’re looking for a highly experienced, hands-on Senior Data Engineer to independently design and build a secure data classification and anonymization pipeline.
This is a focused 2-week engagement where you’ll own the solution end to end — from document ingestion and OCR through sensitive-data classification, anonymization, encryption, and access-policy design.
What You’ll Build
You’ll design and implement a data pipeline running on Apache Spark on Amazon EKS that:
Ingests TXT and PDF documents
Extracts text from PDFs using Amazon Bedrock
Identifies and classifies sensitive data
Anonymizes sensitive fields using Microsoft Presidio
Applies reversible encryption to selected fields using AWS KMS
Processes data at scale using Python/PySpark
Integrates appropriate security and access controls
You’ll also help design the access-policy model using AWS Lake Formation and AWS IAM Identity Center.
What We’re Looking For
Strong Python and PySpark experience
Deep hands-on experience with Apache Spark
Strong AWS experience, particularly with EKS
Experience building production-grade data ingestion and processing pipelines
Understanding of PII/sensitive-data detection, classification, and anonymization
Experience with Microsoft Presidio or similar data privacy tooling
Experience with AWS KMS and encryption patterns
Familiarity with AWS Lake Formation and IAM/access-control concepts
Ability to design and implement solutions independently
Comfortable working in a fast-moving startup environment with limited hand-holding
Nice to Have
Experience with Amazon Bedrock and document/OCR workflows
Previous work on data security, privacy, governance, or compliance platforms
Experience designing fine-grained data-access policies
Experience taking similar data infrastructure projects from architecture through working implementation
Engagement
This is a high-impact, 2-week engagement with clear ownership. You’ll work independently and closely with the team, so we’re looking for someone who can quickly understand the requirements, make pragmatic technical decisions, and deliver a working end-to-end solution.
Отвори в Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Вход