Build Internal Data Platform & Automated Ingestion Engine
Orçamento: -
HOURLY / PART_TIME
⭐ 0.00 (0)
IDN
vue.js, golang, spring-boot, angularjs, postgresql
Project Background
Currently, our operational data—including payroll, invoices, fraud tracking, and employee history—is managed manually across scattered Google Drives, Sheets, and XLSX/TSV files. To eliminate human error and accelerate data reconciliation, we are initiating the development of AXIS (Automated Analytics & Information System), a centralized internal data platform to serve as our single source of truth.
Scope of Work (MVP Phase)
We are looking for an experienced Full-Stack Developer to build our MVP from scratch. The scope of work includes:
1. System Design & Architecture: Designing technical systems including database, API layer, UI, and storage.
2. Data Ingestion Module: Developing multi-format file upload (XLSX, CSV, TSV) and Google Sheets integration via URL/OAuth.
3. Mapping & Validation Engine: Creating a user interface to map source columns to standard AXIS fields with automatic data validation rules.
4. Data Storage Layer: Setting up a centralized relational database with partition support per operational period.
5. Schema Management UI: Building an interface for data engineers to create, edit, and manage database tables dynamically.
6. Query Interface UI: A form-based filtering UI for non-technical business users to easily query and export data to XLSX/CSV.
7. RBAC & Security: Implementing Role-Based Access Control across 4 primary user roles.
8. Audit Trail & Logging: Setting up an end-to-end user activity log and a dedicated audit dashboard.
Preferred Tech Stack
We highly recommend the following stack, though we are open to well-justified alternative frameworks:
- Frontend: Vue.Js.
- Backend: Golang or Spring Boot
- Database: PostgreSQL (supporting table partitioning and JSONB).
Project Timeline & Requirements
- Target Duration: Maximum of 3 months from kick-off to production deployment.
- Language: The application interface will be delivered primarily in Indonesian.
- Compliance: The selected vendor/freelancer must sign an NDA and a data processing agreement.
If your team has extensive experience building scalable internal business tools, automated data pipelines, or ingestion engines, please apply with your relevant portfolio and a brief structural overview of your proposed approach.
Abrir na Upwork