Independent Python Data Pipeline & Source-Control Audit — EBDIS/KBYG.

## Project Overview I am seeking an experienced **Senior Python Engineer / Independent Software Auditor** to conduct a focused technical verification of an existing AI-assisted financial research system called **EBDIS/KBYG (Evidence-Based Decision and Investment System)**. This is a personal, non-commercial research project. The architecture, Python implementation, technical documentation, and extensive offline testing have already been developed. **The objective is independent verification of the existing system, NOT rebuilding or developing a new system.** We are preparing for a controlled historical market-data study covering 2018–2022 and require an independent assessment before starting data acquisition. ## Scope of Work ### 1. Python Code and Data Pipeline Audit Review the existing Python implementation, including: - REST API requests and historical-data acquisition. - Pagination and API error handling. - JSON validation, duplicate detection, and data integrity. - SHA-256 checksums and provenance verification. - Evidence preservation, atomic file operations, and recovery. - Security, reliability, and fail-closed controls. ### 2. Three Core Components **RA10 — Data Acquisition and Provenance** Verify API request integrity, pagination continuity, original HTTP evidence, source receipts, token confidentiality, and audit-trail reliability. **RA11 — Historical Market Calendar** Verify NYSE trading calendars for 2018–2022, including holidays, exceptional closures, early closing sessions, daylight-saving transitions, and timestamp accuracy. **RA12 — Dataset Integrity** Verify historical-data completeness, source-to-dataset traceability, RAW/CANONICAL reconstruction, missing or duplicate bars, and correct symbol/date assignments. ### 3. Governance and Security Verification Review six defined technical controls (GOV-01 through GOV-06) relating to: - Pagination-token security. - Original data custody and restricted access. - Source-generation metadata. - API endpoint restrictions. - HTTP timestamps and clock integrity. - Atomic preservation and crash recovery. Review whether the components are correctly integrated and whether the existing evidence is sufficient to support an acquisition-readiness decision. ### 4. Financial Data and Existing Evidence The research uses six US securities: SPY, AAPL, MSFT, JPM, XOM, and WMT. The frozen historical acquisition plan specifies 5-minute SIP equity bars over 2018–2022, with 360 symbol-month windows, a maximum of 2,000 HTTP attempts, and a maximum of 5 million raw rows. Written clarification from Alpaca concerning personal research use is available. The reviewer should examine the technical evidence and identify any unresolved source-use or agreement-applicability concerns. A formal legal opinion is not required. ## Required Deliverables We require **one consolidated independent technical audit report** containing: 1. Reviewer's qualifications and independence declaration. 2. Exact source files and SHA-256 hashes examined. 3. Technical findings for RA10, RA11, and RA12. 4. Individual PASS, HOLD, or FAIL findings for GOV-01 through GOV-06. 5. Assessment of system integration and data integrity. 6. Identified defects, risks, and necessary corrections. 7. Final recommendation on readiness for consideration of a separately authorized historical-data acquisition. 8. A dated, signed or otherwise attributable technical assessment. An evidence-supported HOLD or FAIL outcome is acceptable. We require an objective professional assessment, not a predetermined approval. ## Important Project Conditions - This is initially an **offline, read-only audit**. - No access to private API credentials or server passwords. - No market-data downloads or live trading. - No cloud execution or model training. - No unnecessary repetition of already accepted tests. - No modifications to existing accepted code without prior approval. - All project materials must remain confidential. The existing system must not be redesigned or simplified without explicit authorization. ## Preferred Qualifications - Strong professional Python experience. - REST API and ETL pipeline development. - Independent source-code review and software testing. - Data engineering and provenance verification. - Linux, filesystem security, logging, and recovery. - Experience with financial market data is highly desirable. - Ability to deliver a documented independent technical assessment. ## Budget and Engagement This is a **fixed-scope, preferably fixed-price assignment**. A complete technical review package is available, including source code, documentation, previous verification results, and audit decision templates. Please provide: - Relevant experience with similar independent audits. - Estimated time required. - Proposed fixed-price quotation. - Availability and expected delivery schedule. - Any essential additional information required. **We are looking for a reliable independent assessment that allows us to proceed toward historical data acquisition and scientific research without unnecessary redevelopment or delays.**