Senior Data Engineer
On-siteWashington, District of Columbia, United States or Washington, United States
Job Summary
Design, develop, test, operate, and optimize high-volume data ingestion, transformation, integration, and processing pipelines for the U.S. Department of Justice Digital Evidence Review Platform. Ingest, normalize, enrich, validate, store, search, export, archive, and restore structured and unstructured data from forensic extraction packages, documents, multimedia, and government-furnished parsers. Implement validation, hashing, error handling, and data-quality controls while preserving source identifiers, lineage, and chain-of-custody information. Develop schemas, canonical data models, and metadata structures to support search, analytics, and AI/ML-enabled processing with human oversight. Automate deployment through CI/CD and configuration management, then tune performance and troubleshoot failures across development, test, UAT, and production environments. Maintain technical documentation and collaborate with architects, software engineers, and cybersecurity personnel.
Required Qualifications
- Bachelor's degree in engineering, mathematics, or science
- At least 15 years of relevant data engineering, data integration, data architecture, software engineering, or large-scale data-processing experience
- A master's degree may substitute for two years of required experience; a PhD may substitute for four years
- Extensive experience designing, developing, and maintaining enterprise data ingestion, transformation, integration, and processing pipelines
- Experience processing structured and unstructured data from multiple sources and formats
- Experience with data modeling, metadata, schema design, data lineage, data quality, error handling, reconciliation, and audit logging
- Experience developing in Python, Java, Scala, SQL, or comparable data-engineering languages
- Experience with cloud-based data platforms, distributed processing, object storage, databases, search platforms, or analytics environments
- Experience supporting CI/CD, automated testing, configuration management, performance tuning, and production troubleshooting
- S. citizenship and ability to meet DOJ residency and personnel-security requirements
- Ability to obtain and maintain a High-Risk Public Trust investigation and PIV credential
Desired Qualifications
- Experience with digital evidence, forensic data, eDiscovery, law-enforcement data, case-management data, or other high-integrity federal datasets
- Experience with AWS GovCloud, Azure Government, FedRAMP-authorized SaaS, or hybrid federal cloud environments
- Experience processing PDFs, text, messages, multimedia, call records, geolocation data, forensic extraction files, or large document collections
- Experience with OCR, natural-language processing, entity extraction, transcription, translation, deduplication, AI/ML enrichment, or LLM/RAG pipelines
- Experience with Python-based data frameworks, Spark, Databricks, Kafka, Airflow, cloud-native data services, or comparable technologies
- Experience implementing hashing, immutable audit records, provenance, lineage, retention, archival, and data-restoration controls
- Experience designing open-format exports, APIs, canonical schemas, or data-exchange interfaces that reduce vendor lock-in
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.