Data Engineer / Architect (Security Clearance Required)
$170,000–$215,000 year
On-siteAshburn, Virginia, United States
Job Summary
Design and implement scalable data architectures on Databricks within AWS and Azure environments. Develop and maintain ETL processes to ensure efficient data flow, while optimizing storage strategies for improved performance and cost-efficiency. Collaborate with stakeholders to translate business requirements into technical specifications and lead the implementation of data governance policies. Ensure data quality, integrity, and security across all activities, providing technical guidance and mentorship to engineering teams. Maintain proficiency in Spark applications, SQL, and Unity Catalog to drive data initiatives.
Required Qualifications
- active DoD Secret or Top Secret security clearance
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field
- Proven experience as a Data Architect, with a strong focus on Databricks
- Proficiency in Databricks, including the ability to build and optimize Spark applications
- Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others
- Strong knowledge of Unity Catalog and its application in managing and securing data assets
- Strong knowledge of data modeling, ETL processes, and data warehousing concepts
- Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark)
- Familiarity with data governance and data security practices
- Databricks Certified Professional
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
Desired Qualifications
- AWS Certified Solutions Architect or similar certification
- Experience with other cloud platforms (e.g., Azure, GCP)
- Knowledge of machine learning and data science concepts
- Experience with data visualization tools (e.g., Tableau, Power BI)
- Prior experience in a leadership or mentorship role
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.