Senior Data Engineer
$125,000–$165,000 year
On-siteMcLean, Virginia, United States
Job Summary
Lead and architect migration of data environments with performance and reliability, assessing ETL jobs, workflows, BI tools, and reports. Address technical inquiries concerning customization, integration, enterprise architecture, and general feature functionality of data products. Craft database and data warehouse solutions in cloud environments, preferably AWS, while supporting an Agile software development lifecycle. Utilize Python, AWS, and big data tools like Spark and Kafka to manipulate, process, and extract value from large, disconnected datasets. Contribute to the growth of the Data Exploitation Practice by supporting project teams of developers and data scientists building web-based interfaces and analytics models.
Required Qualifications
- Ability to hold a position of public trust with the US government
- Bachelor's Degree
- 5-7 years industry experience coding commercial software
- 5-7 years direct experience in Data Engineering
- Key must have skill sets – Python
- Key must have skill sets – AWS
- Experience in crafting database / data warehouse solutions in cloud
- Experience with Big data tools: Hadoop, Spark, Kafka, etc
- Experience with Relational SQL and NoSQL databases, including Postgres and Cassandra
- Experience with Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with Data streaming systems: Storm, Spark-Streaming, etc
- Experience with Search tools: Solr, Lucene, Elasticsearch
- Experience with Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
- Experience with Databricks
- Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization
- Experience with message queuing, stream processing, and highly scalable 'big data' data stores
- Experience manipulating, processing, and extracting value from large, disconnected datasets
- Experience manipulating structured and unstructured data for analysis
- Experience constructing complex queries to analyze results using databases or in a data processing development environment
- Experience with data modeling tools and process
- Experience architecting data systems (transactional and warehouses)
- Experience aggregating results and/or compiling information for reporting from multiple datasets
- Experience working in an Agile environment
- Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models
Desired Qualifications
- Excellent communication and customer service skills
- Passion for data and problem solving
- Preferably AWS (in cloud solutions context)
- Alternatively Azure, GCP (in cloud solutions context)
- Experience with Azure equivalents (in AWS cloud services context)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.