Senior Data Engineer
On-siteMcLean, Virginia, United States
EXPIREDMcLean, Virginia, United StatesOn-siteFull TimeSenior LevelBachelors DegreeMedium
Full TimeSenior LevelBachelors DegreeMedium
Job Summary
Lead and architect migration of data environments with performance and reliability. Assess ETL jobs, workflows, BI tools, and reports while addressing technical inquiries on customization, integration, and enterprise architecture. Craft database and data warehouse solutions in cloud environments using Python and AWS, supporting an Agile software development lifecycle. Manage complex queries, data modeling, and processing of large disconnected datasets using tools like Spark, Kafka, and Airflow. Contribute to the growth of the Data Exploitation Practice.
Required Qualifications
- Ability to hold a position of public trust with the US government
- Bachelor's Degree
- 5-7 years industry experience coding commercial software
- 5-7 years direct experience in Data Engineering
- Python
- AWS
- Hadoop
- Spark
- Kafka
- Relational SQL
- NoSQL databases
- Postgres
- Cassandra
- Azkaban
- Luigi
- Airflow
- EC2
- EMR
- RDS
- Redshift
- Storm
- Spark-Streaming
- Solr
- Lucene
- Elasticsearch
- Java
- C++
- Scala
- Databricks
- Advanced working SQL knowledge
- query authoring
- query optimization
- message queuing
- stream processing
- highly scalable big data data stores
- manipulating, processing, and extracting value from large, disconnected datasets
- manipulating structured and unstructured data for analysis
- constructing complex queries to analyze results using databases or in a data processing development environment
- data modeling tools and process
- architecting data systems (transactional and warehouses)
- aggregating results and/or compiling information for reporting from multiple datasets
- working in an Agile environment
- supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models
Desired Qualifications
- experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP)
- Excellent communication and customer service skills
- passion for data and problem solving
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.