Data Engineer
On-siteMcLean, Virginia, United States
McLean, Virginia, United StatesOn-siteFull TimeBachelors DegreeMedium
Full TimeBachelors DegreeMedium
Job Summary
Lead and architect migration of data environments with performance and reliability. Assess ETL jobs, workflows, BI tools, and reports while addressing technical inquiries regarding customization, integration, and enterprise architecture. Craft database and data warehouse solutions in cloud environments, preferably AWS, utilizing Python and Java. Support an Agile software development lifecycle and contribute to the growth of the Data Exploitation Practice. This role requires a technologist with excellent communication skills to support project teams building web-based interfaces and analytics models.
Required Qualifications
- Ability to hold a position of public trust with the US government
- Bachelor's degree
- 2-4 years industry experience coding commercial software
- 2-4 years direct experience in Data Engineering
- Experience in crafting database / data warehouse solutions in cloud
- Python
- AWS
- Hadoop
- Spark
- Kafka
- Relational SQL
- NoSQL databases
- Postgres
- Cassandra
- Azkaban
- Luigi
- Airflow
- EC2
- EMR
- RDS
- Redshift
- Storm
- Spark-Streaming
- Solr
- Lucene
- Elasticsearch
- Java
- C++
- Scala
- Databricks
- Advanced working SQL knowledge
- query authoring
- query optimization
- message queuing
- stream processing
- highly scalable 'big data' data stores
- manipulating, processing, and extracting value from large, disconnected datasets
- manipulating structured and unstructured data for analysis
- constructing complex queries to analyze results using databases or in a data processing development environment
- data modeling tools and process
- architecting data systems (transactional and warehouses)
- aggregating results and/or compiling information for reporting from multiple datasets
- working in an Agile environment
- supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models
Desired Qualifications
- Azure
- GCP
- Excellent communication and customer service skills
- passion for data and problem solving
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.