PRINCIPAL CONSULTANT AWS + SNOWFLAKES - 703340745
$140,000–$150,000 year
On-sitePortland, Oregon, United States
Job Summary
Design and build reusable components, frameworks, and libraries at scale to support analytics products. Implement product features in collaboration with business and technology stakeholders while identifying and solving data management issues to improve data quality. Clean, prepare, and optimize data for ingestion and consumption, then collaborate on implementing new data management projects and restructuring current data architecture. Build continuous integration, test-driven development, and production deployment frameworks, and implement automated workflows using scheduling tools. Analyze and profile data for designing scalable solutions, troubleshoot data issues, and perform root cause analysis to proactively resolve product and operational problems.
Required Qualifications
- Strong understanding of data structures and algorithms
- Strong understanding of solution and technical design
- A strong problem solving and analytical mindset
- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
- Able to quickly pick up new programming languages, technologies, and frameworks
- Experience building cloud scalable, real time and high-performance data lake solutions
- Fair understanding of developing complex data solutions
- Experience working on end-to-end solution design
- Hands on experience in AWS - EMR [Hive, Pyspark], S3, Athena or any other equivalent cloud
- Familiarity with Spark Structured Streaming
- Minimum experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion
- hands-on experience with SQL, ETL, data transformation and analytics functions
- hands-on Python experience including Batch scripting, data manipulation, distributable packages
- experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow
- working with code versioning tools such as GitHub or BitBucket; expert level understanding of repo design and best practices
- Familiarity with deployment automation tools such as Jenkins
- hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development
- designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake
- Familiarity with Tableau or Cognos use cases
- Familiarity with Agile; working experience preferred
Desired Qualifications
- Willingness to learn new skills and technologies
- Has a passion for data solutions
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.