Senior Data Engineer
$144,000–$187,000 year
On-siteAustin, Texas, United States
Austin, Texas, United StatesOn-sitePart Time$144,000–$187,000 yearSenior LevelMasters DegreeCybersecuritySmall
Part TimeSenior LevelMasters DegreeSmallCybersecurity
Job Summary
Lead architectural transformation of data systems by redesigning platforms for scalability, AI-readiness, and performance using Databricks, Spark, and AWS tools like Lambda, S3, and DynamoDB. Build and optimize real-time and batch pipelines while preparing high-quality data for ML models and LLM applications. Mentor engineering teams, champion best practices, and ensure operational data quality, security, and reliability across large-scale distributed architectures. Collaborate with Product and Engineering teams to align data solutions with evolving product requirements and long-term company goals.
Required Qualifications
- 8+ years of experience in data engineering or closely related disciplines
- 2+ years in a technical leadership or senior engineering role
- Experience building and operating Lakehouse, Databricks, or large-scale distributed data lake architectures in AWS
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience building and managing large Elasticsearch/Opensearch data stores
- Hands on experience building ETL scripts
- Hands-on experience preparing and managing data for machine learning and LLM workflows
- Strong development skills in Python, especially in building data-intensive systems
- Practical experience using DynamoDB and other AWS-native data services at scale
- Effective communication and collaboration across technical and non-technical stakeholders
- Proven ability to mentor and grow engineering talent and lead large-scale initiatives
Desired Qualifications
- Familiarity with AI/ML tools such as SageMaker, LangChain, or vector databases
- Understanding of data governance, privacy, and compliance in AI contexts
- Comfort working in fast-paced environments with evolving product and technical requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related STEM field
- C programming language experience
- Go programming language experience
- Experience with password cracking tools
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.