Databricks Developer
RemotePoland or Spain
Job Summary
Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and Apache Spark. Build data processing solutions with PySpark and optimize performance on large-scale datasets. Implement Delta Lake and Delta Table solutions to ensure reliable, scalable data processing while managing columnar storage formats like Parquet. Develop and maintain unit tests for Databricks workloads and orchestrate processes using Databricks Workflows. Analyze business and technical requirements to translate them into effective engineering solutions and collaborate with cross-functional teams to meet technical and business goals.
Required Qualifications
- 5+ years of hands-on software development experience
- Strong expertise in Apache Spark, including hands-on experience delivering solutions on Databricks
- Advanced Python and data engineering skills, including strong experience with PySpark, Pandas, and related libraries
- Experience developing and maintaining unit tests for Databricks workloads
- Solid understanding of columnar storage formats, such as Parquet
- Hands-on experience with Delta Lake and Delta Tables
- Proven experience working with small to large data volumes, including performance tuning and optimization
- Experience building data ingestion, transformation, and analytics pipelines
- Hands-on experience with Databricks Workflows
- Strong analytical and problem-solving skills with close attention to detail
- Conversational English — B2 level or higher
- Conversational Ukrainian
Desired Qualifications
- Familiarity with Databricks DevOps practices
- Experience with CI/CD processes for data engineering workloads
- Understanding of software development lifecycle and engineering best practices
- Experience working with distributed data processing environments
- Experience working in cross-functional, distributed teams
- Familiarity with enterprise-level data platforms and large-scale data environments
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.