Lead Software Engineer — Java, Spark, Kubernetes, AWS, Databricks
On-site · Glasgow, Scotland, United Kingdom
Job Summary
Lead architectural design and end-to-end delivery of data-intensive platforms and services as a Vice President, Lead Software Engineer. Architect scalable, high-throughput, low-latency data pipelines and microservices; mentor engineers; drive cloud-native and on-prem practices across AWS, Databricks, Spark, and Kubernetes; ensure security, governance, and operability; collaborate with product and platform teams to deliver secure APIs and data services; establish observability, runbooks, and SRE standards.
Required Qualifications
- Strong track record of delivering production systems in software engineering roles
- Expertise in Java (8+) with deep knowledge of concurrency, memory management, and performance tuning
- Advanced experience with Apache Spark and Databricks, including job optimization and Delta Lake patterns
- Hands-on experience with Kubernetes (EKS or equivalent), deploying microservices, and service-to-service networking
- Proficiency in AWS services including IAM, VPC, EC2/EKS, S3, Lambda, Step Functions, and CloudWatch
- Experience with CI/CD tools, infrastructure-as-code, and containerization
- Solid data engineering fundamentals including partitioning, schema evolution, and data quality frameworks
- Practical knowledge of observability stacks, distributed tracing, and production troubleshooting
- Excellent communication and leadership skills
- Ability to influence architecture and guide teams through complex technical decisions
- Commitment to compliance and security standards
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.