Systems Engineer Infrastructure Devops
On-site · Bengaluru, Karnataka, India
Job Summary
The Systems Engineer is responsible for the infrastructure layer that keeps Avolta's scraping platform running reliably at scale. Own orchestration, cloud infrastructure, CI/CD, monitoring and proxy infrastructure management to support 250–1,000+ daily jobs with high availability and observable performance. Write Python and infrastructure-as-code extensively to deliver uptime, cost efficiency, deployment velocity, and mean time to recovery. You will manage the workflow orchestration platform (Airflow/Azure Data Factory/Prefect), implement autoscaling, build a robust retry/failure recovery system, and optimize cloud spend. You will also own the cloud environment (Azure), IaC (Terraform/Azure Bicep), proxy rotation and network management, observability stack (Prometheus, Grafana, ELK), incident response, and SLIs/SLOs, collaborating closely with the scraping and data-processing teams.
Required Qualifications
- Bachelor's degree in Computer Science, Systems Engineering or equivalent
- 4-7 years in a DevOps, Platform Engineering, SRE or Infrastructure Engineering role
- Hands-on experience with a workflow orchestration tool in production (e.g. Apache Airflow, Azure Data Factory or equivalent)
- Strong IaC discipline (Terraform or equivalent)
- Experience with cost optimization on cloud
- Experience with Azure (VMs, ACI/AKS, Blob Storage, SQL, Monitor)
- Python 3.8+ scripting
- Docker + Kubernetes or AKS
- Linux systems administration (Ubuntu/Debian)
- Proxy infrastructure management for web scraping
- Databricks fundamentals
- Experience with CI/CD (Azure DevOps Pipelines; GitHub Actions/GitLab CI)
- Prometheus + Grafana or similar observability tools
- Experience with SQL databases (Azure SQL, PostgreSQL)
- Content related to orchestration tools (Airflow, Prefect)
- Experience with monitoring and incident response
Apply with one swipe on Sorce. We auto-fill applications and apply on your behalf — no cover letters, no 40-minute forms.
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.