Apache Doris运维与集成开发工程师
On-siteBeijing, Beijing, China
Job Summary
Manage Apache Doris clusters through full lifecycle operations, including architecture design, high-availability configuration, and 7×24 stability assurance for FE/BE faults. Lead major version upgrades, gray releases, and rollback drills while establishing monitoring, alerting, and post-mortem SOPs. Optimize performance via table modeling, partitioning, sort key tuning, and CBO analysis to resolve slow queries and OOM issues. Integrate real-time and offline data pipelines using Flink CDC, Kafka, and Airflow, ensuring Exactly-Once semantics for ETL and BI tool connections. Support AI application platforms by designing semantic layers and handling Text-to-SQL permissions. Requires 5+ years in OLAP, Doris production experience, and Flink/Kafka expertise.
Required Qualifications
- Bachelor's degree or above in computer-related major
- 5+ years of experience in big data platform/OLAP field
- Apache Doris production cluster operation experience (any version 1.2/2.1/3.0)
- Familiarity with FE/BE architecture, high availability mechanisms, and common operation commands
- Deep understanding of Doris table models (Duplicate/Unique Key/Aggregate), partition/bucketing principles, Rollup/materialized views, and indexing mechanisms (Prefix/Bloom Filter/inverted index)
- Proficiency in Flink (DataStream/SQL), Kafka, CDC (Debezium/Canal) with real-time data loading implementation experience
- SQL performance analysis and tuning methods
- Ability to read Doris EXPLAIN VERBOSE execution plans and perform targeted optimization
- Familiarity with Linux operating system
- Shell/Python script writing
- Experience with automation operation tools (Ansible/Helm)
- Good problem decomposition ability and cross-team communication skills
- Ability to independently handle production fault troubleshooting and emergency response
Desired Qualifications
- Experience with Apache Doris cross-version upgrades
- Experience with storage-compute separation (Compute Node + Object Storage) implementation
- Familiarity with Flink-Doris-Connector source code or secondary development
- Experience with Dify/ChatBI/LLM application data layer docking
- Understanding of RAG, Text-to-SQL technical chain
- Knowledge of other OLAP engines (StarRocks/ClickHouse/Trino/Impala) for technical selection
- Cloud provider big data related certifications (Alibaba Cloud ACP/ACE, AWS Big Data Specialized, etc.)
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.