资深数据开发工程师(自动驾驶数据平台) _XC
On-siteSuzhou, Jiangsu, China
Suzhou, Jiangsu, ChinaOn-siteFull TimeSmall
Full TimeSmall
Job Summary
Design and evolve the end-to-end autonomous driving data platform, leading architecture for the fleet-to-model pipeline from collection to evaluation. Build PB-scale query, storage, and processing systems using Trino, Lance, and LevelDB while establishing Celery + Redis async scheduling for massive long-running tasks. Optimize distributed query performance, implement vector retrieval for scenario recall, and enforce security protocols including SQL injection defense and data masking. Lead technical standards, code reviews, and cross-team collaboration to drive platform stability and scalability.
Required Qualifications
- 本科及以上学历
- 计算机相关专业
- 5 年以上数据开发经验
- 有大型数据平台 / 数仓 / 湖仓架构落地经验
- 精通 Python
- 熟悉 Django / DRF
- 具备扎实的分布式查询引擎 (Trino / Presto / Spark SQL 等) 原理与调优能力
- 精通至少两类数据存储引擎：列存 / 湖仓 (Lance / Parquet / Iceberg / Hudi)、KV(LevelDB / RocksDB)、OLAP(ClickHouse / Doris 等)
- 深入理解 Celery / Redis 异步调度与消息队列 (MQ / Kafka)
- 有大规模任务编排与稳定性治理经验
- 熟练掌握 Docker / Kubernetes
- 具备容量规划、监控告警、故障排查与高可用设计能力
- 具备优秀的系统设计、抽象建模与复杂问题拆解能力
- 有技术方案主导与团队带教经验
- 强烈的数据安全与质量意识
- 良好的跨团队沟通与推动能力
Desired Qualifications
- 有自动驾驶 / 车联网 / 海量时序 / 多模态数据处理经验
- 精通向量检索 (KNN、cosine / L2、ANN 索引) 与数据挖掘召回体系
- 有数据平台 0→1 建设或大规模重构经验
- 熟悉 SDK / OpenAPI 代码生成 (oapi-codegen)、契约化接口治理
- 有开源贡献、技术专利或行业技术影响力
Hiring someone like this?
Get your role in front of qualified candidates on Sorce.