高级数据工程师 (实时数仓建设)
- Role
- Data Engineering
- Experience
- Senior
- Company size
- Startup
Open to AE only. Set where you work from to check your eligibility.
No BS summary
Senior Data Engineer needed to lead real-time data warehousing construction. Requires 5+ years of big data experience, expertise in Flink, Kafka, and Hologres on Alibaba Cloud, and experience with high-concurrency, low-latency trading data. Experience with crypto exchanges or traditional financial matching engines is a plus. Must have strong ownership and independent problem-solving skills.
Core skills
Required skills
Optional skills
OneBullEx is a next-generation cryptocurrency derivatives exchange, built on speed, reliability, and innovation. OneBullEx 是一家新一代的加密货币合约交易所,以速度、可靠性与创新为核心。我们的平台提供先进的交易功能,包括由人工智能驱动的 300 SPARTANS 智能交易机器人,为专业交易者与机构客户提供高精度的自动化交易策略。通过运用前沿的人工智能与机器学习技术,我们实现了实时、高性能的交易体验,即便在市场剧烈波动期间依然稳定运行。我们的平台融合了以用户为中心的交互设计与稳健透明的风险管理体系,帮助全球交易者在瞬息万变的数字资产市场中自信掌控每一笔交易。 Job Description: 1. 实时数仓建设: 主导并负责实时数仓的架构设计与核心代码开发,构建稳定、高效的实时数据 pipeline 。 2. 实时数据服务: 负责跨系统(内部业务系统、外部数据源如 GA、AF 等)的数据集成 ,设计并提供高可用的对外实时数据服务与 API 。 3. 质量与稳定性保障: 构建并运维实时监控体系,建立完善的告警机制与异常处理 SOP ,提升问题定位与解决的及时性 。 4. 业务赋能: 深入理解衍生品交易业务,支持核心业务和应用的实时数据需求 。 Job Requirements: 1. 5 年以上大数据开发经验,具备扎实的实时计算理论基础和丰富的实战经验。 2. 精通基于阿里云的流式计算架构,精通Flink、Kafka,并对底层原理有深入理解,具备处理高并发、低延迟交易数据的能力,具有丰富的实时数据链路调优经验。 3. 精通 Hologres 等实时数仓/分析引擎的使用与调优。 4. 有加密货币交易所(特别是衍生品/合约交易)或传统金融撮合引擎相关数据开发经验者优先。 5. 具备极强的独立攻坚能力和 Ownership,能够独立完成从需求对接到架构设计、开发部署的全生命周期任务。
What you'll do
- Lead and be responsible for the architecture design and core code development of the real-time data warehouse, building stable and efficient real-time data pipelines.
- Responsible for data integration across systems (internal business systems, external data sources such as GA, AF, etc.), designing and providing highly available external real-time data services and APIs.
- Build and operate a real-time monitoring system, establish a comprehensive alerting mechanism and SOP for exception handling, and improve the timeliness of problem identification and resolution.
- Deeply understand the derivatives trading business and support the real-time data needs of core businesses and applications.
What they require
- 5+ years of big data development experience, with a solid theoretical foundation and rich practical experience in real-time computing.
- Proficient in Alibaba Cloud-based streaming computing architecture, proficient in Flink and Kafka, with a deep understanding of underlying principles, capable of handling high-concurrency, low-latency trading data, and rich experience in real-time data link tuning.
- Proficient in the use and tuning of real-time data warehouses/analysis engines such as Hologres.
- Experience in cryptocurrency exchanges (especially derivatives/futures trading) or traditional financial matching engines is preferred.
- Possess extremely strong independent problem-solving ability and Ownership, capable of independently completing full-lifecycle tasks from requirement docking to architecture design, development, and deployment.
OneBullEx is a next-generation cryptocurrency derivatives exchange, built on speed, reliability, and innovation. OneBullEx 是一家新一代的加密货币合约交易所,以速度、可靠性与创新为核心。