Senior Software Engineer - Streaming Platform as a Service (SPaaS) - SF
San Francisco, CA
Posted Feb 28, 2018 - Requisition No. 65574
Bloomberg is investing in an enterprise-wide Streaming Platform as a Service (or, SPaaS) to support large-scale and low-latency event and stream processing pipelines for financial analytics. This platform is being built around the Kafka ecosystem, with Kubernetes as the deployment runtime.
The platform aims to provide management of Kafka flows, connectivity to a variety of internal publish & consume endpoints and cater to streaming workloads ranging from Tickstream analytics to Tradeflow processing. The workloads are both high-throughput (in the order of millions of messages/sec) and low-latency (sub-10 milliseconds). Our team is building this platform to provide standardized workflows for development, multi-DC deployment, monitoring and disaster recovery for streaming applications.
This is a greenfield effort and we could use your help. If the opportunity to define and implement key components of this platform sounds like the challenge you've been looking for, we'd love to hear from you.
We'll trust you to:
- Contribute to the development of our Streaming Platform
- Interact with application teams to understand specific requirements and drive the next set of platform features
- Meet with key players in the open source community to motivate necessary development efforts
- Contribute code to the Apache Kafka, Kubernetes and or other open-source communities in areas such as Multi-tenancy
You'll need to have:
- 3+ years experience programming in in 2 major programming languages (Java/Scala and Python/Go) and willing to pick up more as needed
- Understanding and enthusiasm to learn the internals of Kafka and it's surrounding ecosystem - your work will require troubleshooting the internals and perhaps modifying it
We'd love to see:
- Experience building data or analytics infrastructure of any kind
- Web Development using React, Angular and NodeJS
- Open source contributions and community evangelism of any sort