Team Lead - Distributed Analytics (PACE Runtime)
New York, NY
Posted Feb 12, 2019 - Requisition No. 73584
Bloomberg's applications teams face complex challenges - large-scale data storage, low-latency retrievals, high-volume requests, and high availability over a distributed environment to name a few. And it's our goal to create standardized solutions to these challenges by building core services and technology frameworks for all teams.
Our Data and Analytics Platform group at Bloomberg is building an Analytics Runtime that supports distributed financial calculations. The runtime is based on Apache Spark. We are excited to find a hands-on Team Leader to guide this effort.
The runtime will provide standardized building blocks that handle aspects such as data lifecycle management through connectivity to several types of data sources and service endpoints. This runtime will also provide structure to distributed applications by making libraries of distributed financial transforms available, so we can encourage standardization across domains, where it makes sense. Daily, team members consult on projects in a wide-variety of application domains and provide design and implementation guidance as well as build self-service tooling to help with the instrumentation, profiling and optimization of distributed financial applications.
We'll trust you to:
- Set the standards for development and operational excellence for the team
- Provide design, architecture and implementation guidance to team members
- Interact with domain teams to understand specific requirements and drive the next set of features for the platform
- Meet with key players in the open source community to motivate necessary development efforts in Apache Spark and guide team members with their code contributions as necessary
You'll need to have:
- 3+ years' experience leading teams, preferably in an infrastructure capacity
- 3+ years' experience in Java and Python
- Strong framework architecture skills
- BA, BS, MS, PhD in Computer Science, Engineering or related technology field
We'd love to see:
- Proficiency in Scala and functional programming idioms
- Professional experience developing analytics infrastructure
- Any open source contributions
If this sounds like you, submit an application and watch our Spark Summit talks to learn more about some of the ideas that underpin our Analytics Runtime:
- https://spark-summit.org/east-2016/events/spark-at-bloomberg/
- https://www.techatbloomberg.com/events/spark-summit-east-2017/
- https://databricks.com/session/apache-spark-on-k8s-and-hdfs-security
Contact {fon Sudarshan Kadambi