Engineering Team Lead - Ticker Plant Database Infrastructure
New York, NY
Posted Sep 16, 2022 - Requisition No. 104894
Our Team
The Ticker Plant system is the core of Bloomberg’s market data infrastructure and is responsible for the storage and distribution of Market Data. Market Data is information -- trades, quotes, and other pricing data -- gathered from around the world on every possible kind of financial instrument, from stocks and bonds to currencies and commodities. In the aggregate, this amounts to over 100 billion events across hundreds of millions of instruments.
The Database Infrastructure team in TickerPlant develops a high performance time-series database that is used to store all the Market Data at Bloomberg. This database is uniquely designed and built to be flexible and fast, while still being able to support massive datasets. We provide low latency data storage and retrieval options for high-frequency/high-volume applications. The storage engine hosts several petabytes of data, across hundreds of millions of instruments. The query engine handles ~80 billion queries each day ranging from interactive queries to batch queries at very high throughputs of upto 100K QPS. Our clients are other engineering teams within TickerPlant and Bloomberg.
Read our blog to know more! (https://www.bloomberg.com/company/stories/how-bloomberg-handles-a-massive-wave-of-real-time-market-data-in-microseconds/)
The Role
Database Infrastructure is organized into two functional areas: Storage Infrastructure and Query Infrastructure. We are looking for a motivated Team Leader to lead the Query Infrastructure team! This team owns distributed software infrastructure that is responsible for the end to end processing of queries. This includes high performance APIs, query routing and load balancing mechanisms, low latency query dispatching and processing infrastructure.
While the system works at an impressive scale today, the Query Infrastructure team’s mission is to make Market Data access easier, flexible, and safer. To that end we are working on opening up Market Data access to Bloomberg’s cloud compute environment, adding client access control, load management, dynamic cluster and data discovery, and a bulk data query system. Our vision is to create a platform to support structured queries that allow hosted computation on Market Data facilitating the creation of new financial products.
Some examples of initiatives you'll be leading are:
- Modernize the query and routing system by creating well tested, mockable, high performance APIs and make market data accessible from cloud environments such as BPaaS
- Make the query routing system simple, flexible and respond to traffic spikes, adopting industry standard software where appropriate
- Enhance the routing infrastructure to work with the next generation of Ticker Plant where data sharding will change dynamically to respond to changing load on our system.
As the team lead, you will lead a team of 5 to 6 engineers. You will be responsible for owning the product vision for the query routing system, managing project execution, and collaborating closely with other teams within Database Infrastructure and Ticker Plant. You will be the technical leader, maintaining high technical standards and actively participate/drive technical designs in close collaboration with Bloomberg’s CTO office counterparts. With your technical expertise, you'll also be actively developing and growing individual contributors through 1-1s, mentoring/training and helping them take up the responsibility of leading critical initiatives. As the technical product owner of the team, you will drive the team forward with a mix of technical expertise, people management, product and stakeholder management skills.
We’ll trust you to:
- Lead the team to design, develop, and release high-quality and maintainable code
- Foster a culture of high quality and strong software development practices within the team
- Partner closely with other teams in Database Infrastructure and CTO office stakeholders to create a vision for the product
- Inspire and motivate team members while supporting their career growth and overall development through coaching and mentoring
- Continue driving innovation within the team by identifying opportunities to experiment and learn new technologies while executing on projects
- Assist in recruiting top-class engineering talent
You’ll need to have:
- Passion for developing scalable, resilient, low-latency and high-throughput distributed systems
- Demonstrated technical leadership with a track record of delivering projects in an agile/incremental manner
- Excellent communication and organizational skills
- Experience working with stakeholders to communicate, manage expectations
- Experience managing a team of software engineers
- In depth knowledge of load balancing schemes/systems such as NGINX is a plus
Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email amer_recruit@bloomberg.net.
Salary Range: 200,000 - 300,000 USD Annually + Benefits + Bonus