Senior Software Engineer- Data Platform
New York, NY
Posted Nov 17, 2022 - Requisition No. 111707
Bloomberg data moves global financial markets and data is the lifeblood of Bloomberg. The Data Platform teams enable application teams and content providers to scale their data by providing a set of tools, frameworks and managed services to manage the full life-cycle of their datasets.
The way our clients consume data has changed. Bloomberg's application teams face complex challenges of large-scale data storage, low-latency retrievals, high-volume requests, and availability over a distributed environment. We create standardized solutions to these problems by building core services and technology frameworks for enterprise-wide use.
You'll need to have:
- 4+ years working with an object-oriented programming language (C/C++, Python, Java, etc.).
- A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience.
- Experience designing scalable, reliable high throughput systems, and low latency services.
- Understanding of databases, distributed systems, network programming, concurrency, Linux file systems, debugging.
Read on to learn more about our teams and what we're looking for:
You can express interest in particular teams during the interview process and we'll do our best to match you with your preference! If you are not sure, we will work with you to try to find a role that matches your interests and skills.
Data Snapshot (CASS):
The Data Snapshot (CASS) team is tasked with selecting and implementing the best possible solutions to create a scalable, high-performance and reliable platform that provides an enterprise-wide standardized snapshot view of financial datasets. CASS platform enables other teams to make our data move faster, be easier to discover and access to support our clients across every imaginable workflow, geographic location, and asset class. We currently serve 100 billion data points to different applications every day and ingest 1-2 TB of data every day with the size of the datastore growing every week.
You’ll work with Java, Hadoop, Kafka, Ignite, Spark
Time Series Services (TSS):
The Time Series Services group is responsible for various data platforms which capture, store, organize, discover and retrieve time series related data. These platforms include:
- Bloomberg High Availability Timeseries Store (BHATS) ecosystem, a consumer timeseries/time-related data store capable of storing multi-temporal data sets as well as allowing retrievals against multiple-temporal dimensions.
- Price History, an application driven pricing platform, which serves as the historical financial instrument repository as well as the data retrieval vehicle used by many of the financial analytics functionality that our clients depend on.
- Bloomberg Product Identifier Repository (BPIR), a product identification creator platform used for defining non-financial or alternative data entities in order to make these time series datasets usable via current analytics functionality as well as those under construction.
Given the needs for date-specific data sets with point-in-time, as-reported use cases and timeframes (anywhere from by-the-minute to hourly to quarterly), our mission is to enable content owners and application teams to acquire, transform, store, and serve business as well as financial data in an expedited and configurable manner.
Depending on the platform, you’ll work with: C++ (14/17), Hadoop/HBase/HDFS, Java (11), Kafka, Python, Redis, Spark as well as SDLC related tooling like GitHub, Google Test/Mock, JAAS integration, and Jira.
Custom Data (CDE):
The Custom Data (CDE) integrates client proprietary datasets into Bloomberg core terminal and cross-product solutions. Custom Data positions Bloomberg as a holistic and integrated solution for Buy-side operations.
Our goal is to build a managed time-series platform for proprietary datasets and provide best-in-class solutions for discoverability, ingestion, retrieval, collaboration, auditing, reporting, and real-time alerts. Exposure to such a rich feature set enables you to solve diverse problems and challenges daily.
Configurable Access & Pipeline (CAP):
The Configurable Access & Pipeline (CAP) team builds and manages tools connecting various technologies in the Data Platform and Data Technologies departments. The goal is to enable analysts to bring valuable alternative datasets into Bloomberg and to clients via API quickly. Users of the Bloomberg Terminal use our data-access and analytics tools for idea generation in the areas of Pharma, Chemicals, Banking, Hospitals, Autos, Electronics, and many others.
Our approach to scaling the number and variety of datasets is to make all parts of the system configuration-driven: pipelines, storage, querying, and UI layouts can all be configured for a new dataset with minimal engineering effort.
You’ll work with: Python, C++, PostgreSQL, distributed database systems, Apache Airflow, Trino, Kafka, Spark.
Dataset Query Metadata:
The Dataset Query Metadata team focuses on automation of Bloomberg Query Metadata for the entire company.
Imagine being able to query datasets across all of debt, equities, and listed derivatives markets. Enabling such query engines requires large scale “query metadata” management. Our goal is to make this easy for dataset owners across the firm by providing them with a set of tools and utilities, systems for managing their metadata life-cycle workflows, and automation.
You will work across all asset classes, interact with engineers, data and product managers across the company and see the impact of your work in the eyes of your delighted colleagues as they unleash new query capabilities for financial markets using your systems.
You’ll work with: Kotlin, Java, Typescript, React, MySQL/Postgress.
If this sounds like you, apply now!
Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email firstname.lastname@example.org.
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
Salary Range: 160,000 - 240,000 USD Annually + Benefits + Bonus