Senior Software Engineer - Data Pipe Infrastructure

Careers at Bloomberg

Back to Search

New York, NY

Posted Nov 10, 2023 - Requisition No. 121551

The DataHub Engineering team provides a distributed platform for hosting datasets, complete with managed data stores, search, discovery, lakehouse and real-time stream processing capabilities. The platform provides a single place in the company to discover, access, publish and subscribe to data. 

This is the team that introduced the abstraction of “dataset”, invented a schema language to formally define all data at Bloomberg, complete with schema evolution, versioning, and a true point in time semantics.  We're the first to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new Data Intensive Platform that is the hub of financial datasets. 

The DataHub’s Data Pipe Infrastructure, built on Apache Kafka, streams the most critical datasets influencing the financial markets. 

We’ll trust you to:

  • Write software for Kafka based Data Pipes for the company wide Data Mesh
  • Debug and diagnose intricate failures, functional and performance regressions, with Apache Kafka, data codecs, low latency services, Spark streaming 
  • Contribute to upstream bug reports and commits.  
  • Collaborate and share extensively with fellow engineers 

You’ll need to have:

  • 4+ years experience programming in Java/Scala
  • Expertise in Apache Kafka and Distributed Systems 
  • A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience
  • Experience building reliable data infrastructure

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg provides reasonable adjustment/accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable adjustment/accommodation to apply for a job or to perform your job. Examples of reasonable adjustment/accommodation include but are not limited to making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you would prefer to discuss this confidentially, please email (Americas), (Europe, the Middle East and Africa), or (Asia-Pacific), based on the region you are submitting an application for.

Salary Range: 160,000 - 240,000 USD Annually + Benefits + Bonus

The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.

We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.

Similar jobs

    The Bloomberg Talent Network

    Stay connected with us and be among the first to learn about new job opportunities. We’ll use the information you provide to help us get in touch with you to align your expertise with our opportunities and better direct our conversations.