Senior Software Engineer - Big Data Infrastructure

Careers at Bloomberg

New York

Posted May 11, 2016 - Requisition No. 49742

Bloomberg runs on data. It's our business and it's our product. It's why thousands of companies partner with us. We're nearing one petabyte and growing, with no end in sight. Our data captures who, what, when, where and why of how our clients use Bloomberg products.

The Bloomberg Big Data Services engineering team (Or BBDS for short) provide a software platform for hosting large datasets. It's a mature platform complete with search, analytics, and real-time pipeline processing capabilities. The system scales out to petabytes while maintaining low latency, availability and immediate discoverability by clients. This puts us in an enviable and unique position to address the unique challenges of financial markets.

Maybe you love solving intricate engineering issues with large systems. Or you like to get stuck into interesting problems around platform API's, real-time data pipelines, search and analytics engines or query optimizers. If this sounds like you, we'd love to talk.

We'll trust you to:

  • Help us build large distributed systems that will be the heart of data platform. Your work will enable us to ingest and process trillions of data items
  • Provide search and analytics across these structured, semi-structured and unstructured datasets
  • Work a number of large distributed computing systems like HBASE, MySQL clusters, Kafka, Spark, Lucene, Solr / Elastic, HaProxy, in-memory stream processors, etc
  • Adapt and change many technologies to provide solutions for distributed data storage. You will care about synchronization, sub-second latencies, search and discoverability. You will also need to maintain fault tolerance and high availability

You'll need to have:

  • Significant exposure to Java and JVM, C and Linux system including expertise in low latency kernel level optimizations
  • 5+ years as software engineer required; you should be capable of programming in compiled and dynamic languages, be comfortable with Python/Javascript
  • You have expertise in data stores (both transactional and non-transactional), and can code in a highly concurrent environment

We'd love to see:

  • You are comfortable with distributed systems, RESTful architectures, and have built scalable, low-latency systems that provide high availability
  • Deep knowledge of HBASE, Spark, Cassandra, Hadoop Eco-system of technologies OR MySQL/WebScaleSQL & InnoDB engine, is a big plus
  • BS/MS in Computer Science/Computer Engineering, Science, Math or equivalent experience
  • Deep knowledge of search engines like Apache Lucene and Solr / Elasticsearch is a plus

Apply if you think you're a good match!

Similar jobs