Senior Data Engineer for Search and Discoverability Team

Careers at Bloomberg

New York

Posted May 24, 2016 - Requisition No. 49862

We work on discovering connections, insights and workflows in a sea of financial and news data. Our hope is to use inherent attributes of data such as co-occurrence in contexts (rather than business rules) for prediction, contextualization and pervasive recommendation tasks to connect our users to the information they seek. To do this well and at scale, we need to build a robust distributed data science platform. Our infrastructure will support ingestion, processing and machine learning-powered analysis of a vast amount of disparate data.

We need your help in designing and engineering this infrastructure. We are a small team bullish on open source (with active contribution in Solr, Maven, Chef and Hadoop communities). Due to our team size, the relative youth of the project and a full stack ownership model, you will work with an uncommon depth and breadth of technologies and have the opportunity to shape a platform that will be critical to companies in the years to come.

We'll trust you to:

  • Build, maintain and scale cloud computing and storage frameworks
  • Develop a framework for releasing, deploying and integrating machine learning models into the Bloomberg application environment
  • Evaluate cutting-edge big data technologies/software (e.g. Spark, TensorFlow)
  • Develop quality software through design reviews, code reviews and unit testing

You need to have:

  • Strong Computer Science fundamentals (algorithms, data structures)
  • 3+ years of experience programming in Java
  • 3+ years of experience working in large-scale distributed environments such as Spark, MapReduce, HBase, Kafka, Pig, Oozie and Hadoop

We'd love to see:

  • Experience with cloud infrastructure
  • Experience with Scala/Spark/IPython notebooks
  • Community engagement - open source contributions or speaking at big data conferences/meetups

If this sounds like you, apply! You can also check out our Bloomberg Labs Website ( to learn more about how our data scientists apply methods from machine learning, natural language processing and search to solve complex problems across the company.

Similar jobs