Big Data Developer - Latency Monitoring

Careers at Bloomberg

New York

Posted Apr 8, 2016 - Requisition No. 49395

You are an engineer who enjoys finding ways to extract and display meaningful information from large data sets. You enjoy working with low-latency, high throughput systems and are comfortable thinking about the distance between two cities in both miles and milliseconds. You are interested in using open-source technologies, but if it doesn't exist, you're happy to build it.

If that sounds like you, then consider working on the Latency Monitoring System. We're building a system from scratch to explore the latency of market data delivery on Bloomberg's global network. You'll be involved from the beginning, designing visualizations that help both developers and business departments understand how data flows through our system and where we can improve. We're looking for someone who can own the display portion of the system from web reports to interactive analytics. You'll work with a small, flexible team on identifying how applications behave under load, which applications can be improved and where the bottlenecks are.

We'll trust you to:

  • Design and implement distributed data analytics systems using Hadoop/Spark, Python and C/C++
  • Manage cloud resources in order to maintain resiliency and performance
  • Effectively roll out new features using an Agile methodology
  • Work with a small team on all parts of the system from data capture to display
  • Participate with the rest of the team in analyzing the latency data, finding bottlenecks and proposing solutions

You need to have:

  • 2+ years experience working with Hadoop and Spark
  • 2+ years experience with Openstack or Amazon EC2 (or equivalent)
  • 4+ years experience programming in Python
  • Bachelor's or Master's degree in Computer Science or equivalent experience
  • Experience with GitHub and a solid understanding of core concepts with Git
  • Familiarity with Linux
  • A solid understanding of basic statistics and core computer science concepts

We'd love to see:

  • A strong understanding of Makefiles
  • Familiarity with distributed computing
  • Experience with web technologies including NGinx, Flask, and REST APIs
  • Familiarity with system administration tasks, such as managing services, hardware, and network configurations
  • Prior experience working with trading or market data
Similar jobs