Senior Software Engineer - Compliance Data Solutions
New York, NY
Posted May 26, 2022 - Requisition No. 101463
You've seen the headlines. Financial firms are fined millions of dollars when just one employee does something they shouldn't. It can be as serious as insider trading or as seemingly innocent as an inappropriate instant message. Keeping track of who is saying, doing, and trading what is a daunting task for compliance officers, especially with the explosion in the volume and variety of data produced by communications and trading platforms.
That’s where Bloomberg Vault comes in. We are composed of Bloomberg Vault Archive and Bloomberg Surveillance to provide a single platform for more than 1,000 organizations customers. Our clients use Bloomberg Vault to manage and archive their enterprise communications and collaboration data, including email, instant message (IM), mobile, files, trade and documents, voice data and social media. Our multi-tenant cloud processes 300 million messages daily and stores about 90 billion archived objects, and we are looking to grow significantly in the next two years.
The Vault Data Solution team is responsible for a suite of services that provide access to the data in the Vault archive. Our consumers are both client-facing applications and firms that subscribe to daily communications reports. Delivery of these reports is critical --- without them clients legally can’t use the Bloomberg Terminal (a computer software system that provides Bloomberg Financial Services) that day! While maintaining and enhancing our existing system, we’re currently building a new data processing pipeline and reporting system using distributed systems (eg: Apache Spark) and modern orchestration workflow management framework (eg: Airflow and Argo). Over the next two years we will work to port our existing pipelines to this new platform. This is a hands-on technically challenging role that requires balancing understanding of complex existing systems with the build-out of new strategic services that include backend processing with client-facing APIs.
You’ll need to have:
- A desire to build robust, scalable, and maintainable systems
- Solid hands-on technical knowledge of Java and/or Python
- An understanding of how to design reusable APIs and microservices in a distributed architecture
- Experience with high volume, high availability distributed systems
- Bachelor’s degree in computer science or a related field, and/or related professional experience
We’d love to see:
- Experience with the Apache Hadoop Ecosystem (Spark, HDFS, Kafka, HBase, Airflow etc.)
- Cluster computing and containerization (Docker, Kubernetes, Calico, Istio, etc.)
- Passion for new technologies
- Passion for solving difficult and complex problems
Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email email@example.com.