Senior Software Engineer - Surveillance Engine
New York, NY
Posted May 3, 2022 - Requisition No. 103195
You've seen the headlines. Financial firms are fined millions of dollars when just one employee does something they shouldn't. It can be as serious as insider trading or as seemingly innocent as an inappropriate instant message. Keeping track of who is saying, doing, and trading what is a daunting task for compliance officers, especially with the explosion in the volume and variety of data produced by communications platforms.
Nearly 1,000 organizations use Vault to manage, archive, and search a broad range of enterprise communications and collaboration data, including email, instant message (IM), mobile, files and documents, voice data and social media. Our multi-tenant cloud processes 300 million messages daily and stores about 90 billion archived objects.
Bloomberg’s Surveillance Platform is a mission critical product used by key risk owners and compliance officers globally to meet the strict regulatory requirements in the financial world. At its core is a policy-driven engine capable of evaluating communications content and metadata in real-time which produces violation events and customized reports. Our end users use the web app to set up preventative policies e.g. anti-money laundering, bribery etc. and information barrier policies appropriate to groups of users within their organization.
You will join a team of software engineers who developed the real-time policy engine, events search, and aggregate reporting components of the Surveillance platform. The entire stack is written in Java and is based on industry standard open-source technologies such as Spark and Kafka that supports the scale we need. Your team's systems process hundreds of millions of communication data in real-time on daily basis with stringent high availability and milliseconds response time SLA. The core textual analysis engine scans content body and attachment files and identifies violations against each client firm's policies as well as enforcing information barriers to help manage risky user interactions.
You and your engineering team will collaborate with Surveillance's product management on innovative ideas to improve Surveillance's precision: new algorithms to detect and filter out unnecessary duplications, more intelligently target conversational threads, and support growing number of cloud communication channels. You'll also participate in the very exciting collaboration with Bloomberg's AI engineering to incorporate Machine Learning-based model to augment the lexicon-based systems
We are looking for:
- 3+ years experience programming in Java with object-oriented software design and development
- Prior experience with Relational and NoSQL databases
- Prior knowledge of how to scale and operate distributed systems on production
- Strong self-organization skills and highly collaborative attitude
- Bachelor’s degree in computer science or a related field, and/or related professional experience
We’d love you to have:
- Familiarity with electronic communications protocols and data model
- Experience with highly scalable technologies such as Spark, Kafka, Redis, Protobuf, Storm, Airflow, Solr, and Cassandra
- Experience building real-time data processing on JVM and optimizing for performance
- Passion in automating software build, test, and deploy to improve overall developers’ efficiency
- Familiarity with C/C++, Python, Linux Shell, or other scripting languages
Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or maternity/parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.
Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email email@example.com.