The AI Group is the central engineering group responsible for driving Machine Learning adoption at Bloomberg, with over 300 researchers and engineers working together to provide clients with the best-in-class news, research, market data, and analytics using innovative machine learning technology. We directly impact a wide variety of our flagship products, including news, research, pricing, communications platforms, search and discovery tools. We work on a range of ML fields, including natural language processing, information retrieval, time series analysis, and recommender systems. 

The AI group contributes to Bloomberg’s flagship products such as news, research, pricing, communications platforms, search and discovery tools. We work on a variety of AI subfields, including NLP, information retrieval, time series analysis, and recommender systems. Textual data is particularly key to understanding how events in the world impact our clients. Whether it's analyzing social media sentiment over thousands of tweets per second, automatically extracting key indicators from press releases and filings, or helping clients derive intelligence from their internal communications by identifying entities and intents, we’ve used NLP to help Bloomberg maintain its edge as the market leader in financial data and communications.

The advent of large language models (LLMs) presents new opportunities for expanding our NLP capabilities in our products. BloombergGPT — our recently announced  large language model — is the most performant language model for financial text, and it puts us at the forefront of building innovative NLP products for our clients.

Broadly, we are looking for colleagues who are passionate about engineering and who want to learn more about:

• Training, fine-tuning, evaluating and deploying Large Language Models
• Applied Machine Learning frameworks such PyTorch, Transformers, Accelerate
• Distributed compute platforms such as Kubernetes and public cloud alternatives
• Specialized hardware for tensor computations

If all of this sounds like the projects you are passionate about and want to work on, apply! Do check out our blog at https://TechAtBloomberg.com/AI and learn more about our projects and research.

The Role:

As a Senior LLM engineer in the AI Group, you will have the opportunity to make key technical decisions which help define the future of infrastructure for LLM training and inference at Bloomberg!

We’ll trust you to:

• Build production LLM systems to power business functions in Bloomberg Terminal
• Contribute to internal initiatives related to LLM research and development
• Optimize and support LLM workloads in on-prem HPC and cloud environments

You’ll need to have:

• 4+ years of programming experience with an object-oriented programming language 
• A degree in Computer Science, Engineering or similar field of study or equivalent work experience
• Proven experience with Unix, Unix tools and shell scripting
• Experience in designing, developing, and supporting ML applications
• Understanding of ML model architectures, specifically, transformers, and underlying computations 
• Experience in profiling, benchmarking and optimizing ML applications

We’d love to see:


• Deep working proficiency in Python
• Experience in using HPC compute platforms and understanding anatomy of distributed computations
• Knowledge of ML accelerators (NVIDIA GPUs, TPUs, other vendor ASICs) and building efficient workloads for them
• Solid understanding of networking (Infinband, AWS EFA, RoCE)
• Experience managing infrastructure in Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).

Bloomberg is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email amer_recruit@bloomberg.net

Salary Range: 165,000 - 260,000 USD Annually + Benefits + Bonus