Software Engineer II
 Microsoft | |
 United States, Washington, Redmond | |
 Jan 22, 2025 | |
|
OverviewThe Azure Machine Learning (ML) team within the Artificial Intelligence (AI) Platform empowers data scientists and developers to effortlessly build, train, deploy, manage, and consume machine learning models. We are seeking a Software Engineer II to join the Models-As-A-Service team! The Models-As-A-Service team designs, builds, and operates the industry's largest-scale engineering system for Large Language Models (LLMs) and Generative AI (GenAI) Services. This team is responsible for providing serverless access to a wide selection of 3rd party models from providers such as Mistral AI, Cohere, and Meta. We are at the forefront of large-scale AI inferencing, working with the latest state-of-the-art models and ensuring our platform can offer the right AI capabilities to anyone, from the individual developer to large enterprise customers. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.
ResponsibilitiesDesign and develop features related to large-scale model inferencing.Benchmark and optimize AI models and inferencing runtimes.Work with Product Manager and our model providers to establish timelines for releasing new models.Other: Embody our Culture and Values | |