Mistral AI

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise as well as personal needs. Our offerings include Le Chat, La Plateforme, Mistral Code and Mistral Compute - a suite that brings frontier intelligence to end-users. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers. Mistral AI participates in the E-Verify program By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. About the role As a Model Behavior Architect, you are at the forefront of defining and measuring LLM behaviour. We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and creating eval pipelines for complicated tasks. Your role is to work hand-in-hand with our Science team to define what ‘good’ looks like for Reasoning, Audio, Alignment, Tools, and all Frontier bets. Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your insights into best-in-class models. What you will do - - Interact with models to identify where model behavior can be improved - Gather internal and external feedback on model behavior to scope areas for improvement - Design and implement evals, data guidelines, data generation, and synthetic testing environments - Identify and fix edge case behaviors through rigorous testing - Develop robust evaluation pipelines for our model candidates - Work collaboratively with AI Scientists About you - - You have a deep understanding of either 1) linguistics, language, and translation, 2) engineering and code behavior, 3) LLM agents at work, including reasoning and tool use - You have prior knowledge in training and optimising model behaviour - You are an expert at building robust evaluations - You thrive in dynamic and technically complex environments - You have a track record of delivering innovative, out-of-the-box solutions to address real-world constraints By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers. Role Summary : M&A Tech Engineer As M&A Tech Engineer, you will be at the forefront of our growth strategy, driving innovation and expansion through strategic acquisitions. This role combines a strong technical background with strategic vision. You will be responsible for identifying and evaluating M&A opportunities that align with our technical and business goals, impacting Mistral’s ability to innovate and expand our market presence. You will collaborate with Product, Engineering, Legal, and Finance teams to assess potential acquisition targets from a technical perspective. By executing on high-potential acquisition opportunities, you will help us enhance our technical capabilities, expand our product offerings, and strengthen our position in the market. Your work will be instrumental in shaping the future of Mistral AI and driving our mission to democratize AI. What You Will Do Identify and Evaluate Opportunities: • Conduct market research in the AI ecosystem to find relevant target companies within our priority acquisition areas • Evaluate the technical potential of targets’ products and technology as well as their fit with Mistral’s offering Conduct Technical Due Diligence: • Evaluate target’s technology by testing their products and reviewing codebases, architectures and tech stack. • Assess target’s technical team members and structure. • Understand target’s product and engineering roadmap and its scalability • Work with our engineering team to assess technical synergies and integration path. Collaborate with Engineering: • Partner with Tech leads to define and adjust our strategic acquisition categories and criteria • Pitch the target post your first technical evaluation to Product and Engineering leads • Provide technical insights to inform investment decisions and integration planning. Leadership Collaboration: • Work with our CEO, CTO, and other senior leaders to align M&A strategy with business objectives. • Provide learnings and trends based on M&A exploration of the AI start-up landscape Who You Are • You hold a degree in a relevant scientific field (e.g., Computer Science, Data Science, Engineering, etc.) • You have deep understanding of concepts and algorithms underlying machine learning and LLMs • You are knowledgeable in AI or machine learning product implementation with APIs, back-end and front-end interfaces. • You can read Python code and are familiar with agents framework such as Langchain, vector DBs • You are curious and knowledgeable about the AI ecosystem and discovering start-ups proposing innovative solutions to tough AI issues • You are curious about M&A, venture capital, or related fields and willing to transfer your technicals skills into sourcing, evaluating, and executing high-impact deals • Your strategic mindset allows you to identify opportunities that align with our business objectives and technical vision Benefits France 💰 Competitive cash salary and equity 🥕 Daily lunch vouchers : Swile meal vouchers with 10,83€ per worked day, incl 60% offered by company 🥎 Sport : Enjoy discounted access to gyms and fitness studios through our Wellpass partnership 🚴 Transportation : Monthly contribution to a mobility pass via Betterway 🧑‍⚕️ Health : Full health insurance for you and your family 🍼 Parental : Generous parental leave policy 🌎 Visa sponsorship 🤝 Coaching: we offer BetterUp coaching on a voluntary basis By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise as well as personal needs. Our offerings include Le Chat, La Plateforme, Mistral Code and Mistral Compute - a suite that brings frontier intelligence to end-users. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers. Mistral AI participates in the E-Verify program By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. Role Summary We are building a team of exceptional Discovery Scientists, who can identify and solve key problems in their respective fields, here in STEM, with a particular focus on Physics, Chemistry, and Material science. The idea is to leverage the cutting-edge capabilities in AI of our Core Science organization. You will be able to shape the mission and: - Accelerate scientific discovery through high quality, open access research - Be empowered with advanced AI tools, participate to improving these tools in STEM, and the freedom to explore high-impact projects at the intersection of your domain and AI. - Participate in the growth of fundamental and industrial applications in AI for science Generally, our team will focus on two axis: (1) improving the models’ capabilities in solving open science problems and (2) systematically accelerating simulations. What you will do • Identify and Define Impactful Problems: Proactively identify critical challenges in your field where AI/ML can drive breakthroughs. • End-to-End Research Ownership: Lead independent research projects from ideation to implementation, including literature review, hypothesis formulation, numerical experimentation, and validation. • Develop and Apply AI/ML Solutions: Design, implement, and refine advanced algorithms, models, and frameworks (e.g., deep learning, LLMs, agentic AI) to address domain-specific problems. • Collaborate and Innovate: Work with a multidisciplinary team of scientists, engineers, and domain experts (including customers) to push the boundaries of what’s possible with AI in science. • Autonomy and Initiative: Operate with high autonomy, setting your own research agenda and driving projects to completion with minimal oversight. About you • Domain Expertise: Strong understanding and research capabilities in at least one scientific domain (e.g., physics, chemistry or materials science), demonstrated by first-author publications, open-source contributions, or other impactful projects. • Track record in AI/ML; the ability to shed light on hard, real-life problems with an AI solution, demonstrated by further contributions. • Broad experience in coding, for scientific computing and in machine learning, deep learning, and/or large language models. • Hands-on experience using frameworks like PyTorch or TensorFlow is especially appreciated. • Interdisciplinarity: ability to communicate to a broad-non specialized audience while still remaining technical. • Customer Collaboration Experience: Experience working with customers or end-users to refine requirements is also appreciated. • Low ego and team spirit mindset • Embraces hands-on, operational work MOTIVATIONAL PARAGRAPH When applying for the AI for Science team at Mistral, please describe in a short paragraph a potential project that you would like to contribute to the team, why it is challenging and interesting in general, and more specifically for Mistral. Please also highlight the specific skill set that you can bring to the team. Benefits 💰 Competitive cash salary and equity 🥕 Daily lunch vouchers : Swile meal vouchers with 10,83€ per worked day, incl 60% offered by company 🥎 Sport : Enjoy discounted access to gyms and fitness studios through our Wellpass partnership 🚴 Transportation : Monthly contribution to a mobility pass via Betterway 🧑‍⚕️ Health : Full health insurance for you and your family 🍼 Parental : Generous parental leave policy 🌎 Visa sponsorship 🤝 Coaching: we offer BetterUp coaching on a voluntary basis WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers. Role summary We are seeking skilled and motivated Data Scientists to join our team in Paris. You will work at the intersection of product, research, and engineering. You will analyze user behavior, optimize product performance, and design data-driven features that enhance our AI product suite. This role is ideal for someone who thrives in a dynamic environment, enjoys tackling ambiguous problems, and wants to influence our product roadmap directly. The ideal candidate will have a strong background in data analysis, statistical modeling and machine learning, with a proven track record of delivering high-quality results in a fast-paced environment. If you’re passionate about data, curious about AI, and eager to shape the data science strategy and make an impact, this is the role for you. What you will do • Define key metrics, understand in-depth the performance of our AI products, and identify opportunities for improvement. • Design and analyze experiments (A/B tests, causal inference) to validate hypotheses and guide product decisions. • Design and implement end-to-end data science projects, from data collection and preprocessing to model building, evaluation, and deployment. • Evaluate model performance in training and production, identifying edge cases, and develop frameworks to measure user satisfaction. • Work with engineering to ensure data quality and accessibility for analytics and ML. • Depending on seniority, mentor peers and share best practices in data science and analytics. About you Must-have: • Minimum of 2 years of industry experience as a Data Scientist. • Master's or Ph.D. degree in Computer Science, Statistics, Mathematics, Engineering, or a related quantitative field. • Proficiency in Python as well as SQL. • Highly technical but with a strong product acumen. • Experience in extracting insights from large and complex data, summarizing findings and sharing takeaways for product and engineering teams. • Strong statistical intuition and experience with experimental design, causal inference and machine learning algorithms. • Excellent communication and ability to explain complex technical concepts to non-technical audiences. • Creative, curious, and innovative—you love exploring new ways to use data. • Low-ego and a team player, eager to collaborate across functions. Nice-to-have: • Familiarity with DBT or similar tools. • We are looking for folks to work on customer facing products, enterprise products and with the science team, so experience working on one or more related topics is a plus. Hiring process • Intro call with Recruiter (30 min) • Hiring Manager Interview (30 min) • Technical interview - Python + Stats/ML (60 min) • Homework Assignment (5-day prep) + Review Presentation (60 min) • Value talk interview (30 min) • References By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. Location & Remote The position is based in our Paris HQ offices and we encourage going to the office as much as we can (at least 3 days per week) to create bonds and smooth communication. Our remote policy aims to provide flexibility, improve work-life balance and increase productivity. Each manager can decide the amount of days worked remotely based on autonomy and a specific context (e.g. more flexibility can occur during summer). In any case, employees are expected to maintain regular communication with their teams and be available during core working hours. What we offer 💰 Competitive salary and equity package 🧑‍⚕️ Health insurance 🚴 Transportation allowance 🥎 Sport allowance 🥕 Meal vouchers 💰 Private pension plan 🍼 Generous parental leave policy By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral we are on a mission to democratize AI, producing frontier intelligence for everyone, developed in the open, and built by engineers all over the world. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation, with teams distributed between Europe, the USA and Asia. We are creative, low-ego and team-spirited.At Mistral, we develop models for the enterprise and for consumers, focusing on delivering systems which can really change the way in which businesses operate and which can integrate into our daily lives. All while releasing frontier models open-source, for everyone to try and benefit. Mistral is hiring experts in the training of large language models and distributed systems. Join us to be part of a pioneering company shaping the future of AI. Role Summary We’re seeking highly motivated Data Quality Specialists with strong analytical skills and a keen eye for detail to join our Human Data Annotation team within the Science organisation. This is a hybrid quality reviewing and tooling role: you'll spend the majority of your time reviewing and auditing code annotations against rubrics to ensure data used for training and evaluating AI models meets a high bar, and the remainder building, maintaining, and troubleshooting the internal tooling that annotators rely on day-to-day. You'll collaborate closely with the annotators, technical program manager, and engineer stakeholders, and contribute to refining the guidelines and processes that shape how our data is produced. Key Responsibilities - - Generate and validate high-quality data annotations, based on guidelines and continuous feedback, for the development and evaluation of AI models - Surface systemic issues, edge cases, and gaps in guidelines back to annotation operations and technical stakeholders - Produce annotations yourself when needed, modeling the quality bar expected of the team - Build and maintain internal tools and automation that streamline annotator workflows such as visualization dashboards, batch configuration scripts, output management utilities, and similar - Troubleshoot environment, tooling, and CLI/git issues for annotators on their local machines, liaising with IT and engineering as needed About you - - A degree in computer science, engineering, or a related field. Alternatively, 2 to 5 years of professional experience in software engineering, technical support, or developing tools - Hands-on experience using code agents (e.g. Mistral’s vibe) in your own development workflow, and genuine interest in how they're evolving - Proficient in at least one programming language (e.g. Python, JavaScript, or similar), with enough breadth to read and reason about code across a few core languages - Able to apply consistent judgment against a rubric and surface edge cases, ambiguities, or gaps in guidelines - Sustained focus and accuracy on detail-oriented, high-volume review work - Comfortable working in a Unix-like terminal: shell basics, package managers, environment setup, and git workflows (branches, merges, resolving conflicts) - Able to troubleshoot local development environment issues (dependencies, virtual environments, paths, permissions) across common operating systems - Professional proficiency in English, with strong writing and comprehension skills Nice to have - - Prior experience in data annotation for AI/ML, especially LLM training (SFT, RLHF, preference data), evals/benchmarks, or agentic data - Experience building an annotation team through interviews and training - Experience supporting technical users or troubleshooting developer environments (internal tools support, DevRel, teaching assistant for coding courses, etc.) - Fluency across multiple programming languages, or domain depth in one of: frontend, backend, DevOps, MLOps, data engineering - Familiarity with rubric-based evaluation concepts, inter-annotator agreement, or quality measurement for human-labeled data - Experience developing, deploying, and managing internal tooling or automation scripts Benefits: France 💰 Competitive cash salary and equity 🥕 Food : Daily lunch vouchers 🥎 Sport : Monthly contribution to a Gympass subscription 🚴 Transportation : Monthly contribution to a mobility pass 🧑‍⚕️ Health : Full health insurance for you and your family 🍼 Parental : Generous parental leave policy 🌎 Visa sponsorship UK 💰 Competitive cash salary and equity 🚑 Insurance 🚴 Transportation: Reimburse office parking charges, or 90GBP/month for public transport 🥎 Sport: 90GBP/month reimbursement for gym membership 🥕 Meal voucher: £200 monthly allowance for its meals 💰 Pension plan: SmartPension (percentages are 5% Employee & 3% Employer) By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited. Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers. About The Job The Applied AI team is Mistral's customer-facing technical organization. We work directly with enterprise clients from pre-sales through implementation to deploy cutting-edge AI solutions that deliver measurable business impact. Our team combines deep ML expertise with strong customer engagement skills, operating like startup CTOs who own end-to-end project execution. However, the AI graveyard is full of great ideas nobody could measure or prototypes that never made it to production. As a first Evaluation Engineer, you'll design the methodology, build the infrastructure, and define what "ready for production" means across verticals and use cases. You will design and implement evaluation systems that help our customers understand model performance across their specific use cases, build robust evaluation infrastructure, and work closely with both research and customer-facing teams. Research builds evals for frontier capabilities but customers don't care about MMLU scores. We need in Applied AI evals and frameworks for customer reality domain-specific, risk-aware, production-grade. The kind that tell you whether your medical summarization model will hallucinate drug interactions, or whether your legal assistant will invent case citations. This role sits at the intersection of research, engineering, and solutions, you will play a critical cross role in measuring, understanding, and improving the capabilities of our models for our enterprise customers. What you will do - Design and implement comprehensive evaluation frameworks to measure LLM capabilities across diverse customer use cases, including text generation, reasoning, code, and domain-specific applications - Build scalable evaluation infrastructure and pipelines that enable rapid, reproducible assessment of model performance - Develop novel evaluation methodologies to assess emerging capabilities or verticalized use cases (cybersecurity, finance, healthcare, etc.) and enable the Solutions (Deployment Strategist and Applied AI) on these topics. - Create custom evaluation suites tailored to enterprise customers' specific needs, working closely with them to understand their requirements and success criteria - Collaborate with research teams to translate evaluation insights into model improvements and training decisions - Partner with product teams to continuously improve our evaluation tooling based on customer feedback How We Work in Applied AI - We care about people and outputs. - What matters is what you ship, not the time you spend on it - Bureaucracy is where urgency goes to vanish. You talk to whoever you need to talk to. The best idea wins, whether it comes from a principal engineer or someone in their first week. - Always ask why. The best solutions come from deep understanding, not from copying what worked before - We say what we mean. Feedback is direct, timely, and given because we care. - No politics. Low ego, high standards. - We embrace an unstructured environment and find joy in it. About you - You are fluent in English - 3+ years of experience in ML evaluation, benchmarking for LLM or agentic systems - You have proven experience in AI or machine learning product implementation with APIs, back-end - You have deep understanding of concepts and algorithms underlying machine learning and LLMs - You have strong technical coding skills in Python - You hold strong communication skills with an ability to explain complex technical concepts in simple terms with technical and non-technical audiences Ideally you have: - Contributions to open-source evaluation frameworks (e.g., LM Eval Harness, OpenAI Evals) or published research on LLM evaluation - Experience as a Customer Engineer, Forward Deployed Engineer, Sales Engineer, Solutions Architect or Technical Product Manager - Experience with ML frameworks (PyTorch, HuggingFace Transformers) Benefits 🏝️ PTO: The CDI contract will be a "Forfait 218 jours", corresponding to 25 days of holidays and on average 8 to 10 days of RTT days, and complete autonomy on working hours ⚕️ Health : Full health insurance coverage for you and your family 🚗 Transportation : We offer a €600 annual mobility allowance. This package covers 50% of your public transportation costs and includes the Sustainable Mobility Allowance (FMD), encouraging eco-friendly travel options such as cycling or carpooling. 🥕 Food : Swile meal vouchers with 10,83€ per worked day, incl 60% offered by company 🏀 Sport : Gymlib - sponsorship by Mistral of a significant part of the monthly fee (depending on the program you chose) 🐤 Parental policy : 4 additional weeks for parents on top of what is offered by the French state. By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.

ABOUT MISTRAL We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited. About Mistral At Mistral we are on a mission to democratize AI, producing frontier intelligence for everyone, developed in the open, and built by engineers all over the world. We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation, with teams distributed between Europe, the USA and Asia. We are creative, low-ego and team-spirited. At Mistral, we develop models for the enterprise and for consumers, focusing on delivering systems which can really change the way in which businesses operate and which can integrate into our daily lives. All while releasing frontier models open-source, for everyone to try and benefit. Mistral is hiring experts in the training of large language models and distributed systems. Join us to be part of a pioneering company shaping the future of AI. What will you do *Research and develop novel AI methods for general-purpose mobile manipulation robots *Build tooling and infrastructure to allow training, evaluation and analysis of AI models at scale *Work cross-functionally with other scientists, engineers and product teams to deploy AI systems on real robot platforms About you *You have hands-on experience either building and deploying AI systems on physical robots or developing large vision-language models *You are a highly proficient software engineer in at least one programming language (preferably Python) *You have hands-on experience with AI frameworks (preferably PyTorch) *You have high engineering competence. This means being able to design complex software and make it usable in production *You are a self-starter, autonomous and a team player Now, it would be ideal if *You have experience in one or more of the following: navigation, manipulation, simulators, 3D, embodied reasoning or vision-language-action models *You can navigate the full MLOps stack, for instance, fine-tuning, evaluation and deployment *You have a strong publication record in a relevant scientific domain Benefits in France 💰 Competitive cash salary and equity 🥕 Food : Daily lunch vouchers 🥎 Sport : Monthly contribution to a Gympass subscription 🚴 Transportation : Monthly contribution to a mobility pass 🧑‍⚕️ Health : Full health insurance for you and your family 🍼 Parental : Generous parental leave policy 🌎 Visa sponsorship By applying, you agree to our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy. WHAT DO WE OFFER? We support our employees’ well-being, growth, and work-life balance, with a range of global benefits designed to meet the diverse needs of our team members worldwide. Health & Family - Healthcare Coverage 100% employer-sponsored premium plans for medical, dental, and vision care for you and your dependents. - Parental Leave 20 weeks of paid leave for all primary parents. - Childcare Support Reserved daycare seats or financial assistance for working parents. Financial & Career Planning - Retirement Plans Competitive employer-matched contributions in applicable markets (e.g., 6% 401k match in the US, 5% pension contribution in the UK) to secure your financial future. - Relocation Support Financial assistance for moving expenses, visa sponsorship, and settling-in services for you and your family. Daily Life & Wellness - Meal Allowances Monthly stipends, vouchers, or catered in-office meals, depending on your office location. - Transportation Support Monthly allowances for public transport, parking, or sustainable mobility - Fitness & Wellness Subsidies or memberships for gyms, wellness programs, or fitness activities Privacy Policy Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.