Free Machine Learning Engineer Interview Prep

Machine Learning Engineer Interview Questions.

17 practice questions across 12 skills — each with what the interviewer is really listening for. Prepare with intent, not guesswork.

Free · No signup · Grouped by skill

How to use this page

Don't memorise answers. For each question, read what the interviewer is looking for, then practise answering out loud in your own words with a real example. The notes describe strong answers and common red flags — they are for your prep, not a script.

Machine Learning

4 questions
  1. How is an ML Engineer's job different from a Data Scientist's, in your experience?

    Basic

    What the interviewer is looking for: Strong answers emphasise productionising, serving, scaling, and reliability of models versus pure experimentation. Treating the roles as identical or ignoring the engineering half is a red flag.

  2. Explain overfitting and the concrete techniques you use to fight it.

    Intermediate

    What the interviewer is looking for: Look for regularisation, more/better data, cross-validation, early stopping, and simpler models, with an understanding of the bias-variance trade-off. Only saying 'add more layers' is a red flag.

  3. What is data leakage, and can you give an example that would inflate offline metrics?

    Advanced

    What the interviewer is looking for: A strong answer explains information from the target or future leaking into features, e.g. using a post-outcome field, and how to catch it. Not recognising leakage as a top failure mode is a serious red flag.

  4. Your model's accuracy is slowly dropping in production over months. What is happening and what do you do?

    Advanced

    What the interviewer is looking for: Strong candidates name data/concept drift, set up monitoring, and plan retraining triggers. Only suggesting a one-off retrain without monitoring is a red flag.

Model Deployment

2 questions
  1. How do you decide whether a model is ready to ship to production?

    Advanced

    What the interviewer is looking for: Strong candidates check offline metrics against a baseline, latency and cost budgets, and a shadow or canary rollout, not just a good validation score. Shipping on a single accuracy number is a red flag.

  2. How do you package and serve a model so it can handle production traffic reliably?

    Advanced

    What the interviewer is looking for: Look for containerisation, a serving layer or API, autoscaling, and monitoring of latency and errors. Loading the model per request or ignoring latency budgets are red flags.

Data Preprocessing

1 question
  1. Why is data preprocessing often where most of the effort and most of the bugs live?

    Intermediate

    What the interviewer is looking for: Look for handling missing values, scaling, encoding, and especially preventing train/serve skew and data leakage. Not mentioning leakage or reproducibility of transforms is a red flag.

PyTorch

1 question
  1. When would you choose PyTorch over TensorFlow, or vice versa?

    Intermediate

    What the interviewer is looking for: Look for a pragmatic view — research flexibility and dynamic graphs versus production/serving ecosystems — rather than dogma. Insisting one is universally better is a red flag.

Python

1 question
  1. How would you use Python to build a reproducible training pipeline?

    Intermediate

    What the interviewer is looking for: Strong answers cover seeding, pinned dependencies, config-driven runs, and versioned data and artifacts. Notebooks with hidden state as the production pipeline are a red flag.

MLOps

1 question
  1. What does MLOps add on top of standard DevOps for a model in production?

    Advanced

    What the interviewer is looking for: Look for data and model versioning, retraining pipelines, drift monitoring, and reproducibility, not just CI/CD. Treating a model like a static binary that never degrades is a red flag.

Docker

1 question
  1. How do you use Docker to keep training and serving environments consistent?

    Intermediate

    What the interviewer is looking for: Strong answers pin the environment including CUDA/library versions and use the same base for train and serve. 'Works on my machine' with unpinned dependencies is a red flag.

LLMs

1 question
  1. You are asked to add an LLM feature. How do you decide between prompting, fine-tuning, and retrieval?

    Advanced

    What the interviewer is looking for: Look for starting simple with prompting/RAG for knowledge grounding and reserving fine-tuning for behaviour/format needs, weighing cost and data. Jumping to fine-tuning by default is a red flag.

Generative AI

1 question
  1. How do you evaluate a generative AI feature where there is no single correct answer?

    Advanced

    What the interviewer is looking for: Strong candidates combine automated proxies, human evaluation, and guardrails for safety and hallucination, and define task-specific criteria. Claiming accuracy alone suffices is a red flag.

TensorFlow

1 question
  1. In TensorFlow, how would you debug a model that trains but whose loss is not decreasing?

    Advanced

    What the interviewer is looking for: Strong answers check the learning rate, data pipeline and labels, loss function choice, and whether the model can overfit a tiny batch as a sanity test. Randomly tweaking hyperparameters with no hypothesis is a red flag.

Git

1 question
  1. How do you version data, code, and models in Git so an experiment is reproducible months later?

    Intermediate

    What the interviewer is looking for: Look for versioning code in Git, data and large artifacts via a data-versioning tool or object storage with references, and pinned environments. Committing giant binaries to Git or not versioning data at all are red flags.

Technical Documentation

1 question
  1. How do you write up your work so another engineer can reproduce and build on it?

    Basic

    What the interviewer is looking for: Strong answers document data sources, assumptions, metrics, and how to run the pipeline, valuing reproducibility. Undocumented notebooks and tribal knowledge are red flags.

Behavioural & role-general

1 question
  1. Tell me about an ML project where the model was good but the product impact was not. Why?

    Intermediate

    What the interviewer is looking for: Look for understanding that model quality is only part of impact — integration, UX, and the right metric matter. Blaming only the model or the data is a red flag.

Before the interview, close the skill gaps first

Upload your resume and see your Machine Learning Engineer Skill Score, the exact skills you're missing, and a free learning path for each one — so you walk in prepared.