Machine Learning Engineer
Interview Questions.
17 practice questions across 12 skills — each with what the interviewer is really listening for. Prepare with intent, not guesswork.
Free · No signup · Grouped by skill
How to use this page
Don't memorise answers. For each question, read what the interviewer is looking for, then practise answering out loud in your own words with a real example. The notes describe strong answers and common red flags — they are for your prep, not a script.
Machine Learning
4 questionsHow is an ML Engineer's job different from a Data Scientist's, in your experience?
BasicWhat the interviewer is looking for: Strong answers emphasise productionising, serving, scaling, and reliability of models versus pure experimentation. Treating the roles as identical or ignoring the engineering half is a red flag.
Explain overfitting and the concrete techniques you use to fight it.
IntermediateWhat the interviewer is looking for: Look for regularisation, more/better data, cross-validation, early stopping, and simpler models, with an understanding of the bias-variance trade-off. Only saying 'add more layers' is a red flag.
What is data leakage, and can you give an example that would inflate offline metrics?
AdvancedWhat the interviewer is looking for: A strong answer explains information from the target or future leaking into features, e.g. using a post-outcome field, and how to catch it. Not recognising leakage as a top failure mode is a serious red flag.
Your model's accuracy is slowly dropping in production over months. What is happening and what do you do?
AdvancedWhat the interviewer is looking for: Strong candidates name data/concept drift, set up monitoring, and plan retraining triggers. Only suggesting a one-off retrain without monitoring is a red flag.
Model Deployment
2 questionsHow do you decide whether a model is ready to ship to production?
AdvancedWhat the interviewer is looking for: Strong candidates check offline metrics against a baseline, latency and cost budgets, and a shadow or canary rollout, not just a good validation score. Shipping on a single accuracy number is a red flag.
How do you package and serve a model so it can handle production traffic reliably?
AdvancedWhat the interviewer is looking for: Look for containerisation, a serving layer or API, autoscaling, and monitoring of latency and errors. Loading the model per request or ignoring latency budgets are red flags.
Data Preprocessing
1 questionWhy is data preprocessing often where most of the effort and most of the bugs live?
IntermediateWhat the interviewer is looking for: Look for handling missing values, scaling, encoding, and especially preventing train/serve skew and data leakage. Not mentioning leakage or reproducibility of transforms is a red flag.
PyTorch
1 questionWhen would you choose PyTorch over TensorFlow, or vice versa?
IntermediateWhat the interviewer is looking for: Look for a pragmatic view — research flexibility and dynamic graphs versus production/serving ecosystems — rather than dogma. Insisting one is universally better is a red flag.
Python
1 questionHow would you use Python to build a reproducible training pipeline?
IntermediateWhat the interviewer is looking for: Strong answers cover seeding, pinned dependencies, config-driven runs, and versioned data and artifacts. Notebooks with hidden state as the production pipeline are a red flag.
MLOps
1 questionWhat does MLOps add on top of standard DevOps for a model in production?
AdvancedWhat the interviewer is looking for: Look for data and model versioning, retraining pipelines, drift monitoring, and reproducibility, not just CI/CD. Treating a model like a static binary that never degrades is a red flag.
Docker
1 questionHow do you use Docker to keep training and serving environments consistent?
IntermediateWhat the interviewer is looking for: Strong answers pin the environment including CUDA/library versions and use the same base for train and serve. 'Works on my machine' with unpinned dependencies is a red flag.
LLMs
1 questionYou are asked to add an LLM feature. How do you decide between prompting, fine-tuning, and retrieval?
AdvancedWhat the interviewer is looking for: Look for starting simple with prompting/RAG for knowledge grounding and reserving fine-tuning for behaviour/format needs, weighing cost and data. Jumping to fine-tuning by default is a red flag.
Generative AI
1 questionHow do you evaluate a generative AI feature where there is no single correct answer?
AdvancedWhat the interviewer is looking for: Strong candidates combine automated proxies, human evaluation, and guardrails for safety and hallucination, and define task-specific criteria. Claiming accuracy alone suffices is a red flag.
TensorFlow
1 questionIn TensorFlow, how would you debug a model that trains but whose loss is not decreasing?
AdvancedWhat the interviewer is looking for: Strong answers check the learning rate, data pipeline and labels, loss function choice, and whether the model can overfit a tiny batch as a sanity test. Randomly tweaking hyperparameters with no hypothesis is a red flag.
Git
1 questionHow do you version data, code, and models in Git so an experiment is reproducible months later?
IntermediateWhat the interviewer is looking for: Look for versioning code in Git, data and large artifacts via a data-versioning tool or object storage with references, and pinned environments. Committing giant binaries to Git or not versioning data at all are red flags.
Technical Documentation
1 questionHow do you write up your work so another engineer can reproduce and build on it?
BasicWhat the interviewer is looking for: Strong answers document data sources, assumptions, metrics, and how to run the pipeline, valuing reproducibility. Undocumented notebooks and tribal knowledge are red flags.
Behavioural & role-general
1 questionTell me about an ML project where the model was good but the product impact was not. Why?
IntermediateWhat the interviewer is looking for: Look for understanding that model quality is only part of impact — integration, UX, and the right metric matter. Blaming only the model or the data is a red flag.