AI Engineer & ResearcherPhD candidate, Southampton

I work on making neural networks smaller and faster.

I’m an AI engineer and researcher working across efficient machine learning, from model compression and low-level kernels to inference systems and evaluation. My work has covered vision, language and generative models, in both research and industry. I’m a PhD candidate at the University of Southampton.

Portrait of Oliver Grainge
East Sussex, United Kingdom
All projects →
  1. Feb 2025 – Now

    Contract Researcher, Performance Engineering

    Arm · Remote

    Architected six hands-on tutorials for the Arm Total Performance toolkit covering memory optimization, library acceleration (APL, KleidiAI) and automated porting for AWS Graviton instances.

  2. Jun – Nov 2025

    Research Assistant

    University College London · London

    Engineered a 1.58-bit precision pipeline for Stable Diffusion (4× memory reduction, 95% quality retention). Designed custom CUDA and Triton kernels for bit-packed tensor operations, delivering a 30% speedup over the PyTorch baseline.

  3. Nov 2024 – Jan 2025

    Contract Researcher, AI Inference Optimization

    Arm · Remote

    Built demonstrations achieving 40% latency reduction via SIMD/INT8 on mobile and 2.1× throughput on cloud instances. Built a Hyperopt-based per-layer precision optimizer showing 22% memory reduction on GPT models.

  4. Aug 2024 – Jan 2025

    Visiting Researcher

    Queensland University of Technology · Brisbane

    Engineered speculative decoding for vision-language transformers, achieving a 2.5× inference speedup for sub-100 ms robotic navigation. Implemented training-data filtering that matched accuracy with 38% less data.

  5. Jan 2024 – Jan 2025

    Research Fellow

    AI Security Institute · Remote

    Built an automated benchmarking framework evaluating 25+ VLMs across 26k geo-tagged images with 99.9% reliability over 500k+ API calls. Developed privacy-preserving techniques that cut geolocation accuracy by 40%, with an interactive demo used by 5k+ people.

All publications →
Languages
Python, C/C++, CUDA, Triton, Bash, SQL
Optimization
Quantization (INT8, INT4, ternary), QAT/PTQ, GPTQ, AWQ, pruning, distillation, LoRA/QLoRA, FlashAttention, SIMD (NEON, AVX2)
Frameworks
PyTorch, TensorFlow, Hugging Face, vLLM, llama.cpp, ONNX Runtime, TensorRT, OpenCV
Infrastructure
AWS (EC2, Graviton), Docker, Kubernetes, SLURM, Ray, MLflow, W&B, Triton Inference Server, FastAPI

PhD (iPhD) in Machine Intelligence

University of Southampton · 2022 – present

Thesis: Efficient Resource-Constrained Visual Place Recognition

BEng Electronics and Electrical Engineering, First Class (83%)

University of Southampton · 2019 – 2022

Contact

Working on efficient ML or production AI? Let’s talk.