Senior Data Engineer · London

Experienced in academia, low-level software engineering, and data science environments.

Proficient in DevOps and DataOps.

Passionate about understanding programming language strengths and weaknesses.

Programming languages

C++GoPythonRustSQLTypeScript

Platforms

AirflowSnowflakeAWSAzure

Exploring

OdinSwiftZig

Experience

Senior Data Engineer

Advertising Standards Authority

May 2023 - Present

  • Led a team of data engineers across day-to-day delivery, code review, hiring, and mentoring.
  • Built high-volume ingestion pipelines for APIs and web scraping workflows across platforms including Meta, Google, and TikTok.
  • Overhauled a hybrid Azure and AWS data platform with Snowflake and Airflow, reducing cost per data item by 30% while supporting more than 100x data growth.

Doctoral Researcher

Queen Mary University of London

Sep 2020 - Apr 2023

  • Developed the near detector upstream DAQ for the DUNE experiment at Fermilab using C++, Python, ZeroMQ, and custom TCP socket and buffer handling.
  • Studied the impact of DUNE PRISM on statistical and systematic uncertainties using Tikhonov regularisation with SciPy and NumPy.
  • Demonstrated Statistical Data Analysis, Elemetnary Particle Physics, and Practical Machine Learning modules.

Senior Data Engineer

Rewire Online

May 2021 - Dec 2022

  • Built Python data collection pipelines around Twitter and Reddit APIs, deployed on AWS EC2.
  • Handled data analysis, cleaning, storage, and automation testing with pandas, PostgreSQL, S3, Selenium, and custom tooling.
  • Integrated the Rewire API into a Python Discord bot that was distributed publicly.

Selected projects

FEX

Universal interactive system package search for the terminal, written in Rust and published on crates.io.

RustCLITerminal UX

whisper-parallel-cpu

A pybind11 wrapper around whisper.cpp for CPU-parallel transcription workloads in cloud environments.

PythonC++FFMPEG

Writing

AI coding is underwhelming

A short essay on where AI coding tools help, where they disappoint, and how that changes the way engineering work should be judged.

Read on Medium