Jithesh Gopinathan
Senior Data Engineer
Leeds, United Kingdom
Profile
Data engineer with 14+ years building and operating large-scale data platforms, most recently as a Senior Data Engineer with the UK Civil Service in Leeds. Background spans Java and big data development — ETL and streaming pipelines, Hadoop and Spark ecosystems built from the ground up, and cloud platforms including AWS, Azure, Databricks, and Snowflake. As a consultant with BJSS/CGI, delivered data platforms for clients across aviation, energy, e-commerce, utilities, and public health. AWS Certified Data Analytics – Specialty and AWS Certified Developer – Associate, with a Machine Learning Nanodegree from Udacity.
Experience
Senior Data Engineer — UK Civil Service
Apr 2026 – Present
Azure Fabric, Delta Lake, Informatica
Senior Data Engineer — BJSS/CGI (client: a UK water services provider)
Sep 2025 – Mar 2026
- Built ingestion pipelines drawing customer, usage, and market data from multiple channels into a Delta Lake landing layer using Azure Data Factory.
- Built the billing data pipelines in Azure Data Factory, using ingested data to generate customer billing.
Azure Data Factory, Delta Lake, Azure Pipelines, Azure Functions
Senior Data Engineer — BJSS/CGI (client: a major UK airline)
Jan 2025 – Jul 2025
- Led the initial phase of moving data capabilities onto a modern, decentralised data mesh architecture, improving data accessibility across the organisation.
Python, Spark, Databricks, Delta Lake, Azure Fabric, Azure Pipelines
Lead Data Engineer — BJSS/CGI (client: a UK e-commerce retailer)
Oct 2024 – Dec 2024
- Built real-time and batch ingestion into a Delta Lake landing layer on Azure Fabric.
- Worked directly with business analysts and stakeholders to translate requirements into pipeline design.
Python, Spark, Databricks, Delta Lake, Azure Fabric, Azure Pipelines
Senior Data Engineer — BJSS/CGI (client: a UK energy-sector organisation)
Sep 2022 – Aug 2024
- Applied complex business logic across large national energy datasets, storing results in Delta tables.
- Collected real-time data from multiple energy data endpoints and transformed it for downstream teams.
Python, Spark, Databricks, Delta Lake, Azure, Azure Pipelines
Data Engineer — BJSS/CGI (client: a UK public health body)
Nov 2021 – Aug 2022
- Ran ETL processes over a national dataset, including code updates, and maintained the data warehouse.
Python, Spark, Databricks, Jenkins, Git
Data Engineer — The Oakland Group (client: a major UK radio broadcaster)
May 2021 – Oct 2021
- Built streaming and batch ingestion pipelines feeding mParticle across the client’s full user base.
Java, Python, Spark, Airflow, dbt, Snowflake, AWS EC2, AWS EMR, AWS Kinesis, AWS Lambda, GCP BigQuery, GCP Dataproc, GCP Data Fusion
Assistant Principal Engineer — ST Engineering
Sep 2020 – Mar 2021
- Built the entire Hadoop ecosystem from a bare installation, standing up the big data infrastructure.
- Worked closely with data scientists across the full ML lifecycle and automated model deployment.
Java, Python, Hadoop, Spark, Hive, Airflow, MLflow, AWS EC2, AWS EMR, AWS RDS, AWS Kinesis, HBase, Kafka
Big Data Developer — Crédit Agricole CIB
Jul 2018 – Aug 2020
- Built a Kafka-to-Kafka streaming application processing payment events for systems handling millions of transactions.
Hadoop, Spark, Yarn, HBase, Kafka, Maven
Java Developer — Crédit Agricole CIB
Feb 2018 – Jul 2018
- Implemented change requests on the bank’s KYC application, working directly with the Paris team.
Java, J2EE, JSP, Spring, Hibernate, jQuery, MS SQL
Senior Software Engineer — Allianz Cornhill Information Services
Aug 2015 – Jan 2018
- Delivered production-ready code across the full development lifecycle as an offshore engineer for Australian clients.
Java, J2EE, JSP, Spring Boot, Hibernate, Angular, JMS, DB2
Software Engineer — D+H Solutions India
Jul 2012 – Jul 2015
- Designed and built the Newday configuration tool for D+H’s uOpen platform, cutting a 5–6 day process down to one day.
- Received the company’s ‘Go Extra Mile’ award, March 2014.
Java, J2EE, JSP, JavaScript, jQuery, AJAX, Spring, Hibernate, MS SQL
Skills
- Languages & runtimes
- Java, Python
- Frameworks & platforms
- Spark, Hadoop, Databricks, Airflow, MLflow, dbt, Spring, Spring Boot, Hibernate, J2EE, Angular
- Cloud & infrastructure
- AWS (EC2, EMR, RDS, Kinesis, Lambda), Azure (Data Factory, Fabric, Pipelines, Functions), GCP (BigQuery, Dataproc, Data Fusion), Docker, Kafka, IBM MQ
- Data & integration
- Delta Lake, Snowflake, Redshift, HBase, Hive, ETL/ELT pipelines, Data mesh, Data fabric
Education & certifications
B.Tech, Computer Science — University College of Engineering, Kariavattom
2007 – 2011
- AWS Certified Data Analytics – Specialty, Amazon Web Services
- AWS Certified Developer – Associate, Amazon Web Services
- Machine Learning Nanodegree, Udacity