Skip to Content

Hal Wall

Data Engineer at Chubb Insurance

Somewhere between Databricks and Tolstoy.

About

Analytical, creative, and quietly relentless. I'm a London-based Data Engineer with a background in Theoretical Physics and a deep love for building clean, scalable, intelligent systems. I work at the intersection of data, machine learning, distributed architecture, and cloud transformation, helping organisations turn complex information into clarity and action.

Outside the data world, I'm a devoted reader of fiction and philosophy, a long-distance runner, and an enthusiastic hiker, often found exploring the wilder corners of the UK with my dog. Whether I'm building resilient pipelines or trekking through Glen Coe, I bring the same focused energy: improve continuously, learn deeply, and leave things better than I found them.

Experience

  1. Aug 2025 — Present

    Selected to join the Global Analytics team, where I work across North America, EMEA, and APAC to architect and maintain global datasets for enterprise risk assessment. Building resilient, cloud-native data pipelines on Databricks and implementing complex entity resolution algorithms, enabling underwriters and business teams to make more accurate risk decisions and premium calculations at scale.

    • Python
    • SQL
    • Databricks
    • PySpark
    • Azure
    • Postman
  2. Nov 2024 — Aug 2025

    Collaborated with data scientists on end-to-end data products for AI-driven portfolio management. Led Databricks optimization efforts and shaped platform governance during Azure migration. Implemented Unity Catalog and automated business-critical pipelines using Kafka.

    • Python
    • SQL
    • Databricks
    • PySpark
    • Azure
    • Unity Catalog
  3. Jun 2025 — Aug 2025

    Deep-dive into complex metadata-driven infrastructure. Created architectural diagrams for pipeline clarity and enhanced GDPR compliance through a Deletion & Retention framework. Automated record removal across medallion architecture.

    • Python
    • Databricks
    • ADF
    • Databricks
    • Azure DevOps
  4. Oct 2022 — Nov 2024

    Drove cloud migration strategy from on-premises to Azure-native pipelines. Designed a custom PySpark CDC solution that reduced data volumes by 85% and cut file transfer times from 1+ hour to 15 minutes. Partnered with product managers and analysts to deliver data products.

    • Databricks
    • Azure Data Factory
    • Python
    • SQL
    • PySpark
    • Power BI
  5. Mar 2021 — Apr 2022

    Owned analytics reporting across B2B marketing campaigns. Piloted and scaled employee advocacy program. Collaborated on diversity and inclusion initiatives while managing stakeholder relationships.

    • Analytics
    • Campaign Management
    • Stakeholder Engagement
  6. Oct 2019 — May 2021

    Founded a creative consultancy delivering photography, branding, and design work. Managed client relationships and design roadmaps, creating visual identities for businesses ranging from startups to established brands.

    • Photography
    • Graphic Design
    • Creative Direction
    • Branding

Projects

  • Timewell

    An annual leave planner for UK employees. Stripped of its usual HR clunkiness and dressed in clarity. It offers visual insight into your year ahead and calculates the ROI of your time off. Vanilla JavaScript, no build step required, just honest utility.

    • JavaScript
    • HTML/CSS
    • UX Design
    Featured
  • Renovision

    An AI-powered property renovation visualization tool. Paste a Rightmove URL, select rooms, configure a renovation style, and see possibilities beyond avocado walls. Built during my partner and I's own property search.

    • Next.js
    • AI/ML
    • TypeScript
    • Tailwind CSS
    Featured
  • Long Form Press

    A literary goods brand for serious readers. Small-batch production of bookmarks, literary prints, t-shirts and curated goods; celebrating the canon and the craft of paying attention.

    longformpress.com
    • E-commerce
    • Brand Design
    • Product Design
    • Copywriting
    Featured