Andalib Ansari
DATA PLATFORM & AI ENGINEERING
Andalib Ansari

End-to-end data platforms, wired for AI agents.

I design and build data platforms from raw events to trusted warehouse — orchestration, quality gates, modeling — then put n8n and LangChain agents on top of them.

Also teaches data engineering to 29,283 students on Udemy — see the course ↓

Platform design
Airflow setup
Data quality server
Warehouse modeling
n8n + LangChain AI apps
// platform_to_agent.svg
Events stream data S3 batch data Airflow orchestration DQ Server custom checks Warehouse modeled schema n8n + LangChain HUMAN validation DECISION shipped
// core expertise

What I build, end to end

Not a generalist list — this is the specific stack I've shipped in production, repeatedly.

End-to-End Data Platform Design

Architecting the full path from raw ingestion to governed, trusted data — data lake, warehouse, catalog, and lineage as one coherent platform, not disconnected tools.

AWS S3Data LakeData CatalogData Lineage

Airflow Platform Setup

Standing up production-grade Airflow — custom operators and plugins, DAG authoring standards, code-review conventions, and on-call runbooks that scale as teams grow.

Apache AirflowCustom OperatorsDAG StandardsPagerDuty SOPs

Custom Data Quality Server

Building in-house data quality services from scratch — automated checks that catch schema drift, null violations, and SLA breaches before they hit downstream consumers.

Flask API800+ checks/daySLA/SLOObservability

Data Warehouse Modeling

Designing dimensional models and star schemas built for fast, trustworthy BI — the layer between raw pipelines and the dashboards people actually make decisions from.

RedshiftSnowflakeDimensional ModelingSQL

AI Apps on Warehouse & Event Data

Building agentic AI applications with n8n and LangChain directly on top of warehouse and event-stream data — RAG assistants, natural-language query agents, and automation workflows.

n8nLangChainRAGEvent Data

Data Warehouse Migration

Moving traditional, on-prem data warehouses to modern cloud platforms — replatforming schemas, pipelines, and workloads with minimal downtime and validated parity.

RedshiftSnowflakeDatabricksBigQuery

1:1 / Group Data & AI Engineering Coaching

Mentoring engineers and small teams on data platform fundamentals and applied AI — architecture reviews, career guidance, and hands-on pairing, one-on-one or in groups.

MentoringArchitecture ReviewsCareer GuidanceTeam Training
// engagement

How an engagement runs

01 / Discover

Audit & scope

Review your current data platform, pipelines, and any existing AI workflows. Come out with a scoped, prioritised plan.

02 / Build

Design & implement

Hands-on delivery — platform architecture, Airflow setup, data quality server, warehouse models, or the n8n/LangChain agent itself.

03 / Handover

Document & support

Runbooks, DAG standards, and a short support window so your team can own and extend what's built.

// engagement models

Ways to work with me

Data & AI Consulting

Architecture reviews and hands-on build support across any of the five core areas — scoped as a fixed project or ongoing advisory.

Discuss a project →

Digital Presence Audit

A structured report on how your data/AI stack and technical presence hold up against current market standards, with a prioritised roadmap.

Request an audit →

Data Engineering Build

End-to-end delivery: pipelines, Airflow platform, data quality server, or warehouse migration — scoped and shipped.

Scope a build →
// teaching

Also on Udemy

I teach data engineering to a global student base alongside consulting work.

12+
years in data & AI engineering
60%
infrastructure cost reduction delivered
800+
automated data-quality checks / day
35%
query cost savings delivered
// proof

Selected work

Employer and client names withheld where engagements are proprietary — full context available on request.

Global gaming platform

Enterprise data lake consolidation

Unified BI, AI, and operational workloads onto a single governed AWS data lake, cutting infrastructure costs 60%.

Global gaming platform

In-house data quality server

Built a Flask-based data quality platform running 800+ automated checks a day across ingestion and transformation layers.

Global gaming platform

n8n + LangChain RAG assistant

Shipped a natural-language BI assistant over the warehouse using an agentic n8n workflow, LangChain, and a vector database.

Ride-hailing super-app

Centralised warehouse & Airflow platform

Built the data warehouse powering executive dashboards, plus an Airflow DAG generator framework to automate pipeline creation.

// background

Experience

JUL 2023 — PRESENT · PERTH
Senior Data Architect, Data & AI Engineering
Microgaming Asia
Architected an enterprise AWS data lake and led a production RAG-based BI Assistant. Manages a team of 5 data engineers.
DEC 2019 — JUN 2023 · SINGAPORE
Data Architect, Data & AI Engineering
Microgaming Asia
Re-engineered the on-prem Financial Data Warehouse onto Redshift; scaled the Airflow platform and trained 15+ engineers.
AUG 2017 — NOV 2019 · SINGAPORE
Data Engineer
Grab
Built the centralised Data Warehouse powering C-suite dashboards across ride-hailing, payments, food, and delivery.
JAN 2015 — JUL 2017 · MUMBAI
Data Engineer
WebEngage
Built the company's Data Warehouse from scratch on Redshift, maintaining 99.9% uptime across ETL, warehouse, and BI layers.
JAN 2014 — DEC 2014 · MUMBAI
Data Analyst
Freestone Infotech
Designed ETL pipelines generating credit scoring metrics from raw telco datasets on an EMR/Hadoop/Hive stack.
// let's talk

Start a conversation

Tell me a bit about what you're working on and I'll follow up within a couple of days.