Hi, I'm

Ernest Paul

I work on  

Machine Learning Engineer & independent researcher building reinforcement‑learning agents, motion & pose foundation models, and vision systems — currently exploring language‑guided RL and large‑scale mocap pretraining.

Get to know

About Me

Ernest Paul
Based in Sri Lanka

I'm an ML Engineer focused on building production‑grade ML and AI systems that solve real‑world problems.

Currently at Home of Performance (HOP), I design and build LLM‑based systems and agentic workflows for clients, from architecture through deployment.

My research background spans reinforcement learning, power grid control, LLMs & SLMs, motion capture, and game AI — I enjoy working across both ends, from research to production.

Open to freelance & research collaborations
20+ Research & ML Projects
5 Core Domains
B.IT Honours Degree

What I work on

Research & Expertise

Reinforcement Learning

Hierarchical & meta multi‑agent RL, PPO / SAC / A2C baselines, and AlphaZero‑style MCTS agents applied to power‑grid topology control (L2RPN) and physics‑driven combat environments.

Multi-Agent RL MCTS L2RPN Dreamer World Model Meta RL Simulations

Motion & Pose Models

GPT‑ and Mamba‑style sequence models pretrained on large‑scale mocap data for human motion generation and prediction.

Mamba / SSM Mocap GPT SMPL-X IoT

Computer Vision

Vision Transformers for multi‑cancer & lung‑cancer classification, segmentation for autonomous driving, and skull‑stripping pipelines.

ViT Medical Imaging YOLO U-Net

LLMs & Agents

Small‑LM coding agents, DSPy‑powered synthetic data generation, and low‑resource language modelling for Tamil.

DSPy Agents Ollama

Power Grid AI

Graph neural networks, neural‑guided A* search and hierarchical/meta RL for grid topology optimization and congestion management on the L2RPN benchmark.

GNNs A* Search Grid2Op

Selected work

Featured Projects

Motion Foundation Model

Leonidas

Foundation model for human motion, pretrained on large‑scale mocap data spanning sports, combat, and tactical movement.

Mocap Transformers Foundation Model
Sequence Model

GPSM‑1

Generative Pre‑trained State Machine trained on large‑scale mocap data to predict and generate human motion.

MambaSSM
Multi-Agent RL

H‑MARL4PowerGridTopo

Hierarchical multi‑agent reinforcement learning for power grid topology control on the L2RPN benchmark.

GNNHRL
Search + RL

AlphaGrid

AlphaZero‑based topology optimization agent for power grid congestion management using Monte Carlo Tree Search.

MCTSAlphaZero
Search Algorithms

GridStar

Neural‑guided A* search for power grid topology optimization.

A* SearchGrid2Op
LLM Agent

Nanocode

Claude Code‑inspired coding agent powered by small language models instead of large LLMs.

Small LMsAgents
LLM Research

project‑koperundevi

A study of Large Language Models for the Tamil language — exploring low‑resource language modelling.

NLPLow-Resource
Data Tooling

Synthetic‑Data‑Generator

A unified tool to generate synthetic text and sensor data using LLMs with the help of DSPy.

DSPySynthetic Data
Computer Vision

MulticancerViT

Vision Transformer architecture for multi‑cancer image classification.

ViTMedical Imaging
Reinforcement Learning

KAN‑Agents

Deep reinforcement learning agents built with Kolmogorov–Arnold Networks (KAN).

KANDeep RL

Toolbox

Skills & Stack

Languages

Python C++ C C# Java HTML & CSS

ML / DL Frameworks

PyTorch TensorFlow scikit-learn NumPy Pandas MLOps MLflow

RL & Simulation

Grid2Op / L2RPN PyBullet OpenAI Gym MCTS Baseline Agents World Models Dreamer

Vision & Generative

OpenCV Vision Transformers GANs Diffusion

LLM Tooling

DSPy Hugging Face Ollama OpenAI API LLMOps AWS Bedrock RAG Agentic AI MCP

Infra & Tools

Docker Git REST APIs AWS GCP Pulumi

Get in touch

Let's build something

Open to research collaborations, ML engineering roles, and interesting problems in reinforcement learning or computer vision. Reach out.