Physical AI · Perception · Real-time systems

Research depth,operational impact.

I build perception and ML systems that connect research with working applications: grounding objects in 3D, evaluating robot policies, searching visual data, and making inference practical under latency and memory constraints.

01 / Selected work

Perception, learning and deployment

From a model to a working system.

Independent implementations and adaptations spanning physical AI and ML engineering, alongside research and real-hardware work.

Perception · Completed

Text-Guided RGB-D Object Localization

Combined pretrained detection and segmentation with depth filtering and calibrated camera-to-workspace transforms to locate named tabletop objects and estimate their dimensions.

Approx. 85–95% object-finding success · 5–15 mm position error · a few hundred milliseconds per query.

Inference · Completed

Compact Vision Inference Service

Exported a PyTorch vision model to ONNX and served it through a containerised API. Benchmarked prediction agreement, memory and end-to-end latency under concurrent requests.

INT8: approx. 4× smaller model · hardware-dependent 1.5–3× CPU speedups · under one percentage point of accuracy loss.

Data quality · Completed

Robot Demonstration Quality Inspector

Linked robot video with state and action traces to flag frozen frames, timestamp gaps and action discontinuities, then export reviewed training subsets.

Detected nearly 100% of frozen frames and timestamp gaps; approx. 70–90% of jerky or idle segments.

Multimodal retrieval · Completed

Semantic Search over Robot Videos

Built natural-language search with visual embeddings, vector indexing, timestamped clip retrieval and duplicate suppression.

Approx. 60–80% Recall@5 on visible-state queries, with millisecond-scale search. Failure-event queries remain harder.

Robot learning · Completed

Visual Pushing Policy and Robustness

Reproduced and adapted an image-conditioned Diffusion Policy for PushT. Evaluated visual augmentation and action-execution horizons through controlled simulation rollouts.

Approx. PushT score of 0.85–0.90. Augmentation partially recovered the performance lost under background changes.

Document retrieval · Completed

Visual Retrieval for Engineering Manuals

Built visual retrieval over engineering manuals and datasheets, returning source-linked pages for questions about diagrams and tables.

Page-level visual retrieval · source-linked answers · diagram and table queries.

Research and robotics

Experiments, evaluation and hardware.

Edge vision / URECAPresented · IEEE ICIEA 2026

FPGA-Accelerated Edge Vision

Built and deployed PCB-defect classification and ADAS detection on a Xilinx ZCU104, including a custom Verilog 3×3 convolution accelerator, INT8 quantisation, and confidence recalibration.

3.3× faster than onboard ARM6.3× lower energy / image85.3% accuracy44.6% mAP@0.5
Deployment relevance: measured accuracy, latency, recall, and energy together rather than optimising an offline metric in isolation.
Detector output with labelled people on a baseball field
ADAS detection outputPublic inference result · GitHub
Precision, recall, F1 score, and accuracy plotted across defect classification thresholds
Threshold selection under deployment trade-offsPublic evaluation artifact · GitHub
3D perception / URECAResearch in progress

Gaussian Occupancy & Selective Scene Updates

Implemented voxelised LiDAR initialisation for Gaussian semantic occupancy and a mask-aware evaluator reporting per-class IoU, GPU latency and peak memory. I am designing confidence-gated temporal updates to reuse reliable geometry and prioritise uncertain or changed regions, with the aim of reducing recomputation while preserving accuracy. Research target: ICCV 2027.

LiDAR initialiser implementedOccupancy evaluator builtTemporal updates in design
Deployment relevance: the research asks when a scene model needs to be recomputed, balancing occupancy accuracy against latency and memory.
Method sketch: LiDAR-initialised Gaussian scene representation A LiDAR sweep produces points, which are quantised into fixed-size anchors, which seed 3D Gaussians that predict occupancy for driving, drones and indoor robots. LIDAR SWEEP direct geometry FIXED-SIZE ANCHORS replace ray-cast init 3D GAUSSIANS → occupancy DRIVING · DRONES · INDOOR ROBOTS
Geometry before appearanceMethod sketch: LiDAR points become fixed-size anchors that seed the 3D Gaussians. Schematic, not a result.
Diagram · Gaussian occupancy
Robotics systemsCurrent internship

Robot Learning, Retargeting & Real-Hardware Infrastructure

Deployed and evaluated VLA and imitation-learning policies including π0.5, GR00T N1, ACT and Diffusion Policy across UR5/UR5e, Unitree G1 and RoboParty V1. Built ROS 2 and MoveIt 2 Servo integrations, RGB-D calibration and trajectory-auditing tools, plus Docker-based Isaac Sim/Isaac Lab workflows with a shared simulation and hardware control path.

VLA / ACT / Diffusion PolicyPPO and retargetingIsaac Lab / MuJoCoROS 2
Deployment relevance: turns learned motion into a safer, testable path from simulation and demonstrations to real hardware.
Several simulated Unitree G1 humanoids carrying boxes during parallel policy training
Retargeted motion, trained at scaleUnitree G1 box-carry policy training in simulation, reproducing the open-source HoloSoMa box-carry task. Simulation only.
Simulation · Isaac
Robot safety / Runtime guardrailImplemented guardrail · predictor planned

Task-Aware Joint-Space Safety Envelope

Built a task-specific safety layer from recorded successful trajectories. It validates requested motion against the observed joint-angle and joint-speed space, rejects commands outside that envelope, terminates the run, and returns an explicit diagnostic. Next direction: predict commanded trajectories from current joint positions and velocities so the system can flag gripper-to-body impacts at damaging speeds before execution.

Task-conditionedJoint positionJoint velocityFail-fast diagnostics
Deployment relevance: adds an independent, inspectable boundary between a learned policy and physical hardware without requiring the task policy itself to be retrained.
Schematic of the task-aware joint-space safety envelope Recorded successful trajectories define an accepted region of joint angle and joint speed. A command inside the region is accepted; a command that leaves it is rejected, the run stops and a diagnostic is returned. JOINT ANGLE JOINT SPEED ACCEPTED OUT OF ENVELOPE stop run · return diagnostic ENVELOPE FROM SUCCESSFUL RUNS
Inside the envelope, or stopHow the check works: commands that stay inside the space of successful runs pass; anything that leaves it ends the run with a diagnostic. Illustrative, not recorded data.
Diagram · Schematic
02 / Experience

Technical depth + commercial context

Research, deployment, and product judgement.

My technical work is complemented by business-development and product experience, which shapes how I evaluate usefulness, adoption, and scale.

Physical AI & ML Research Intern · Panasonic R&D Singapore

VLA and imitation-learning integration, PPO, motion retargeting, RGB-D perception, and simulation-to-hardware evaluation. Cross-validated Isaac PhysX and MuJoCo models against real torque measurements. Developing geometry-conditioned ACT for in-hand reorientation; manuscript in preparation for IROS 2027 with NTU MARS Lab.

Undergraduate Researcher · NTU EEE

Implemented LiDAR initialisation and occupancy-evaluation tooling under Prof. Tay Wee Peng, working with Dr. Loo Junn Yong. Designing confidence-gated temporal updates for efficient Gaussian occupancy; targeting ICCV 2027.

Business Development · MLDA@EEE

Industry partnerships and applied-AI initiatives with NVIDIA, Micron, and collaborators.

Product Owner & Go-to-Market · Golden Horizon

Led an AI analytics product, built event-to-price data pipelines, and analysed 20+ competitors to shape positioning and execution.

Undergraduate Researcher · NTU EEE

Deployment-aware edge-vision research with Dr. Loo Xi Sung, culminating in the IEEE ICIEA 2026 paper below.

03 / Skills & resumes

Methods and engineering

Tools I use to build and evaluate.

3D perception
RGB-D / LiDAR, Gaussian occupancy, ICP registration, camera calibration, DINOv2 features
Robot learning
Behaviour cloning, ACT, Diffusion Policy, PPO, VLA integration (π0.5, GR00T N1)
ML and inference
PyTorch, TensorFlow, scikit-learn, ONNX export, INT8 post-training quantisation, latency / memory benchmarking
Robotics and simulation
ROS 2, MoveIt 2 Servo, Isaac Sim, Isaac Lab, MuJoCo, simulation / hardware validation
Multimodal retrieval
Visual embeddings, semantic search, vector indexing, LangChain, retrieval-augmented generation
Engineering and data
Python, C/C++, SQL, NumPy, pandas, Docker, Linux, Git, REST APIs
04 / Publication

IEEE ICIEA 2026 · Catania, Italy

Deployment constraints are part of the research problem.

2026

FPGA-Accelerated Edge Vision: PCB Defect Detection and ADAS Object Detection on Xilinx ZCU104

Completed through URECA, the work covers classification, detection, custom hardware acceleration, quantisation, and confidence recalibration under measured performance and energy constraints.

A. Prakash and X. S. Loo · Presented at the 21st IEEE Conference on Industrial Electronics and Applications.
05 / How I think

Technical work with a reason to exist

The research question and the deployment question belong together.

I am interested in model capability, but also in what determines whether that capability becomes reliable, economical, and valuable in a real operation.

Perception

Give the system a grounded model of the world.

Better geometry and persistent state reduce ambiguity for planning, safety, and manipulation, which also reduces the cost of failures caused by incomplete scene understanding.

Efficiency

Treat latency and compute as design inputs.

Batching, routing, selective computation, and memory-aware execution are what make larger models practical under real response-time and hardware constraints.

Operations

Measure the fleet, not only the demo.

Robot utilisation, idle time, failure recovery, and the usefulness of generated data determine whether a technically capable system delivers value at scale.

06 / Responsible AI practice

Augment judgement, preserve accountability

I use AI to challenge my work, not as a single source of truth.

I care a lot about using AI intelligently and responsibly. I use complementary agents, durable project context, explicit verification, and scheduled experiment monitoring because moving faster only matters if the work still holds up.

01

Different agents, different strengths

I use Codex and Claude for different parts of a problem, then get them to challenge and cross-check each other's work instead of trusting whichever answer arrives first.

02

Evidence before acceptance

I check claims against source files, logs, experiment results, and reproducible tests. If two agents disagree, I want that disagreement surfaced rather than quietly smoothed over.

03

Context that survives the session

I keep structured project records, handoffs, and status files so decisions don't disappear when a chat ends, which really matters when research runs across weeks or months.

04

Research that keeps moving

I pair long-running RL training with scheduled agent check-ins that inspect progress, flag failures, and preserve results outside working hours, including weekends, while bringing decisions that need a person back to me.

07 / Current agenda

Systems built and in development

Three layers of dependable physical AI.

This agenda combines an implemented runtime guardrail with active work on policy robustness, richer safety prediction, and the orchestration needed for large deployments.

01
Research direction · Baselines pending

Generalised RL policies with efficient large-model inference

Developing a simulation-first research direction around terrain, texture and lighting variation, with planned study of batching and serving under latency and compute constraints. Implementation baselines and performance results remain pending.

Concept: one generalised policy served efficiently Many simulated environments with different terrain, textures and lighting train one policy, which is served with batched inference. ONEPOLICY VARIED SIMULATION terrain · texture · light GENERALISED fewer retrains BATCHED SERVING latency + compute budget
Concept diagram · many environments, one policy
02
Implemented guardrail · learned predictor planned

Task-aware joint-space safety envelope

An implemented runtime layer derives an accepted joint-angle and joint-speed envelope from successful task trajectories, rejects motion outside that observed space, stops the run, and returns a clear diagnostic. The next direction predicts requested trajectories from the robot's current joint state to identify damaging gripper-to-body impacts before execution.

Sketch of a humanoid robot carrying an object through a home while anticipating the paths of a person, a child and a dog
Concept illustration · predicting motion before acting
03
Systems concept · Foreman, in design

Make robot activity legible and useful at fleet scale

Foreman is my design for an orchestration layer that is installed into a site that already runs robots. It discovers and onboards them with operator approval, assigns missions across mixed fleets of robots and people, tracks progress, and recovers from operational exceptions. The plan and repository scaffold are done; robot integration is next.

Sketch of a mobile robot, a robot arm and a humanoid coordinated by a shared orchestration layer in a workshop
Concept illustration · one layer coordinating a mixed fleet