Applied AI case studies

Autonomous systems that keep track of what they know... and what they do not.

Two compact examples of uncertainty-aware AI in action: a household world model that revises its plan as evidence changes and an embodied drone controller that acts from internal beliefs rather than privileged simulator truth.

Case study 01 · World models

Completing a task when the world is only partly known.

A rigid task script assumes that the right object is where expected and that each prerequisite is already known. The tea-making agent instead maintains explicit beliefs about objects and hidden task states, then changes its behaviour as evidence accumulates.

Autonomous task execution under incomplete information

Search, infer, act, verify.

The system must find a mug, kettle and teabag, reason about hidden task state such as whether the kettle contains water and execute a dependency-aware sequence of actions. Its search decisions combine semantic priors, information gain, task relevance and travel cost.

The plan is not merely made robust to uncertainty. Uncertainty is represented explicitly and changes the plan.
The problem

Long-horizon tasks become brittle when assumptions are hidden.

An autonomous agent may know the overall task but not the location or state of the objects needed to complete it. A fixed sequence can fail as soon as one assumption is wrong.

The architecture

Separate beliefs, observations, task dependencies and actions.

The system maintains independent location beliefs for multiple objects, probabilistic beliefs over hidden task states, a directed task graph and an expected-free-energy-style search policy. Simulator truth remains separate from the agent's internal beliefs.

What uncertainty changes

Absence becomes evidence.

If an object is not found where expected, probability is redistributed across the remaining candidate locations. If a hidden task state is already satisfied, the corresponding action can be skipped. Evidence therefore changes both search and task execution.

Where this could apply

Any system that must search, inspect and act in a changing environment.

The current implementation is a research prototype, but the architectural pattern is relevant wherever a system must maintain explicit hypotheses, gather missing information and update a multi-step plan.

Warehouse picking Industrial inspection Lab automation Service robotics Autonomous sampling Smart environments
Case study 02 · Embodied AI

Control when perception is uncertain and viewpoint matters.

An embodied system never sees the world from nowhere. Its observations depend on position, motion, occlusion and sensing limits. The drone prototype explores a controller that maintains internal beliefs, predicts possible futures and balances multiple concurrent demands during action.

Embodied control under partial observability

Belief, not ground-truth control.

The controller operates in a 3D PyBullet environment using noisy self-observations, target cues and obstacle sensing. Candidate actions are rolled forward through an internal dynamics model and evaluated against goal, safety, information-seeking, efficiency and memory-related pressures.

The controller acts on what it currently believes to be true — not on the hidden state available to the simulator.
The problem

Real autonomous systems act with incomplete state information.

A moving platform must continue to regulate itself while observations are noisy, obstacles are only partly observed and task-relevant information may disappear through occlusion or viewpoint change.

The architecture

Internal state + prospective action evaluation.

The prototype combines a belief state over pose, velocity, occupancy and uncertainty with a learned transition model, short-horizon policy rollouts and a multi-term objective that makes competing control pressures explicit.

What uncertainty changes

Information itself becomes part of control.

Candidate trajectories are not evaluated only by whether they move toward a target. They are also shaped by obstacle risk, uncertain regions, novelty and the need to preserve coherent behaviour as the system's beliefs evolve.

Where this could apply

Autonomy in environments where sensing and action are tightly coupled.

The current work remains simulation-based, but the architecture targets the class of problems where an autonomous platform must reason about uncertainty while remaining continuously engaged with the environment.

Drone inspection Mobile robotics Remote autonomy Agricultural robotics Search and rescue Physical AI R&D
What connects the two

The commercial theme is not “active inference”. It is adaptive systems under uncertainty.

Active inference, generative modelling and polyphonic control are technical ingredients. The practical value is in making hidden assumptions explicit, allowing uncertainty to influence behaviour and producing systems whose decisions can be interrogated when something goes wrong.

Belief-based autonomy

Represent hidden state explicitly

Keep an internal model of what is likely, what is uncertain and what evidence would change the current hypothesis.

Active information gathering

Choose actions partly for what they reveal

In uncertain settings, the best next action may be the one that improves the system's state estimate before committing further.

Inspectable decision logic

Expose why the system acted

Separate beliefs, task state, candidate policies and competing pressures so debugging and counterfactual analysis remain possible.

Consulting and collaboration

Have a system that behaves badly when the world becomes uncertain?

I work on early-stage R&D, technical architecture, modelling and prototypes for autonomous systems, world models and decision problems where hidden state, partial observability or competing objectives matter.

The strongest fit is a technically difficult problem where a principled model or prototype can de-risk a larger engineering programme.