Engineering case study Laser metal deposition

Inside the LMD
control system.

An experiment starts with a question. This system connects that question to the machine, the sensors and the results—with three AI agents guiding the workflow and a modular control layer handling the process.

About the images. The supervisory and calibration panels are offline demonstrations of the actual GUI, with example readings and states. The process-viewer capture below shows the path display and camera views separately. Click any screenshot to inspect it at full resolution.

Offline CASPAR/TICON control-panel demonstration: authority and health at left, machine and stand-off overview in the centre, manual controls at right.
Figure 01The supervisory control panel

The interface keeps machine context, measurement status and control authority visible together. The recording-fault indicator belongs to the non-running demo recorder; it is not a production fault report.

View full size

I built this system to connect the parts of laser metal deposition that an operator has to understand together: the machine, the deposited material, the sensor measurements and the next process decision.

Laser metal deposition (LMD) is a directed energy deposition process. A laser creates a melt pool while material is added along a programmed path. As the build grows, the distance to the surface, local geometry and process response change. The control software needs to interpret those changes in the context of the actual machine movement.

My work brings modelling, monitoring, simulation, toolpath development and control into one engineering workflow. A conversational layer helps the user prepare an experiment, approve its execution and review the results. Underneath it, modular sensor and machine interfaces make the architecture adaptable to different equipment.

01 / Interface

Give the operator a coherent view of the process.

The panel has three working areas. The left column shows operating authority and system health. The centre explains the current process state. The right rail keeps manual baselines and the selected automatic sources in view.

This arrangement answers practical questions: Is deposition happening? Which height measurement is being used? Is the data current? Is the software only observing, or is an adjustment allowed to reach the machine?

Left / Authority

Know what is enabled.

Observe, Assist and Active describe different levels of control. Health indicators expose missing sources and recording problems. A requested change must be applied explicitly.

Centre / Process

Read measurements in context.

Machine position, pass identity, stand-off, operating limits and source timing sit alongside each other. Raw values and accepted measurements have distinct roles.

Right / Action

See how a command is formed.

Manual baselines, automatic contributions, final factors and machine readback are shown separately. Source selection is visible rather than hidden inside an algorithm.

The stop request in the GUI is a supervisory action. Machine interlocks, motion authority and the safety-rated stopping function remain with the machine controller.

Put the toolpath and camera views beside each other.

The process viewer connects the programmed deposition path to the current machine position and the optical measurements. On the left, the G-code path and position marker sit over a spatial map of raw stand-off observations. On the right, the coaxial melt-pool view shows the deposition region, while the triangulation camera exposes the feature used to estimate nozzle-to-surface distance for height control.

Seeing these together helps an engineer relate a change in the camera image to a particular part of the path. The viewer is read-only: closing it does not interrupt acquisition or control.

Read-only CASPAR process viewer: G-code path, current position and raw stand-off map on the left; coaxial melt-pool image at top right and Height-T triangulation image at bottom right.
Figure 02The deposition path and two camera perspectives

Left: programmed path, position and raw diagnostic map. Top right: coaxial melt pool. Bottom right: triangulation feature and measurement overlay. This capture reports an unvalidated calibration; the displayed raw values are not qualified control measurements. Camera images in this viewer are live-only and are not recorded by the viewer.

View full size
02 / Guided experiments

Three AI agents, from experiment idea to analysis.

I built a three-agent workflow around experiments. The user can explain what they want to investigate, which physical systems are connected and why the experiment matters. The agents connect that conversation to preparation, approved execution and analysis.

  1. 01 / Describe

    Manager agent

    The user's conversational point of contact. The user describes the experiment, the connected equipment and the motivation. The Manager carries that context into preparation and receives the analysis report after the run.

  2. 02 / Confirm & run

    Operator agent

    Asks questions and requests explicit confirmations before taking over. With the user's approval, it coordinates the required checks, machine and software startup, and data recording for the agreed experiment.

  3. 03 / Review

    Analysis agent

    After the experiment is stopped, it analyses the recorded data and prepares a report for the Manager. The user can then discuss the results through the same conversation that began the experiment.

Experiment intent → questions and approval → execution → analysis → back to the Manager.

Make the procedure accessible to someone new to the setup.

The aim is to reduce how much specialist software knowledge a user needs before conducting an experiment. Someone learning the equipment can describe a goal and be guided through the missing details, instead of already knowing every sensor interface, launch command and analysis script.

The agents coordinate the experiment; the supervisory controller still governs which machine actions are available. User approval does not bypass calibration, commissioning limits or machine interlocks. Physical preparation and operation still require the appropriate equipment training.

03 / Inputs

Different sensors. A shared process context.

I chose Robot Operating System 2 (ROS 2) as the integration layer so that people could develop sensors, algorithms and machine interfaces independently. Each component publishes a defined message. The rest of the system can consume that message without taking over the component's internal implementation.

The central engineering problem is alignment. Cameras and machine interfaces update at different times. The backend uses timestamped machine history to associate an optical measurement with the relevant position and pass. It also tracks uncertainty, so a delayed or ambiguous sample does not silently become a precise point on a process map.

Inputs in the supervisory architecture
InputWhat it contributesHow it is used
Machine statePosition, feed, laser and powder state, overrides and connection health.OPC UA provides the machine context needed to interpret camera measurements.
Height-TA triangulation-camera measurement of nozzle-to-surface stand-off.Calibration, feature checks and timing determine whether a measurement can inform control.
Height-CAn alternative height-measurement input.Designed as a selected fallback source; it is not averaged with Height-T.
Melt-pool cameraProcess presence, image features and a live view of the deposition region.Feedback for managing heat input and maintaining a stable melt pool through laser-power, travel-speed and powder-feed adjustments.
Toolpath & passA read-only copy of the planned path and the current deposition pass.Measurements are associated with position, path segments and layers for spatial review.
Operator & jobMode, manual baselines, enabled sources, calibration and operating limits.The selected job provides the context and limits for interpreting data and proposing changes.

A connected sensor still needs calibration, units, timing information and a valid operating range. This is what makes modular integration useful in practice: every module has an explicit responsibility, including how it reports missing or unreliable data.

04 / Measurement

Make the measurement explainable before using it for control.

Height-T estimates stand-off from a camera view. The setup workflow connects image coordinates to physical references and makes the assumptions visible to the person commissioning the sensor.

The operator establishes the physical reference, waits for the measurement to settle, then captures a short numeric window. Approved reference windows can be reviewed and saved in a calibration receipt. The software does not choose or verify the physical reference on the operator's behalf.

Offline Height-T setup showing reference capture, approval controls, calibration-fit preview and a missing-receipt warning.
Figure 03Reference capture and calibration receipts

A guided sequence makes the physical reference, captured values and operator approval explicit. The example has no approved receipt and is not ready for Active operation.

View full size

Keep image-processing choices visible.

The engineering panel exposes thresholding, morphology, image geometry, the nozzle-axis corridor and the measurement strip. These settings define where the detector looks and what kind of feature it accepts.

This matters when illumination, reflections or deposition geometry change. A numerical output can look plausible even when the detector is following the wrong feature. The setup makes it possible to inspect the measurement logic alongside the camera image.

Preserve the reasons a sample was rejected.

Feature limits and diagnostics help distinguish an accepted measurement from an optical disturbance. The interface exposes checks for image clipping, bright regions, competing peaks and feature shape, with an optional diagnostic overlay.

The software also considers freshness and abrupt changes. Raw observations remain useful for investigation even when they are unsuitable for automatic correction. Keeping both the value and its validity state is essential for understanding a run afterwards.

05 / Decisions

A control architecture with explicit authority.

The architecture separates measurement, interpretation, proposed action and the final machine-facing command. That separation makes it possible to follow a control decision from the sensor data to the adjustment sent to the machine.

  1. 01

    Acquire

    Machine, cameras and operator inputs

  2. 02

    Align

    Time, position and deposition pass

  3. 03

    Qualify

    Freshness, calibration and validity

  4. 04

    Propose

    Bounded process adjustments

  5. 05

    Apply & record

    Permitted commands, readback and history

Three timescales for three different problems.

Immediate stand-off correction. The fast control path calculates a bounded speed adjustment from accepted height data and a configured operating envelope. Hysteresis and rate limits constrain its response. Stale or rejected measurements remove automatic authority rather than leaving an old correction in charge.

Memory of the previous pass. The spatial path associates measurements with regions of the build. Its purpose is to prepare a correction when the nozzle revisits a region on a later pass. Uncertain pass identity or alignment prevents that map from silently influencing control.

Slower powder adaptation. Powder transport has a delay. The supervisory design therefore separates the requested setting, machine readback and estimated material arrival. Its decisions use longer evidence windows instead of reacting to every camera sample.

Keep the melt pool stable throughout the build.

Melt-pool feedback helps manage heat input and temperature as deposition progresses. The aim is a pool with a consistent size, shape and behaviour along the toolpath. Camera measurements describe how the pool is changing and guide adjustments to laser power, travel speed or powder feed. These variables influence the balance between energy input and added material, so the controller coordinates their response within the selected process limits.

Observe

Acquire, interpret and record. No machine writes. Use it to inspect signals, timing and proposed responses.

Assist

Permit deliberate operator baseline adjustments through the guarded command path, within the configured process limits.

Active

Selected automatic contributions can influence permitted actuators only after their measurement and machine interface have been qualified.

A single regulation layer combines the allowed contributions. Commands carry identity, expiry and bounds, and the interface checks readback. ROS 2 coordinates this supervisory layer; the CNC or robot controller continues to execute motion and enforce the machine's own interlocks.

06 / Transfer

Reuse the architecture. Engineer the machine connection.

My control-system work began on a three-axis CNC LMD machine and was then adapted for a KUKA robot and the wide-track BreitbahnDED machine. That work spans Exafuse and the ZESS research environment at Ruhr University Bochum.

The transferable part is the structure: sensor messages, measurement interpretation, control proposals, operator views and build records. Machine adapters translate equipment-specific signals into that common structure. Job profiles supply the relevant calibration, timing and operating limits.

A new machine still needs its own engineering work. I need to establish which interfaces are available, what the signals actually mean, how quickly they update and how a permitted command changes the process. Different sensors can then be introduced through the same message contracts, with their own calibration and validity checks.

Shared across the system

Sensor contracts · timestamps · validity states · control structure · operator workflow · run identity

Established for each machine

Interfaces · coordinate conventions · timing · calibration · actuator response · process limits · commissioning

07 / Traceability

Keep the data that explains the decision.

A live dashboard answers what is happening now. An engineering record must also explain what happened, which configuration was in use and why a particular action was proposed or rejected.

The data architecture separates the live control path from operator views and storage. Local history and ROS recording retain measurements, state and decisions. A run package brings these together with the relevant toolpath, effective settings and logs. A saved hash inventory lets the recorded files be checked for later changes.

In parallel, asynchronous telemetry passes through RabbitMQ into InfluxDB for Grafana dashboards and comparison. Storage and dashboard updates are kept outside the control callback path. Simulation and production records carry distinct identifiers.

At company level, the operations software I developed connects quotations, costing, scheduling and manufacturing records. Each order has a print ID linking planning, production monitoring and quality documentation. That wider workflow gives the control-system record a place in the history of the part.

Monitoring supports process investigation and quality review. Final part acceptance still depends on the required inspection, testing and engineering judgement.

08 / Research into use

Build, test and extend the system in stages.

The wider research includes heat-transfer and deposition simulation, physics-informed bead models, parameter studies and experimental comparison. These tools help me investigate process behaviour before machine trials.

The runtime simulator serves a different purpose: exercising interfaces, sensor faults, delays and controller behaviour in a controlled environment. It is not a validated prediction of the physical process. Likewise, the supervisory system reads an existing toolpath for context; toolpath development is a separate part of my engineering work.

This distinction is useful during development. A software interface test, a successful monitoring run and a physical closed-loop trial answer different questions. Each provides evidence for the next stage.

My contribution

I led the system architecture and development, the selection and interpretation of sensor data, and the integration of machine interfaces, software and manufacturing workflows. I also coordinated contributors working on sensors and algorithms. This work forms part of my doctoral research and my R&D role at Exafuse.

For the 2024 Duisburg bridge components, my responsibility covered process monitoring and control that enabled unattended builds, together with the project schedule. The planning, monitoring and control methods from that work informed later projects. The broader goal is an operator workflow that carries the process knowledge in the system, while keeping its measurements and decisions open to inspection.