Workflow activity monitoring using dynamics of pair-wise qualitative spatial relations

Ardhendu Behera, Anthony Cohn, David Hogg

Research output: Contribution to conferencePaperpeer-review

12 Citations (Scopus)


We present a method for real-time monitoring of workflows in a constrained environment. The monitoring system should not only be able to recognise the current step but also provide instructions about the possible next steps in an ongoing workflow. In this paper, we address this issue by using a robust approach (HMM-pLSA) which relies on a Hidden Markov Model (HMM) and generative model such as probabilistic Latent Semantic Analysis (pLSA). The proposed method exploits the dynamics of the qualitative spatial relation between pairs of objects involved in a workflow. The novel view-invariant relational feature is based on distance and its rate of change in 3D space. The multiple pair-wise relational features are represented in a multi-dimensional relational state space using an HMM. The workflow monitoring task is inferred from the relational state space using pLSA on datasets, which consist of workflow activities such as ‘hammering nails’ and ‘driving screws’. The proposed approach is evaluated for both ‘off-line’ (complete observation) and ‘on-line’ (partial observation). The evaluation of the novel approach justifies the robustness of the technique in overcoming issues of noise evolving from object tracking and occlusions
Original languageEnglish
Publication statusPublished - 4 Jan 2012
Event18th International Conference, MultiMedia Modeling (MMM) 2012 - Klagenfurt, Austria
Duration: 4 Jan 20126 Jan 2012


Conference18th International Conference, MultiMedia Modeling (MMM) 2012


Dive into the research topics of 'Workflow activity monitoring using dynamics of pair-wise qualitative spatial relations'. Together they form a unique fingerprint.

Cite this