completed Project
Human Validation of Computer-Driven Action Segmentation
Human action is composed of chunks that are smoothly joined to form a continuous signal. Correspondingly, human observers as well as computers can decompose (segment) actions into characteristic phases. However, it remains unclear whether or not these phases are representative and relevant for action processing in the brain. To address this problem, we seek to quantify action phases asking whether purely data-driven action segmentation by computers is convergent with signatures of natural action segmentation as measured by human brain responses (fMRI) and behavior.
Thus, the common aim of this work is to arrive at an objective description of actions, and to biologically validate this approach to the characterization of human object manipulations.
This project gets funded by the German Research Foundation (SCHU1439-8-1)
References
Schubotz, R. I., Korb, F. M., Schiffer, A.-M., Stadler, W. & von Cramon, D. Y. (2012). The fraction of an action is more than a movement: Neural signatures of event segmentation in fMRI. NeuroImage, 61(4), 1195-1205.
Wörgötter, F., Aksoy, E. E.., Krüger, N., Piater, J., Ude, A. & Tamosiunaite, M. (2013). A simple ontology of manipulation actions based on hand-object relations. IEEE Transactions on Autonomous Mental Development, 5(2), 117-134.
Publications
Pomp, J., Wurm, M.F., Selvan, R.N., Wörgötter, F., Schubotz, R.I. (2025) Touching-Untouching Patterns Organize Action Representation in the Inferior Parietal Cortex. in press
Pomp, J., Garlichs, A., Kulvicius, T., Tamosiunaite, M., Wurm, M., Zahedi, A., Wörgötter, F., Schubotz, R.I. (2024). Action segmentation in the brain: the role of object-action associations. JOCN-2023-0320.R2
Heins, N., Pomp, J., Kluger, D.S., Vinbrüx, S., Trempler, I., Kohler, A., Kornysheva, K., Zentgraf, K., Raab, M., Schubotz, R.I. (2021) Surmising synchrony of sound and sight: Factors explaining variance of audiovisual integration in hurdling, tap dancing and drumming. PLoS ONE 16(7): e0253130
Pomp, J., Heins, N., Trempler, I., Kulvicius, T., Tamosiunaite, M., Mecklenbrauck, F., Wurm, M.F., Wörgötter, F., Schubotz, R.I. (2021) Touching events predict human action segmentation in brain and behavior. NeuroImage, 243 (2021) 118534, doi.org/10.1016/j.neuroimage.2021.118534
Ziaeetabar, F., Pomp, J., Pfeiffer, S., Schubotz, R.I., Tamosiunaite, M., Wörgötter, F. (2020). Using enriched Semantic Event Chains to model human action prediction based on (minimal) spatial information. PLOS One.
Heins, N., Pomp, J., Kluger, D.S., Trempler, I., Zentgraf, K., Raab, M., Schubotz, R.I. (2020) Incidental or intentional? Different brain responses to one's own action sounds in hurdling vs. tap dancing. Frontiers in Neuroscience,14:483, doi: 10.3389/fnins.2020.00483
Hosang, T. J., Fischer, R., Pomp, J., & Liepelt, R. (2018). Dual-Tasking in the Near-Hand Space: Effects of Stimulus-Hand Proximity on Between-Task Shifts in the Psychological Refractory Period Paradigm. Frontiers in psychology, 9.
Pomp, J., Bestgen, A. K., Schulze, P., Müller, C. J., Citron, F. M. M., Suchan, B., & Kuchinke, L. (2018). Lexical olfaction recruits olfactory orbitofrontal cortex in metaphorical and literal contexts. Brain and Language, 179, 11-21.
Pomp, J. (2013). Processing of Metaphors in the Context of Bilingualism (Bachelor's Thesis).
Conference Contributions
Pomp, J., Tamosiunaite, M., Wörgötter, F., Schubotz, R. I. (2020). Humans exploit movements rather than endpoints in action segmentation: a computer vision model test. Abstracts of the 26th Annual Meeting of the Orgnaization for Human Brain Mapping, p. 128.
Pomp, J., Fischer, R., & Liepelt, R. (2016, June). Effects of stimulus-hand proximity on response crosstalk in multitasking. Poster at the Meeting for the DFG Priority Program SPP 1772 (Human performance under multiple cognitive task requirements: From basic mechanisms to optimized task scheduling). Aachen, Germany.
Pomp, J., Fischer, R., & Liepelt, R. (2016, March). Does stimulus-hand proximity affect multitasking performance? Poster at the 58. Tagung experimentell arbeitender Psychologen (TeaP). Heidelberg, Germany.
Pomp, J., Fischer, R., & Liepelt, R. (2015, October). Embodied Cognition in Multitasking: Stimulus-hand proximity and cognitive control in dual-task performance. Talk at the Kickoff Meeting for the DFG Priority Program SPP 1772 (Human performance under multiple cognitive task requirements: From basic mechanisms to optimized task scheduling). Freiburg, Germany.