The NEUROGES® Analysis System for Nonverbal Behavior and Gesture
The Complete Research Coding Manual including an Interactive Video Learning Tool and Coding Template
Summary
Following up on the first book on theoretical background of the NEUROGES® system, which was published in 2013, this book contains the complete coding manual for the application of the system in research including an interactive video learning tool with video examples of all NEUROGES® hand movement and gesture types, training videos, and a template file for the Multimedia Annotator ELAN.
Excerpt
Table Of Contents
- Cover
- Title Page
- Copyright Page
- Dedication
- Preface
- Contents
- About the Author
- About the book
- Citability of the eBook
- 1 How to use the system in research
- 1.1 Complete algorithmic analysis
- 1.2 Algorithmic analysis of one module
- 1.3 The analysis of one category
- 1.4 Objectivity of the NEUROGES® values
- 1.5 Reliability of the NEUROGES® values
- 1.6 Validity of the NEUROGES® values
- 1.7 Occurrence, frequency, and duration of the NEUROGES® values
- 1.8 How to use the coding manual
- 1.9 How to use the interactive video learning tool, the NEUROGES® template file for the multimedia annotation ELAN, and the annotated NEUROGES® training videos
- 1.10 How to acquire the NEUROGES® certificate
- 2 Parts of the body submitted to the analysis
- 2.1 Upper limbs
- 2.2 Lower limbs
- 2.3 Head
- 2.4 Trunk
- 3 The Activation category
- 3.1 Definition of the Activation category
- 3.2 Data submitted to the Activation assessment
- 3.3 Criteria for the definition of the Activation values
- 3.4 Definitions of the Activation values
- 3.4.1 movement
- 3.4.2 rest/pose
- 3.5 Procedure for Step 1 / Module I in NEUROGES® –ELAN
- 4 The Structure category
- 4.1 Definition of the Structure category
- 4.2 Generation of the ‘to-be-coded’ Structure and R/PStructure units
- 4.2.1 Generation and assessment of to-be-coded Structure and R/PStructureunits
- 4.2.2 Alternative generation of ‘to-be-coded’ Structure and R/PStructure units
- 4.3 Criteria for the definition of the Structure values
- 4.4 Definitions of the Structure and R/PStructure values
- 4.4.1 irregular
- 4.4.2 repetitive
- 4.4.3 phasic
- 4.4.4 shift
- 4.4.5 aborted
- 4.4.6 r/p rest
- 4.4.7 r/p pose
- 4.5 Procedure for Step 2 / Module I in NEUROGES® -ELAN
- 4.5.1 Generation of the ‘to-be-coded’ Structure and R/P Structure units
- 4.5.2 Coding of the ‘to-be-coded’ Structure and R/P Structure units
- 4.5.3 Alternative procedure: Manual generation of Step 2 / Module I units and coding
- 5 The Focus category
- 5.1 Definition of the Focus category
- 5.2 Generation of the ‘to-be-coded’ Focus units and selection of the unit phases submitted to Focus assessment
- 5.2.1 Generation of the ‘to-be-coded’ Focus units
- 5.2.2 Selection of the unit phases submitted to Focus assessment
- 5.2.3 Alternative generation of ‘to-be-coded’ Focus units
- 5.3 Criteria for the definition of the Focus values
- 5.4 Definitions of the Focus values
- 5.4.1 within body
- 5.4.2 on body
- 5.4.3 on attached object
- 5.4.4 on separate object
- 5.4.5 on person
- 5.4.6 in space
- 5.5 Generation of StructureFocus units
- 5.6 Procedure in for Step 3 / Module I in NEUROGES® -ELAN
- 5.6.1 Generation of the ‘to-be-coded’ Focus units
- 5.6.2 Selecting and coding the ‘to-be-coded’ Focus units
- 5.6.3 Alternative procedure: Manual generation of ‘to-be-coded’ Focus units
- 5.6.4 Generation of the StructureFocus units by concatenating the Structure units and the Focus units
- 6 The Contact category
- 6.1 Definition of the Contact category
- 6.2 Generation of the ‘to-be-coded’ Contact and R/PContact units and selection of the unit phases submitted to Contact assessment
- 6.2.1 Generation of the ‘to-be-coded’ Contact and R/PContact units
- 6.2.2 Selection of the unit phases submitted to Contact assessment
- 6.2.3 Alternative generation of ‘to-be-coded’ Contact and R/PContact units
- 6.3 Criteria for the definition of the Contact and R/PContact values
- 6.4 Definitions of the Contact and R/PContact values
- 6.4.1 act on each other
- 6.4.2 act as a unit
- 6.4.3 act apart
- 6.4.4 Special template value prep-retract
- 6.4.5 r/p crossed
- 6.4.6 r/p closed
- 6.4.7 r/p open
- 6.5 Generation of StructureFocusContact units and RestPoseR/PContact units
- 6.6 Procedure for Step 4 / Module II in NEUROGES® -ELAN
- 6.6.1 Generation of the right hand Unilateral StructureFocus units
- 6.6.2 Generation of the left hand Unilateral StructureFocus units
- 6.6.3 Generation of Bilateral ‘to-be-coded’ Contact and R/PContact units
- 6.6.4 Coding the ‘to-be-coded’ Contact and R/PContact units
- 6.6.5 Alternative procedure: Manual generation of ‘to-be-coded’ Contact and R/PContact units
- 6.6.6 Concatenation of StructureFocus values with Contact values and of Rest/Pose values with R/PContact values
- 6.6.7 Frequency distribution of the StructureFocusContact and the Rest/PoseR/PContact values
- 7 The Formal Relation category
- 7.1 Definition of the Formal Relation category
- 7.2 Generation of the ‘to-be-coded’ Formal Relation units and selection of the unit phases submitted to Formal Relation assessment
- 7.2.1 Generation of the ‘to-be-coded’ Formal Relation units
- 7.2.2 Selection of the unit phases submitted to Formal Relation assessment
- 7.2.3 Alternative generation of ‘to-be-coded’ Formal Relation units
- 7.3 Criteria for the definition of the Formal Relation values
- 7.4 Definitions of the Formal Relation values
- 7.4.1 symmetrical
- 7.4.2 right hand dominance
- 7.4.3 left hand dominance
- 7.4.4 asymmetrical
- 7.5 Procedure for Step 5 / Module II in NEUROGES® -ELAN
- 7.5.1 Generation of the ‘to-be-coded’ Formal Relation units
- 7.5.1.1 Copying the bh_StructureFocusContact units
- 7.5.1.2 Selecting units with a phasic or repetitive Structure value in both hands
- 7.5.2 Assessing the ‘to-be-coded’ Formal Relation units
- 7.5.3 Alternative procedure: Manual generation of ‘to-be-coded’ Formal Relation units
- 7.5.4 Optional: Concatenation of the Formal Relation values with the StructureFocusContact values
- 8 The Function category
- 8.1 Definition of the Function category
- 8.2 Generation of the ‘to-be-coded’ Function units
- 8.2.1 Selection of units for the generation of ‘to-be-coded’ Function units
- 8.2.2 The Formal Relation values as an orientation for the assessment of bilateral ‘to-be-coded’ Function units
- 8.2.3 The chronology of coding the ‘to-be-coded’ Function units
- 8.2.4 Alternative generation of ‘to-be-coded’ Function units
- 8.3 Criteria for the definition of the Function values
- 8.4 Definitions of the Function values
- 8.4.1 emotion/attitude
- 8.4.2 emphasis
- 8.4.3 egocentric deictic
- 8.4.4 egocentric direction
- 8.4.5 pantomime
- 8.4.6 form presentation
- 8.4.7 spatial relation presentation
- 8.4.8 motion quality presentation
- 8.4.9 object-oriented action
- 8.4.10 subject-oriented action
- 8.4.11 emblem/social convention
- 8.4.11.1 emblem
- 8.4.11.2 social convention
- 8.4.12 Special template value different functions
- 8.5 Procedure for Step 6 / Module III in NEUROGES®–ELAN
- 8.5.1 Copying units from preceding tiers
- 8.5.2 Selecting the copied units with a phasic or repetitive Structure
- 8.5.3 Assessing the ‘to-be-coded’ Function units
- 8.5.4 Alternative procedure: Manual generation of ‘to-be-coded’ Function units
- 8.5.5 Optional: Concatenation of the Function values with the values of the preceding categories
- 9 The Type category
- 9.1 Definition of the Type category
- 9.2 Generation of the ‘to-be-coded’ Type units
- 9.2.1 Selection of units for the generation of ‘to-be-coded’ Type units
- 9.2.2 Alternative generation of ‘to-be-coded’ Type units
- 9.3 Criteria for the definition of the Type values
- 9.4 Definitions of the Type values
- 9.4.1 Types of the Function value emotion/attitude
- 9.4.1.1 emotion/attitude–rise
- 9.4.1.2 emotion/attitude–fall
- 9.4.1.3 emotion/attitude–clap/beat
- 9.4.1.4 emotion/attitude–shrug
- 9.4.1.5 Special template value other e-motion
- 9.4.2 Types of the Function value emphasis
- 9.4.2.1 emphasis–baton
- 9.4.2.2 emphasis–back-toss
- 9.4.2.3 emphasis–palm-out
- 9.4.2.4 emphasis–superimposed
- 9.4.3 Types of the Function value egocentric deictic
- 9.4.3.1 deictic – external target
- 9.4.3.2 deictic–You
- 9.4.3.3 deictic–self
- 9.4.3.4 deictic–body
- 9.4.4 Types of the Function value egocentric direction
- 9.4.4.1 direction–neutral
- 9.4.4.2 direction–imperative
- 9.4.4.3 direction–self-related
- 9.4.5 Types of the Function value pantomime
- 9.4.5.1 pantomime–intransitive
- 9.4.5.2 pantomime–transitive-active
- 9.4.5.3 pantomime–transitive-passive
- 9.4.6 Types of the Function value form presentation
- 9.4.6.1 form–shape
- 9.4.6.2 form–size
- 9.4.7 Types of the Function value Spatial relation presentation
- 9.4.7.1 spatial relation–route
- 9.4.7.2 spatial relation–position
- 9.4.8 Types of the Function value Motion Quality Presentation
- 9.4.8.1 motion quality–manner
- 9.4.8.2 motion quality–dynamics
- 9.4.9 Specific emblems and social conventions
- 9.5 Procedure for Step 7 / Module III in NEUROGES®-ELAN
- 9.5.1 Generation of the ‘to-be-coded’ Type units
- 9.5.2 Coding the ‘to-be-coded’ Type units
- 9.5.3 Alternative procedure: Manual generation of ‘to-be-coded’ Type units
- 10 Supplementary category Technique of Presentation
- 10.1 Definition of the category Technique of Presentation
- 10.2 Selection of units for the Technique of Presentation assessment
- 10.3 Definitions of the Techniques of Presentation values
- 10.3.1 hand-as-object
- 10.3.2 enclosure
- 10.3.3 palpating
- 10.3.4 tracing
- 11 Supplementary category Efforts
- 11.1 Definition of the category Efforts
- 11.2 Selection of units for the Effort assessment
- 11.3 Definition of the Effort values
- 11.3.1 free flow
- 11.3.2 bound flow
- 11.3.3 light weight
- 11.3.4 strong weight
- 11.3.5 heavy weight
- 11.3.6 sustained time
- 11.3.7 sudden time
- 11.3.8 indirect space
- 11.3.9 direct space
- 12 Supplementary category Temporal Structure
- 12.1 Definition of the category Temporal Structure
- 12.2 Selection of units for the Temporal Structure assessment
- 12.3 Definition of the Temporal Structure values
- 12.3.1 single accents
- 12.3.2 metrical
- 12.3.3 rhythmical
- 13 Supplementary category Target Location
- 13.1 Definition of the category Target Location
- 13.2 Selection of the units for the Target Location assessment
- 13.3 Definition of the Target Location values
- 13.3.1 right side
- 13.3.2 left side
- 13.3.3 body-midline
- 13.3.4 both sides
- 14 Supplementary category Execution Hemi-Space
- 14.1 Definition of the category Execution Hemi-Space
- 14.2 Selection of units for the Execution Hemi-Space assessment
- 14.3 Definition of the Execution Hemi-Space values
- 14.3.1 ipsilateral
- 14.3.2 contralateral
- 14.3.3 body-midline
- 14.3.4 ipsi-contra
- 15 Supplementary category Referent
- 15.1 Definition of the category Referent
- 15.2 Selection of units for the Referent assessment
- 15.3 Definition of the Referent values
- 15.3.1 material
- 15.3.2 non-material
- 16 Supplementary category Trigger/Motive
- 16.1 Definition of the category Trigger/Motive
- 16.2 Selection of units for the Trigger/Motive assessment
- 16.3 Definition of the Trigger/Motive values
- 16.3.1 physical regulation
- 16.3.2 visual appearance
- 16.3.3 mental regulation
- 16.3.4 trigger/motive unknown
- List of Figures
- List of Tables
- References
The NEUROGES® Analysis System for Nonverbal Behavior and Gesture
The Complete Research Coding Manual including an Interactive Video Learning Tool and Coding Template
Bibliographic Information published by the Deutsche Nationalbibliothek
The Deutsche Nationalbibliothek lists this publication in the Deutsche Nationalbibliografie; detailed bibliographic data is available online at http://dnb.d-nb.de.
Library of Congress Cataloging-in-Publication Data
A CIP catalog record for this book has been applied for at the Library of Congress.
The development of the NEUROGES analysis system was supported by the
German Research Association Grants DFG LA 1249/1-1, 1-2, 1-3.
Cover design: Olaf Glöckler, Atelier Platen, Friedberg
Printed by CPI books GmbH, Leck
ISBN 978-3-631-77172-3 (Print)
E‐ISBN 978-3-631-77852-4 (E‐PDF)
E‐ISBN 978-3-631-77853-1 (EPUB)
E‐ISBN 978-3-631-77854-8 (MOBI)
DOI 10.3726/b15103
© Hedda Lausberg, 2019
Peter Lang – Berlin ∙ Bern ∙ Bruxelles ∙ New York ∙ Oxford ∙ Warszawa ∙ Wien
Open Access: This work is licensed under a
Creative Commons Attribution
CC-BY 4.0 license. To view a copy of this license,
visit https://creativecommons.org/licenses/by/4.0/
This publication has been peer reviewed.
Preface
Nonverbal interaction and gesture researchers can proudly look up on a long and multi-disciplinary history of their research field. Currently, research on nonverbal interaction and gesture is conducted among others in medicine, psychology, neuroscience, linguistics, anthropology, sociology, or computer science. Given the long history, documented since the ancient Greek, and the broad spectrum of research areas, nowadays a substantial body of knowledge on body movement, gesture, and nonverbal interaction research is available.
However, while the exploration of the field by many different scientific disciplines extends the understanding of nonverbal interaction and gesture, the spread across many different scientific disciplines also bears the risk of isolated areas of specialized knowledge caused by a lack of communication between the different disciplines. Unfortunately, this often applies and one important reason for the scant exchange between the scientific disciplines is that many different methods are used. Researchers of different disciplines often do not understand each other’s terminology, methodology including coding systems, and consequently, findings. This condition constitutes a severe obstacle for comparing and relating the results of different studies and for gradually building up a common inter- or even trans-disciplinary corpus of knowledge on body movement, gesture, and nonverbal interaction. Furthermore, many studies in the field still lack a reliable methodology and an operationalization of the behavioral units and gesture types submitted to investigation. As units and types are often not clearly defined, it remains vague what kind of phenomenon had actually been investigated. Different researchers might use the same term, e.g. “symbolic” gesture, but actually refer to different phenomena, or vice versa – a fact that constitutes a severe obstacle in developing a reliable body of knowledge on body movement, gesture, and nonverbal interaction.
The development of the NEUROGES® system, which was made possible by a long-lasting funding of the German Research Association from 1999–2017 (grants LA 1249/1-1, 1-2, 1-3, 2-1), responds to this situation in research. On the one hand, NEUROGES® has become an objective, reliable and user-friendly analysis system for body movements and gestures. A recent review of 18 empirical studies using NEUROGES® in combination with ELAN demonstrated a good objectivity and reliability of the system. On the other hand, NEUROGES® suits as a basic analysis system that can be used across scientific disciplines and thereby facilitates interdisciplinary exchange. Recent studies using NEUROGES® cover a broad range of different scientific disciplines, e.g. linguistics/psycholinguistics, psychology, neuropsychology, medicine, evolutionary anthropology, or criminology. Thus far, altogether more than 500 individuals from different cultures of five continents have been investigated, Germans, British, US Americans, francophone and anglophone Canadians, Suisse, Koreans, Kenyans, and Papua New Guineans, including healthy adults and children as well as individuals with brain damage and with mental illness. Furthermore, NEUROGES® has been used for studies on non-human primates. Finally, NEUROGES® can be combined with other more specialized coding systems such as the Linguistic Annotation System for Gestures (LASG) or the Movement Psychodiagnostic Inventory (MPI).
The present book follows up on the first book “Understanding Body Movement” published 2013 in Peter Lang Academic Research, in which the theoretical background and design of the NEUROGES® system are presented. This second book contains the complete coding manual for the application of the system in research. It further includes an interactive video learning tool that illustrates the assessment algorithm and provides video examples of all NEUROGES® -registered hand movement and gesture types. In addition, four training videos are provided that enable readers to train the application of NEUROGES® and to compare their analyses with a correct solution. Thus, the present book provides all materials needed for an effective self-study of the NEUROGES® system and it enables to a reliable application of the system in research.
I would like to thank the German Research Association for the long-lasting funding of this project and the Peter Lang Company, notably Benjamin Kloss, for publishing the two books on the NEUROGES® system. Furthermore, over the past two decades, discussions with many colleagues from different scientific disciplines have influenced the development to the NEUROGES® system and have made it a truly interdisciplinary tool, notably with Martha Davis, Robyn Flaum Cruz, Miriam Roskild Berger, Norbert Freedman, Georg Goldenberg, Alain Ptito, Eran Zaidel, Joachim Hermsdörfer, Cornelia Müller, Sotaro Kita, Irene Mittelberg, Ellen Fricke, Katja Liebal, Mandana Seyfeddinipur, Janka Bryjovà, Marianne Eberhard-Kaechele, Peter Joraschky, Angela v. Arnim, Harald Skomroch, Ingo Helmich, Robert Rein, Melanie Seiler, Konrad Juszczyk, Oliver Schreer, Ippokrates Konstantinidis, Katharina Reinecke, Niklas Neumann and the many students of the NEUROGES® seminars that have been held since 2007. In particular, the scientific exchange with Han Slöetjes, the main software developer of the ELAN video and audio annotation tool, has been inspiring for the elaboration of the NEUROGES® algorithm and resulted in a highly efficient combination of NEUROGES® and ELAN. Janka Bryjovà has made major contributions to the interactive learning tool, not only by collecting numerous video examples of participants willing to give their consent to publication but also with regards to the aesthetic design of the learning tool. Corinna Klabunde has formatted the manuscript and designed and over the years repeatedly updated the figures of the algorithms in the course of the NEUROGES® development.
Finally, I am thinking of my husband Lothar Stemwedel whose insights were always an inspiration. I miss him deeply.
In order to receive your individual password for the login area on the NEUROGES® website www.neuroges-bast.info please send the code of this book to c.klabunde@dshs-koeln.de and h.lausberg@dshs-koeln.de.
Contents
I. Introduction to the NEUROGES® analysis system
1How to use the system in research
1.1Complete algorithmic analysis
1.2Algorithmic analysis of one module
1.3The analysis of one category
1.4Objectivity of the NEUROGES® values
1.5Reliability of the NEUROGES® values
1.6Validity of the NEUROGES® values
1.7Occurrence, frequency, and duration of the NEUROGES® values
1.8How to use the coding manual
1.10How to acquire the NEUROGES® certificate
2Parts of the body submitted to the analysis
II. The Kinesic Module (Module I)
3.1Definition of the Activation category
3.2Data submitted to the Activation assessment
3.3Criteria for the definition of the Activation values
3.4Definitions of the Activation values
3.5Procedure for Step 1 / Module I in NEUROGES® –ELAN
4.1Definition of the Structure category
4.2Generation of the ‘to-be-coded’ Structure and R/PStructure units
4.2.1Generation and assessment of to-be-coded Structure and R/PStructure units
4.2.2Alternative generation of ‘to-be-coded’ Structure and R/PStructure units
4.3Criteria for the definition of the Structure values
4.4Definitions of the Structure and R/PStructure values
4.5Procedure for Step 2 / Module I in NEUROGES®-ELAN
4.5.1Generation of the ‘to-be-coded’ Structure and R/P Structure units
4.5.2Coding of the ‘to-be-coded’ Structure and R/PStructure units
4.5.3Alternative procedure: Manual generation of Step 2 / Module I units and coding
5.1Definition of the Focus category
5.2.1Generation of the ‘to-be-coded’ Focus units
5.2.2Selection of the unit phases submitted to Focus assessment
5.2.3Alternative generation of ‘to-be-coded’ Focus units
5.3Criteria for the definition of the Focus values
Details
- Pages
- 366
- Publication Year
- 2019
- ISBN (PDF)
- 9783631778524
- ISBN (ePUB)
- 9783631778531
- ISBN (MOBI)
- 9783631778548
- ISBN (Softcover)
- 9783631771723
- DOI
- 10.3726/b15103
- Open Access
- CC-BY
- Language
- English
- Publication date
- 2019 (January)
- Keywords
- movement analysis kinesic behaviour algorithmic analysis interaction cognition mental state
- Published
- Berlin, Bern, Bruxelles, New York, Oxford, Warszawa, Wien, 2019. 366 pp., […] 18 fig. b/w, 14 tables