In regular face to face communication, we interact with words, prosody, gestures (performed with hands, head, face, torso), and eye gaze. All these channels function in conjunction, but this fact is not always recognized in linguistics. It is interesting to know how various channels interact and cooperate.
In order to study such issues, one needs a resource that registers various kinds of communicative behaviour. In the course of the project "Language as is" a Russian language resource has been created, involving video, audio, and eye tracking recordings, as well as annotations of multichannel behaviour. The talk presents the multichannel resource and a number of research questions that can be addressed on the basis of that resource.
