Prologi Ei- manuaalisuus SVKS110 (kevät 2016) Tommi Jantunen There are numerous popular misconcepcons about sign languages. One of these misconcepcons has it that sign languages are languages on the hands, that is, that sign language lexemes as well as morphologically and syntacccally complex structures are arcculated encrely by the hands (and possibly by the lower arm). (Pfau & Quer 2010:381.) Nonmanuals Osa 1 PERUSASIOITA EI- MANUAALISUUDESTA Surely, the hands play an important role in the arcculacon of signed uterances, but other arcculators the body, the head and (parts of) the face are just as important. All linguisccally significant elements that are not expressed by the hands are referred to as nonmanual markers or just nonmanuals. (Pfau & Quer 2010:381.) 1
TradiConal classificacon of nonmanuals AffecEve LinguisEc E.g. facial expressions: GrammaEcal (What is the role of nonmanuals on different levels of linguiscc structure, e.g. in syntax?) Prosodic (How nonmanuals are used for edge and domain marking?) SyntacCc (i.e. grammaccal) nonmanuals may funccon as prosodic markers PFAU, R. & Quer, J. (2010). Nonmanuals: their grammaccal and prosodic roles. In Brentari, D. (Ed.), Sign languages: A Cambridge language survey, 381-402. Cambridge: CUP. WILBUR, R. B. (2000). Phonological and prosodic layering of nonmanuals in ASL. In K. Emmorey & H. Lane (Eds.), The signs of language revisited: An anthology to honor Ursula Bellugi and Edward Klima, 215-244. Mahwah, New Jersey (USA): LEA. TradiEonal classificaeon of prosodic nonmanuals TradiEonal examples of grammaecal nonmanuals Lexical phonological nonmanuals E.g. mouthings and mouth gestures that funccon as structural parts of signs (e.g. [viu]) Morphological nonmanuals E.g. mouth gestures and facial expressions that are recurring and add semancc informacon to the sign (e.g. puffed cheeks) SyntacCc nonmanuals E.g. facial expressions and head movements that operate on the level of the clause (e.g. the negacve headshake) The problem of the tradiconal view Domain markers Prosodic words: mouthings IntonaConal phrases: brows, eyes, mouth, head, torso Edge markers Punctual in nature, no spreading E.g. head thrusts and nods (occur on the last sign of a prosodic domain) and (periodic) blinks (follow the last sign of a prosodic domain) PUUPPONEN, A. (2015). FinSL head movements at the interface between gesture and language... or..? Poster presented at the Nonmanuals at the Gesture Sign Interface (NaGSI) - seminar, Georg- August- Universität Gömngen, 9 10 October 2015. PUUPPONEN, A.; Wainio, T.; Burger, B. & Jantunen, T. (2015). Head movements in Finnish Sign Language on the basis of MoCon Capture data: a study of the form and funccon of nods, nodding, head thrusts, and head pulls. Sign Language & LinguisIcs 18(1), 41-89. 2
Prosodia Osa 2 MIKÄ TAI MITÄ ON PROSODIA? Segmenmen kanssa limityvät, tai segmenmen yläpuoliset eli puheen suprasegmentaaliset ominaisuudet; esim. kvancteem [fonologinen pituus; vrt. foneemnen pituus, kesto], painotus, intonaaco. (Karlsson 1994:51) Sellaiset äänteelliset ilmiöt, jotka asetuvat valtaosin tavujen ja sitä laajempien yksiköiden tasolle; esim. kesto, paino, sävel ja intonaaco, ts. suprasegmentaaliset piirteet. (Ojutkangas et al. 2009:100) Prosody 1. The study of poecc metre and of versificacon. 2. The study of stress [paino], pitch [puheen perustaajuus; audit. äänenkorkeus] and intonacon [lausetason sävelkulku; vrt. tooni eli sanatason sävel]. 3. A phonological element which is realized phoneccally on more than one segment [so. suprasegmenm]. 4. A phonological element which can only be described with reference to a domain longer than a single segment, including all those menconed in sense 3 and also suprasegmental elements like stress and tone [sävel]. 5. In Prosodic Analysis, a similar but much broader nocon which includes everything in sense 4 but also boundary signals, phonotacccs and anything else which can conceivable be described in terms of something larger than a single segment. Such prosodies are superimposed upon a skeleton of phonemacc units. FoneCikka - Syntaksi - Leksikko LingvisCikka - Morfologia - Fonologia Trask (1996:295) 3
Prosodic Hierarchy Examples of prosodic consctuents in SL Large domain Prosodic uterance ilmaus IntonaEonal phrase intonaaco Phonological phrase lauseke Phonological word sana Foot jalka Syllable tavu Mora Segment Small domain /tytönen syö kylmää pizzaa/ /kylmää pizzaa/ /tytönen/ /tyt.tö - nen/ /tyt/ /ty - t/ /t - y - t/tönen syö kylmää pizzaa Adapted from Trask (1996:295) Syllable (cf. TIETO+KONE vs. TIETO^KONE in FinSL) Prosodic Word (cf. MAN INDEX vs. MAN+INDEX in FinSL, or h1&h2:deaf^h2:association/h1:index) Phonological Phrase (cf. h1&h2:yellow PENCIL in FinSL; cf. Liddell s Fragment byos and other h2- related phonological processes) IntonaConal Phrase (cf. MAN THERE / MY UNCLE in FinSL) On prosodic theories Studies that form the branch of linguisccs called Prosodic Phonology are primarily formal accounts that are in the need of an empirical base (Ohala & Kawasaki 1984:114). Prosodia viitomakielessä? Signaalin dynaamiset ominaisuudet l. liike (Prosodinen malli, Brentari 1998) Ei- manuaalisilla arckulaatoreilla tuotetut liikkeet ja asennot (vrt. Pfau & Quer 2010). ilmenee käsien, kasvojen ja kehon arckulaacoiden kauta (Sandler 2010:298) 4
On manual prosody [We] are beginning to encounter manual features as correlates of prosodic structure in NGT as well. For instance, it appears that the movement size of the hands can be increased, or that the locacon of the hands may be raised, when a lexical item is put in focus. (Van der Kooij et al. 2006:1601.) Manual prosody Loudness Larger and smaller forms of a sign can be compared to shoucng and whispering in speech (Crasborn 2012:15; see also 2001). DistalizaCon in FinSL: PÄIVÄ [Elbow] > PÄIVÄ [Wrist] ProximalizaCon in FinSL: JO [Wrist] > JO [Elbow] Manual prosody Lengthening The increase of duracon in signs in phrase- or sentence- final posicons. Formal accounts: Mora insercon (PerlmuTer 1992) AddiCon of x- slot (Brentari 1998) Marks the right edge of the PP (Sandler 1999). Manual prosody Stress in ASL ASL has several kinds of stress: emphacc, contrascve, morphological, and word- level (Wilbur & Schick 1987:303). [In a phrase] stressed signs are modified and set off from surrounding unstressed signs by means of one or more cues: sharper boundaries, nocceably higher in the signing space, repeccon; change of speed and increased tension, and obvious break in the established rhythmic patern. (Wilbur 1999:218) 5
Näkemykseni viitomakielen prosodiasta Prosody refers to the way how we say what we say. [It] is encoded by both manual and non- manual ariculators, and all of these ariculators also subserve other, non- prosodic funcions in sign language. (Sandler 2012: 54.) Manuaalinen eli käsien toiminnan kauta ilmenevä prosodia: viitomien, lausekkeiden ja lauseiden ajallinen järjestyminen ja yhteenliityminen (so. rytmi; esim. arckulaaconopeus, tauotus), ja esim. painotaminen (vrt. prominenssi; liikkeen fysikaaliset ominaisuudet). Ei- manuaalinen eli kasvojen, pään ja kehon toiminnan kauta ilmenevä prosodia: lingviscsten yksiköiden alojen ja rajojen osoitaminen (vrt. intonaaco) ja tätä kauta viitomisen rytmitys, ja myös esim. painotaminen (vrt. prominenssi). Osa 3 PROSODINEN (EI- MANUAALINEN) ALANMERKINTÄ Suun toiminta alanmerkitsijänä Suun toiminta vs. perinteiset viitomat 6
Silmät ja kulmat alanmerkitsijöinä 1 Silmät ja kulmat alanmerkitsijöinä 2 Facial expression as intonacon (Sandler 2012:63) Pään kallistusliike alanmerkitsijänä (1) It fulfills many of the same pragmacc funccons as vocal intonacon, such as cuing different types of quescons, concnuacon from one consctuent to another, and shared informacon. It is temporally aligned with prosodic consctuents, in parccular with intonaconal phrases. It can be dissociated from syntaccc properces of the text. 7
Pään kallistusliike alanmerkitsijänä (2) Kehonliike alanmerkitsijänä (huom! disjunkcivi) Suvi 517/3 Osa 4 PROSODINEN (EI- MANUAALINEN) RAJANMERKINTÄ 8
Blinks (Wilbur 2000) Human ocular system Startle reflex blinks Involuntary periodic blinks Voluntary blinks ASL Startle reflex blinks not used linguisccally Involuntary periodic blinks and voluntary blinks are used for linguiscc purposes Periodic blinks used for linguiscc purposes are referred to as inhibited periodic blinks; they mark the right edge of IPs in ASL Longer voluntary blinks occur with lexical signs and perform semancc and/or prosodic funccon of emphasis, assercon, or stress. Tahdosta riippumatomat jaksolliset räpäytykset Räpäytykset lause(ke)rajoilla 9
Räpäytykset evidenssinä syntakcsesta yhteenkuuluvuudesta Head nods (Wilbur 2000) Perform a variety of funccons in ASL When cooccurring with a sign, may mark emphasis, assercon, and/or existence Mark the syntaccc locacon of a missing verb and focus May also mark (counterfactual) condiconals and "hedging" KYLLÄ ] r [ MUTTA NYT The nod (sagital dimension) PUUPPONEN, A.; Jantunen, T.; Wainio, T. & Burger, B. (2013). Messing with the head: on the form and funccon of head movements in Finnish Sign Language. Poster presented at the 11th TheoreCcal Issues in Sign Language Research conference (TISLR 11), University College London, July 10 13, 2013. Mostly a domain marker (e.g. above) Edge marking: last signs of phrases tend to occur with head nods (cf. periodic eye blinks) Head nods & syntaccc boundaries Puupponen, A.; Jantunen, T. & Mesch, J. (forthcoming in May 2016). The alignment of head nods with syntaccc units in Finnish Sign Language and Swedish Sign Language. To appear in the Proceedings of the Speech Prosody 2016, to be organized in Boston (USA), 31 May- 3 June, 2016. 10
Epilogi EI- MANUAALISUUDEN KAAOS Kirjallisuus (1) Kirjallisuus (2) Brentari, D. (1998). A prosodic model of sign language phonology. Cambridge, Mass.: A Bradford Book. Crasborn, O. (2001). Phonetic implementation of phonological categories in Sign Language of the Netherlands. Utrecht, The Netherlands: LOT. Crasborn, O. (2012). Phonetics. Teoksessa R. Pfau, M. Steinbach & B. Woll (toim.), Sign language: An international handbook, 4-20. Berlin: Mouton De Gruyter. Jantunen, T. (2007). The equative sentence in FinSL. Sign Language & Linguistics 10, 113-143. Jantunen, T. (2015). Rinnastuksen prosodiaa suomalaisessa viittomakielessä. Esitelmä 25. Fonetiikan päivillä Otaniemessä 20.3.2015 Jantunen, T. (2010). A comparison of two linguistic sign identification methods. In P. Dreuw, E. Efthimiou, T. Hanke, T. Johnston, G. Martínez Ruiz, A. Schembri (Eds.), Proceedings of the 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies[, organized as a part of the 7th Language resources and evaluation conference (LREC) at Valletta, Malta, May 22-23, 2010]. Paris: ELRA, pp. 129-132. Karlsson, F. (1994). Yleinen kielitiede. Helsinki: Yliopistopaino. Van der Kooij, E., Crasborn, O. & Emmerik, W. (2006). Explaining prosodic body leans in Sign Language of the Netherlands: Pragmatics required. Journal of Pragmatics 38:1598-1614. Ohala, J. & Kawasaki, H. (1984). Prosodic phonology and phonetics. In C. Ewen & J. Anderson (Eds.), Phonology Yearbook 1, 113-128. Cambridge: CUP. Ojutkangas, K., Larjavaara, M., Miestamo, M. & Ylikoski, J. (2009). Johdatus kielitieteeseen. Helsinki: WSOY. Perlmutter, D. M. (1992). Sonority and syllable structure in American Sign Language. Linguistic Inquiry 23:407 442. Pfau, R. & Quer, J. (2010). Nonmanuals: their grammatical and prosodic roles. In Brentari, D. (Ed.), Sign languages: a Cambridge language survey, 381-402. Cambridge: CUP. Sandler, W. (1999). The medium and the message: Prosodic interpretation of linguistic content in sign language. Sign Language & Linguistics 2:187-216. Sandler, W. (2010). Prosody and syntax in sign languages. Transactions of the Philological Society, Volume 108:3, 298-328. Sandler, W. (2012). Visual prosody. In R. Pfau, M. Steinbach & B. Woll (Eds.), Sign language: An international handbook, 55-76. Berlin: Mouton De Gruyter. Suvi = Suomalaisen viittomakielen verkkosanakirja (2003). Kuurojen Liitto ry: Helsinki. Trask, R. L. (1996). A dictionary of phonetics and phonology. London: Routledge. Wilbur, R. (1999). Metrical structure, morphological gaps, and possible grammaticalization in ASL. Sign Language & Linguistics 2:217-244. Wilbur, R. (2000). Phonological and prosodic layering of nonmanuals in ASL. In Emmorey, K. & Lane, H. (Eds.), The signs of language revisited. An anthology to honor Ursula Bellugi and Edward Klima, 215-244. Mahwah, New Jersey: LEA. Wilbur, R. & Schick, B. (1987). The effects of linguistic stress on ASL signs. Language and Speech 30:301-323. 11