Seeing music: The perception of melodic ‘ups and downs’ modulates the spatial processing of visual stimuli.

Carlos Romero Rivas, F Vera- Constan, Sara Rodriguez-Cuadrado, L Puigcerver, I Fernandez-Prieto, J Navarra

Research output: Contribution to journalArticle

2 Citations (Scopus)
102 Downloads (Pure)

Abstract

Musical melodies have “peaks” and “valleys”. Although the vertical component of pitch and music is well-known, the mechanisms underlying its mental representation still remain elusive. We show evidence regarding the importance of previous experience with melodies for crossmodal interactions to emerge. The impact of these crossmodal interactions on other perceptual and attentional processes was also studied. Melodies including two tones with different frequency (e.g., E4 and D3) were repeatedly presented during the study. These melodies could either generate strong predictions (e.g., E4-D3-E4-D3-E4-[D3]) or not (e.g., E4-D3-E4-E4-D3-[?]). After the presentation of each melody, the participants had to judge the colour of a visual stimulus that appeared in a position that was, according to the traditional vertical connotations of pitch, either congruent (e.g., high-low-high-low-[up]), incongruent (high-low-high-low-[down]) or unpredicted with respect to the melody. Behavioural and electroencephalographic responses to the visual stimuli were obtained. Congruent visual stimuli elicited faster responses at the end of the experiment than at the beginning. Additionally, incongruent visual stimuli that broke the spatial prediction generated by the melody elicited larger P3b amplitudes (reflecting ‘surprise’ responses). Our results suggest that the passive (but repeated) exposure to melodies elicits spatial predictions that modulate the processing of other sensory events.
Original languageEnglish
Pages (from-to)67-74
JournalNeuropsychologia
Volume117
Early online date10 May 2018
DOIs
Publication statusE-pub ahead of print - 10 May 2018

Keywords

  • Music perception
  • Pitch
  • Spatial attention
  • Multisensory interactions
  • ERPs

Fingerprint Dive into the research topics of 'Seeing music: The perception of melodic ‘ups and downs’ modulates the spatial processing of visual stimuli.'. Together they form a unique fingerprint.

  • Cite this

    Romero Rivas, C., Vera- Constan, F., Rodriguez-Cuadrado, S., Puigcerver, L., Fernandez-Prieto, I., & Navarra, J. (2018). Seeing music: The perception of melodic ‘ups and downs’ modulates the spatial processing of visual stimuli. Neuropsychologia, 117, 67-74. https://doi.org/10.1016/j.neuropsychologia.2018.05.009