The effect of emotional auditory stimuli on visual memory and decision-making processes.


Mavral S. M., Şişman Bal S.

Anatomy: International Journal of Experimental & Clinical Anatomy, cilt.16, sa.S3, ss.224, 2022 (Hakemli Dergi)

Özet

Objective: This study aims to investigate the effects of affective auditory stimuli (negative, positive, and neutral) on visual memory and decision-making processes.

Methods: Neutral human faces and emotional sounds were presented simultaneously to 65 university students (53 female, 12 male) aged between 18−27. Participants first rated the emotional valence of stimuli and then answered the decision-making questions under different instruction conditions. In the visual recognition memory task, participants reported ‘OldNew’ judgments for neutral face stimuli, participants also reported how confident they were in their answers. The study conducted 2 (instruction type: directive instruction, not-directive instruction) ¥ 3 (emotional valence of auditory stimulus: positive, negative, neutral) factorial design. The instruction type variable was created as the between-group design and the emotional valence of auditory stimulus variable was created as the within-group design. The directive instructions were balanced and presented to participants who received the directive instruction as auditory-oriented and visual-oriented instructions. The emotion evaluation score and answers to the decision-making questions, the visual recognition memory task and confidence assessment scores, and the reaction times of all tasks were analyzed with 2x3 mixed-design ANOVA. 

Results: The main effect of the emotional valence of the auditory stimulus was significant (p<.05) while the main effect of the instruction type was not significant (p>.05). There were also significant interaction effects on the emotion evaluation and decision-making performances and reaction time of the emotion evaluation performance (p<.05). 

Conclusion: The findings showed that the emotion evaluation and decision-making scores were affected by the emotional valence of the auditory stimulus. The neutral face stimuli presented with the negative auditory stimuli can have a disruptive effect on visual recognition memory performance. The results indicated that when the information from one modality is unclear, emotional information from another modality can create a context effect and change perception and attention processes towards stimuli.

Keywords: Emotional auditory stimuli, neutral faces, visual memory, decision-making