Caring conversations are considered essential in psychiatric and mental health nursing. However, some patients are more or less silent and rarely express themselves verbally. This can be challenging for nurses who also need to find ways of communicating with these patients. Therefore, the aim of this study is to describe psychiatric nurses’ lived experiences of communication with patients who rarely speak. Five nurses were recruited from a psychiatric nursing home. Participants were encouraged in interviews to reflect on their experiences of caring for patients who are more or less silent. The transcribed interviews were subject to a phenomenological hermeneutic analysis. The findings are reflected in three main themes: (i) giving space for the unspoken narrative, (ii) remaining in uncertainty, and (iii) being in reflective vigilance. The themes were synthesised and reflected on in the light of Fredriksson’s theory of caring conversations. The comprehensive understanding reveals that nurses’ understanding of the patient’s unspoken narrative relies both on compassion and a willingness to engage, but also on a preparedness to remain in the uncertainty of not knowing. Balancing good intentions and the fear of one’s own shortcomings requires reflections not only in actions during encounters with the patient, but on actions. When nurses can apprehend and respond to what the patient expresses non-verbally, a joint narrative can emerge.