No, you do not indent paragraphs in a cover letter. Simply skip a line when you start a new paragraph.
Indenting your body paragraphs is optional, but by not indenting your paragraphs, you allow yourself more space to talk about your relevant achievements, qualifications, and skills.