Yes, you can do that. This is from the manual:
If you would like to preview the sound of an instrument without selecting it, hold down Command + Options (Mac) and click the instrument (Control + Alt + Click for PC). Conversely, it's possible to select an instrument without previewing its sound by holding down the Shift + Option while clicking (Shift + Alt + Click for PC).