Navigate to your collection and click Manage.
Under Datastreams, find the TN (thumbnail) datastream. Click the Replace link. (If no TN datastream is available, create a new one.)
Replace the image with your own. Make sure your new image has the right dimensions. Default is 128x128 pixels.