Preview picture for video

When you link a youtube video you see a preview image.
I created a video and stored it on our AWS S3 bucket (cloud storage place). When I link this video I do no see a preview image. Does anybody know how I can add a preview image for a video? I want to make sure that when a unit is loaded the student sees something, not an empty video.