Do I need to create images for all of the stores?

Yes and to make this easier we have integrated a re-sizing tool into the service that enables you to quickly create all of the images necessary directly from the hi-res versions of you Google Play images.