Do these stores just push users to Google Play?

No, all but 3 of the stores (AndroidPit, AppBrain, Opera (which includes the Nokia Store)) hosts the APK for download from the respective store.