Yes you can, it doesn't force you to log in at installation. You can't use the Play Store to install new applications, but you can update existing apps. Google Play services continue to work too (Location and common APIs)

I personally use Aurora Store, a FOSS reimplementation of Google Play Store, to install new apps without a Google account