Wordpress Plugins are stored both in the filesystem and in the database and need to match. Same for the Wordpress Core when an update occurs as WP updates the PHP files locally for the upgrade process. The AWS guidance for a multi-webserver Wordpress setup has included EFS for this reason for years now. You can store uploaded media in S3, but that is a performance optimization that doesn't solve the previous issues.