If you have a server that is connected via 100Mbps link to the entire network, yea, it's not enough. When multiple clients are hitting it e.g. during login, downloading updates from wsus etc. it will be painfully slow