Most pro/under-sink water filters can be recycled. I use a body glove system, and you send back the cartridge for recycling after you've replaced it. I didn't install mine (came with my place), but I think it's around $1000 to get a full system with filter, instant hot water, tap, etc. Drop the instant hot water, and and you're probably down to $500 or less.

If you're concerned about waste, a filter is far preferable to bottles of water or consumer-grade water pitchers, even if there's plastic involved.