Sure, the amount of materials needed exceeds what current technology can get even into LEO by several orders of magnitude. Nobody's proposing to actually build a lunar space elevator. All I'm saying is that a super-advanced civilisation could theoretically build one from the materials available to us today, which is not true for a space elevator from the Earth's surface.
Just because something ticks the checkbox of being theoretically possible doesn't mean it's practical or feasible to build.
Maybe in a few hundred years we'll have the means to build something on that scale. It still takes $10k to put 1kg in LEO, imagine the cost of transferring to the Lagrange points.