I suspect what stops this from being a universal feature of plants is the energy required to fix nitrogen. A plant is better off not trying to do that. Especially since if nitrogen is a limit then other nutrients are probably close behind.