It's getting close. There are newer SoCs that are MMU capable and also contain enough RAM and Flash to run a small Linux instance off a single part...or a single part with some simple QSPI flash hung off of it. Renesas has the RZ line that can do this, but it will probably take up $30-$35 of your $50 budget.