Most design tools like Figma come with some sort of dev handoff tool that produces pixel-perfect HTML/CSS (though you might need some tweaks for responsiveness). Have you tried feeding that to the LLM as a starting point?

I also work on Plasmic (https://plasmic.app) a no-code editor that aims to fix this problem by eliminating the dev handoff, though it does take some organizational buy-in to work.