This is an issue with nearly every conference I've been to. Most attendees seem ok with higher level talks, though whenever there is a deeply technical and interesting topic the room is always overflowing.

If there are multiple tracks on the same day, maybe consider a high and low level track?

The only conference I've been to that felt targeted to me was Django Under The Hood, which is billed as very technical talks about the innards of a framework.