Methinks as the organizer you should keep your word and still show up; whoever finds it awkward would simply not go.