What visa do you hold? I wouldn't be confident that organising a conference would fall under ESTA or B1, speaking at one should be, but ultimately it's upto the goon looking at your application at the desk. In any case ensure you immigrate as early in the day as possible to maximise the chance of a quick deportation if you are rejected.