You may not want to turn it off. From an advertising perspective I would suggest you split-test it. Yeah it will annoy some people, but entry-pops have great effect and are used by most performance marketers whenever possible.