News for hackers. Stuff that matters.
Re:Varnish 4.0.2 released by imaginenore on Thursday October 09, 2014 @09:11AM (#8432112)
Varnish left a sour taste in my mouth. We have used it on one of our high-traffic sites, and had some truly bizarre hard-to-reproduce problems with it.

The major bug it had was that it would work normally for hours, but then it would randomly let the flood of requests through basically killing our servers. It happened over and over and over again. We had multiple talented sysadmins look at it, and none of them could give us any explanation. The only solution was to restart it, and warm the cache all over again. We couldn't figure out what sets it off, it looked just so random.

Re:Varnish 4.0.2 released by phkamp on Thursday October 09, 2014 @09:54AM (#8432318)
That sounds like a "hit-for-pass" scenario: Something from your backend told Varnish "Don't cache this" and varnish stopped doing so.
Re:Varnish 4.0.2 released by bkeroack on Thursday October 09, 2014 @11:29AM (#8432974)
This. The thing to remember is that you always have to set beresp.ttl in vcl_fetch in a hit-for-pass situation. Varnish caches the decision to hit-for-pass (or lookup or whatever), so if you do a hit-for-pass and your TTL is 1 hour, Varnish will hit-for-pass that cache key for the next hour without running your VCL logic again.
Re:Varnish 4.0.2 released by imaginenore on Thursday October 09, 2014 @11:43AM (#8433052)
Except we didn't have that. This was 99.9% content pages dynamically generated and nearly static. They all had roughly the same headers that haven't changed really, and they were not even aware of Varnish.

Response headers is the first thing we checked, there are only a few of them that affect Varnish:

https://www.varnish-software.com/static/book/HTTP.html

Re:Varnish 4.0.2 released by seanp2k2 on Thursday October 09, 2014 @12:43PM (#8433506)
Are you sure it wasn't an issue with cache evictions?
Re:Varnish 4.0.2 released by imaginenore on Thursday October 09, 2014 @05:26PM (#8435096)
All pages at the same exact time?
Re:Varnish 4.0.2 released by ruben_varnish on Thursday October 09, 2014 @11:48AM (#8433096)
Next time call me and I will make sure that the best minds doing cache invalidation in the industry have a look and fix your issue.

[Varnish Software sales hat on]