News for hackers. Stuff that matters.
Re:Bitwarden second security audit report by gentleman11 on Thursday July 23, 2020 @05:22AM (#23925579)
What does it cost to hire somebody reputable to perform an audit like this? Its something I want to look into for one of my own projects, but I have no frame of reference for what is a reasonable price for a simple full stack app (way simpler than bitwarden for sure)
Re:Bitwarden second security audit report by morrbo on Thursday July 23, 2020 @06:17AM (#23925820)
Pentester for 10 odd years: usually for an external test you would scope it at X days depending on the number of IPs etc. And it should note that an external test really doesn't find much. External is usually £750/day for 1-2 days testing and one reporting. Internal testing (ie. Auditing a domain and all computers attached) is about the same price, maybe a bit more, and takes a bit longer usually. A build review is hardening the server itself, takes about a day and a day reporting. App testing is totally dependent on the app itself (this is where people have a crack at an actual installed web application usually using user accounts etc. And runs a bit more - £800+ per day usually. Specialist stuff (hardware testing, code review (what I used to do), social engineering, hardcore app testing (stuff like auditing bespoke network devices, high frequency trading apps, etc. Etc.)) is typically 1-1.2k a day.

You can get it cheaper but a lot of it - for better or for worse - really comes down to the skill of the individual consultant. You can pretty much halve these prices, but then you'd end up getting stuff outsourced to India and it wouldn't be any good. Depends if you care about the security of your product or just want a box ticked for some arbitrary compliance and want it done as cheap as possible.

I haven't been a tester/consultant for a few years now, but the prices hold up. That being said one development which has happened since I've left the industry is the advent of crowd sourced pentesting. I know a lot of friends who moonlight with these things and are very good at their jobs, and the rates are lower. The name crowd strike comes to mind, but I'm not 100% sure if that was the company or not. I know a lot of good UK based companies (if it's a web app/remote then the physical testers location doesn't matter) if you needed.

Re:Bitwarden second security audit report by no-dr-onboard on Thursday July 23, 2020 @09:55AM (#23927372)
Appsec pentester for 6 or so years: The 1-1.2k a day figure (GBP) is relatively low for 2020. I know you mentioned that i's been a while; just trying to shed some light.

Boutique Firm X billed at 285/hr with an average of 60 hours for a small application. That comes out to $2,280 USD a day.

Standard Small Consulting Firm Y billed at 250/hr. In the past 6 years I have yet to see anything below 235/hr, which is still $1880 USD/day (1479, GBP).

Hope that helps, GP.

Re:Bitwarden second security audit report by raesene9 on Thursday July 23, 2020 @10:33AM (#23927750)
Worth noting that (IME) US day rates are a lot higher for pentest work :) your US rates sound similar to what I've seen but Morrbo's UK rates sound ballpark right for the UK (I'd have said a little higher but it does depend on the company and work)
Re:Bitwarden second security audit report by dogma1138 on Thursday July 23, 2020 @11:30AM (#23928384)
When I did pentesting for a consulting firm the daily rate was £2000-2500 (depending if we had to pay reverse VAT for non UK/SM clients, and some other factors) we worked with financial firms and software companies primarily, there for remote on-site would be the same + expenses.

More bespoke services like proper red teaming, DDoS simulation IOT/connected cars/hardware were about double that.

£800 a day is the very bottom of the price scale in the UK for general SME public sector companies.

Re:Bitwarden second security audit report by user5994461 on Thursday July 23, 2020 @01:42PM (#23929979)
Sounds a bit much. Could you have names of firms running this sort of service? and are they recruiting?

When I was working in financial firms, there were internal red teams running vulnerability scanners or manual pentest (manual requires much more planning and coordination) . No point in paying external firms £10k per app to run an automated test. I am gonna have to consider changing side if audit firms are really billing £2-4k a day for this.

Re:Bitwarden second security audit report by dogma1138 on Friday July 24, 2020 @02:01PM (#23942586)
We didn’t run automated vuln scanners, the majority of the work was app focused grey box testing, VA was only performed in the rare cases where we actually were testing against a live prod environment nearly all of our testing was done pre-production, quite often it would start pre-QA/UAT.
Re:Bitwarden second security audit report by rtempaccount1 on Thursday July 23, 2020 @01:39PM (#23929937)
Let me guess, Big-4? boutiques in the UK don't usually charge that kind of day-rate and the big banks all use their purchasing power to get day rates down.

£800/day is low, but not unheard of especially if you use freelancers/small boutiques, but £2k/days is more than I've seen for most things in the UK.

Re:Bitwarden second security audit report by dogma1138 on Friday July 24, 2020 @01:58PM (#23942552)
No, quite boutique but not a UK firm I was one of 5 in the UK office.

We didn’t really deal with retail banks the banking clients would be investment and asset management banks like RaboBank.

Re:Bitwarden second security audit report by splynch on Thursday July 23, 2020 @07:11AM (#23926091)
Those prices might stand up for contractors -- but are a bit low to bring in a commercial outfit, at least for any of the larger reputable security consulting businesses. Would suggest starting prices would be closer to £1000 a day. And rates are significantly higher in the US.

Accountability and consistency is a real concern in crowdsourcing. There is a reason we dont spend too much time designing an idea and then crowdsourcing all development. Why would security be different?

Re:Bitwarden second security audit report by morrbo on Thursday July 23, 2020 @07:19AM (#23926133)
The crowd sourcing stuff that I've seen comes in two different formats usually. There is the one where you put your URLs/IPs up there a d say "this is in scope"and someone finds something wrong, you pay them (ie. Someone says this has xss, you pay them a few hundred dollars) which has relatively little risk in terms of you only pay for what you get. The other ones are where you'd be allocated a test which then gets shipped out to some consultant anywhere in the world. I agree these are more risky (as you pay a flat rate). These are the ones I was hinting at that my friends moonlight on,but you do need some proof of technical ability and have to take a fairly decent entrance exam to participate in which (from what I've heard) hasn't been subject to the rampant cheating/"preparation" that other UK based aptitude tests/things like OSCP have. I'd personally go to a reputable vendor and ask for a senior consultant, but it's definitely a viable alternative especially if money is tight. Disagree about the pricing though, 750 (excl VAT) a day for external testing is pretty reasonable these days even for big vendors. App testing though, yeah, the prices can easily push 1k+ depending on what it is.
Re:Bitwarden second security audit report by ramimac on Thursday July 23, 2020 @09:44AM (#23927276)
Just for reference, the former example you give is just a bug bounty as far as I can tell.

The discussion of relative merit of bug bounty versus a pentest is well trod ground, so I won't rehash here except to say I would never consider a bug bounty replacement for a pentest, and if you're asked for a pentest report as part of third-party vetting etc. many organizations will be concerned to see a bug bounty program compiled report.

The latter example sounds like https://cobalt.io/. I've seen several reports and all I can say is if I were vetting a third-party or otherwise looking for assurance of security posture I would still want to see a "real" pentest from a reputable firm.

Re:Bitwarden second security audit report by splynch on Thursday July 23, 2020 @10:25AM (#23927663)
was going to say similar things. A bug bounty has value -- and its effectively to incentivise someone who finds a vulnerability to tell you, rather than exploit it or sell it to someone who will exploit it. Its the same as a pen test.

I dont want to name companies and start a war, but the industry is moving in a dangerous direction with some of the other options -- there are companies offering pen testing where those companies have no full time employees. They post the scope, and their registered users can sign in, take the work, and deliver it. Quality is all over the place. And things like confidentiality, data processing, etc, and any way to confirm a corporate entity adheres to their contractual obligations? Nonexistent.

Re:Bitwarden second security audit report by raesene9 on Thursday July 23, 2020 @07:25AM (#23926161)
Interesting how little pentest rates have moved on in the UK in the last 20 years. I was a customer of big UK testing companies back then and rates were around that already, so there's been effectively no increase there in that timeframe, if you're still getting work at the £750-£1000 range.
Re:Bitwarden second security audit report by morrbo on Thursday July 23, 2020 @07:36AM (#23926224)
Yep, more competition, more knowledge and more efficiency is meaning that you can't really push big prices unless you're either going for a massive company (I've seen my day rate as high as 1800 before for doing relatively generic work for gov organizations). When I first started contracting we were replacing a big-4 consulting firm charging 3200/day for some stuff (!) For a UK insurance comoany. Alternatively as I mentioned if you're doing specialist work (code review, hardware, some forms of SE, mainframe testing) you can definitely push the numbers up depending on the client. I have friends still working at several of the larger companies and the day rates really around about 8-900/day on average but they just supplement it by tacking an extra day on whenever they can. All depends on the customer and the sales guy tbh.

On average I'd even say that my day rate went down compared with 10 odd years ago - when you needed an interview at GCHQ to get CHECK - as there were just few people doing it whereas there are loads now.

Re:Bitwarden second security audit report by starfallg on Thursday July 23, 2020 @06:55AM (#23926012)
Your comment really surprised me as I didn't expect that this was just a pen-test, but after visiting the link, indeed it was!

I think it's a bit sneaky as for a product like this, people expect this to be a code and crypto audit. The "network" part should be emphasised and in the title of the page, instead of just the PDF.

Re:Bitwarden second security audit report by user5994461 on Thursday July 23, 2020 @07:02AM (#23926052)
In this business the title "External Penetration Test and Vulnerability Assessment" means the auditing company has run qualys/nessus* against bitwarden.com.

* expensive commercial vulnerability scanning tools.

Re:Bitwarden second security audit report by starfallg on Thursday July 23, 2020 @07:12AM (#23926096)
Yes, but the title of the page/blog post is "Security Audit Complete".
Re:Bitwarden second security audit report by jiveturkey on Thursday July 23, 2020 @11:33AM (#23928412)
the cost varies widely.

$8k - $12k for a "platform" that hires 100% outsourced pentesters of highly variable skill and quality, and takes no liability themselves, and whose pentesters are located in developing countries and good luck getting damages out of them, ever, regardless of their platform "reputation" pretend points. also communication tends to be difficult as the norm is ESL.

$25k for a US-based boutique firm with in-house pentesters of vetted high quality, who accept liability and against whom you can actually expect to enforce an NDA and/or extract other damages. source code and design audit starts at about this price.

then, you can run your own program on top of the bounty platforms, however scope and focused work is not going to happen (a lot of the work is boring), and it will cost you a lot of your own time. the money you save DIY is not worth your own time investment.

if you actually want a good pentest, go with a boutique, quality firm. if you want something to give to an auditor or to meet a VSA, go with cheap.

Re:Bitwarden second security audit report by user5994461 on Thursday July 23, 2020 @06:51AM (#23925985)
The attached PDF is an automatically generated report.

You can get something like that for £5-10k if you go through one of the typical audit firms (KPMG, Deloitte and co).

In addition you can look into some ISO certifications or industry specific regulations. It's basically a checklist of a thousand questions: do you use TLS? are your applications protected by authentication? can custom folks access personal data of customers? are there audit logs of support accessing customer information?

Re:Bitwarden second security audit report by Aeolun on Thursday July 23, 2020 @08:47AM (#23926751)
If you want an automatically generated report you can just run ZAP, Burp or Checkmarx against your system yourself :/
Re:Bitwarden second security audit report by nix23 on Thursday July 23, 2020 @06:03AM (#23925761)
Just ask them. Cure53 is one of the most reputable one's, and remember always make white-box testing, you want to test your system, NOT the security researcher.
Re:Bitwarden second security audit report by dabeeeenster on Thursday July 23, 2020 @06:11AM (#23925788)
We (https://www.bullet-train.io/) recently had a third party perform a pretty in depth security audit - cost was low to mid 4 figure Euro. Result was a ~20 page report - I felt it struck the right balance of cost / effectiveness.
Re:Bitwarden second security audit report by Narkov on Thursday July 23, 2020 @05:55AM (#23925722)
Unfortunately, it varies wildly. Some firms can perform fully automated remote scans for a few hundred $$$ and it can move all the way up to 100+ page reports with manual pen testing for literally hundreds of thousands of dollars.

What you want or need will fit somewhere in between.