News for hackers. Stuff that matters.
Re:Saas CTO Security Checklist by tptacek on Sunday March 18, 2018 @10:17PM (#16615781)
It's not a bad list, though it is a bit of a marketing tool for "Sqreen" (though, I guess if we did one, it'd come off as a marketing tool for us).

What I actively don't like is their use of "Seed", "Series A", "Post-Series-A". It's cutesy but, more importantly, their categories are mostly wrong.

Here's their "Series A" list:

* No shared accounts * Centralized account management * Centralized logs * Server list * DDoS protection * IP restrictions for internal services * Monitor metrics * Public security policy * Special security for non-tech staff * Real-time monitoring/protection * Customer 2FA * Monitor suspicious activities * Security-oriented test sessions

Many of these are things you want to be doing ASAP. That doesn't mean they take priority over product/market fit, but it does mean you're not waiting for a milestone to build them. For instance: most competent teams have centralized logs. Every competent team restricts access to internal services (and IP restrictions aren't the way to do that). If you don't get this stuff started early, it's a nightmare to start later.

Other things on the list are things that mature, profitable companies don't bother doing, because the ROI isn't high enough. Customer 2FA is an example --- if you need it, you probably know. Real-time security monitoring tools are another big one; chances are, if you're reading a checklist like this, your monitoring needs are too idiosyncratic to buy COTS.

Post-Series-A is worse:

* CloudFormation * Incident Response * Internal security policy * Asset inventory * Bug bounty program * Security audits * SDLC

With the exception of bug bounties, which you might not bother ever doing at all, these are all ASAP items.

You could also start a list of important things they're missing:

* Security testing integrated into CI/CD pipeline * Automated routine network monitoring * Segmenting AWS accounts * Having a process to tag PRs for security review * Adding a security page to your website

This list reads to me like it was originally shrink wrapped around a product, and then expanded with bullets with links to random websites to throw the scent off.

Re:Saas CTO Security Checklist by beager on Monday March 19, 2018 @12:15AM (#16616157)
I would like to see each particular item tagged not as "Seed", "Series A", "Post Series A" but with more tangible events or metrics that would trigger needing to take those things seriously.

For instance:

---

"Follow an onboarding / offboarding checklist"

Do this when...

- you have ten or more employees,

- you have at least ten thousand user accounts, OR

- you have at least ten thousand dollars MRR

---

"Protect your application from DDoS attacks"

Do this when...

- you have publicly announced funding, put a major product launch or milestone in commercial press, or have publicized a key strategic hire

- a prolonged period of downtime (N minutes/breaking 3 or 4 nine availability) would have a materially adverse effect on your business

---

"Use SSL certificates to secure people using your website"

Do this when...

- you are collecting any information from visitors to your website (logins, email addresses, phone numbers)

- you would not want the traffic from sessions browsing your website to be intercepted by third parties.

Of course, a lot of these things would be obvious, but there's a chance here to make this really accessible to the security ignorant or security illiterate.

Re:Saas CTO Security Checklist by ozim on Monday March 19, 2018 @04:47AM (#16616930)
For SSL I think there is industry consensus to push for HTTPS everywhere. There is no argument to skip it. With free lets encrypt certificates. It is not like you will spend a week implementing it, without prior experience decent developer should have it up and running in half of day.
Re:Saas CTO Security Checklist by beager on Monday March 19, 2018 @07:26AM (#16617605)
I agree with you, maybe the advice should be “do this immediately, regardless of stage or size”
Re:Saas CTO Security Checklist by paulb81 on Monday March 19, 2018 @05:25PM (#16623337)
This is really great input! Thank you.

We will definitely take this into consideration for the next iteration.

Re:Saas CTO Security Checklist by jbaviat on Sunday March 18, 2018 @10:32PM (#16615840)
I’m the CTO at Sqreen and I do love Matasano (cryptopals... awesome crypto challenge https://cryptopals.com/). Realistically, security audits or bug bounty are not doable in seed startups - where most of the time no one has any security knowledge, and no money :) Thanks for the missing things we will update! By the way this is open source, feel free to contribute: https://github.com/sqreen/CTOSecurityChecklist (not sure this is 100% today with the version on Sqreen.io, we’ll get there this week).
Re:Saas CTO Security Checklist by ozim on Monday March 19, 2018 @04:52AM (#16616954)
I have only one thing to nag about. Password complexity rules. Please only do length check and promote checking against dictionary passwords to be rejected. For password security this was last year hot document: https://www.nist.gov/itl/tig/projects/special-publication-80...
Re:Saas CTO Security Checklist by jerrre on Monday March 19, 2018 @05:45AM (#16617165)
There could be a different between password rules for your users, and for your employees. The former should probably be more focused on usability, the latter on security.
Re:Saas CTO Security Checklist by ozim on Monday March 19, 2018 @09:44AM (#16618264)
Sounds reasonable, since you can (and should) enforce use of password manager by your employees.
Re:Saas CTO Security Checklist by dsacco on Sunday March 18, 2018 @11:51PM (#16616079)
> Realistically, security audits or bug bounty are not doable in seed startups - where most of the time no one has any security knowledge, and no money

Ehhhhhhh...I disagree.

1. Most of my clients tend closer to seed stage than to well-funded.

2. You don’t need security expertise or money to run a good bug bounty program. You can start one immediately. There are enough high quality resources available for free on the internet (that are not content marketing) that you can learn most of the important unknown unknowns.

For example, I think this is excellent reading for any young company thinking about security: https://medium.com/starting-up-security/starting-up-security...

Re:Saas CTO Security Checklist by amarkov on Monday March 19, 2018 @12:39AM (#16616220)
What do you do when the response to a bug bounty is "yeah, we already knew about that, and we're not planning to fix it soon because the consequences aren't high"? In my experience that's a pretty common scenario for early to medium stage startups.
Re:Saas CTO Security Checklist by thaumasiotes on Monday March 19, 2018 @05:38AM (#16617137)
It's not just a common scenario for early to medium stage startups. It's also a common scenario for every other business with a bug bounty program.

Sometimes, the consequences aren't high.

"Your CORS is configured to allow access from another domain, also owned by you."

"You can give yourself a redirect to any site by intercepting and modifying your own Host header."

"Your static blog on a separate domain from your actual site is accessible over unencrypted HTTP."

"If I zoom in on your web page, the text becomes blurry."

If your question was from the other end, "what do you do as the company when you get a report like this?", I say something like "We don't believe that this warrants fixing at this time. Thanks for your interest in our program, and we hope you continue reporting to us in the future!"

Re:Saas CTO Security Checklist by amarkov on Monday March 19, 2018 @11:36AM (#16619205)
What I'm thinking of are things like "a paying customer can DoS you with a carefully constructed malicious input". That usually won't be practical issue if you're small enough to know all your customers - but it has the potential to be very problematic if you incentivize people to find it.
Re:Saas CTO Security Checklist by thaumasiotes on Monday March 19, 2018 @12:21PM (#16619615)
This is usually addressed in your program policy. For example, look at https://hackerone.com/twitter :

> Accessing private information of other users, performing actions that may negatively affect Twitter users (e.g., spam, denial of service), or sending reports from automated tools without verifying them will immediately disqualify the report

Re:Saas CTO Security Checklist by lcpriest on Monday March 19, 2018 @05:25AM (#16617093)
Was this list also you? https://gdprchecklist.io/

The html is almost identical - is there a checklist-templating service that you used to build this?

Re:Saas CTO Security Checklist by paulb81 on Monday March 19, 2018 @05:03PM (#16623141)
It's inspired by this checklist.

You can get two code implementations here: https://github.com/sqreen/CTOSecurityChecklist https://github.com/sqreen/DevOpsSecurityChecklist

Re:Saas CTO Security Checklist by dewey on Monday March 19, 2018 @05:50AM (#16617192)
> The project is inspired by The SaaS CTO Security Checklist created by Sqreen.io
Re:Saas CTO Security Checklist by lcpriest on Monday March 19, 2018 @10:11PM (#16625436)
Ah, thanks! I didn't spot that on my first read through.
Re:Saas CTO Security Checklist by paulb81 on Sunday March 18, 2018 @10:41PM (#16615881)
I worked on this checklist and your feedback is very appreciated.

You're right on all your points from a pure security point of view. We should be doing security as soon as possible. Unfortunately, the reality of building a startup is about finding product-market-fit. Entrepreneurs are not incentivized to do security early on. The fear strategy our industry is using for the last XX years has failed.

As security professionals, we need to help entrepreneurs and educate developers find a good balance between building a business and building good security practices. This is the goal of this checklist.

We can't expect developers to spend days implementing security best practices before even having a business.

Re:Saas CTO Security Checklist by dsacco on Sunday March 18, 2018 @11:58PM (#16616111)
> As security professionals, we need to help entrepreneurs and educate developers find a good balance between building a business and building good security practices. This is the goal of this checklist.

No offense, but that’s not an answer to tptacek’s point. I can’t speak for him, but he probably agrees with this point. But that’s a soundbite - everyone would agree with that “we security professionals need to help entrepreneurs help themselves”, etc. The devil is in the details. He is critiquing the checklist’s content, not the checklist.

To make this comment constructive, I’m going to provide a link to what I personally consider very high quality advice for companies, written on the blog of Facebook and Coinbase’s former director of security:

https://medium.com/starting-up-security/starting-up-security...

Beyond that, having worked directly with many founders of early stage companies for security, I have to say I disagree that they can’t think about security early on. Resources like the series of articles I’ve linked to show how to navigate that compromise effectively.

Re:Saas CTO Security Checklist by tptacek on Monday March 19, 2018 @12:29AM (#16616197)
Everything Ryan McGeehan writes is amazing. All of it belongs with the very best startup security content on HN.
Re:Saas CTO Security Checklist by toomuchtodo on Sunday March 18, 2018 @10:52PM (#16615932)
> We can't expect developers to spend days implementing security best practices before even having a business.

We absolutely can. Otherwise, expect regulation to do it (see: GDPR).

Re:Saas CTO Security Checklist by cookiecaper on Sunday March 18, 2018 @11:09PM (#16615980)
Yeah. At the risk of digging at a raw wound and trivializing a recent tragedy, this is kind of like saying "We can't expect structural engineers to develop a fundamentally-safe construction plan right from the get-go."

If you're going to do something at all, there are some fundamental standards that you just don't risk by putting them off for later. Not saying you have to start out with all the frills, but there is a minimum acceptable standard of safety and competency that can and should be expected of any new work, and things that don't meet such standards should never exist in a form that could potentially be misconstrued as doing so. Reasonable baseline security practices are certainly part of those inviolable professional standards.

Re:Saas CTO Security Checklist by nickpsecurity on Monday March 19, 2018 @11:02AM (#16618846)
Or see TCSEC that was how the market produced the first, security-focused systems. They were only ones to pass pentesting at the time with designs and implementations still stronger than most software today. Although it had issues, its core lifecycle requirements mostly work and are still used for high-assurance security implementations. Alternatively, the DO-178B standard (now DO-178C) that got more vendors writing well-documented, well-reviewed code that they run through all kinds of static analyzers and testing tools to avoid costly re-certifications. Two examples of regulations that worked so well that they raised the status quo for both security and safety.

People mostly mention bad or questionable regulations when the topic comes up. I figure the good ones deserve mention, too, esp given they worked better than the market. That's probably due to the absence in market of both liability for software failures and most customers' ability to evaluate security claims.

TCSEC Overview https://en.wikipedia.org/wiki/Trusted_Computer_System_Evalua...

Bell Looking Back on TCSEC/TPEP http://lukemuehlhauser.com/wp-content/uploads/Bell-Looking-B...

DO-178B Overview https://en.wikipedia.org/wiki/DO-178B

Re:Saas CTO Security Checklist by irundebian on Sunday March 18, 2018 @10:55PM (#16615944)
OT-fun: You have 27007 karma points. ISO/IEC 27007 is one standard for "information security management systems auditing".
Re:Saas CTO Security Checklist by toomuchtodo on Monday March 19, 2018 @02:25PM (#16621449)
I’ve wasted so much time on HN, but have enjoyed it very much. Thanks for pointing that out :)
Re:Saas CTO Security Checklist by unclebucknasty on Sunday March 18, 2018 @10:35PM (#16615854)
I'd add to this that there is also a culture of security that is being created from day one. It is unrealistic to purposely let things slide security-wise with the idea that you'll care about it later, and expect a healthy culture to emerge.

Going back to layer on security can be challenging, but it's even harder to retroactively layer on a way of thinking about and prioritizing security. For instance, it literally has to be that every engineer is thinking about the security implications of every design/implementation choice with the same urgency as the product features themselves. And there has to be a sense of standards, accountability and direction coming from the top.

Equifax is a good example of a company that failed in this. You look at the original incident, then consider how they made it so much worse in their response. At a certain point you start to think "is anyone even thinking about security there?" and you realize their culture is fundamentally broken in such a way that their entire organizational mindset will need to be clean-sheeted. That's a tough road.

Re:Saas CTO Security Checklist by irundebian on Sunday March 18, 2018 @10:51PM (#16615927)
That's a very important and interesting topic. Do you know any literature and standards on how to establish such a "culture of security" (afterwards)?
Re:Saas CTO Security Checklist by wglb on Monday March 19, 2018 @10:30AM (#16618570)
The thing that became evident to me with this breach and the long-delayed response from Uber about their breach was the the following is one way to look at a company's ability to deal with the reality of the internet.

First, there is the overall company culture. If employees, top to bottom, care about the company, its mission, and what they are doing day to day, it makes it feasible to introduce a security culture.

Secondly, technical competence, top to bottom. Not understanding the importance of patching (didn't they tell congress that it was too hard?), or the fact that that your customer outreach web site should be part of your already existing domain, as opposed to a totally independent easily spoofable domain that can even fool your social media guy.

Third, a serious security team. Penetration testing, security awareness training, logging/monitoring. But a crack security team is hard-pressed to overcome weakness in the other two.

This all clearly starts at the top.

Re:Saas CTO Security Checklist by irundebian on Sunday March 18, 2018 @10:48PM (#16615917)
The list is mixing different subject matters.

The security of all the information in your company should be handled by an information security management system, which is normally under the supervision of a CSO or CISO. The ISM gets established by defining (e. g. through policies) roles, processes and requirements for many problems occurring related to information security.

The security of your infrastructure should also be supervised by some management position and your infrastructure should be designed in advance to fulfill your security requirements.

The security of your software should also be supervised by some management position and your the whole software process have to be designed to produce secure software.

I don't believe this can be handled by a CTO with a basic checklist, although it includes important points which should be supervised. This list also feels kinda incomplete.

Re:Saas CTO Security Checklist by twunde on Monday March 19, 2018 @12:19AM (#16616173)
I know very few startups that have or had a CSO/CISO. I would assume that most startups that have one, are in one of the following fields security/fintech/healthcare/education. Typically it falls on the CTO at early stage startups to ensure that appropriate security measures have been taken
Re:Saas CTO Security Checklist by paulb81 on Monday March 19, 2018 @05:08PM (#16623188)
Thanks for your input.

Unfortunately, startups don't have this kind of resources (CIO/CISO etc.). What we see is that security is often handled by CTOs in Seed/SeriesA startups.

Re:Saas CTO Security Checklist by wglb on Monday March 19, 2018 @10:51AM (#16618750)
One thing missing from all these is a basic anti-phishing training for top folks in the company. Be sure that they who control financial string have a pre-agreed non-email pattern of, for example, CEO telling CFO to transfer money.
Re:Saas CTO Security Checklist by mkagenius on Sunday March 18, 2018 @10:30PM (#16615829)
> IP restrictions aren't the way to do that

I think they might talking about something else — like restricting db access to only certain IP where apps are hosted. That’s the problem with checklists — they aren’t very clear at times.

Re:Saas CTO Security Checklist by cocoflunchy on Monday March 19, 2018 @11:57AM (#16619379)
> * Security testing integrated into CI/CD pipeline

> * Automated routine network monitoring

Do you have specific recommendations on these 2 things?

Re:Saas CTO Security Checklist by twelve40 on Monday March 19, 2018 @01:26AM (#16616329)
> With the exception of bug bounties, which you might not bother ever doing at all

Why not?