Software Testing Anti-patterns

Re:Software Testing Anti-patterns by nwatson on Sunday April 22, 2018 @02:13PM (#16897548)

I'd prefer that all testing be done with live data in a real database ... maybe not at the very beginning but as soon as practicable. I came into a project recently with so many issues around differences between real data and assumed data, and unrealistic assumptions about real data that it's been hugely painful, with lots of back and forth between Dev and QA and Ops. With Docker now there's no excuse for not setting up soon in a project's lifecycle a realistic environment (infrastructure topology-wise) with real data on development and QA laptops.

With this you still have fast and slow perhaps, but everybody can run all but the most extreme scaling tests.

[ Parent | on HN ]

Re:Software Testing Anti-patterns by kodr on Sunday April 22, 2018 @04:00PM (#16898222)

That's E2E test. What's interesting with unit tests is that you can run them locally, offline. They are fast enough so that you can run them and see if you broke anything. If your tests take too much time to start or relies on a live env (which may be down or broken), you'll spend more time for maybe nothing.

[ Parent | on HN ]

Re:Software Testing Anti-patterns by nwatson on Sunday April 22, 2018 @04:05PM (#16898253)

With Docker I can run my E2E "offline".

[ Parent | on HN ]

Re:Software Testing Anti-patterns by joshuamorton on Monday April 23, 2018 @12:15AM (#16900473)

If you're touching real data, your test isn't offline.

[ Parent | on HN ]

Re:Software Testing Anti-patterns by AstralStorm on Monday April 23, 2018 @03:18AM (#16901165)

Not true. You might be touching local sample of real or realistic data. It does not need to be static either.

The performance of such a test is still a problem.

[ Parent | on HN ]

Re:Software Testing Anti-patterns by bsandert on Monday April 23, 2018 @08:20AM (#16902705)

    it('sends an email to the user', ...)

[ Parent | on HN ]

Re:Software Testing Anti-patterns by nwatson on Monday April 23, 2018 @05:24PM (#16907556)

An automated test causes the tested product to send an email to the user? So ... my docker local deployment has a DNS server with the proper MX records, an SMTP server to receive the emails, an IMAP server to expose and serve up the received emails, and the test running on my macOS can check the entire flow. No need to even have my laptop connected to any network for this test to run in its fullest.

[ Parent | on HN ]