News for hackers. Stuff that matters.
Re:Three ways "formally verified" can go wrong by rook_line_sinkr on Sunday October 12, 2025 @05:21PM (#45562027)
I got told to use these words back in uni

verification - Are we building the software right?

validation - Are we building the right software?

makes many a thing easier to talk about at work

Re:Three ways "formally verified" can go wrong by moandcompany on Sunday October 12, 2025 @08:40PM (#45563533)
Yep... Along with this

Verification aligns with a specification. E.g. verify if what was implemented matches what was specified.

Validation aligns with a requirement. E.g. verify if what was implemented solves the actual problem.

Re:Three ways "formally verified" can go wrong by friendzis on Monday October 13, 2025 @04:12AM (#45565993)
Engineering specifications implement requirements.

EDIT: more formally, specification is a document stating requirements

Re:Three ways "formally verified" can go wrong by ijustlovemath on Monday October 13, 2025 @08:02AM (#45567396)
Usually there's a separate document that has the requirements, and from that document you have a "software detailed design" which has the specifications for how to build the software such that it upholds the requirements. Subtle but important difference.
Re:Three ways "formally verified" can go wrong by tirant on Monday October 13, 2025 @08:13AM (#45567480)
I like to talk about goals and not requirements.

What is your product goal? Both for the customer (solving a problem) and for the company(solve a marketing need, make money)?

Can you proof that you are meeting both? Then you are validating your goals successfully.

Most of the time products are missing defined goals, so lots of people have no idea what the fuck they are developing and everyone ends up with their own idea of the product.

Re:Three ways "formally verified" can go wrong by dapperdrake on Sunday October 12, 2025 @09:37PM (#45563842)
There is an important and distinct pair of definitions used by a possibly smaller but significant number of people:

Verification: formal theoretical proof

Validation: Empirical test based approach

Re:Three ways "formally verified" can go wrong by 01HNNWZ0MV43FF on Sunday October 12, 2025 @10:01PM (#45564002)
If it's hard to remember which is which, maybe they should be different words.

Like "Customer validation" and "Verification against the spec"

Like "sympathy" and "empathy". I finally heard a mnemonic but if I need a mnemonic maybe it's a sign that the words are just too hard to understand

Re:Three ways "formally verified" can go wrong by RHSeeger on Monday October 13, 2025 @12:58AM (#45564808)
I just don't bother to shorten it...

- Did we correctly understand and build what the customer asked for

- Did the customer actually ask for what would solve the problem they are trying to solve

The second one is very important to ask early on, and _not_ asking it can cause a lot of wasted time. When I'm in a position to comment on whether I think someone fits the requirements of a senior developer, whether or not they ask that question plays directly into it.

Re:Three ways "formally verified" can go wrong by smokel on Monday October 13, 2025 @04:50AM (#45566232)
Etymology to the rescue. "Valid" and "value" share a root, and so do "verify" and "verity." You validate something to see if it has value, meaning it works and is fit for purpose. You verify it to check that it is true and meets its specifications. Does that help? :)
Re:Three ways "formally verified" can go wrong by armanboyaci on Monday October 13, 2025 @01:37AM (#45565002)
Should we validate before we verify the software?
Re:Three ways "formally verified" can go wrong by 8n4vidtmkvmk on Monday October 13, 2025 @03:10AM (#45565604)
Yes.
Re:Three ways "formally verified" can go wrong by friendzis on Monday October 13, 2025 @04:25AM (#45566077)
While this is a good general rule of thumb, this terminology has nothing to do with how these terms are formally defined.

Verification first and foremost concerns design and development stage, a formal definition would be something like "outputs of design and development step meet specified requirements for that step". For example, you could verify that a formal specification for a module actually implements imposed requirements. Especially in software this can get murky as you cover different phases with different tests/suites, e.g. unit, integration, e2e implicitly test different stages, yet are often part of the same testing run.

Validation first and foremost concerns the whole system/product and fitness for market availability.

For example you would verify that e.g. for a motor vehicle ABS functions correctly, airbags deploy in a crash and frame meets passenger safety requirements in a crash, and you would still not be able to sell such vehicle. You would validate the vehicle as a whole with corresponding regulatory body to get vehicle deemed fit for market.

TLDR: Verification is getting passing grade in a lab test, validation is submitting all relevant lab test protocols to get CE certified.

Re:Three ways "formally verified" can go wrong by tirant on Monday October 13, 2025 @08:10AM (#45567463)
Just by reading the headlines I immediately suspected the topic of Verification vs Validation would be involved. I still cannot comprehend why it is still such a gap in many software projects I have worked in. Everyone knows about testing but barely a few understand or want to understand why Validation is equally important.