Hacker News

points by nickabe 3 days ago | 0 comments

Tests can be green and I think doing E2E is better than just unit tests. But it's also very easy to have hundreds of tests that are green - but if they are testing the wrong thing then it really doesn't matter.

Ultimately, you spec out these tests and create deterministic code around them - but that doesn't mean that the tests didn't drift from the intended spec.

I think I agree with the author in that what you were TRYING to achieve is much more important than what you actually achieved (in code or tests) and actually using the product is your best defense to see if code / spec has drifted.

[–] manmal 3 days ago

But good gherkin tests encode pretty well what I’m trying to achieve, because they can be super high level - any flight level I want them to be. The only precondition is that the test env can deterministically measure the conditions.

Given the user is logged in

And the XYZ endpoint is offline

And the dashboard is visible

When the user clicks on the endpoint status

Then an overview of XYZ endpoint errors is shown