Hacker News Reader

Comment by liampulles | Hacker News Reader

"...Bun on Windows passes 98% of our own test suite for Bun on macOS and Linux."

Does this mean the release was made with failing tests, or am I misunderstanding?

Looks like it, it seems the 2% are mostly odd platform specific issues that the authors' did not deem very important (my assumption for the release happening anyway). AFAIK this[1] PR tries to fix them.

[1]: https://github.com/oven-sh/bun/pull/9729

Skipping particular tests depending on platform is a very common practice, for better or worse.

That's not what's happening. Bun has tests that are supposed to work on the platform, but currently doesn't.

Skipping tests from a Linux suite that doesn't make sense to run on Windows is very common. Skipping tests that should pass on a platform but doesn't just in order to cut a release isn't as common.

Every growing project has things thing the maintainers would like to work but that do not currently. The job of the maintainer is to balance the value of releasing a cut of the software as stands and learning about other unknown issues while continuing to work on the known, or to work on the known and ignore the unknown until finished with the known. Neither way is strictly good or bad.

At some point it becomes infeasible to 100% the test suite for all configurations.

At some point further away it becomes infeasible to 100% the test suite for any configuration.

Reply on news.ycombinator.com