We're running the hypothesis test suite as part of our integration tests and packaging fails occasionally.
For example:
self = <tests.property.test_specifier_matching.TestCompatibleReleaseDefinition object at 0xffff81484550>
@given(spec_ver=multi_segment_versions(), candidate=pep440_versions())
> @SETTINGS
E hypothesis.errors.FailedHealthCheck: It looks like this test is filtering out a lot of inputs. 9 inputs were generated successfully, while 50 inputs were filtered out.
E
E An input might be filtered out by calls to assume(), strategy.filter(...), or occasionally by Hypothesis internals.
E
E Applying this much filtering makes input generation slow, since Hypothesis must discard inputs which are filtered out and try generating it again. It is also possible that applying this much filtering will distort the domain and/or distribution of the test, leaving your testing less rigorous than expected.
E
E If you expect this many inputs to be filtered out during generation, you can disable this health check with @settings(suppress_health_check=[HealthCheck.filter_too_much]). See https://hypothesis.readthedocs.io/en/latest/reference/api.html#hypothesis.HealthCheck for details.
tests/property/test_specifier_matching.py:202: FailedHealthCheck
FAIL: tests/property/test_specifier_matching.py:TestCompatibleReleaseDefinition.test_compatible_release_matches_expected_compatible
We've only seen this a handful of times but it's always in the same test. It appears that the filtering function is rejecting slightly too many inputs and the random generation means it sometimes trips the health check.
We're running the hypothesis test suite as part of our integration tests and packaging fails occasionally.
For example:
We've only seen this a handful of times but it's always in the same test. It appears that the filtering function is rejecting slightly too many inputs and the random generation means it sometimes trips the health check.