Try to avoid using xfail fixture. Use inline function instead:

if text_visible(p, "Destination cannot be located in the US"):
    pytest.xfail(reason="Negative - Origin and destination inside the US")

That way only that specific issue/code line will be expected to fail, not “anything” within a test.