This test is ignored because we expect it to "ignore but fail". But it will generate a fatal error because it doesn't have the metrics file, thus should have been skipped instead.