We were running it in shippable and travis, but since it didn't return
an error it wasn't actually catching things.