A perfect model can still get causality backwards