"I knew I didn't have what it would've taken to make that movie great," the director said of parting ways with the MCU film ...