spi: Fix warnings about CS# being de-asserted.