Literally

The itch went with cold water.

What it means

The dreaded thing turned out to need nothing much at all.

Heard it differently, or know we've got the sense wrong? Tell us — that is exactly the kind of correction this needs.