A one second delay in site load leads to a 7% drop in conversions

Click to enlarge

Source:  Taken from Aberdeen Group's The Performance of Web Applications, November 2008
Note - this is a very old, and often quoted stat.  If you know of a newer one please leave a comment!