E. Cobham Brewer 18101897. Dictionary of Phrase and Fable. 1898.
Back-hander.
A blow on the face with the back of the hand. Also one who takes back the decanter in order to hand himself another glass before the decanter is passed on.
1
Ill take a back-hander, as Clive dont seem to drink.Thackeray: The Newcomes.