According to census records, Anstey was probably born at Otterton (Devon) in 1843. (See particularly the 1881 Census; Otterton is also mentioned in 1851, 1871 and 1911; the 1901 Census says "Atterton", but that's probably a transcription error; the 1891 Census says "East Budleigh", which is a neighbouring village.) The estimated birth year varies between 1841 and 1844, but perhaps he was the Henry Anstey whose birth was registered at St. Thomas (Devon) in the second quarter of 1843.
---
Some other links I was sent on HCA,
His last will:
https://www.flickr.com/photos/dpape/5981131227/sizes/o/in/set-72157622476280739/
Anstey with family:
https://www.flickr.com/photos/dpape/2570901562/sizes/l/in/set-72157605554639906/
or
https://c2.staticflickr.com/4/3020/2570901562_668345f53e_b.jpg
Henry himself:
https://www.flickr.com/photos/dpape/3869656978/in/album-72157605554639906/
His wife:
https://www.flickr.com/photos/dpape/3869656616/in/album-72157605554639906/
Gravestone:
http://membersb.heritagesports.com/cgi-bin/fg.cgi?page=gr&GRid=130654548
and
https://s3-us-west-2.amazonaws.com/find-a-grave-prod/photos/2014/150/130654638_1401571920.jpg
