In the 1861 census, there is this large household:

Surname Forename Age Relation Occupation Birth Place

Inglefield Samuel 39 Head Lieutenant Commercial R A  Chillenham, Gloucestershire
Inglefield Charlotte 34 Wife Lieutenant Commercial R A Wife  Strutton Hall, Yorkshire
Inglefield Loftes 12 Son Scholar Woolverston, Kent
Inglefield Sophia 11 Daur Scholar Southsea, Hampshire
Inglefield Florence 9 Daur Scholar Southsea, Hampshire
Inglefield Frederick 6 Son Scholar Woolwich, Kent
Inglefield Arthur 5 Son Scholar Southsea, Hampshire
Holmes Miss 20 - Governess Chichester, Sussex
Madden Miss 39 Serv Nurse Ireland Mason
Rebecca 23 Serv House Maid Snaps, Yorkshire
Clarken Lucy 15 Serv Nursery Maid Durham, Durham
Gard Thomas 19 Serv Footman Clifton, Gloucestershire

Ref: RG9/0546/~F50

Address: 7 East Brook Place
Parish: Dover St James The Apostle
Registration District: Dover
________________

And it is similarly large in 1891:

Name  Relation  Condition Sex Age Birth Year  Occupation  Disability Where born

INGLEFIELD, Samuel H S Head Married M 69 1822  Retired Colonel Royal Artillery  Cheltenham, Gloucestershire
INGLEFIELD, Charlotte Wife Married F 64 1827
Scruton, Yorkshire
INGLEFIELD, Sophia C A Daughter Single F 40  1851
Southsea, Hampshire
HAYWOOD, Olga V W Granddaughter F 16 1875
Bombay, India British Subject
INGLEFIELD, Lionel D L Grandson M 9 1882
Knightsbridge, London
INGLEFIELD, Julian P Grandson M 7 1884
Ireland
LOUGHRAM, Margaret A Servant Single F 24 1867  Nurse Domestic  Ireland
LOUGHRAM, Francis J Servant Single F 22 1869  Cook Domestic  Ireland
MADDEN, Mary Servant Single F 23 1868 Housemaid Domestic  Ireland Cork

Piece: 3967 Folio: 42 Page: 71

Registration District: Scarborough
Civil Parish: Scarborough
Municipal Borough: Scarborough
Address: 1, Albion Road, Scarborough
County: Yorkshire (North Riding)
_____________

His death:

Surname First name(s) Age District Vol  Page
Deaths Sep 1910   (>99%)
Inglefield Samuel H S 88 Eton 3a 353

I would guess that he died at his daughter’s in Old Windsor.