His date of birth was "about 1796" in Early Germans of NJ, by Theodore Chambers. Baltimore Genealogical Publishers Company: 1882. If this is true, then he would not have appeared in any of the censuses.
From Ronny Bodine (Dec. 24, 2021):
Charles died in infancy. There is a little info on Charles in "History of the West Branch Valley," page 522. His date of birth was "about 1796" in Early Germans of NJ, by Theodore Chambers. Baltimore Genealogical Publishers Company: 1882.