Charles grew up in Wisconsin and remained there with his family until it became too populated and it was starting to grow scarce of food. Caroline, Charles and their children left the big woods and went to Kansas. After many hardships they settled for a while but later were ordered to leave by the government because they lived on Indian territory.

The Ingalls family then settled in Plum Creek of Walnut Grove, Minnesota.

In order to obtain the deed for their land Charles took several jobs like working at Hanson's Mill and repairing the roof and stacking bags of grain at the feed and seed for Liam O'Neil; under the conditions that if it was not done in time O'Neil could take Charles' new oxen as collateral. At a family picnic, while getting a kite down from a tree Charles fell and broke several bones and was advised not to do any work by Doctor Baker.

Charles however attempted to finish stacking the grain bags at the feed and seed but soon was unable to continue.