The 2-year-old, Jamaal Turkvan died on July 4, 2013. Police say Jamaal died from blunt force trauma to his abdomen caused by multiple blows with either a fist or hand.
Theriault has a lengthy criminal history in Vermont and New Hampshire.
Theriault was arrested on Wednesday after a year-long investigation. He's currently being held without bail.
Copyright 2015 Nexstar Broadcasting, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.