Charley grew up in Celina, Texas about an hour north of Dallas where he played football and baseball and was involved with the Fellowship of Christian Athletes. He went on to attend The University of Alabama and was a member of the baseball team all four years of college. After college he coached high school football and baseball and taught special education in McKinney, Texas at McKinney Boyd High School. He then coached baseball collegiately at Northwestern State University in Natchitoches, Louisiana for two years.
Charley has one older brother, Trey, and his parents are Kent and Lynn Waldrep.
He now lives in Benton, Louisiana with his fiancée, Natalie Stewart.