Armey was a scout for the Atlanta Falcons from 1988-90 and a scout for the Green Bay Packers from 1985-87. He served the Denver Gold, Memphis Showboats, and Chicago Blitz of the USPL as an assistant coach, director of scouting, and as an assistant general manager from 1983-85. He was the Gold's head coach for one game in 1983 and was a scout for the Buffalo Bills from 1978-82.

Charley began his career as linebackers' coach at North Dakota State in 1968, was head coach and athletic director at Montana Tech from 1969-70, defensive coordinator at Montana, 1971-73, and assistant head coach and offensive and defensive coordinator at Colorado State from 1973-78.

Armey, a four-year veteran of the U.S. Navy, holds a bachelor's degree from Valley City State in North Dakota and a master's degree from North Dakota State. Armey enjoys classical music and reading, and authored a book, Winning Football with the 4-3 Defense. Charley and his wife, Audrey, reside in Lake St. Louis, Missouri, and have two daughters, Lisa and KeIlie, and two grandsons, Travis and Tristam.