Jim and his wife Jane (Lentz) are the parents of eight children, Jim III, Jane, Jennifer, Janine, Jill, John, Jason, and Judd, and grandparents of twenty-seven grandchildren. His sons John, Jason, and Judd played and coached in the NFL. John and Jason are assistant coaches with the Dallas Cowboys, Judd is an assistant coach with the St. Louis Rams, and Jim III coaches high school football.
