Named captain of the Manhattan men's golf team as a sophomore and did not relinquish the title for the next three years. Fisher set a school record with a round of 68, which remained unbroken until 2009. In his freshman year, Fisher shot an 81, despite playing through a snowy course, which helped the Jaspers to a win over Army at West Point. In 1972-73, Fisher earned a medal vs. Seton Hall, shooting an 81, and later that year he posted 78's in matches against Columbia, Cornell and Army. As a senior, he shot the lowest Jasper score of 80 at the ECAC Tournament, and the lowest score among the Jaspers at the Metropolitan Golf Association Tournament. For the third year in a row, he was named the Manhattan golf team's Most Outstanding Performer. Fisher was also named an Outstanding College Athlete in America for three years and a was a member of the Dean's List from 1972-1974.