The show's focus on "serious" rock music rather than chart hits was emphasised by a lack of showbiz glitter: bands would often perform their songs in front of either the bare studio walls or plain wooden boards (actually the backs of set walls from other programmes filmed in the same studio). As with many BBC productions, this was (initially at least) as much a matter of money as of style; other late night shows of the time, having only 'minority' appeal, also had to be content with spartan sets. Another factor was that the programme was originally made in a studio known as "Pres B", which had been originally intended for in-vision continuity. The studio was only 32x22  feet (a little under 10 x 7 metres) which left little room for a set once the cameras and band were in.
The series' opening titles consisted of an animation of a male figure (known as the 'Star Kicker') made up of stars dancing. The programme's title music, with its distinctive harmonica theme, was a track called "Stone Fox Chase" by a Nashville band, Area Code 615 (once played live on the show, in 1978, by Val Doonican and Charlie McCoy).
The first host was Richard Williams, features editor of Melody Maker, the music weekly. From 1972, the programme was presented by DJ Bob Harris (nicknamed "Whispering Bob Harris", due to his quiet voice and "laid back" style). He later became notorious among the younger generation for calling the New York Dolls "mock rock" and left OGWT in 1978.
Anne Nightingale took over as host in 1978 when it was felt the programme was behind the times in its failure to embrace punk. This was acknowledged when The Adverts opened Nightingale's first show, T. V. Smith beginning with the words "At last the 1978 show" (a pun on the television comedy At Last the 1948 Show) and a sigh of relief that the programme was finally contemporary.
In December 1980 Nightingale faced the daunting task of presenting the show in the immediate aftermath of the shooting of John Lennon (who had himself appeared on the show in 1975). This particular episode consisted almost entirely of interviews with various people about Lennon's life and career.
In 1983, the programme was moved to a live mid-evening slot. The title was abridged to Whistle Test and the title credits and music were changed. The programme's run ended with a live New Year's Eve special broadcast through to the early hours of New Year's Day 1988; material included "Hotel California" by The Eagles, live from 1977, and "Bat Out of Hell" by Meat Loaf.
The executive producer of The Old Grey Whistle Test was Mike Appleton. Tom Corcoran, Derek Burbidge and Kate Humphreys directed and videoed many of the artists. The audio was always of prime importance. Gregg Baily was the recordist for the show on location.
Although many assumed the bands were playing live, due to technical issues and the need to ensure performances were controlled, the bands often recorded the performance on the day of shooting prior to taping, and then mimed to this "live" track.
Other directors and camera operators were Martin Pitts in the USA, and for England, John Metcalfe and Tim Pope and many others. Location shoots all over the world were an essential part of the programme.