A Cajun fiddler with close ties to several Byrds.

Guilbeau began his career in the mid-1960s with Gene Parsons and Wayne Moore in Vegas country act the Castaways. That band metamorphosed into Cajun Gib and Gene, and then, with the addition of Clarence White, into Nashville West.

After White and then Parsons defected to the Byrds in the late 1960s, Guilbeau formed the country-rock band Swampwater with John Beland and Glen D. Hardin.

In the mid-19'70s, Guilbeau revived the Flying Burrito Brothers name, along with Gene Parsons and two original Burritos, steel player Sneaky Pete Kleinow and bassist Chris Ethridge. Guilbeau remained part of the 'Refried' Burritos through the 1970s, along with ex-Byrd Skip Battin and Kleinow, and, as half of the band's songwriting team with John Beland, was instrumental in their commercial success as a mainstream country act under the name The Burrito Brothers in the 1980s. Guilbeau also participated in the 1990s version of the band with Beland and Kleinow among others.