After signing with Decca in the late 1950s he released a handful of singles before moving on to Columbia Records, also the home of Dylan. There, he took part in the recording of "Bringing it All Back Home," the album in which Dylan moved firmly from an all-acoustic folk music sound to an electric mixture of pop and rock 'n' roll.
Soon after, he made his first appearance on "The Tonight Show," where he impressed host Johnny Carson so much that Carson contributed liner notes to Rankin's first album, 1967's "Mind Dusters." Other albums included "Family," "Like a Seed," "Inside and "Silver Morning:"
He would go on to appear as Carson's "Tonight Show" guest more than 20 times.
His supple tenor voice on such recordings as "Spanish Harlem," "'Round Midnight" and the Beatles' "Blackbird" and "I've Just a Face" also won him the respect of fellow musicians as a singer's singer.
Mack Records said he so impressed the Beatles' Paul McCartney that McCartney asked him to perform "Blackbird" when he and songwriting partner John Lennon were inducted into the Songwriters Hall Of Fame.
Rankin spent much of the past 20 years touring, although he returned to the studio in the mid-1990s to release a pair of albums, "Professional Dreamer" and "Here In My Heart." He also released a Christmas album in 1999.
Born in New York City on Feb. 10, 1940, Rankin was raised in the city's Washington Heights neighborhood, where he said he grew up listening to a broad spectrum of music, including Afro-Cuban, jazz, Top 40 and Brazilian.
He is survived by his son, Chris Rankin, daughters Chanda Rankin and Jena Rankin-Ray and a granddaughter.
His record label said funeral arrangements are pending.