- The Brothers (Prestige, 1949) – with Stan Getz and Al Cohn
- Zoot Sims All Stars (Zoot Sims – Al Cohn – Kai Winding – George Wallington – Percy Heath – Art Blakey) (1953 Esquire Records)
- Zoot! (Riverside 1956)
- Tenor Conclave (Riverside, 1956) with Hank Mobley, Al Cohn, John Coltrane, Red Garland, Paul Chambers and Art Taylor
- Jutta Hipp with Zoot Sims (Blue Note, 1956) – with Jutta Hipp
- Goes To Jazzville (1956) with Totah, Williams, Bill Anthony, Jerome Lloyd, and Gus Johnson
- Zoot Sims and The Joe Castro Trio Live at Falcon Lair (1956)
- That Old Feeling is a double-issue CD of two 1956 albums, one including “Bohemia After Dark”, Sims’ first recorded alto solo, and Zoot Sims plays Alto, Tenor, and Baritone
- Zoot Sims/Al Cohn – Hoagy Carmichael Sessions and More (1957) recorded in New York, Sims plays tenor and Cohn, baritone with Nick Travis, trombonist Jimmy Cleveland, pianist Elliot Lawrence, bassist Milt Hinton, and drummer Osie Johnson. Arrangements by Bill Elton
- Together Again! (1957) with Al Cohn, Herbie Steward, Serge Chaloff, Elliot Lawrence, Burgher Jones and Don Lamond
- A Night at the Half Note (1959) with Al Cohn, Mose Allison, Paul Motian, Nabil Totah, and Phil Woods
- Either Way (1959–60) with Cecil Colier, Bill Crow, Gus Johnson, and Mose Allison
- The double-CD Al Cohn with Zoot Sims Complete Original Quintet/Sextet Studio Recordings contains:
- their first quintet/sextet collaboration from 1952
- From A To Z (1956)
- Al And Zoot (1957)
- You ‘N’ Me (1960) with Allison, Major Holley, and Osie Johnson. Cohn and Sims play clarinet on “Angel Eyes” and tenor on most tracks
- Down Home (1960) with Dave McKenna, George Tucker, and Dannie Richmond
- At the Half Note Again (1965) with Cohn, pianist Roger Kellaway, bassist Bill Crow, drummer Mel Lewis. On some tracks there is a third tenor player Richie Kamuca and a different rhythm section (pianist Dave Frishberg, bassist Tommy Potter and Lewis
- Bossa Nova Session (1962) – with Jim Hall
- Inter-Action (Cadet, 1965) – with Sonny Stitt
- Waiting Game (Impulse!, 1966) – with orchestra arranged by Gary McFarland
- The Greatest Jazz Concert in the World (1967) with various artists as part of a jam session (Pablo, 1967)
- Al Cohn & Zoot Sims – Easy As Pie – live at the Left Bank Jazz Society night at the Famous Ballroom in Baltimore, 1968. Rhythm section is Dave Frishberg, Victor Sproles on bass and Donald McDonald on drums
- Zoot Sims/Al Cohn – Body and Soul (1973) with Jaki Byard on piano, George Duvivier on bass and Mel Lewis on drums
- Zoot Suite (1973) – live with Jimmy Rowles, George Mraz(bass) and Mousey Alexander
- Joe Venuti/Zoot Sims – Joe & Zoot & More (1973) w Spencer Clark on bass saxophone, Milt Hinton and Bucky Pizzarelli
- Zoot Sims and the Gershwin Brothers (1975) with pianist Oscar Peterson, guitarist Joe Pass, George Mraz and Grady Tate (drums)
- Count Basie/Zoot Sims Basie & Zoot (1975) quartet w bassist John Heard and drummer Louie Bellson. A bluesy set.
- Soprano Sax (1976) with Ray Bryant, George Mraz, and Grady Tate
- Hawthorne Nights (1976) with a small big band and arrangements by Bill Holman
- Somebody Loves Me, a re-issue of tracks cut in the mid-70s for the Groove Merchant label, featuring Sims on tenor and soprano with Bucky Pizzarelli (guitar), Milt Hinton (bass), and Buddy Rich (drums). Some of this was released at the time as the album Nirvana. Reissued by Pilz Records (USA) on CD as Send in the Clowns
- If I’m Lucky (1977) with pianist Jimmy Rowles, George Mraz and Mousey Alexander. Released on Norman Granz‘s Pablo Records
- For Lady Day (1978) Sims, Rowles and Mraz, performing some of Billie Holiday‘s favourite numbers. Jackie Williams on drums
- Zoot Sims and Sweets Edison – Just Friends (1978). Released on Norman Granz‘s Pablo Records
- Zoot Sims in Copenhagen (1978)
- I Wish I Were Twins – Zoot Sims with Jimmy Rowles (1981)
- Art Pepper/Zoot Sims – Art ‘n’ Zoot (1981) – with bassist Ray Brown and guitarist Barney Kessell
- Zoot Sims with Joe Pass – Blues For Two (1982)
- Suddenly It’s Spring – (1983) w Rowles, Mraz and Akira Tana
- Quietly There (1984) Zoot Sims plays Johnny Mandel compositions with Mike Wofford piano, Chuck Berghofer bass, Nick Ceroli drums, and Victor Feldman percussion, his penultimate recording
As Sideman
With Trigger Alpert
- Trigger Happy! (Riverside, 1956)
With Art Farmer
- The Aztec Suite (United Artists, 1959)
With Curtis Fuller
- South American Cookin’ (Epic, 1961)
With Charles Mingus
- The Complete Town Hall Concert (Blue Note, 1962 [1994])
With Gerry Mulligan
- Presenting the Gerry Mulligan Sextet (EmArcy, 1955)
- Mainstream of Jazz (EmArcy, 1956)
With Lalo Schifrin and Bob Brookmeyer
- Samba Para Dos (Verve, 1963)
With Sonny Stitt
- Broadway Soul (Colpix, 1965)
With Sarah Vaughan
- Vaughan and Violins (Mercury, 1958)
- The Duke Ellington Songbook, Vol. 1 (Pablo, 1979)
- Linger Awhile: Live at Newport and More (Pablo, 2000)