Let's watch Harvey Pekar commit talk show suicide on David Letterman's old NBC show.
This scene was recreated in the film American Splendor featuring Paul Giamatti as Pekar. If you saw that film, you know Harvey essentially went on the show looking for trouble in the first place.
Dave gets legitimately angry here, and - according to Pekar's comic strip based on the appearance - reportedly told Pekar, "You f---ed up a good thing." when they went to commercial.