Comics Alliance details Avengers #239 - the issue that featured David Letterman.
It was published in 1984, when Dave's 12:30 NBC show was still somewhat of a cult phenomenon.
Note that Dave uses the "giant phony door knob" as a weapon in this comic. This was a great bit from his original show, and I wish somebody would post it on YouTube.
