It turns out that iTerm2 has a 'Open Quickly' shortcut (bound to ⌘+Shift+o) that brings up a Quicksilver like interface, allowing you to quickly search, and switch terminal sessions.
The interface looks like this:
Figure 1. iTerm2 "Open Quickly" interface
One less reason to use your mouse!