This is similar to what fenugrec asked to have on IRC: click+drag selects (instead of drags) <modifier>+mouse (either click+drag or scrollwheel) to pan and zoom