I figured it out, intellipoint had the wheel/mid-click set to something else. Mapped another button on the mouse for Middle-Button and it works now. Not sure why you just didn't use the right mouse button as it doesn't seem to do anything else on the cloth map.