Building traps for them is fun. Take a plastic soda bottle, cut it in half, take the top half and turn it upside down and stick it back into the bottom half. Then pour some syrup or sweet stuff into the bottle and put it out somewhere where they can find it. They'll fly in through the hole to get the sweet stuff and then be too dumb to get back out and eventually fall into the syrup/water and drown.
We always used to do that when we went camping. Normally I'm not too big on that kind of stuff but wasps are vicious motherfuckers and they deserve it.