I was just thinking earlier since I have the same problems with my benches - could you wear wrist weights while holding a 20lb dumbbell?
You can also buy things called plate mates that are small magnetic weights that you can stick on the dumbbell plates. Those wouldn't work for me since our weights are rubber and they don't sell them over this side of the pond
