I made my own a few years back - if you get two accurate incubator thermometers (they must read the same temperature) and wire them to the side of a very small piece of wood - then attach a small plastic container beneath one - an old film canister was perfect but they are harder to find now, cut a small clearance hole in the lid. Take a piece of wick that when stretched fits over the bulb of the thermometer and place it in the tub, passing through the hole in the lid and onto the thermometer bulb. Add water and hey presto - Wet bulb temperature and Dry bulb temperature. You use a look up table to get the % humidity.
Alternatively, I would go with the electronic version as suggested but check the accuracy quoted before buying.