Transmission trouble?

I am hearing a "whining" noise when I release the gas pedal? It's not all the time but I hear it a lot. Is my transmission going bad? What can I do to make it stop? I have a '98 Toyota Tacoma (manual transmission) 4x4 2.7 liter 4 cyl.