Yeah, the itching is caused by the hairs growing back.
You might try treating the area with witch hazel...but honestly you'll probably either need to shave it again, or just bear with the itch for a few days.
I tried this a couple times in college...after that, it been strictly trims with scissors for me.