UPDATE: I was able to get my TM apart to give it a through once over. Everything checked out ok- trucks, worm gears, drive shaft. Turned out it was the contact between the motor leads and the PC board. I bent the leads up a bit so they would contact better and used some rubbing alcohol to clean the bottom of the PC board contacts, which had a little dirt on them. It runs well now.
Thanks for all your help guys!