I would recommend getting at least 8" or so (more if you're running longer cars) of straight track in there. Make it long enough that each loco and car can negotiate one curve at a time. The longer the straight section, the better, but of course that will eat up linear space.
Got a plan that you can post?