Almost all "real rock" ballast dries darker than it looks, including plain sand. Gluing washes the dust off, and the remaining rocks are darker. So, yes, mix it a little lighter than you want. Ballasting a test section, which can be as simple as scrap track nailed to a board, is also a good idea, if you want an exact match for a prototype scene.