Dynamic objects turn grey when baking light

I'm using Unity 5 to make a mobile game. Therefore, I can't afford to have realtime GI. I have one directional light with baking turned to "baked" instead of "realtime". This, however causes all objects that are not flagged as static to turn grey and ugly looking. Even a model that uses the default material (which is white), becomes grey when using baked lightmap, but not when using realtime lightmapping.

How can I make dynamic objects retain their color (white) when using baked lighting? (Using light probes is not really an option, since the main game object will constantly be traveling upwards with pretty high speed, which would require an enormous amount of light probes.

Thanks!