How can I make my player stay in the directions i have assigned to it?

Okay so i have made a player character who upon pressing the arrow keys,turns in that direction(note: he does not move).however,when the key is lifted,he keeps returning to the default direction he was in before game initialization.How can i make him stay in a direction when I press an arrow key?