C# Randomize Background.Color Issues

I've been trying to create a script which upon start randomizes the background color and changes as you move the scripted gameobject around. For some reason background.color resets to 255 instead of randomizing. Maybe start is causing this issue? Does random.range take longer than a single frame to execute properly?

 using UnityEngine;
 using System.Collections;
 
 public class ColorChangeMove : MonoBehaviour {
     // Use this for initialization
     void Start () {
         GetComponent<Camera>().backgroundColor  = new Color(Random.Range(0, 255),Random.Range(0, 255),Random.Range(0, 255),5);
     }
     
     // Update is called once per frame
     void LateUpdate () {
         GetComponent<Camera>().backgroundColor = new Color(
             GetComponent<Camera>().backgroundColor.r + transform.position.x * Time.smoothDeltaTime,
             GetComponent<Camera>().backgroundColor.g + transform.position.y * Time.smoothDeltaTime,
             GetComponent<Camera>().backgroundColor.b + transform.position.z * Time.smoothDeltaTime,
             5
         );
     }
 }