NavMeshAgent is slower when TimeScale is higher?

I want to give the impression time is moving faster using Time.timescale. Everything works fine apart from the NavMeshAgent. The actor seems to be slower whenever I increase the Time.timescale value.

I set a basic test where the agent goes from A to B then back to A over and over and tried to see how long it takes him between each point. To do so I have on Update():

worldTime += Time.deltaTime;

And I print the 'worldTime' every time the actor arrives at point A or B.

Timescale = 1

• worldTime at A: 2.52

• worldTime at B: 9.11

• worldTime at A: 15.69 +6 secs

• worldTime at B: 22.28 + 6 secs

Timescale = 40

• worldTime at A: 2.52

• worldTime at B: 11.98

• worldTime at A: 22.33 +10 secs

• worldTime at B: 32.98 +10 secs

I realized that the higher I go with the Time.timescale value, the longer the time it takes between A and B in the world time(at Timescale 90 it takes around 15 secs).

I need these times to be the same whatever the timeScale value is. Is there a way to fix it? Maybe I'm doing something wrong?