Duckietown Challenges Home Challenges Submissions

Evaluator 2453

ID2453
evaluatorgpu-prod-01
ownerI don't have one 😀
machinegpu_fd9f8bea230b
processgpu-prod-01_fd9f8bea230b
version6.1.27
first heard
last heard
statusinactive
# evaluating
# success2 44165
# timeout1 45738
# failed
# error1 44278
# aborted26 44308
# host-error18 45518
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4573811801Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simtimeoutnogpu-prod-01----No reset possible
4573011803Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4571811410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simhost-errornogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ae1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0&fromImage=docker.io%2Fandreacensi%2Faido5-lf-sim-validation-lfv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:e1e8de561318f5f33b56ee002d3a480a9499ccf54f90bbdd6c869c76eb6649e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4570911803Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4570611806Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f&fromImage=docker.io%2Fandreacensi%2Faido5-lfvi_multi-sim-validation-lfviv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4569411802Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4568811805Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4567611802Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4566911799Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4566611799Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4565011804Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4564211866Bea Baselines 🐤template-pytorchaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f&fromImage=docker.io%2Fandreacensi%2Faido5-lfvi_multi-sim-validation-lfviv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4562211848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ad6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator@sha256:d6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator@sha256:d6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4559511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4558711850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4557411850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4556611850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simhost-errornogpu-prod-010:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4554611848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ad6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator@sha256:d6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-testing-lfvmultibodyv-sim-evaluator@sha256:d6ab8f9b737d9f05ebccbcc95f9efcadd48c2c87980dd655410793fe6e3bacb6
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4551811848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Afbbd993a86dd666b40a94c884ccefddb221bbbc2578c4be4b020f5900c730465&fromImage=docker.io%2Fandreacensi%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido-submissions@sha256:fbbd993a86dd666b40a94c884ccefddb221bbbc2578c4be4b020f5900c730465  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido-submissions@sha256:fbbd993a86dd666b40a94c884ccefddb221bbbc2578c4be4b020f5900c730465
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4547911850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4543211848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:00:31
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4539211848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:00:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4536511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:39
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4531511848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4529511848Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:00:31
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4525511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4522511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4519511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:01:05
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4515311850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4511111850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4507811850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4503911850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4499711850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4494911850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4491511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4487211850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4484011850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4479511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4475811850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:37
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4473211850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4469611850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4463511850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4459211850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4454111850Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:00:45
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4430811835Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednogpu-prod-010:15:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4427811830Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simerrornogpu-prod-010:02:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4419011812Bea Baselines 🐤template-rosaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessnogpu-prod-010:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6115996441804761
survival_time_median3.949999999999994
deviation-center-line_median0.22230368739517892
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego0_max0.012011401260955424
agent_compute-ego0_mean0.011866094785856289
agent_compute-ego0_median0.01193887922498915
agent_compute-ego0_min0.011648003871624287
agent_compute-ego1_max0.012152656530722594
agent_compute-ego1_mean0.01168206746174074
agent_compute-ego1_median0.011613293539119673
agent_compute-ego1_min0.011280252315379956
agent_compute-ego2_max0.012920917405022516
agent_compute-ego2_mean0.01175413337210064
agent_compute-ego2_median0.011448300801790675
agent_compute-ego2_min0.010893181909488726
complete-iteration_max0.41415328857226247
complete-iteration_mean0.4061962511957702
complete-iteration_median0.4129236317888091
complete-iteration_min0.3915118332262392
deviation-center-line_max0.6462097954312954
deviation-center-line_mean0.26143882350763004
deviation-center-line_min0.09471234890128628
deviation-heading_max2.7477865404847557
deviation-heading_mean0.93169406922398
deviation-heading_median0.7353394674861208
deviation-heading_min0.3853830600754873
driven_any_max4.015167719567092
driven_any_mean1.1163334698037315
driven_any_median0.907126002430467
driven_any_min0.4432194951407477
driven_lanedir_consec_max0.93193954888622
driven_lanedir_consec_mean0.6046473479859168
driven_lanedir_consec_min0.31123246831254336
driven_lanedir_max0.93193954888622
driven_lanedir_mean0.6046473479859168
driven_lanedir_median0.6115996441804761
driven_lanedir_min0.31123246831254336
get_duckie_state_max1.8322909319842303e-06
get_duckie_state_mean1.8054875786747248e-06
get_duckie_state_median1.815649179311899e-06
get_duckie_state_min1.7685226247280458e-06
get_robot_state_max0.02103258401919634
get_robot_state_mean0.020876939062536997
get_robot_state_median0.020883536037010483
get_robot_state_min0.02071469713140417
get_state_dump_max0.014430963540379003
get_state_dump_mean0.014102541706058104
get_state_dump_median0.01413839923010932
get_state_dump_min0.013738262347685984
get_ui_image_max0.04302058340627936
get_ui_image_mean0.041535589085280766
get_ui_image_median0.04092075294918484
get_ui_image_min0.04066543090037811
in-drivable-lane_max10.45000000000006
in-drivable-lane_mean2.800000000000012
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.4432194951407477, "get_ui_image": 0.04092075294918484, "step_physics": 0.23527389455724643, "survival_time": 13.500000000000057, "driven_lanedir": 0.44123419328007074, "get_state_dump": 0.01413839923010932, "get_robot_state": 0.02071469713140417, "sim_render-ego0": 0.0040045649917037395, "sim_render-ego1": 0.003914044521473072, "sim_render-ego2": 0.004064961715980813, "get_duckie_state": 1.8322909319842303e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.7477865404847557, "agent_compute-ego0": 0.01193887922498915, "agent_compute-ego1": 0.011280252315379956, "agent_compute-ego2": 0.012920917405022516, "complete-iteration": 0.3915118332262392, "set_robot_commands": 0.002631505330403646, "deviation-center-line": 0.6462097954312954, "driven_lanedir_consec": 0.44123419328007074, "sim_compute_sim_state": 0.017035054277490688, "sim_compute_performance-ego0": 0.002430870797899034, "sim_compute_performance-ego1": 0.0024095288029423465, "sim_compute_performance-ego2": 0.002388573575902868}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 1.1390233317110388, "get_ui_image": 0.04092075294918484, "step_physics": 0.23527389455724643, "survival_time": 13.500000000000057, "driven_lanedir": 0.7356672581552575, "get_state_dump": 0.01413839923010932, "get_robot_state": 0.02071469713140417, "sim_render-ego0": 0.0040045649917037395, "sim_render-ego1": 0.003914044521473072, "sim_render-ego2": 0.004064961715980813, "get_duckie_state": 1.8322909319842303e-06, "in-drivable-lane": 10.25000000000006, "deviation-heading": 0.8622263589279874, "agent_compute-ego0": 0.01193887922498915, "agent_compute-ego1": 0.011280252315379956, "agent_compute-ego2": 0.012920917405022516, "complete-iteration": 0.3915118332262392, "set_robot_commands": 0.002631505330403646, "deviation-center-line": 0.26024745827126833, "driven_lanedir_consec": 0.7356672581552575, "sim_compute_sim_state": 0.017035054277490688, "sim_compute_performance-ego0": 0.002430870797899034, "sim_compute_performance-ego1": 0.0024095288029423465, "sim_compute_performance-ego2": 0.002388573575902868}, "ETHZ_autolab_technical_track-sc0-0-ego2": {"driven_any": 4.015167719567092, "get_ui_image": 0.04092075294918484, "step_physics": 0.23527389455724643, "survival_time": 13.500000000000057, "driven_lanedir": 0.6251660703918687, "get_state_dump": 0.01413839923010932, "get_robot_state": 0.02071469713140417, "sim_render-ego0": 0.0040045649917037395, "sim_render-ego1": 0.003914044521473072, "sim_render-ego2": 0.004064961715980813, "get_duckie_state": 1.8322909319842303e-06, "in-drivable-lane": 10.45000000000006, "deviation-heading": 1.435300152363987, "agent_compute-ego0": 0.01193887922498915, "agent_compute-ego1": 0.011280252315379956, "agent_compute-ego2": 0.012920917405022516, "complete-iteration": 0.3915118332262392, "set_robot_commands": 0.002631505330403646, "deviation-center-line": 0.16753688199300665, "driven_lanedir_consec": 0.6251660703918687, "sim_compute_sim_state": 0.017035054277490688, "sim_compute_performance-ego0": 0.002430870797899034, "sim_compute_performance-ego1": 0.0024095288029423465, "sim_compute_performance-ego2": 0.002388573575902868}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.4680043391491516, "get_ui_image": 0.04302058340627936, "step_physics": 0.2509126331232771, "survival_time": 3.949999999999994, "driven_lanedir": 0.45944177336305, "get_state_dump": 0.014430963540379003, "get_robot_state": 0.020883536037010483, "sim_render-ego0": 0.004013879389702519, "sim_render-ego1": 0.003926778141456314, "sim_render-ego2": 0.0038821546337272543, "get_duckie_state": 1.7685226247280458e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.3853830600754873, "agent_compute-ego0": 0.012011401260955424, "agent_compute-ego1": 0.011613293539119673, "agent_compute-ego2": 0.010893181909488726, "complete-iteration": 0.4129236317888091, "set_robot_commands": 0.0025642702851114392, "deviation-center-line": 0.27484014120670813, "driven_lanedir_consec": 0.45944177336305, "sim_compute_sim_state": 0.02229768113244938, "sim_compute_performance-ego0": 0.0024229001395310026, "sim_compute_performance-ego1": 0.0023732034465934657, "sim_compute_performance-ego2": 0.002338985853557345}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 1.0924538329135092, "get_ui_image": 0.04302058340627936, "step_physics": 0.2509126331232771, "survival_time": 3.949999999999994, "driven_lanedir": 0.93193954888622, "get_state_dump": 0.014430963540379003, "get_robot_state": 0.020883536037010483, "sim_render-ego0": 0.004013879389702519, "sim_render-ego1": 0.003926778141456314, "sim_render-ego2": 0.0038821546337272543, "get_duckie_state": 1.7685226247280458e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 0.7353394674861208, "agent_compute-ego0": 0.012011401260955424, "agent_compute-ego1": 0.011613293539119673, "agent_compute-ego2": 0.010893181909488726, "complete-iteration": 0.4129236317888091, "set_robot_commands": 0.0025642702851114392, "deviation-center-line": 0.22230368739517892, "driven_lanedir_consec": 0.93193954888622, "sim_compute_sim_state": 0.02229768113244938, "sim_compute_performance-ego0": 0.0024229001395310026, "sim_compute_performance-ego1": 0.0023732034465934657, "sim_compute_performance-ego2": 0.002338985853557345}, "ETHZ_autolab_technical_track-sc0-1-ego2": {"driven_any": 0.4534762584097082, "get_ui_image": 0.04302058340627936, "step_physics": 0.2509126331232771, "survival_time": 3.949999999999994, "driven_lanedir": 0.31123246831254336, "get_state_dump": 0.014430963540379003, "get_robot_state": 0.020883536037010483, "sim_render-ego0": 0.004013879389702519, "sim_render-ego1": 0.003926778141456314, "sim_render-ego2": 0.0038821546337272543, "get_duckie_state": 1.7685226247280458e-06, "in-drivable-lane": 2.5999999999999934, "deviation-heading": 0.4182538381817393, "agent_compute-ego0": 0.012011401260955424, "agent_compute-ego1": 0.011613293539119673, "agent_compute-ego2": 0.010893181909488726, "complete-iteration": 0.4129236317888091, "set_robot_commands": 0.0025642702851114392, "deviation-center-line": 0.09471234890128628, "driven_lanedir_consec": 0.31123246831254336, "sim_compute_sim_state": 0.02229768113244938, "sim_compute_performance-ego0": 0.0024229001395310026, "sim_compute_performance-ego1": 0.0023732034465934657, "sim_compute_performance-ego2": 0.002338985853557345}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.44505450095151294, "get_ui_image": 0.04066543090037811, "step_physics": 0.2520562196389223, "survival_time": 3.899999999999994, "driven_lanedir": 0.44402014561826486, "get_state_dump": 0.013738262347685984, "get_robot_state": 0.02103258401919634, "sim_render-ego0": 0.004071880609561236, "sim_render-ego1": 0.003974070915809045, "sim_render-ego2": 0.003937556193425105, "get_duckie_state": 1.815649179311899e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.3903812742250666, "agent_compute-ego0": 0.011648003871624287, "agent_compute-ego1": 0.012152656530722594, "agent_compute-ego2": 0.011448300801790675, "complete-iteration": 0.41415328857226247, "set_robot_commands": 0.0026262448384211613, "deviation-center-line": 0.19568713170660657, "driven_lanedir_consec": 0.44402014561826486, "sim_compute_sim_state": 0.024061933541909244, "sim_compute_performance-ego0": 0.002455476002815442, "sim_compute_performance-ego1": 0.002427856127421061, "sim_compute_performance-ego2": 0.0023791331511277417}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 1.0834757479603565, "get_ui_image": 0.04066543090037811, "step_physics": 0.2520562196389223, "survival_time": 3.899999999999994, "driven_lanedir": 0.6115996441804761, "get_state_dump": 0.013738262347685984, "get_robot_state": 0.02103258401919634, "sim_render-ego0": 0.004071880609561236, "sim_render-ego1": 0.003974070915809045, "sim_render-ego2": 0.003937556193425105, "get_duckie_state": 1.815649179311899e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.5342509189954274, "agent_compute-ego0": 0.011648003871624287, "agent_compute-ego1": 0.012152656530722594, "agent_compute-ego2": 0.011448300801790675, "complete-iteration": 0.41415328857226247, "set_robot_commands": 0.0026262448384211613, "deviation-center-line": 0.15078658345744886, "driven_lanedir_consec": 0.6115996441804761, "sim_compute_sim_state": 0.024061933541909244, "sim_compute_performance-ego0": 0.002455476002815442, "sim_compute_performance-ego1": 0.002427856127421061, "sim_compute_performance-ego2": 0.0023791331511277417}, "ETHZ_autolab_technical_track-sc0-2-ego2": {"driven_any": 0.907126002430467, "get_ui_image": 0.04066543090037811, "step_physics": 0.2520562196389223, "survival_time": 3.899999999999994, "driven_lanedir": 0.8815250296854997, "get_state_dump": 0.013738262347685984, "get_robot_state": 0.02103258401919634, "sim_render-ego0": 0.004071880609561236, "sim_render-ego1": 0.003974070915809045, "sim_render-ego2": 0.003937556193425105, "get_duckie_state": 1.815649179311899e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8763250122752486, "agent_compute-ego0": 0.011648003871624287, "agent_compute-ego1": 0.012152656530722594, "agent_compute-ego2": 0.011448300801790675, "complete-iteration": 0.41415328857226247, "set_robot_commands": 0.0026262448384211613, "deviation-center-line": 0.34062538320587105, "driven_lanedir_consec": 0.8815250296854997, "sim_compute_sim_state": 0.024061933541909244, "sim_compute_performance-ego0": 0.002455476002815442, "sim_compute_performance-ego1": 0.002427856127421061, "sim_compute_performance-ego2": 0.0023791331511277417}}
set_robot_commands_max0.002631505330403646
set_robot_commands_mean0.0026073401513120823
set_robot_commands_median0.0026262448384211613
set_robot_commands_min0.0025642702851114392
sim_compute_performance-ego0_max0.002455476002815442
sim_compute_performance-ego0_mean0.0024364156467484932
sim_compute_performance-ego0_median0.002430870797899034
sim_compute_performance-ego0_min0.0024229001395310026
sim_compute_performance-ego1_max0.002427856127421061
sim_compute_performance-ego1_mean0.0024035294589856244
sim_compute_performance-ego1_median0.0024095288029423465
sim_compute_performance-ego1_min0.0023732034465934657
sim_compute_performance-ego2_max0.002388573575902868
sim_compute_performance-ego2_mean0.0023688975268626516
sim_compute_performance-ego2_median0.0023791331511277417
sim_compute_performance-ego2_min0.002338985853557345
sim_compute_sim_state_max0.024061933541909244
sim_compute_sim_state_mean0.021131556317283105
sim_compute_sim_state_median0.02229768113244938
sim_compute_sim_state_min0.017035054277490688
sim_render-ego0_max0.004071880609561236
sim_render-ego0_mean0.004030108330322498
sim_render-ego0_median0.004013879389702519
sim_render-ego0_min0.0040045649917037395
sim_render-ego1_max0.003974070915809045
sim_render-ego1_mean0.003938297859579477
sim_render-ego1_median0.003926778141456314
sim_render-ego1_min0.003914044521473072
sim_render-ego2_max0.004064961715980813
sim_render-ego2_mean0.003961557514377724
sim_render-ego2_median0.003937556193425105
sim_render-ego2_min0.0038821546337272543
simulation-passed1
step_physics_max0.2520562196389223
step_physics_mean0.2460809157731486
step_physics_median0.2509126331232771
step_physics_min0.23527389455724643
survival_time_max13.500000000000057
survival_time_mean7.116666666666682
survival_time_min3.899999999999994
No reset possible
4416511788Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessnogpu-prod-010:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4513226228765323
survival_time_median2.6999999999999984
deviation-center-line_median0.10221366864314324
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego0_max0.011921158376729713
agent_compute-ego0_mean0.01135910392006983
agent_compute-ego0_median0.011108706214211204
agent_compute-ego0_min0.011047447169268572
agent_compute-ego1_max0.012162100593998746
agent_compute-ego1_mean0.011379276196813198
agent_compute-ego1_median0.011014288122003729
agent_compute-ego1_min0.01096143987443712
agent_compute-ego2_max0.011330537076266307
agent_compute-ego2_mean0.010762759984515258
agent_compute-ego2_median0.010508819059892134
agent_compute-ego2_min0.010448923817387334
complete-iteration_max0.4186203877131144
complete-iteration_mean0.4140622704374874
complete-iteration_median0.41359185722638975
complete-iteration_min0.4099745663729581
deviation-center-line_max0.25522699154298745
deviation-center-line_mean0.1351503385888991
deviation-center-line_min0.07704213956438252
deviation-heading_max0.4968270620134011
deviation-heading_mean0.3401036968820363
deviation-heading_median0.3178062212227546
deviation-heading_min0.197674152616458
driven_any_max1.0694467179451983
driven_any_mean0.7245237198242859
driven_any_median0.634085891521401
driven_any_min0.44853348101270807
driven_lanedir_consec_max0.803926818595218
driven_lanedir_consec_mean0.5546985425760107
driven_lanedir_consec_min0.3461853921480116
driven_lanedir_max0.803926818595218
driven_lanedir_mean0.5546985425760107
driven_lanedir_median0.4513226228765323
driven_lanedir_min0.3461853921480116
get_duckie_state_max1.902850169055867e-06
get_duckie_state_mean1.7976108561769195e-06
get_duckie_state_median1.798976551402699e-06
get_duckie_state_min1.6910058480721933e-06
get_robot_state_max0.02083344893022017
get_robot_state_mean0.0207152963833229
get_robot_state_median0.02071580796871545
get_robot_state_min0.020596632251033076
get_state_dump_max0.014019201386649652
get_state_dump_mean0.01396312733919146
get_state_dump_median0.014007939232720267
get_state_dump_min0.013862241398204456
get_ui_image_max0.04180092723281295
get_ui_image_mean0.041101847278484385
get_ui_image_median0.04088416189517615
get_ui_image_min0.04062045270746405
in-drivable-lane_max1.5499999999999985
in-drivable-lane_mean0.644444444444443
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.45800751537035805, "get_ui_image": 0.04062045270746405, "step_physics": 0.25232794935053043, "survival_time": 2.7499999999999982, "driven_lanedir": 0.4513226228765323, "get_state_dump": 0.013862241398204456, "get_robot_state": 0.02083344893022017, "sim_render-ego0": 0.003997100483287465, "sim_render-ego1": 0.003925492546775124, "sim_render-ego2": 0.0038887544111772016, "get_duckie_state": 1.798976551402699e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.4909349690432338, "agent_compute-ego0": 0.011108706214211204, "agent_compute-ego1": 0.011014288122003729, "agent_compute-ego2": 0.010508819059892134, "complete-iteration": 0.4099745663729581, "set_robot_commands": 0.00274616154757413, "deviation-center-line": 0.25522699154298745, "driven_lanedir_consec": 0.4513226228765323, "sim_compute_sim_state": 0.022222380204634233, "sim_compute_performance-ego0": 0.002451961690729315, "sim_compute_performance-ego1": 0.0023953134363347835, "sim_compute_performance-ego2": 0.002378103949806907}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 1.0694467179451983, "get_ui_image": 0.04062045270746405, "step_physics": 0.25232794935053043, "survival_time": 2.7499999999999982, "driven_lanedir": 0.748971050170999, "get_state_dump": 0.013862241398204456, "get_robot_state": 0.02083344893022017, "sim_render-ego0": 0.003997100483287465, "sim_render-ego1": 0.003925492546775124, "sim_render-ego2": 0.0038887544111772016, "get_duckie_state": 1.798976551402699e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 0.3150628149214953, "agent_compute-ego0": 0.011108706214211204, "agent_compute-ego1": 0.011014288122003729, "agent_compute-ego2": 0.010508819059892134, "complete-iteration": 0.4099745663729581, "set_robot_commands": 0.00274616154757413, "deviation-center-line": 0.10221366864314324, "driven_lanedir_consec": 0.748971050170999, "sim_compute_sim_state": 0.022222380204634233, "sim_compute_performance-ego0": 0.002451961690729315, "sim_compute_performance-ego1": 0.0023953134363347835, "sim_compute_performance-ego2": 0.002378103949806907}, "ETHZ_autolab_technical_track-sc0-0-ego2": {"driven_any": 0.5281377270490605, "get_ui_image": 0.04062045270746405, "step_physics": 0.25232794935053043, "survival_time": 2.7499999999999982, "driven_lanedir": 0.3699920202433282, "get_state_dump": 0.013862241398204456, "get_robot_state": 0.02083344893022017, "sim_render-ego0": 0.003997100483287465, "sim_render-ego1": 0.003925492546775124, "sim_render-ego2": 0.0038887544111772016, "get_duckie_state": 1.798976551402699e-06, "in-drivable-lane": 1.4999999999999978, "deviation-heading": 0.3402686501065437, "agent_compute-ego0": 0.011108706214211204, "agent_compute-ego1": 0.011014288122003729, "agent_compute-ego2": 0.010508819059892134, "complete-iteration": 0.4099745663729581, "set_robot_commands": 0.00274616154757413, "deviation-center-line": 0.082686111045166, "driven_lanedir_consec": 0.3699920202433282, "sim_compute_sim_state": 0.022222380204634233, "sim_compute_performance-ego0": 0.002451961690729315, "sim_compute_performance-ego1": 0.0023953134363347835, "sim_compute_performance-ego2": 0.002378103949806907}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.44853348101270807, "get_ui_image": 0.04180092723281295, "step_physics": 0.25715327704394303, "survival_time": 2.6999999999999984, "driven_lanedir": 0.4480250747196772, "get_state_dump": 0.014007939232720267, "get_robot_state": 0.020596632251033076, "sim_render-ego0": 0.004265688083789966, "sim_render-ego1": 0.004176938975298846, "sim_render-ego2": 0.004131811636465567, "get_duckie_state": 1.6910058480721933e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.197674152616458, "agent_compute-ego0": 0.011047447169268572, "agent_compute-ego1": 0.01096143987443712, "agent_compute-ego2": 0.010448923817387334, "complete-iteration": 0.4186203877131144, "set_robot_commands": 0.0029628011915418836, "deviation-center-line": 0.07704213956438252, "driven_lanedir_consec": 0.4480250747196772, "sim_compute_sim_state": 0.02334776631108037, "sim_compute_performance-ego0": 0.002586695883009169, "sim_compute_performance-ego1": 0.002543458232173213, "sim_compute_performance-ego2": 0.0025054746203952366}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 1.069110376518297, "get_ui_image": 0.04180092723281295, "step_physics": 0.25715327704394303, "survival_time": 2.6999999999999984, "driven_lanedir": 0.803926818595218, "get_state_dump": 0.014007939232720267, "get_robot_state": 0.020596632251033076, "sim_render-ego0": 0.004265688083789966, "sim_render-ego1": 0.004176938975298846, "sim_render-ego2": 0.004131811636465567, "get_duckie_state": 1.6910058480721933e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 0.4968270620134011, "agent_compute-ego0": 0.011047447169268572, "agent_compute-ego1": 0.01096143987443712, "agent_compute-ego2": 0.010448923817387334, "complete-iteration": 0.4186203877131144, "set_robot_commands": 0.0029628011915418836, "deviation-center-line": 0.16741691761824823, "driven_lanedir_consec": 0.803926818595218, "sim_compute_sim_state": 0.02334776631108037, "sim_compute_performance-ego0": 0.002586695883009169, "sim_compute_performance-ego1": 0.002543458232173213, "sim_compute_performance-ego2": 0.0025054746203952366}, "ETHZ_autolab_technical_track-sc0-1-ego2": {"driven_any": 0.793713206275548, "get_ui_image": 0.04180092723281295, "step_physics": 0.25715327704394303, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5729468356586889, "get_state_dump": 0.014007939232720267, "get_robot_state": 0.020596632251033076, "sim_render-ego0": 0.004265688083789966, "sim_render-ego1": 0.004176938975298846, "sim_render-ego2": 0.004131811636465567, "get_duckie_state": 1.6910058480721933e-06, "in-drivable-lane": 1.0999999999999976, "deviation-heading": 0.31143273040891, "agent_compute-ego0": 0.011047447169268572, "agent_compute-ego1": 0.01096143987443712, "agent_compute-ego2": 0.010448923817387334, "complete-iteration": 0.4186203877131144, "set_robot_commands": 0.0029628011915418836, "deviation-center-line": 0.11901084825577277, "driven_lanedir_consec": 0.5729468356586889, "sim_compute_sim_state": 0.02334776631108037, "sim_compute_performance-ego0": 0.002586695883009169, "sim_compute_performance-ego1": 0.002543458232173213, "sim_compute_performance-ego2": 0.0025054746203952366}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.4539511869394153, "get_ui_image": 0.04088416189517615, "step_physics": 0.25257456977412385, "survival_time": 2.6499999999999986, "driven_lanedir": 0.44895781686312675, "get_state_dump": 0.014019201386649652, "get_robot_state": 0.02071580796871545, "sim_render-ego0": 0.003914117813110352, "sim_render-ego1": 0.0038666860112604104, "sim_render-ego2": 0.00382054976697238, "get_duckie_state": 1.902850169055867e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.2479658173185499, "agent_compute-ego0": 0.011921158376729713, "agent_compute-ego1": 0.012162100593998746, "agent_compute-ego2": 0.011330537076266307, "complete-iteration": 0.41359185722638975, "set_robot_commands": 0.0025366207338728994, "deviation-center-line": 0.2426740292753437, "driven_lanedir_consec": 0.44895781686312675, "sim_compute_sim_state": 0.02345651950476305, "sim_compute_performance-ego0": 0.0024531742311873525, "sim_compute_performance-ego1": 0.0023400873508093493, "sim_compute_performance-ego2": 0.002331409814222804}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 1.0657273757865866, "get_ui_image": 0.04088416189517615, "step_physics": 0.25257456977412385, "survival_time": 2.6499999999999986, "driven_lanedir": 0.801959251908515, "get_state_dump": 0.014019201386649652, "get_robot_state": 0.02071580796871545, "sim_render-ego0": 0.003914117813110352, "sim_render-ego1": 0.0038666860112604104, "sim_render-ego2": 0.00382054976697238, "get_duckie_state": 1.902850169055867e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 0.3429608542869798, "agent_compute-ego0": 0.011921158376729713, "agent_compute-ego1": 0.012162100593998746, "agent_compute-ego2": 0.011330537076266307, "complete-iteration": 0.41359185722638975, "set_robot_commands": 0.0025366207338728994, "deviation-center-line": 0.09024893061424598, "driven_lanedir_consec": 0.801959251908515, "sim_compute_sim_state": 0.02345651950476305, "sim_compute_performance-ego0": 0.0024531742311873525, "sim_compute_performance-ego1": 0.0023400873508093493, "sim_compute_performance-ego2": 0.002331409814222804}, "ETHZ_autolab_technical_track-sc0-2-ego2": {"driven_any": 0.634085891521401, "get_ui_image": 0.04088416189517615, "step_physics": 0.25257456977412385, "survival_time": 2.6499999999999986, "driven_lanedir": 0.3461853921480116, "get_state_dump": 0.014019201386649652, "get_robot_state": 0.02071580796871545, "sim_render-ego0": 0.003914117813110352, "sim_render-ego1": 0.0038666860112604104, "sim_render-ego2": 0.00382054976697238, "get_duckie_state": 1.902850169055867e-06, "in-drivable-lane": 1.5499999999999985, "deviation-heading": 0.3178062212227546, "agent_compute-ego0": 0.011921158376729713, "agent_compute-ego1": 0.012162100593998746, "agent_compute-ego2": 0.011330537076266307, "complete-iteration": 0.41359185722638975, "set_robot_commands": 0.0025366207338728994, "deviation-center-line": 0.07983341074080218, "driven_lanedir_consec": 0.3461853921480116, "sim_compute_sim_state": 0.02345651950476305, "sim_compute_performance-ego0": 0.0024531742311873525, "sim_compute_performance-ego1": 0.0023400873508093493, "sim_compute_performance-ego2": 0.002331409814222804}}
set_robot_commands_max0.0029628011915418836
set_robot_commands_mean0.002748527824329638
set_robot_commands_median0.00274616154757413
set_robot_commands_min0.0025366207338728994
sim_compute_performance-ego0_max0.002586695883009169
sim_compute_performance-ego0_mean0.0024972772683086123
sim_compute_performance-ego0_median0.0024531742311873525
sim_compute_performance-ego0_min0.002451961690729315
sim_compute_performance-ego1_max0.002543458232173213
sim_compute_performance-ego1_mean0.0024262863397724486
sim_compute_performance-ego1_median0.0023953134363347835
sim_compute_performance-ego1_min0.0023400873508093493
sim_compute_performance-ego2_max0.0025054746203952366
sim_compute_performance-ego2_mean0.002404996128141649
sim_compute_performance-ego2_median0.002378103949806907
sim_compute_performance-ego2_min0.002331409814222804
sim_compute_sim_state_max0.02345651950476305
sim_compute_sim_state_mean0.023008888673492548
sim_compute_sim_state_median0.02334776631108037
sim_compute_sim_state_min0.022222380204634233
sim_render-ego0_max0.004265688083789966
sim_render-ego0_mean0.004058968793395927
sim_render-ego0_median0.003997100483287465
sim_render-ego0_min0.003914117813110352
sim_render-ego1_max0.004176938975298846
sim_render-ego1_mean0.003989705844444793
sim_render-ego1_median0.003925492546775124
sim_render-ego1_min0.0038666860112604104
sim_render-ego2_max0.004131811636465567
sim_render-ego2_mean0.003947038604871716
sim_render-ego2_median0.0038887544111772016
sim_render-ego2_min0.00382054976697238
simulation-passed1
step_physics_max0.25715327704394303
step_physics_mean0.25401859872286575
step_physics_median0.25257456977412385
step_physics_min0.25232794935053043
survival_time_max2.7499999999999982
survival_time_mean2.699999999999998
survival_time_min2.6499999999999986
No reset possible