Duckietown Challenges Home Challenges Submissions

Evaluator 2468

ID2468
evaluatornogpu-prod-10
ownerI don't have one 😀
machinenogpu-prod_748f2f808fb2
processnogpu-prod-10_748f2f808fb2
version6.1.27
first heard
last heard
statusinactive
# evaluating
# success1 44177
# timeout1 45196
# failed
# error
# aborted5 44272
# host-error17 44232
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4519611785Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simtimeoutnonogpu-prod-10----No reset possible
4514011842Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-100:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f&fromImage=docker.io%2Fandreacensi%2Faido5-lfvi_multi-sim-validation-lfviv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4512411814Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4504711837Bea Baselines 🐤baseline-duckietownaido5-LF-sim-testingLFt-simabortednonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A37ad79e7f0036c64702c200914df673efdaa523a1722c452348f3f693ff11cc4&fromImage=docker.io%2Fandreacensi%2Faido5-lf-sim-testing-lft-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lf-sim-testing-lft-sim-evaluator@sha256:37ad79e7f0036c64702c200914df673efdaa523a1722c452348f3f693ff11cc4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lf-sim-testing-lft-sim-evaluator@sha256:37ad79e7f0036c64702c200914df673efdaa523a1722c452348f3f693ff11cc4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4503711814Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4502011815Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4497711810Bea Baselines 🐤template-rosaido5-LFP-sim-testingLFP-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4496211842Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f&fromImage=docker.io%2Fandreacensi%2Faido5-lfvi_multi-sim-validation-lfviv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfvi_multi-sim-validation-lfviv-sim-evaluator@sha256:1e8da51999da890eb39008007990f9b65697645b293197f5318161ca653b293f
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4491311785Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-validation-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4490411787Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4488211817Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4484711809Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-validation-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-validation-lfp-sim-evaluator@sha256:281b90306b0806d063bd14f3ba8e89c2c2591cd47f549ac61bec1f80e388430b
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4470011787Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornonogpu-prod-100:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4464311815Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4457611810Bea Baselines 🐤template-rosaido5-LFP-sim-testingLFP-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef&fromImage=docker.io%2Fandreacensi%2Faido5-lfp-sim-testing-lfp-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfp-sim-testing-lfp-sim-evaluator@sha256:4f139d9ac1ffea1728031a561292e4d907449125eee9c8be4a55462520e24bef
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4452311787Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0&fromImage=docker.io%2Fandreacensi%2Faido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido5-lfv_multi-sim-validation-lfvmultibodyv-sim-evaluator@sha256:8b08e43e4b5b3720a136f33247895e5948a3df2b2a35d2cd1c5849a27b7be7e0
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4451411815Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4&fromImage=docker.io%2Fduckietown%2Fchallenge-aido_lf-minimal-agent-full

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:8664bdae16c52e2ff18071465b167a034c06e45689d8957722865067ae285fb4
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4429811841Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simabortednonogpu-prod-100:16:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1147, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 612, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4428111807Bea Baselines 🐤template-rosaido5-LF-sanity-sim-validationsanity-checkhost-erroryesnogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Aea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551&fromImage=docker.io%2Fandreacensi%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido-submissions@sha256:ea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido-submissions@sha256:ea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4427211772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4426011786Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simhost-errornonogpu-prod-100:00:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30&fromImage=docker.io%2Fandreacensi%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido-submissions@sha256:9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido-submissions@sha256:9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4424911786Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30&fromImage=docker.io%2Fandreacensi%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido-submissions@sha256:9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido-submissions@sha256:9d47605f9e4e80fee3ebf0c7ef2f9693f7b4d11a8399c3ba3f69c8140e997b30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4423211818Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simhost-errornonogpu-prod-100:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Aea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551&fromImage=docker.io%2Fandreacensi%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/andreacensi/aido-submissions@sha256:ea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 761, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 960, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/andreacensi/aido-submissions@sha256:ea5f4116dc2053a1024fe8b4cec631f38c18bf9c4289ce891e41452db776b551
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4417711799Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessnonogpu-prod-100:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.450420973251336
survival_time_median6.749999999999984
deviation-center-line_median0.2678979880501701
in-drivable-lane_median1.399999999999995


other stats
agent_compute-ego0_max0.011473577993887442
agent_compute-ego0_mean0.011046946296951972
agent_compute-ego0_median0.01121387658295808
agent_compute-ego0_min0.010453384314010392
agent_compute-ego1_max0.011451436855174878
agent_compute-ego1_mean0.01095058098229471
agent_compute-ego1_median0.01089353914614077
agent_compute-ego1_min0.010506766945568484
agent_compute-ego2_max0.011185953352186416
agent_compute-ego2_mean0.01089531619267194
agent_compute-ego2_median0.010860171141447845
agent_compute-ego2_min0.010639824084381558
complete-iteration_max0.5240512088493064
complete-iteration_mean0.5002582525139423
complete-iteration_median0.518688134793882
complete-iteration_min0.4580354138986388
deviation-center-line_max0.6259542662549828
deviation-center-line_mean0.362715977726308
deviation-center-line_min0.22220606145745328
deviation-heading_max0.9864115900360364
deviation-heading_mean0.8136816825285736
deviation-heading_median0.8021196429506658
deviation-heading_min0.7271589658507641
driven_any_max1.0597494879386689
driven_any_mean0.7063387635570355
driven_any_median0.6174080560751429
driven_any_min0.44846498795635154
driven_lanedir_consec_max0.79268631270049
driven_lanedir_consec_mean0.540998212888652
driven_lanedir_consec_min0.3670047047608236
driven_lanedir_max0.79268631270049
driven_lanedir_mean0.540998212888652
driven_lanedir_median0.450420973251336
driven_lanedir_min0.3670047047608236
get_duckie_state_max3.7599492956090857e-06
get_duckie_state_mean3.2677930737367667e-06
get_duckie_state_median3.1877447057653356e-06
get_duckie_state_min2.855685219835879e-06
get_robot_state_max0.025029253076623983
get_robot_state_mean0.02405470023832643
get_robot_state_median0.02420212780987775
get_robot_state_min0.022932719828477548
get_state_dump_max0.016500744996247468
get_state_dump_mean0.01607696642769356
get_state_dump_median0.016395724261248554
get_state_dump_min0.015334430025584662
get_ui_image_max0.051469128220169635
get_ui_image_mean0.04893261155788688
get_ui_image_median0.05030226177639431
get_ui_image_min0.0450264446770967
in-drivable-lane_max4.049999999999986
in-drivable-lane_mean1.7999999999999936
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.44846498795635154, "get_ui_image": 0.051469128220169635, "step_physics": 0.33712834075645165, "survival_time": 6.749999999999984, "driven_lanedir": 0.4455810515391705, "get_state_dump": 0.016500744996247468, "get_robot_state": 0.025029253076623983, "sim_render-ego0": 0.004815928141276042, "sim_render-ego1": 0.004687885001853661, "sim_render-ego2": 0.004642066249140987, "get_duckie_state": 3.7599492956090857e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7418712403875578, "agent_compute-ego0": 0.011473577993887442, "agent_compute-ego1": 0.011451436855174878, "agent_compute-ego2": 0.011185953352186416, "complete-iteration": 0.5240512088493064, "set_robot_commands": 0.003123205679434317, "deviation-center-line": 0.5309236715271055, "driven_lanedir_consec": 0.4455810515391705, "sim_compute_sim_state": 0.027101675669352215, "sim_compute_performance-ego0": 0.00307241369176794, "sim_compute_performance-ego1": 0.0028273847368028428, "sim_compute_performance-ego2": 0.0029372515501799408}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 1.0597494879386689, "get_ui_image": 0.051469128220169635, "step_physics": 0.33712834075645165, "survival_time": 6.749999999999984, "driven_lanedir": 0.7923704750254537, "get_state_dump": 0.016500744996247468, "get_robot_state": 0.025029253076623983, "sim_render-ego0": 0.004815928141276042, "sim_render-ego1": 0.004687885001853661, "sim_render-ego2": 0.004642066249140987, "get_duckie_state": 3.7599492956090857e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.916954216178206, "agent_compute-ego0": 0.011473577993887442, "agent_compute-ego1": 0.011451436855174878, "agent_compute-ego2": 0.011185953352186416, "complete-iteration": 0.5240512088493064, "set_robot_commands": 0.003123205679434317, "deviation-center-line": 0.2863576423455541, "driven_lanedir_consec": 0.7923704750254537, "sim_compute_sim_state": 0.027101675669352215, "sim_compute_performance-ego0": 0.00307241369176794, "sim_compute_performance-ego1": 0.0028273847368028428, "sim_compute_performance-ego2": 0.0029372515501799408}, "ETHZ_autolab_technical_track-sc0-0-ego2": {"driven_any": 0.640001172233773, "get_ui_image": 0.051469128220169635, "step_physics": 0.33712834075645165, "survival_time": 6.749999999999984, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.016500744996247468, "get_robot_state": 0.025029253076623983, "sim_render-ego0": 0.004815928141276042, "sim_render-ego1": 0.004687885001853661, "sim_render-ego2": 0.004642066249140987, "get_duckie_state": 3.7599492956090857e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.7352695890794493, "agent_compute-ego0": 0.011473577993887442, "agent_compute-ego1": 0.011451436855174878, "agent_compute-ego2": 0.011185953352186416, "complete-iteration": 0.5240512088493064, "set_robot_commands": 0.003123205679434317, "deviation-center-line": 0.2574637225826533, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.027101675669352215, "sim_compute_performance-ego0": 0.00307241369176794, "sim_compute_performance-ego1": 0.0028273847368028428, "sim_compute_performance-ego2": 0.0029372515501799408}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.45391741356230486, "get_ui_image": 0.05030226177639431, "step_physics": 0.3371379251833315, "survival_time": 6.749999999999984, "driven_lanedir": 0.450420973251336, "get_state_dump": 0.016395724261248554, "get_robot_state": 0.02420212780987775, "sim_render-ego0": 0.004603808014481156, "sim_render-ego1": 0.0045766865765606915, "sim_render-ego2": 0.004483053419325087, "get_duckie_state": 3.1877447057653356e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8021196429506658, "agent_compute-ego0": 0.01121387658295808, "agent_compute-ego1": 0.01089353914614077, "agent_compute-ego2": 0.010860171141447845, "complete-iteration": 0.518688134793882, "set_robot_commands": 0.0030241789641203705, "deviation-center-line": 0.5759523948546109, "driven_lanedir_consec": 0.450420973251336, "sim_compute_sim_state": 0.026393948660956488, "sim_compute_performance-ego0": 0.0028551578521728515, "sim_compute_performance-ego1": 0.0027838371418140552, "sim_compute_performance-ego2": 0.002687404773853443}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 1.0582621695225167, "get_ui_image": 0.05030226177639431, "step_physics": 0.3371379251833315, "survival_time": 6.749999999999984, "driven_lanedir": 0.79268631270049, "get_state_dump": 0.016395724261248554, "get_robot_state": 0.02420212780987775, "sim_render-ego0": 0.004603808014481156, "sim_render-ego1": 0.0045766865765606915, "sim_render-ego2": 0.004483053419325087, "get_duckie_state": 3.1877447057653356e-06, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.8418073950192356, "agent_compute-ego0": 0.01121387658295808, "agent_compute-ego1": 0.01089353914614077, "agent_compute-ego2": 0.010860171141447845, "complete-iteration": 0.518688134793882, "set_robot_commands": 0.0030241789641203705, "deviation-center-line": 0.2678979880501701, "driven_lanedir_consec": 0.79268631270049, "sim_compute_sim_state": 0.026393948660956488, "sim_compute_performance-ego0": 0.0028551578521728515, "sim_compute_performance-ego1": 0.0027838371418140552, "sim_compute_performance-ego2": 0.002687404773853443}, "ETHZ_autolab_technical_track-sc0-1-ego2": {"driven_any": 0.6174080560751429, "get_ui_image": 0.05030226177639431, "step_physics": 0.3371379251833315, "survival_time": 6.749999999999984, "driven_lanedir": 0.3904422088366064, "get_state_dump": 0.016395724261248554, "get_robot_state": 0.02420212780987775, "sim_render-ego0": 0.004603808014481156, "sim_render-ego1": 0.0045766865765606915, "sim_render-ego2": 0.004483053419325087, "get_duckie_state": 3.1877447057653356e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 0.7383431576551982, "agent_compute-ego0": 0.01121387658295808, "agent_compute-ego1": 0.01089353914614077, "agent_compute-ego2": 0.010860171141447845, "complete-iteration": 0.518688134793882, "set_robot_commands": 0.0030241789641203705, "deviation-center-line": 0.24730366316587632, "driven_lanedir_consec": 0.3904422088366064, "sim_compute_sim_state": 0.026393948660956488, "sim_compute_performance-ego0": 0.0028551578521728515, "sim_compute_performance-ego1": 0.0027838371418140552, "sim_compute_performance-ego2": 0.002687404773853443}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.45677459871106657, "get_ui_image": 0.0450264446770967, "step_physics": 0.2904588126424533, "survival_time": 6.699999999999984, "driven_lanedir": 0.4522145544995684, "get_state_dump": 0.015334430025584662, "get_robot_state": 0.022932719828477548, "sim_render-ego0": 0.004186955850515792, "sim_render-ego1": 0.00426068412723826, "sim_render-ego2": 0.004189946758213328, "get_duckie_state": 2.855685219835879e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9864115900360364, "agent_compute-ego0": 0.010453384314010392, "agent_compute-ego1": 0.010506766945568484, "agent_compute-ego2": 0.010639824084381558, "complete-iteration": 0.4580354138986388, "set_robot_commands": 0.0028206892867586506, "deviation-center-line": 0.6259542662549828, "driven_lanedir_consec": 0.4522145544995684, "sim_compute_sim_state": 0.023544989415069124, "sim_compute_performance-ego0": 0.002681872737941457, "sim_compute_performance-ego1": 0.002542997474101052, "sim_compute_performance-ego2": 0.0025010304664497946}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 1.055846934876289, "get_ui_image": 0.0450264446770967, "step_physics": 0.2904588126424533, "survival_time": 6.699999999999984, "driven_lanedir": 0.7685126560636006, "get_state_dump": 0.015334430025584662, "get_robot_state": 0.022932719828477548, "sim_render-ego0": 0.004186955850515792, "sim_render-ego1": 0.00426068412723826, "sim_render-ego2": 0.004189946758213328, "get_duckie_state": 2.855685219835879e-06, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.8331993456000497, "agent_compute-ego0": 0.010453384314010392, "agent_compute-ego1": 0.010506766945568484, "agent_compute-ego2": 0.010639824084381558, "complete-iteration": 0.4580354138986388, "set_robot_commands": 0.0028206892867586506, "deviation-center-line": 0.2503843892983658, "driven_lanedir_consec": 0.7685126560636006, "sim_compute_sim_state": 0.023544989415069124, "sim_compute_performance-ego0": 0.002681872737941457, "sim_compute_performance-ego1": 0.002542997474101052, "sim_compute_performance-ego2": 0.0025010304664497946}, "ETHZ_autolab_technical_track-sc0-2-ego2": {"driven_any": 0.5666240511372057, "get_ui_image": 0.0450264446770967, "step_physics": 0.2904588126424533, "survival_time": 6.699999999999984, "driven_lanedir": 0.3670047047608236, "get_state_dump": 0.015334430025584662, "get_robot_state": 0.022932719828477548, "sim_render-ego0": 0.004186955850515792, "sim_render-ego1": 0.00426068412723826, "sim_render-ego2": 0.004189946758213328, "get_duckie_state": 2.855685219835879e-06, "in-drivable-lane": 4.049999999999986, "deviation-heading": 0.7271589658507641, "agent_compute-ego0": 0.010453384314010392, "agent_compute-ego1": 0.010506766945568484, "agent_compute-ego2": 0.010639824084381558, "complete-iteration": 0.4580354138986388, "set_robot_commands": 0.0028206892867586506, "deviation-center-line": 0.22220606145745328, "driven_lanedir_consec": 0.3670047047608236, "sim_compute_sim_state": 0.023544989415069124, "sim_compute_performance-ego0": 0.002681872737941457, "sim_compute_performance-ego1": 0.002542997474101052, "sim_compute_performance-ego2": 0.0025010304664497946}}
set_robot_commands_max0.003123205679434317
set_robot_commands_mean0.002989357976771112
set_robot_commands_median0.0030241789641203705
set_robot_commands_min0.0028206892867586506
sim_compute_performance-ego0_max0.00307241369176794
sim_compute_performance-ego0_mean0.0028698147606274157
sim_compute_performance-ego0_median0.0028551578521728515
sim_compute_performance-ego0_min0.002681872737941457
sim_compute_performance-ego1_max0.0028273847368028428
sim_compute_performance-ego1_mean0.00271807311757265
sim_compute_performance-ego1_median0.0027838371418140552
sim_compute_performance-ego1_min0.002542997474101052
sim_compute_performance-ego2_max0.0029372515501799408
sim_compute_performance-ego2_mean0.0027085622634943924
sim_compute_performance-ego2_median0.002687404773853443
sim_compute_performance-ego2_min0.0025010304664497946
sim_compute_sim_state_max0.027101675669352215
sim_compute_sim_state_mean0.02568020458179261
sim_compute_sim_state_median0.026393948660956488
sim_compute_sim_state_min0.023544989415069124
sim_render-ego0_max0.004815928141276042
sim_render-ego0_mean0.004535564002090996
sim_render-ego0_median0.004603808014481156
sim_render-ego0_min0.004186955850515792
sim_render-ego1_max0.004687885001853661
sim_render-ego1_mean0.004508418568550871
sim_render-ego1_median0.0045766865765606915
sim_render-ego1_min0.00426068412723826
sim_render-ego2_max0.004642066249140987
sim_render-ego2_mean0.0044383554755598005
sim_render-ego2_median0.004483053419325087
sim_render-ego2_min0.004189946758213328
simulation-passed1
step_physics_max0.3371379251833315
step_physics_mean0.32157502619407885
step_physics_median0.33712834075645165
step_physics_min0.2904588126424533
survival_time_max6.749999999999984
survival_time_mean6.7333333333333165
survival_time_min6.699999999999984
No reset possible