Duckietown Challenges Home Challenges Submissions

Evaluator 5401

ID5401
evaluatornogpu-production-b-spot-0-05
ownerI don't have one 😀
machinenogpu-production-b-spot-0_0209900085d7
processnogpu-production-b-spot-0-05_0209900085d7
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success15 80271
# timeout
# failed
# error
# aborted6 80228
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)184.7 GB
RAM free (MB)181.8 GB
Disk (MB)969.3 GB
Disk available (MB)956.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8036513798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8036413798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-050:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8036313798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-050:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8036213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-050:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8036113798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-050:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8034916193Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-050:08:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.778141034214059


other stats
agent_compute-ego0_max0.009863667444424467
agent_compute-ego0_mean0.009863667444424467
agent_compute-ego0_median0.009863667444424467
agent_compute-ego0_min0.009863667444424467
complete-iteration_max0.1892553271103858
complete-iteration_mean0.1892553271103858
complete-iteration_median0.1892553271103858
complete-iteration_min0.1892553271103858
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.778141034214059
distance-from-start_median3.778141034214059
distance-from-start_min3.778141034214059
driven_any_max4.021269588491816
driven_any_mean4.021269588491816
driven_any_median4.021269588491816
driven_any_min4.021269588491816
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05533095343126842
get_duckie_state_mean0.05533095343126842
get_duckie_state_median0.05533095343126842
get_duckie_state_min0.05533095343126842
get_robot_state_max0.003256982212558972
get_robot_state_mean0.003256982212558972
get_robot_state_median0.003256982212558972
get_robot_state_min0.003256982212558972
get_state_dump_max0.012088578309147283
get_state_dump_mean0.012088578309147283
get_state_dump_median0.012088578309147283
get_state_dump_min0.012088578309147283
get_ui_image_max0.03238253748287865
get_ui_image_mean0.03238253748287865
get_ui_image_median0.03238253748287865
get_ui_image_min0.03238253748287865
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 4.021269588491816, "get_ui_image": 0.03238253748287865, "step_physics": 0.062289901815981395, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.012088578309147283, "get_robot_state": 0.003256982212558972, "sim_render-ego0": 0.003221169597997356, "get_duckie_state": 0.05533095343126842, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.009863667444424467, "complete-iteration": 0.1892553271103858, "set_robot_commands": 0.001953417018093138, "distance-from-start": 3.778141034214059, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0070452445948947775, "sim_compute_performance-ego0": 0.0017273803237673642}}
set_robot_commands_max0.001953417018093138
set_robot_commands_mean0.001953417018093138
set_robot_commands_median0.001953417018093138
set_robot_commands_min0.001953417018093138
sim_compute_performance-ego0_max0.0017273803237673642
sim_compute_performance-ego0_mean0.0017273803237673642
sim_compute_performance-ego0_median0.0017273803237673642
sim_compute_performance-ego0_min0.0017273803237673642
sim_compute_sim_state_max0.0070452445948947775
sim_compute_sim_state_mean0.0070452445948947775
sim_compute_sim_state_median0.0070452445948947775
sim_compute_sim_state_min0.0070452445948947775
sim_render-ego0_max0.003221169597997356
sim_render-ego0_mean0.003221169597997356
sim_render-ego0_median0.003221169597997356
sim_render-ego0_min0.003221169597997356
simulation-passed1
step_physics_max0.062289901815981395
step_physics_mean0.062289901815981395
step_physics_median0.062289901815981395
step_physics_min0.062289901815981395
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
8032516015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.12


other stats
nsamples200
No reset possible
8032016020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.06


other stats
nsamples200
No reset possible
8031816015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.12


other stats
nsamples200
No reset possible
8031616015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.12


other stats
nsamples200
No reset possible
8031216015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.12


other stats
nsamples200
No reset possible
8031015894Shengjie Hu 🇨🇭All truemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples200
No reset possible
8030815894Shengjie Hu 🇨🇭All truemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples200
No reset possible
8030515894Shengjie Hu 🇨🇭All truemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples200
No reset possible
8030016020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.02
false_positive_rate0.06


other stats
nsamples200
No reset possible
8029815894Shengjie Hu 🇨🇭All truemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples200
No reset possible
8028715874Bea Baselines 🐤collision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-050:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.485
false_positive_rate0.54


other stats
nsamples400
No reset possible
8028115893Shengjie Hu 🇨🇭All truemooc-collision-check-valistep1successnonogpu-production-b-spot-0-050:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples400
No reset possible
8027415893Shengjie Hu 🇨🇭All truemooc-collision-check-valistep1successnonogpu-production-b-spot-0-050:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples400
No reset possible
8027115875Bea Baselines 🐤collision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-050:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.52
false_positive_rate0.55


other stats
nsamples200
No reset possible
8022816191Maximilian van Amerongenexercises_braitenbergmooc-BV1sim-3of5abortednonogpu-production-b-spot-0-050:04:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.0003671377945875


other stats
agent_compute-ego0_max0.010428912146797394
agent_compute-ego0_mean0.010428912146797394
agent_compute-ego0_median0.010428912146797394
agent_compute-ego0_min0.010428912146797394
complete-iteration_max0.19847773706446817
complete-iteration_mean0.19847773706446817
complete-iteration_median0.19847773706446817
complete-iteration_min0.19847773706446817
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.0003671377945875
distance-from-start_median2.0003671377945875
distance-from-start_min2.0003671377945875
driven_any_max2.6940910403449667
driven_any_mean2.6940910403449667
driven_any_median2.6940910403449667
driven_any_min2.6940910403449667
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05989549279878925
get_duckie_state_mean0.05989549279878925
get_duckie_state_median0.05989549279878925
get_duckie_state_min0.05989549279878925
get_robot_state_max0.003454101818233895
get_robot_state_mean0.003454101818233895
get_robot_state_median0.003454101818233895
get_robot_state_min0.003454101818233895
get_state_dump_max0.012506363778140956
get_state_dump_mean0.012506363778140956
get_state_dump_median0.012506363778140956
get_state_dump_min0.012506363778140956
get_ui_image_max0.03353176836194939
get_ui_image_mean0.03353176836194939
get_ui_image_median0.03353176836194939
get_ui_image_min0.03353176836194939
in-drivable-lane_max17.85000000000012
in-drivable-lane_mean17.85000000000012
in-drivable-lane_median17.85000000000012
in-drivable-lane_min17.85000000000012
per-episodes
details{"d30-ego0": {"driven_any": 2.6940910403449667, "get_ui_image": 0.03353176836194939, "step_physics": 0.06326150294788722, "survival_time": 17.85000000000012, "driven_lanedir": 0.0, "get_state_dump": 0.012506363778140956, "get_robot_state": 0.003454101818233895, "sim_render-ego0": 0.0032932265510772192, "get_duckie_state": 0.05989549279878925, "in-drivable-lane": 17.85000000000012, "deviation-heading": 0.0, "agent_compute-ego0": 0.010428912146797394, "complete-iteration": 0.19847773706446817, "set_robot_commands": 0.002029424273101977, "distance-from-start": 2.0003671377945875, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008140414120764706, "sim_compute_performance-ego0": 0.0018524251170664529}}
set_robot_commands_max0.002029424273101977
set_robot_commands_mean0.002029424273101977
set_robot_commands_median0.002029424273101977
set_robot_commands_min0.002029424273101977
sim_compute_performance-ego0_max0.0018524251170664529
sim_compute_performance-ego0_mean0.0018524251170664529
sim_compute_performance-ego0_median0.0018524251170664529
sim_compute_performance-ego0_min0.0018524251170664529
sim_compute_sim_state_max0.008140414120764706
sim_compute_sim_state_mean0.008140414120764706
sim_compute_sim_state_median0.008140414120764706
sim_compute_sim_state_min0.008140414120764706
sim_render-ego0_max0.0032932265510772192
sim_render-ego0_mean0.0032932265510772192
sim_render-ego0_median0.0032932265510772192
sim_render-ego0_min0.0032932265510772192
simulation-passed1
step_physics_max0.06326150294788722
step_physics_mean0.06326150294788722
step_physics_median0.06326150294788722
step_physics_min0.06326150294788722
survival_time_max17.85000000000012
survival_time_mean17.85000000000012
survival_time_median17.85000000000012
survival_time_min17.85000000000012
No reset possible