Duckietown Challenges Home Challenges Submissions

Evaluator 2285

ID2285
evaluatorreg02-a6c0d476038a-1
ownerI don't have one 😀
machinearchimede
processreg02-a6c0d476038a-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success10 42026
# timeout
# failed7 42019
# error
# aborted
# host-error27 42030
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4245911458Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-testingLFt-simhost-errornoreg02-a6c0d476038a-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4240311443Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:01:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4239911443Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4239711442Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4238011441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4236811440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4236711440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4236511440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4233811424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4232911414Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-testingLFP-simsuccessnoreg02-a6c0d476038a-10:24:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.13710885208718
survival_time_median14.950000000000076
deviation-center-line_median0.5610015460321951
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.2013535745938619
agent_compute-ego_mean0.09879249419952996
agent_compute-ego_median0.06605669379234314
agent_compute-ego_min0.06170301461957165
complete-iteration_max0.8203165094057719
complete-iteration_mean0.5205780569691838
complete-iteration_median0.42977925737289224
complete-iteration_min0.40243720372517905
deviation-center-line_max0.6381077323606118
deviation-center-line_mean0.5245165104121453
deviation-center-line_min0.33795521722357924
deviation-heading_max2.699690417820893
deviation-heading_mean1.9650322674321916
deviation-heading_median1.8383715099841151
deviation-heading_min1.4836956319396426
driven_any_max3.5733060127186045
driven_any_mean3.2523024915588885
driven_any_median3.5732680901558327
driven_any_min2.2893677732052833
driven_lanedir_consec_max3.523349574546978
driven_lanedir_consec_mean3.0120538777028427
driven_lanedir_consec_min2.2506482320900325
driven_lanedir_max3.523349574546978
driven_lanedir_mean3.0120538777028427
driven_lanedir_median3.13710885208718
driven_lanedir_min2.2506482320900325
get_duckie_state_max0.10492726723353069
get_duckie_state_mean0.06479435836326626
get_duckie_state_median0.052916818857192995
get_duckie_state_min0.04841652850514835
get_robot_state_max0.05565416097640991
get_robot_state_mean0.0330164136919369
get_robot_state_median0.026842992703119913
get_robot_state_min0.02272550838509786
get_state_dump_max0.0618200953801473
get_state_dump_mean0.0368200506643741
get_state_dump_median0.029447437524795533
get_state_dump_min0.026565232227758032
get_ui_image_max0.097967844804128
get_ui_image_mean0.06859431357727837
get_ui_image_median0.059611390661128194
get_ui_image_min0.057186628182729085
in-drivable-lane_max1.6500000000000234
in-drivable-lane_mean0.6625000000000094
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5732869716343125, "get_ui_image": 0.097967844804128, "step_physics": 0.17070664485295614, "survival_time": 14.950000000000076, "driven_lanedir": 3.24084063925694, "get_state_dump": 0.0618200953801473, "sim_render-ego": 0.021392192045847577, "get_robot_state": 0.05565416097640991, "get_duckie_state": 0.10492726723353069, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.2013535745938619, "deviation-heading": 2.113546754611741, "complete-iteration": 0.8203165094057719, "set_robot_commands": 0.021441143353780112, "deviation-center-line": 0.4904289615909242, "driven_lanedir_consec": 3.24084063925694, "sim_compute_sim_state": 0.06781335035959879, "sim_compute_performance-ego": 0.01702298561731974}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5733060127186045, "get_ui_image": 0.059763887723286946, "step_physics": 0.13707626978556314, "survival_time": 14.950000000000076, "driven_lanedir": 3.523349574546978, "get_state_dump": 0.031088871161142985, "sim_render-ego": 0.010861607392628987, "get_robot_state": 0.029610691865285237, "get_duckie_state": 0.056763588587443035, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0691552718480428, "deviation-heading": 1.56319626535649, "complete-iteration": 0.4447217639287313, "set_robot_commands": 0.008478646278381347, "deviation-center-line": 0.6381077323606118, "driven_lanedir_consec": 3.523349574546978, "sim_compute_sim_state": 0.03440238873163859, "sim_compute_performance-ego": 0.007292669614156087}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.573249208677353, "get_ui_image": 0.057186628182729085, "step_physics": 0.12307806332906088, "survival_time": 14.950000000000076, "driven_lanedir": 3.03337706491742, "get_state_dump": 0.02780600388844808, "sim_render-ego": 0.009409973621368408, "get_robot_state": 0.02407529354095459, "get_duckie_state": 0.049070049126942954, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.06295811573664348, "deviation-heading": 2.699690417820893, "complete-iteration": 0.40243720372517905, "set_robot_commands": 0.00813114086786906, "deviation-center-line": 0.6315741304734659, "driven_lanedir_consec": 3.03337706491742, "sim_compute_sim_state": 0.0338504958152771, "sim_compute_performance-ego": 0.0066483648618062335}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2893677732052833, "get_ui_image": 0.05945889359896945, "step_physics": 0.13610442889105415, "survival_time": 9.700000000000005, "driven_lanedir": 2.2506482320900325, "get_state_dump": 0.026565232227758032, "sim_render-ego": 0.009083481179070228, "get_robot_state": 0.02272550838509786, "get_duckie_state": 0.04841652850514835, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06170301461957165, "deviation-heading": 1.4836956319396426, "complete-iteration": 0.4148367508170531, "set_robot_commands": 0.007440417083268313, "deviation-center-line": 0.33795521722357924, "driven_lanedir_consec": 2.2506482320900325, "sim_compute_sim_state": 0.03708561179564171, "sim_compute_performance-ego": 0.006039907022849801}}
set_robot_commands_max0.021441143353780112
set_robot_commands_mean0.011372836895824709
set_robot_commands_median0.008304893573125204
set_robot_commands_min0.007440417083268313
sim_compute_performance-ego_max0.01702298561731974
sim_compute_performance-ego_mean0.009250981779032968
sim_compute_performance-ego_median0.00697051723798116
sim_compute_performance-ego_min0.006039907022849801
sim_compute_sim_state_max0.06781335035959879
sim_compute_sim_state_mean0.04328796167553905
sim_compute_sim_state_median0.03574400026364015
sim_compute_sim_state_min0.0338504958152771
sim_render-ego_max0.021392192045847577
sim_render-ego_mean0.0126868135597288
sim_render-ego_median0.0101357905069987
sim_render-ego_min0.009083481179070228
simulation-passed1
step_physics_max0.17070664485295614
step_physics_mean0.14174135171465857
step_physics_median0.13659034933830866
step_physics_min0.12307806332906088
survival_time_max14.950000000000076
survival_time_mean13.63750000000006
survival_time_min9.700000000000005
No reset possible
4231911418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-errornoreg02-a6c0d476038a-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4231611418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-errornoreg02-a6c0d476038a-10:00:30
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230911417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simhost-errornoreg02-a6c0d476038a-10:00:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4230411415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornoreg02-a6c0d476038a-10:00:19
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4228511411Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sanity-sim-validationsanity-checkhost-erroryesreg02-a6c0d476038a-10:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4226511410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 66, in on_received_get_commands
             ||     linear, angular = self.compute_action(self.to_predictor)
             ||   File "solution.py", line 61, in compute_action
             ||     (linear, angular) = self.model.predict(observation)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
             ||     return method(self, *args, **kwargs)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
             ||     tmp_batch_outputs = predict_function(iterator)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
             ||     result = self._call(*args, **kwds)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
             ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
             ||     return self._call_flat(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
             ||     return self._build_call_outputs(self._inference_function.call(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
             ||     outputs = execute.execute(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
             ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
             || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
             || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:61) ]] [Op:__inference_predict_function_790]
             ||
             || Errors may have originated from an input operation.
             || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
             ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
             ||
             || Function call stack:
             || predict_function
             ||
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4226211409Frank (Chude) Qian 🇨🇦template-tensorflowaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:04:35
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225811408Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:01:23
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4225311407Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:01:52
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4224511406Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:04:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4224311405Thomas Wiggers 🇳🇱ppo_v1aido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:23:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1825634495993187
survival_time_median7.749999999999986
deviation-center-line_median0.21988112290109524
in-drivable-lane_median3.4499999999999926


other stats
agent_compute-ego_max1.631122908264241
agent_compute-ego_mean1.621140025204746
agent_compute-ego_median1.6226658981618634
agent_compute-ego_min1.6081053962310154
complete-iteration_max1.923971309863701
complete-iteration_mean1.9020090364710844
complete-iteration_median1.901360960411712
complete-iteration_min1.8813429151972136
deviation-center-line_max0.49515740917328177
deviation-center-line_mean0.2566426776753402
deviation-center-line_min0.09165105572588854
deviation-heading_max1.1394357801284334
deviation-heading_mean0.7371325773485278
deviation-heading_median0.7070515245109132
deviation-heading_min0.3949914802438512
driven_any_max3.250123165302364
driven_any_mean2.5149625469136163
driven_any_median2.616873795847667
driven_any_min1.5759794306567665
driven_lanedir_consec_max1.4880012624083028
driven_lanedir_consec_mean1.113281191705881
driven_lanedir_consec_min0.5999966052165835
driven_lanedir_max1.4880012624083028
driven_lanedir_mean1.113281191705881
driven_lanedir_median1.1825634495993187
driven_lanedir_min0.5999966052165835
get_duckie_state_max4.037566806959069e-06
get_duckie_state_mean3.628288658551435e-06
get_duckie_state_median3.5291274300621375e-06
get_duckie_state_min3.417332967122396e-06
get_robot_state_max0.024659637091816337
get_robot_state_mean0.024272762755359372
get_robot_state_median0.02422836249467557
get_robot_state_min0.02397468894027
get_state_dump_max0.019969553187273552
get_state_dump_mean0.019744801650091355
get_state_dump_median0.01971351418387953
get_state_dump_min0.0195826250453328
get_ui_image_max0.05341101038283196
get_ui_image_mean0.05249138881918753
get_ui_image_median0.0524368260940004
get_ui_image_min0.05168089270591736
in-drivable-lane_max5.800000000000004
in-drivable-lane_mean3.7374999999999954
in-drivable-lane_min2.249999999999992
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.31840553152786, "get_ui_image": 0.05341101038283196, "step_physics": 0.12957601961882215, "survival_time": 6.8999999999999835, "driven_lanedir": 1.4880012624083028, "get_state_dump": 0.019969553187273552, "sim_render-ego": 0.009452356808427452, "get_robot_state": 0.024659637091816337, "get_duckie_state": 4.037566806959069e-06, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 1.6206318571947622, "deviation-heading": 0.6777640536347418, "complete-iteration": 1.904664371324622, "set_robot_commands": 0.0063583868137304335, "deviation-center-line": 0.1919388041631079, "driven_lanedir_consec": 1.4880012624083028, "sim_compute_sim_state": 0.03383572032486183, "sim_compute_performance-ego": 0.006551524867182193}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.915342060167474, "get_ui_image": 0.0524748494458753, "step_physics": 0.12224880068801172, "survival_time": 8.599999999999987, "driven_lanedir": 1.30917824341581, "get_state_dump": 0.0195826250453328, "sim_render-ego": 0.01012293821157411, "get_robot_state": 0.02397468894027, "get_duckie_state": 3.523604814396348e-06, "in-drivable-lane": 4.2999999999999945, "agent_compute-ego": 1.6246999391289645, "deviation-heading": 0.7363389953870846, "complete-iteration": 1.898057549498802, "set_robot_commands": 0.006203004094057305, "deviation-center-line": 0.49515740917328177, "driven_lanedir_consec": 1.30917824341581, "sim_compute_sim_state": 0.03212997386621874, "sim_compute_performance-ego": 0.0064064860343933105}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5759794306567665, "get_ui_image": 0.05168089270591736, "step_physics": 0.12451807409524918, "survival_time": 4.799999999999991, "driven_lanedir": 0.5999966052165835, "get_state_dump": 0.01963145037492116, "sim_render-ego": 0.009904672702153524, "get_robot_state": 0.024349013964335125, "get_duckie_state": 3.417332967122396e-06, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 1.6081053962310154, "deviation-heading": 0.3949914802438512, "complete-iteration": 1.8813429151972136, "set_robot_commands": 0.006677113473415375, "deviation-center-line": 0.09165105572588854, "driven_lanedir_consec": 0.5999966052165835, "sim_compute_sim_state": 0.02964194118976593, "sim_compute_performance-ego": 0.006614464024702708}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.250123165302364, "get_ui_image": 0.052398802742125494, "step_physics": 0.13747922327152637, "survival_time": 9.45, "driven_lanedir": 1.055948655782827, "get_state_dump": 0.019795577992837897, "sim_render-ego": 0.00947232725759032, "get_robot_state": 0.024107711025016017, "get_duckie_state": 3.5346500457279267e-06, "in-drivable-lane": 5.800000000000004, "agent_compute-ego": 1.631122908264241, "deviation-heading": 1.1394357801284334, "complete-iteration": 1.923971309863701, "set_robot_commands": 0.006426230940238508, "deviation-center-line": 0.24782344163908257, "driven_lanedir_consec": 1.055948655782827, "sim_compute_sim_state": 0.03655273573739188, "sim_compute_performance-ego": 0.0064015502021426245}}
set_robot_commands_max0.006677113473415375
set_robot_commands_mean0.006416183830360406
set_robot_commands_median0.0063923088769844705
set_robot_commands_min0.006203004094057305
sim_compute_performance-ego_max0.006614464024702708
sim_compute_performance-ego_mean0.0064935062821052094
sim_compute_performance-ego_median0.006479005450787752
sim_compute_performance-ego_min0.0064015502021426245
sim_compute_sim_state_max0.03655273573739188
sim_compute_sim_state_mean0.0330400927795596
sim_compute_sim_state_median0.03298284709554029
sim_compute_sim_state_min0.02964194118976593
sim_render-ego_max0.01012293821157411
sim_render-ego_mean0.009738073744936352
sim_render-ego_median0.009688499979871925
sim_render-ego_min0.009452356808427452
simulation-passed1
step_physics_max0.13747922327152637
step_physics_mean0.12845552941840235
step_physics_median0.12704704685703566
step_physics_min0.12224880068801172
survival_time_max9.45
survival_time_mean7.43749999999999
survival_time_min4.799999999999991
No reset possible
4220911397Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3563667544083842
survival_time_median14.950000000000076
deviation-center-line_median0.571484779396724
in-drivable-lane_median1.5250000000000217


other stats
agent_compute-ego_max0.13398319323857624
agent_compute-ego_mean0.081009570757548
agent_compute-ego_median0.080606552362442
agent_compute-ego_min0.02884198506673177
complete-iteration_max0.408675754070282
complete-iteration_mean0.3629408452908198
complete-iteration_median0.3647547515233358
complete-iteration_min0.3135781240463257
deviation-center-line_max0.9669082041611388
deviation-center-line_mean0.5680310257256154
deviation-center-line_min0.16224633994787416
deviation-heading_max3.201067363964764
deviation-heading_mean1.996088352721916
deviation-heading_median1.9959932343856717
deviation-heading_min0.7912995781515555
driven_any_max1.9399655506617275
driven_any_mean1.9382995640099556
driven_any_median1.939831680371796
driven_any_min1.9335693446345028
driven_lanedir_consec_max1.7529626717325115
driven_lanedir_consec_mean1.1758853313188038
driven_lanedir_consec_min0.23784514472593477
driven_lanedir_max1.7529626717325115
driven_lanedir_mean1.3323261189350724
driven_lanedir_median1.6692483296409213
driven_lanedir_min0.23784514472593477
get_duckie_state_max5.337397257486979e-06
get_duckie_state_mean5.2485863367716475e-06
get_duckie_state_median5.25355339050293e-06
get_duckie_state_min5.14984130859375e-06
get_robot_state_max0.025426581700642905
get_robot_state_mean0.024834620356559752
get_robot_state_median0.024820429086685174
get_robot_state_min0.024271041552225748
get_state_dump_max0.020535616079966228
get_state_dump_mean0.02006492714087169
get_state_dump_median0.02001445531845093
get_state_dump_min0.019695181846618653
get_ui_image_max0.05332027673721314
get_ui_image_mean0.05182415088017782
get_ui_image_median0.05139411846796671
get_ui_image_min0.0511880898475647
in-drivable-lane_max12.600000000000078
in-drivable-lane_mean4.1750000000000345
in-drivable-lane_min1.050000000000015
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9335693446345028, "get_ui_image": 0.0511880898475647, "step_physics": 0.13305277983347574, "survival_time": 14.950000000000076, "driven_lanedir": 1.6931306283767709, "get_state_dump": 0.020535616079966228, "sim_render-ego": 0.00964603026707967, "get_robot_state": 0.024493935108184813, "get_duckie_state": 5.296071370442709e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.02884198506673177, "deviation-heading": 3.201067363964764, "complete-iteration": 0.3135781240463257, "set_robot_commands": 0.0076084136962890625, "deviation-center-line": 0.9669082041611388, "driven_lanedir_consec": 1.0673674779116962, "sim_compute_sim_state": 0.031762797037760415, "sim_compute_performance-ego": 0.00621910015741984}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398694318031648, "get_ui_image": 0.05332027673721314, "step_physics": 0.13624226172765097, "survival_time": 14.950000000000076, "driven_lanedir": 1.645366030905072, "get_state_dump": 0.02026710589726766, "sim_render-ego": 0.010706799825032552, "get_robot_state": 0.025146923065185543, "get_duckie_state": 5.211035410563151e-06, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.03123278299967448, "deviation-heading": 2.0562921402648704, "complete-iteration": 0.3233002289136251, "set_robot_commands": 0.007230463822682698, "deviation-center-line": 0.7141070325745964, "driven_lanedir_consec": 1.645366030905072, "sim_compute_sim_state": 0.03245745579401652, "sim_compute_performance-ego": 0.006468227704366048}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939793928940428, "get_ui_image": 0.05153746922810872, "step_physics": 0.12106059630711874, "survival_time": 14.950000000000076, "driven_lanedir": 0.23784514472593477, "get_state_dump": 0.019761804739634195, "sim_render-ego": 0.011203223864237468, "get_robot_state": 0.025426581700642905, "get_duckie_state": 5.14984130859375e-06, "in-drivable-lane": 12.600000000000078, "agent_compute-ego": 0.12998032172520954, "deviation-heading": 0.7912995781515555, "complete-iteration": 0.40620927413304647, "set_robot_commands": 0.006303967634836833, "deviation-center-line": 0.16224633994787416, "driven_lanedir_consec": 0.23784514472593477, "sim_compute_sim_state": 0.033023498853047686, "sim_compute_performance-ego": 0.007682209014892578}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399655506617275, "get_ui_image": 0.051250767707824704, "step_physics": 0.12042572498321533, "survival_time": 14.950000000000076, "driven_lanedir": 1.7529626717325115, "get_state_dump": 0.019695181846618653, "sim_render-ego": 0.009942937692006429, "get_robot_state": 0.024271041552225748, "get_duckie_state": 5.337397257486979e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.13398319323857624, "deviation-heading": 1.9356943285064732, "complete-iteration": 0.408675754070282, "set_robot_commands": 0.00664087454477946, "deviation-center-line": 0.42886252621885174, "driven_lanedir_consec": 1.7529626717325115, "sim_compute_sim_state": 0.035666279792785645, "sim_compute_performance-ego": 0.0065648190180460616}}
set_robot_commands_max0.0076084136962890625
set_robot_commands_mean0.0069459299246470135
set_robot_commands_median0.006935669183731079
set_robot_commands_min0.006303967634836833
sim_compute_performance-ego_max0.007682209014892578
sim_compute_performance-ego_mean0.006733588973681132
sim_compute_performance-ego_median0.006516523361206054
sim_compute_performance-ego_min0.00621910015741984
sim_compute_sim_state_max0.035666279792785645
sim_compute_sim_state_mean0.03322750786940257
sim_compute_sim_state_median0.03274047732353211
sim_compute_sim_state_min0.031762797037760415
sim_render-ego_max0.011203223864237468
sim_render-ego_mean0.010374747912089031
sim_render-ego_median0.010324868758519491
sim_render-ego_min0.00964603026707967
simulation-passed1
step_physics_max0.13624226172765097
step_physics_mean0.1276953407128652
step_physics_median0.12705668807029724
step_physics_min0.12042572498321533
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4220511396Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:15:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0389950130305814
survival_time_median14.950000000000076
deviation-center-line_median0.6322954498025716
in-drivable-lane_median4.500000000000055


other stats
agent_compute-ego_max0.1458504891395569
agent_compute-ego_mean0.10740751802921294
agent_compute-ego_median0.12576653838157653
agent_compute-ego_min0.032246506214141844
complete-iteration_max0.4565943908691406
complete-iteration_mean0.4073919202884038
complete-iteration_median0.4113202261924744
complete-iteration_min0.35033283789952596
deviation-center-line_max1.1408703674129268
deviation-center-line_mean0.6288251777859293
deviation-center-line_min0.1098394441256471
deviation-heading_max6.481873988085825
deviation-heading_mean2.8392352568328434
deviation-heading_median1.8276900189807577
deviation-heading_min1.2196870012840335
driven_any_max1.939923982293902
driven_any_mean1.9364307512532437
driven_any_median1.9398026480244817
driven_any_min1.9261937266701104
driven_lanedir_consec_max1.7363368925249394
driven_lanedir_consec_mean0.976821941468664
driven_lanedir_consec_min0.09296084728855349
driven_lanedir_max1.7363368925249394
driven_lanedir_mean1.0438266683937685
driven_lanedir_median1.1730044668807906
driven_lanedir_min0.09296084728855349
get_duckie_state_max3.5619735717773436e-06
get_duckie_state_mean3.4429629643758135e-06
get_duckie_state_median3.4201145172119142e-06
get_duckie_state_min3.3696492513020832e-06
get_robot_state_max0.025685362021128335
get_robot_state_mean0.024247817397117614
get_robot_state_median0.02394803245862325
get_robot_state_min0.023409842650095623
get_state_dump_max0.021852434476216633
get_state_dump_mean0.01961249808470408
get_state_dump_median0.01905003547668457
get_state_dump_min0.01849748690923055
get_ui_image_max0.06233784914016724
get_ui_image_mean0.05863002479076385
get_ui_image_median0.05900914708773295
get_ui_image_min0.054163955847422285
in-drivable-lane_max12.90000000000008
in-drivable-lane_mean5.787500000000052
in-drivable-lane_min1.2500000000000178
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9261937266701104, "get_ui_image": 0.06233784914016724, "step_physics": 0.15279510577519734, "survival_time": 14.950000000000076, "driven_lanedir": 1.2182467422783143, "get_state_dump": 0.01957039753595988, "sim_render-ego": 0.009229136308034262, "get_robot_state": 0.023923250834147137, "get_duckie_state": 3.5619735717773436e-06, "in-drivable-lane": 3.000000000000024, "agent_compute-ego": 0.032246506214141844, "deviation-heading": 6.481873988085825, "complete-iteration": 0.35033283789952596, "set_robot_commands": 0.006962915261586507, "deviation-center-line": 1.1408703674129268, "driven_lanedir_consec": 0.9502278345778958, "sim_compute_sim_state": 0.03562757730484009, "sim_compute_performance-ego": 0.007444129784901937}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9398962425623012, "get_ui_image": 0.05600645065307617, "step_physics": 0.12478580395380656, "survival_time": 14.950000000000076, "driven_lanedir": 1.1277621914832667, "get_state_dump": 0.01849748690923055, "sim_render-ego": 0.010422983169555663, "get_robot_state": 0.023409842650095623, "get_duckie_state": 3.3847490946451824e-06, "in-drivable-lane": 6.000000000000085, "agent_compute-ego": 0.1094339116414388, "deviation-heading": 1.2196870012840335, "complete-iteration": 0.3914650344848633, "set_robot_commands": 0.008344411849975586, "deviation-center-line": 0.6890335284099324, "driven_lanedir_consec": 1.1277621914832667, "sim_compute_sim_state": 0.03338820139567057, "sim_compute_performance-ego": 0.0069829440116882325}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9397090534866617, "get_ui_image": 0.06201184352238973, "step_physics": 0.1396306824684143, "survival_time": 14.950000000000076, "driven_lanedir": 0.09296084728855349, "get_state_dump": 0.021852434476216633, "sim_render-ego": 0.010152534643809, "get_robot_state": 0.025685362021128335, "get_duckie_state": 3.3696492513020832e-06, "in-drivable-lane": 12.90000000000008, "agent_compute-ego": 0.1458504891395569, "deviation-heading": 1.9197182505730708, "complete-iteration": 0.4565943908691406, "set_robot_commands": 0.008081130186716716, "deviation-center-line": 0.1098394441256471, "driven_lanedir_consec": 0.09296084728855349, "sim_compute_sim_state": 0.036017748514811196, "sim_compute_performance-ego": 0.007117551167805989}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939923982293902, "get_ui_image": 0.054163955847422285, "step_physics": 0.13206265767415365, "survival_time": 14.950000000000076, "driven_lanedir": 1.7363368925249394, "get_state_dump": 0.01852967341740926, "sim_render-ego": 0.009261109828948975, "get_robot_state": 0.02397281408309937, "get_duckie_state": 3.455479939778646e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.14209916512171428, "deviation-heading": 1.735661787388444, "complete-iteration": 0.43117541790008546, "set_robot_commands": 0.006330885092417399, "deviation-center-line": 0.5755573711952108, "driven_lanedir_consec": 1.7363368925249394, "sim_compute_sim_state": 0.038374176820119225, "sim_compute_performance-ego": 0.00617923657099406}}
set_robot_commands_max0.008344411849975586
set_robot_commands_mean0.007429835597674051
set_robot_commands_median0.007522022724151612
set_robot_commands_min0.006330885092417399
sim_compute_performance-ego_max0.007444129784901937
sim_compute_performance-ego_mean0.006930965383847554
sim_compute_performance-ego_median0.007050247589747111
sim_compute_performance-ego_min0.00617923657099406
sim_compute_sim_state_max0.038374176820119225
sim_compute_sim_state_mean0.03585192600886027
sim_compute_sim_state_median0.035822662909825644
sim_compute_sim_state_min0.03338820139567057
sim_render-ego_max0.010422983169555663
sim_render-ego_mean0.009766440987586975
sim_render-ego_median0.009706822236378988
sim_render-ego_min0.009229136308034262
simulation-passed1
step_physics_max0.15279510577519734
step_physics_mean0.13731856246789298
step_physics_median0.13584667007128398
step_physics_min0.12478580395380656
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4216611388Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4213111381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4212811380Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4212611380Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4211411379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4211311379Martin Cote 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:09
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4210611377Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:12:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7910198591033286
survival_time_median13.100000000000051
deviation-center-line_median0.3563495327788391
in-drivable-lane_median2.700000000000019


other stats
agent_compute-ego_max0.05953615744908651
agent_compute-ego_mean0.0385349291894171
agent_compute-ego_median0.03527888205316332
agent_compute-ego_min0.02404579520225525
complete-iteration_max0.337549413839976
complete-iteration_mean0.31348026013781877
complete-iteration_median0.30978635754340733
complete-iteration_min0.2967989116244846
deviation-center-line_max0.7218813793379725
deviation-center-line_mean0.4028548253134531
deviation-center-line_min0.17683885635816174
deviation-heading_max1.136456556669024
deviation-heading_mean0.9713029858291846
deviation-heading_median0.9680552615119368
deviation-heading_min0.812644863623841
driven_any_max1.9399996330380056
driven_any_mean1.4919667290813052
driven_any_median1.6912084474456837
driven_any_min0.6454503883958473
driven_lanedir_consec_max1.9186847490066183
driven_lanedir_consec_mean0.9784806586975732
driven_lanedir_consec_min0.4131981675770175
driven_lanedir_max1.9186847490066183
driven_lanedir_mean0.9784806586975732
driven_lanedir_median0.7910198591033286
driven_lanedir_min0.4131981675770175
get_duckie_state_max3.803041246202257e-06
get_duckie_state_mean3.74778468384702e-06
get_duckie_state_median3.7749608357747393e-06
get_duckie_state_min3.6381758176363432e-06
get_robot_state_max0.028219429346231315
get_robot_state_mean0.02356207647894183
get_robot_state_median0.0220925948354933
get_robot_state_min0.0218436868985494
get_state_dump_max0.02116453876862159
get_state_dump_mean0.018992394848257047
get_state_dump_median0.018419911596510144
get_state_dump_min0.01796521743138631
get_ui_image_max0.05658045411109924
get_ui_image_mean0.05399453239308464
get_ui_image_median0.05423932287428114
get_ui_image_min0.050919029712677005
in-drivable-lane_max9.500000000000089
in-drivable-lane_mean3.725000000000032
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4424172618533695, "get_ui_image": 0.054033471213446725, "step_physics": 0.12080002148946126, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389674539410052, "get_state_dump": 0.018591096666124133, "sim_render-ego": 0.009072742462158202, "get_robot_state": 0.022006535000271263, "get_duckie_state": 3.803041246202257e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.02514823489718967, "deviation-heading": 0.812644863623841, "complete-iteration": 0.2967989116244846, "set_robot_commands": 0.0067923132578531905, "deviation-center-line": 0.7218813793379725, "driven_lanedir_consec": 0.9389674539410052, "sim_compute_sim_state": 0.034139087465074325, "sim_compute_performance-ego": 0.006014501783582899}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503883958473, "get_ui_image": 0.05658045411109924, "step_physics": 0.12588615830128008, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4131981675770175, "get_state_dump": 0.02116453876862159, "sim_render-ego": 0.0088575528218196, "get_robot_state": 0.028219429346231315, "get_duckie_state": 3.6381758176363432e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.02404579520225525, "deviation-heading": 0.8847340546717286, "complete-iteration": 0.3080509671798119, "set_robot_commands": 0.006466911389277532, "deviation-center-line": 0.3183349243700995, "driven_lanedir_consec": 0.4131981675770175, "sim_compute_sim_state": 0.030705493230086107, "sim_compute_performance-ego": 0.005932610768538255}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399996330380056, "get_ui_image": 0.05444517453511556, "step_physics": 0.11828229824701944, "survival_time": 14.950000000000076, "driven_lanedir": 0.643072264265652, "get_state_dump": 0.01796521743138631, "sim_render-ego": 0.00922195593516032, "get_robot_state": 0.022178654670715333, "get_duckie_state": 3.749529520670573e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.04540952920913696, "deviation-heading": 1.051376468352145, "complete-iteration": 0.31152174790700277, "set_robot_commands": 0.0068102018038431805, "deviation-center-line": 0.17683885635816174, "driven_lanedir_consec": 0.643072264265652, "sim_compute_sim_state": 0.0310677703221639, "sim_compute_performance-ego": 0.005935828685760498}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939999633037998, "get_ui_image": 0.050919029712677005, "step_physics": 0.12648375193277994, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186847490066183, "get_state_dump": 0.01824872652689616, "sim_render-ego": 0.00914227326711019, "get_robot_state": 0.0218436868985494, "get_duckie_state": 3.800392150878906e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05953615744908651, "deviation-heading": 1.136456556669024, "complete-iteration": 0.337549413839976, "set_robot_commands": 0.008729706605275472, "deviation-center-line": 0.3943641411875786, "driven_lanedir_consec": 1.9186847490066183, "sim_compute_sim_state": 0.03655483325322469, "sim_compute_performance-ego": 0.005888553460439047}}
set_robot_commands_max0.008729706605275472
set_robot_commands_mean0.007199783264062344
set_robot_commands_median0.0068012575308481855
set_robot_commands_min0.006466911389277532
sim_compute_performance-ego_max0.006014501783582899
sim_compute_performance-ego_mean0.005942873674580174
sim_compute_performance-ego_median0.005934219727149376
sim_compute_performance-ego_min0.005888553460439047
sim_compute_sim_state_max0.03655483325322469
sim_compute_sim_state_mean0.033116796067637254
sim_compute_sim_state_median0.03260342889361911
sim_compute_sim_state_min0.030705493230086107
sim_render-ego_max0.00922195593516032
sim_render-ego_mean0.009073631121562077
sim_render-ego_median0.009107507864634197
sim_render-ego_min0.0088575528218196
simulation-passed1
step_physics_max0.12648375193277994
step_physics_mean0.12286305749263518
step_physics_median0.12334308989537068
step_physics_min0.11828229824701944
survival_time_max14.950000000000076
survival_time_mean11.58750000000004
survival_time_min5.1999999999999895
No reset possible
4209511375Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:19:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2592768382174464
survival_time_median14.950000000000076
deviation-center-line_median0.5733869500101747
in-drivable-lane_median4.100000000000058


other stats
agent_compute-ego_max0.19827248573303224
agent_compute-ego_mean0.17787340501944224
agent_compute-ego_median0.18927428483963013
agent_compute-ego_min0.13467256466547647
complete-iteration_max0.5775069197018942
complete-iteration_mean0.5501817957560221
complete-iteration_median0.5550325830777486
complete-iteration_min0.5131550971666972
deviation-center-line_max0.8389116959597991
deviation-center-line_mean0.5281022492761552
deviation-center-line_min0.12672340112447228
deviation-heading_max2.539305079426191
deviation-heading_mean1.8781449038200224
deviation-heading_median1.9060699871936568
deviation-heading_min1.1611345614665856
driven_any_max1.9399007068275047
driven_any_mean1.938221707761275
driven_any_median1.9396900892586664
driven_any_min1.9336059457002617
driven_lanedir_consec_max1.810179426328749
driven_lanedir_consec_mean1.1187476217825538
driven_lanedir_consec_min0.1462573843665741
driven_lanedir_max1.810179426328749
driven_lanedir_mean1.156243091005298
driven_lanedir_median1.334267776662934
driven_lanedir_min0.1462573843665741
get_duckie_state_max3.239313761393229e-06
get_duckie_state_mean2.890626589457194e-06
get_duckie_state_median2.8693675994873047e-06
get_duckie_state_min2.5844573974609375e-06
get_robot_state_max0.02588790814081828
get_robot_state_mean0.024482383529345196
get_robot_state_median0.024239573876063028
get_robot_state_min0.023562478224436443
get_state_dump_max0.022736201286315916
get_state_dump_mean0.02049154837926229
get_state_dump_median0.020089426438013713
get_state_dump_min0.01905113935470581
get_ui_image_max0.07652443885803223
get_ui_image_mean0.07340950230757395
get_ui_image_median0.07292947292327881
get_ui_image_min0.07125462452570597
in-drivable-lane_max12.800000000000082
in-drivable-lane_mean5.412500000000052
in-drivable-lane_min0.6500000000000092
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9336059457002617, "get_ui_image": 0.07652443885803223, "step_physics": 0.18222875197728475, "survival_time": 14.950000000000076, "driven_lanedir": 1.1236002737741857, "get_state_dump": 0.022736201286315916, "sim_render-ego": 0.01145030975341797, "get_robot_state": 0.024364285469055176, "get_duckie_state": 3.0008951822916665e-06, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.13467256466547647, "deviation-heading": 1.1611345614665856, "complete-iteration": 0.5131550971666972, "set_robot_commands": 0.007531290849049886, "deviation-center-line": 0.5048480021841402, "driven_lanedir_consec": 1.1236002737741857, "sim_compute_sim_state": 0.04601141929626465, "sim_compute_performance-ego": 0.007470590273539225}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9396514737068185, "get_ui_image": 0.07125462452570597, "step_physics": 0.17691630999247232, "survival_time": 14.950000000000076, "driven_lanedir": 1.5449352795516822, "get_state_dump": 0.01962715228398641, "sim_render-ego": 0.00964324156443278, "get_robot_state": 0.023562478224436443, "get_duckie_state": 3.239313761393229e-06, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.19157696803410848, "deviation-heading": 2.539305079426191, "complete-iteration": 0.5492655650774638, "set_robot_commands": 0.006938695112864176, "deviation-center-line": 0.8389116959597991, "driven_lanedir_consec": 1.394953402660707, "sim_compute_sim_state": 0.0435366694132487, "sim_compute_performance-ego": 0.006044826507568359}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939728704810515, "get_ui_image": 0.07368632793426513, "step_physics": 0.18499598821004232, "survival_time": 14.950000000000076, "driven_lanedir": 0.1462573843665741, "get_state_dump": 0.020551700592041016, "sim_render-ego": 0.01352068265279134, "get_robot_state": 0.02588790814081828, "get_duckie_state": 2.7378400166829425e-06, "in-drivable-lane": 12.800000000000082, "agent_compute-ego": 0.19827248573303224, "deviation-heading": 1.6491985925726804, "complete-iteration": 0.5775069197018942, "set_robot_commands": 0.008350382645924886, "deviation-center-line": 0.12672340112447228, "driven_lanedir_consec": 0.1462573843665741, "sim_compute_sim_state": 0.04468173344930013, "sim_compute_performance-ego": 0.00739323616027832}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399007068275047, "get_ui_image": 0.07217261791229249, "step_physics": 0.1853640834490458, "survival_time": 14.950000000000076, "driven_lanedir": 1.810179426328749, "get_state_dump": 0.01905113935470581, "sim_render-ego": 0.01088697910308838, "get_robot_state": 0.024114862283070884, "get_duckie_state": 2.5844573974609375e-06, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.18697160164515175, "deviation-heading": 2.162941381814633, "complete-iteration": 0.5607996010780334, "set_robot_commands": 0.007302263577779134, "deviation-center-line": 0.6419258978362093, "driven_lanedir_consec": 1.810179426328749, "sim_compute_sim_state": 0.04900413433710734, "sim_compute_performance-ego": 0.005765084425608317}}
set_robot_commands_max0.008350382645924886
set_robot_commands_mean0.007530658046404521
set_robot_commands_median0.00741677721341451
set_robot_commands_min0.006938695112864176
sim_compute_performance-ego_max0.007470590273539225
sim_compute_performance-ego_mean0.006668434341748555
sim_compute_performance-ego_median0.00671903133392334
sim_compute_performance-ego_min0.005765084425608317
sim_compute_sim_state_max0.04900413433710734
sim_compute_sim_state_mean0.04580848912398021
sim_compute_sim_state_median0.04534657637278239
sim_compute_sim_state_min0.0435366694132487
sim_render-ego_max0.01352068265279134
sim_render-ego_mean0.011375303268432616
sim_render-ego_median0.011168644428253174
sim_render-ego_min0.00964324156443278
simulation-passed1
step_physics_max0.1853640834490458
step_physics_mean0.1823762834072113
step_physics_median0.18361237009366357
step_physics_min0.17691630999247232
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4207811372Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:12
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4206611367Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:13:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.94453103258904
survival_time_median14.950000000000076
deviation-center-line_median0.46733418990291153
in-drivable-lane_median5.225000000000071


other stats
agent_compute-ego_max0.07504526376724244
agent_compute-ego_mean0.06055945376555125
agent_compute-ego_median0.07067889889081319
agent_compute-ego_min0.02583475351333618
complete-iteration_max0.38269580364227296
complete-iteration_mean0.3529283805688222
complete-iteration_median0.36771576484044394
complete-iteration_min0.29358618895212807
deviation-center-line_max0.7340052417654294
deviation-center-line_mean0.48452990552384945
deviation-center-line_min0.2694460005241452
deviation-heading_max2.6604258655227992
deviation-heading_mean1.635468217170885
deviation-heading_median1.4663077500096866
deviation-heading_min0.9488315031413678
driven_any_max3.17906008208981
driven_any_mean2.7883324255797377
driven_any_median2.7288939531801053
driven_any_min2.5164817138689295
driven_lanedir_consec_max3.1403373959347753
driven_lanedir_consec_mean1.940500345715365
driven_lanedir_consec_min0.7326019217486044
driven_lanedir_max3.1403373959347753
driven_lanedir_mean1.940500345715365
driven_lanedir_median1.94453103258904
driven_lanedir_min0.7326019217486044
get_duckie_state_max3.5381317138671875e-06
get_duckie_state_mean3.310640652974447e-06
get_duckie_state_median3.2981236775716143e-06
get_duckie_state_min3.10818354288737e-06
get_robot_state_max0.026614514191945392
get_robot_state_mean0.024122225046157835
get_robot_state_median0.023656123479207355
get_robot_state_min0.02256213903427124
get_state_dump_max0.02095180670420329
get_state_dump_mean0.019637490113576253
get_state_dump_median0.019600886106491088
get_state_dump_min0.018396381537119547
get_ui_image_max0.057872973283131915
get_ui_image_mean0.05607402702172597
get_ui_image_median0.05697729508082072
get_ui_image_min0.052468544642130535
in-drivable-lane_max10.05000000000006
in-drivable-lane_mean5.125000000000051
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.6009834685729047, "get_ui_image": 0.052468544642130535, "step_physics": 0.11747722307840984, "survival_time": 14.950000000000076, "driven_lanedir": 1.5735212026385184, "get_state_dump": 0.018396381537119547, "sim_render-ego": 0.009765673478444417, "get_robot_state": 0.022917577425638835, "get_duckie_state": 3.5381317138671875e-06, "in-drivable-lane": 7.350000000000096, "agent_compute-ego": 0.02583475351333618, "deviation-heading": 0.9488315031413678, "complete-iteration": 0.29358618895212807, "set_robot_commands": 0.007020459175109863, "deviation-center-line": 0.33193460248502393, "driven_lanedir_consec": 1.5735212026385184, "sim_compute_sim_state": 0.03343005339304606, "sim_compute_performance-ego": 0.006084541479746501}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.856804437787306, "get_ui_image": 0.05609545151392619, "step_physics": 0.12671534061431886, "survival_time": 14.950000000000076, "driven_lanedir": 2.315540862539562, "get_state_dump": 0.01968696753184001, "sim_render-ego": 0.009551192124684652, "get_robot_state": 0.02439466953277588, "get_duckie_state": 3.3052762349446614e-06, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.06925367832183837, "deviation-heading": 1.333255542144297, "complete-iteration": 0.3539818453788757, "set_robot_commands": 0.007399779955546061, "deviation-center-line": 0.6027337773207991, "driven_lanedir_consec": 2.315540862539562, "sim_compute_sim_state": 0.034378602504730224, "sim_compute_performance-ego": 0.006323765913645426}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5164817138689295, "get_ui_image": 0.057872973283131915, "step_physics": 0.14256056785583496, "survival_time": 14.950000000000076, "driven_lanedir": 0.7326019217486044, "get_state_dump": 0.02095180670420329, "sim_render-ego": 0.010183748404184977, "get_robot_state": 0.02256213903427124, "get_duckie_state": 3.10818354288737e-06, "in-drivable-lane": 10.05000000000006, "agent_compute-ego": 0.07504526376724244, "deviation-heading": 2.6604258655227992, "complete-iteration": 0.38144968430201215, "set_robot_commands": 0.007232214609781901, "deviation-center-line": 0.2694460005241452, "driven_lanedir_consec": 0.7326019217486044, "sim_compute_sim_state": 0.03777344544728597, "sim_compute_performance-ego": 0.007085522015889485}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.17906008208981, "get_ui_image": 0.057859138647715254, "step_physics": 0.13712592601776122, "survival_time": 14.950000000000076, "driven_lanedir": 3.1403373959347753, "get_state_dump": 0.01951480468114217, "sim_render-ego": 0.009480671087900796, "get_robot_state": 0.026614514191945392, "get_duckie_state": 3.2909711201985676e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.07210411945978801, "deviation-heading": 1.599359957875076, "complete-iteration": 0.38269580364227296, "set_robot_commands": 0.008415024280548095, "deviation-center-line": 0.7340052417654294, "driven_lanedir_consec": 3.1403373959347753, "sim_compute_sim_state": 0.04354812939961751, "sim_compute_performance-ego": 0.00785506010055542}}
set_robot_commands_max0.008415024280548095
set_robot_commands_mean0.00751686950524648
set_robot_commands_median0.007315997282663981
set_robot_commands_min0.007020459175109863
sim_compute_performance-ego_max0.00785506010055542
sim_compute_performance-ego_mean0.006837222377459208
sim_compute_performance-ego_median0.006704643964767456
sim_compute_performance-ego_min0.006084541479746501
sim_compute_sim_state_max0.04354812939961751
sim_compute_sim_state_mean0.03728255768616995
sim_compute_sim_state_median0.03607602397600809
sim_compute_sim_state_min0.03343005339304606
sim_render-ego_max0.010183748404184977
sim_render-ego_mean0.00974532127380371
sim_render-ego_median0.009658432801564537
sim_render-ego_min0.009480671087900796
simulation-passed1
step_physics_max0.14256056785583496
step_physics_mean0.1309697643915812
step_physics_median0.13192063331604004
step_physics_min0.11747722307840984
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4206211365brian wongtemplate-randomaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.644037326580434
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.0279185852761996
agent_compute-ego_mean0.025306355309046964
agent_compute-ego_median0.024662595385252825
agent_compute-ego_min0.02398164518948259
complete-iteration_max0.3594287290717616
complete-iteration_mean0.3281925546785842
complete-iteration_median0.3195988373892966
complete-iteration_min0.314143814863982
deviation-center-line_max0.1558386830383756
deviation-center-line_mean0.10879855071843546
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876907
driven_any_mean1.8510551780477624
driven_any_median1.9986666350865232
driven_any_min0.5174263274303109
driven_lanedir_consec_max0.8904446665936316
driven_lanedir_consec_mean0.6302364342579729
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936316
driven_lanedir_mean0.6302364342579729
driven_lanedir_median0.644037326580434
driven_lanedir_min0.3424264172773923
get_duckie_state_max3.4694013924434266e-06
get_duckie_state_mean3.3247371261870947e-06
get_duckie_state_median3.299126442468024e-06
get_duckie_state_min3.231294227368904e-06
get_robot_state_max0.02290391113798497
get_robot_state_mean0.02190104287885544
get_robot_state_median0.021869045471073816
get_robot_state_min0.020962169435289172
get_state_dump_max0.01870417594909668
get_state_dump_mean0.01830857836227709
get_state_dump_median0.01838200340349029
get_state_dump_min0.01776613069303108
get_ui_image_max0.06393998680692731
get_ui_image_mean0.060212194999803154
get_ui_image_median0.05978872656298371
get_ui_image_min0.057331340066317855
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.05859196388115317, "step_physics": 0.13968428110672257, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.01845779257305598, "sim_render-ego": 0.00889544567819369, "get_robot_state": 0.02290391113798497, "get_duckie_state": 3.3257371288234903e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.0279185852761996, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.3240489676847296, "set_robot_commands": 0.006684182053905422, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.03412456027532028, "sim_compute_performance-ego": 0.006585630319886289}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303109, "get_ui_image": 0.057331340066317855, "step_physics": 0.12854275210150357, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.018306214233924603, "sim_render-ego": 0.009276562723620183, "get_robot_state": 0.02146946150681068, "get_duckie_state": 3.4694013924434266e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.02398164518948259, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.31514870709386367, "set_robot_commands": 0.00658502249882139, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.03125899413536335, "sim_compute_performance-ego": 0.01818439056133402}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.835401090377117, "get_ui_image": 0.06098548924481427, "step_physics": 0.1333245665938766, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921869, "get_state_dump": 0.01870417594909668, "sim_render-ego": 0.008943902121649848, "get_robot_state": 0.020962169435289172, "get_duckie_state": 3.272515756112558e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.024039861891004773, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.314143814863982, "set_robot_commands": 0.006510870544998734, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921869, "sim_compute_sim_state": 0.03466684023539225, "sim_compute_performance-ego": 0.005802355872260199}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876907, "get_ui_image": 0.06393998680692731, "step_physics": 0.1563023906765562, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936316, "get_state_dump": 0.01776613069303108, "sim_render-ego": 0.011330620809034868, "get_robot_state": 0.022268629435336952, "get_duckie_state": 3.231294227368904e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.02528532887950088, "deviation-heading": 0.976837469261332, "complete-iteration": 0.3594287290717616, "set_robot_commands": 0.007877138527956877, "deviation-center-line": 0.1558386830383756, "driven_lanedir_consec": 0.8904446665936316, "sim_compute_sim_state": 0.04739344481265906, "sim_compute_performance-ego": 0.00706419258406668}}
set_robot_commands_max0.007877138527956877
set_robot_commands_mean0.006914303406420606
set_robot_commands_median0.006634602276363406
set_robot_commands_min0.006510870544998734
sim_compute_performance-ego_max0.01818439056133402
sim_compute_performance-ego_mean0.009409142334386797
sim_compute_performance-ego_median0.006824911451976484
sim_compute_performance-ego_min0.005802355872260199
sim_compute_sim_state_max0.04739344481265906
sim_compute_sim_state_mean0.03686095986468374
sim_compute_sim_state_median0.034395700255356265
sim_compute_sim_state_min0.03125899413536335
sim_render-ego_max0.011330620809034868
sim_render-ego_mean0.009611632833124648
sim_render-ego_median0.009110232422635017
sim_render-ego_min0.00889544567819369
simulation-passed1
step_physics_max0.1563023906765562
step_physics_mean0.13946349761966476
step_physics_median0.1365044238502996
step_physics_min0.12854275210150357
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible
4203611359Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203511359Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203411359Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203311360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203211360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203111360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4203011360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornoreg02-a6c0d476038a-10:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4202911358Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:10:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9170347614610272
survival_time_median11.125000000000025
deviation-center-line_median0.3653167228037504
in-drivable-lane_median2.450000000000035


other stats
agent_compute-ego_max0.07835329055786133
agent_compute-ego_mean0.055529171464933934
agent_compute-ego_median0.058808682971697446
agent_compute-ego_min0.026146029358479515
complete-iteration_max0.34381406784057617
complete-iteration_mean0.3189883703451422
complete-iteration_median0.3197638129858577
complete-iteration_min0.2926117875682774
deviation-center-line_max0.3842752186088163
deviation-center-line_mean0.34262668930324724
deviation-center-line_min0.2555980929966719
deviation-heading_max1.9999421327636049
deviation-heading_mean1.5578562508599485
deviation-heading_median1.4445887853944694
deviation-heading_min1.3423052998872498
driven_any_max2.8829004775051765
driven_any_mean2.413589592069594
driven_any_median2.669931114668432
driven_any_min1.4315956614363343
driven_lanedir_consec_max2.1760965257436427
driven_lanedir_consec_mean1.8168263082733296
driven_lanedir_consec_min1.2571391844276216
driven_lanedir_max2.1760965257436427
driven_lanedir_mean1.8168263082733296
driven_lanedir_median1.9170347614610272
driven_lanedir_min1.2571391844276216
get_duckie_state_max5.028141078664296e-06
get_duckie_state_mean4.60685871051095e-06
get_duckie_state_median4.585271449357395e-06
get_duckie_state_min4.228750864664714e-06
get_robot_state_max0.02481336529190476
get_robot_state_mean0.02442797056058743
get_robot_state_median0.02455252225073009
get_robot_state_min0.023793472448984783
get_state_dump_max0.020406968958742985
get_state_dump_mean0.02005304802388787
get_state_dump_median0.019974058606343065
get_state_dump_min0.01985710592412237
get_ui_image_max0.05122909972916788
get_ui_image_mean0.05020421560181397
get_ui_image_median0.0506596340467264
get_ui_image_min0.04826849458463523
in-drivable-lane_max7.150000000000097
in-drivable-lane_mean3.2875000000000405
in-drivable-lane_min1.099999999999996
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4315956614363343, "get_ui_image": 0.05122909972916788, "step_physics": 0.11509238072295688, "survival_time": 6.699999999999984, "driven_lanedir": 1.2571391844276216, "get_state_dump": 0.01985710592412237, "sim_render-ego": 0.009888424802182326, "get_robot_state": 0.024424748634224502, "get_duckie_state": 5.028141078664296e-06, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.026146029358479515, "deviation-heading": 1.3423052998872498, "complete-iteration": 0.2926117875682774, "set_robot_commands": 0.007288192635151877, "deviation-center-line": 0.2555980929966719, "driven_lanedir_consec": 1.2571391844276216, "sim_compute_sim_state": 0.03179617248364349, "sim_compute_performance-ego": 0.006677570627696479}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.6375578195330807, "get_ui_image": 0.050409263318723384, "step_physics": 0.1090231972771722, "survival_time": 11.100000000000025, "driven_lanedir": 2.086633775969297, "get_state_dump": 0.020406968958742985, "sim_render-ego": 0.009738320702905054, "get_robot_state": 0.02481336529190476, "get_duckie_state": 4.644866462226386e-06, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.043982368331771715, "deviation-heading": 1.9999421327636049, "complete-iteration": 0.3046768613763758, "set_robot_commands": 0.008293047681585088, "deviation-center-line": 0.3842752186088163, "driven_lanedir_consec": 2.086633775969297, "sim_compute_sim_state": 0.03108187731321867, "sim_compute_performance-ego": 0.006702024657447059}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8829004775051765, "get_ui_image": 0.05091000477472941, "step_physics": 0.11529348850250244, "survival_time": 14.950000000000076, "driven_lanedir": 1.7474357469527573, "get_state_dump": 0.019957910378774008, "sim_render-ego": 0.009582223097483316, "get_robot_state": 0.023793472448984783, "get_duckie_state": 4.228750864664714e-06, "in-drivable-lane": 7.150000000000097, "agent_compute-ego": 0.07835329055786133, "deviation-heading": 1.5440590902472962, "complete-iteration": 0.34381406784057617, "set_robot_commands": 0.007410556475321452, "deviation-center-line": 0.3703613512506795, "driven_lanedir_consec": 1.7474357469527573, "sim_compute_sim_state": 0.031904166539510094, "sim_compute_performance-ego": 0.006393411159515381}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.702304409803783, "get_ui_image": 0.04826849458463523, "step_physics": 0.1087904735530973, "survival_time": 11.150000000000023, "driven_lanedir": 2.1760965257436427, "get_state_dump": 0.01999020683391212, "sim_render-ego": 0.009770204133517004, "get_robot_state": 0.02468029586723567, "get_duckie_state": 4.525676436488404e-06, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.07363499761162318, "deviation-heading": 1.3451184805416423, "complete-iteration": 0.33485076459533963, "set_robot_commands": 0.007684426457358048, "deviation-center-line": 0.3602720943568212, "driven_lanedir_consec": 2.1760965257436427, "sim_compute_sim_state": 0.035336135214219716, "sim_compute_performance-ego": 0.0064673188555935575}}
set_robot_commands_max0.008293047681585088
set_robot_commands_mean0.007669055812354116
set_robot_commands_median0.00754749146633975
set_robot_commands_min0.007288192635151877
sim_compute_performance-ego_max0.006702024657447059
sim_compute_performance-ego_mean0.006560081325063119
sim_compute_performance-ego_median0.006572444741645018
sim_compute_performance-ego_min0.006393411159515381
sim_compute_sim_state_max0.035336135214219716
sim_compute_sim_state_mean0.032529587887647995
sim_compute_sim_state_median0.03185016951157679
sim_compute_sim_state_min0.03108187731321867
sim_render-ego_max0.009888424802182326
sim_render-ego_mean0.009744793184021924
sim_render-ego_median0.009754262418211028
sim_render-ego_min0.009582223097483316
simulation-passed1
step_physics_max0.11529348850250244
step_physics_mean0.1120498850139322
step_physics_median0.11205778900006452
step_physics_min0.1087904735530973
survival_time_max14.950000000000076
survival_time_mean10.975000000000026
survival_time_min6.699999999999984
No reset possible
4202611357Bhavya Patwa 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-a6c0d476038a-10:11:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6392247504377742
survival_time_median14.950000000000076
deviation-center-line_median0.682554892740306
in-drivable-lane_median3.8250000000000544


other stats
agent_compute-ego_max0.036897801567988144
agent_compute-ego_mean0.02963932136939877
agent_compute-ego_median0.027891586224238075
agent_compute-ego_min0.02587631146113078
complete-iteration_max0.3048333326975505
complete-iteration_mean0.2962863262494405
complete-iteration_median0.29839213331540426
complete-iteration_min0.28352770566940305
deviation-center-line_max0.8918709834356909
deviation-center-line_mean0.6142744770830909
deviation-center-line_min0.20011713941606069
deviation-heading_max3.1367081511457204
deviation-heading_mean2.1072269527583325
deviation-heading_median1.9925436558071936
deviation-heading_min1.3071123482732223
driven_any_max2.44859748836726
driven_any_mean2.250727395931837
driven_any_median2.2984943666612043
driven_any_min1.9573233620376789
driven_lanedir_consec_max2.092476757680246
driven_lanedir_consec_mean1.534826529496506
driven_lanedir_consec_min0.7683798594302296
driven_lanedir_max2.092476757680246
driven_lanedir_mean1.534826529496506
driven_lanedir_median1.6392247504377742
driven_lanedir_min0.7683798594302296
get_duckie_state_max4.884146859125836e-06
get_duckie_state_mean3.967817428180711e-06
get_duckie_state_median3.6978721618652343e-06
get_duckie_state_min3.5913785298665363e-06
get_robot_state_max0.024779644012451172
get_robot_state_mean0.024640326897303264
get_robot_state_median0.02466113805770874
get_robot_state_min0.024459387461344403
get_state_dump_max0.020679644596429517
get_state_dump_mean0.020135709010524513
get_state_dump_median0.020156365235646567
get_state_dump_min0.019550460974375405
get_ui_image_max0.053517306292498554
get_ui_image_mean0.0518114228160293
get_ui_image_median0.05141851305961609
get_ui_image_min0.05089135885238647
in-drivable-lane_max10.350000000000067
in-drivable-lane_mean4.762500000000048
in-drivable-lane_min1.050000000000015
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9573233620376789, "get_ui_image": 0.053517306292498554, "step_physics": 0.10924087532263234, "survival_time": 12.150000000000038, "driven_lanedir": 1.3249326277652522, "get_state_dump": 0.020679644596429517, "sim_render-ego": 0.01080477973561228, "get_robot_state": 0.02475436528523763, "get_duckie_state": 4.884146859125836e-06, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.036897801567988144, "deviation-heading": 2.2090556943284665, "complete-iteration": 0.3048333326975505, "set_robot_commands": 0.007450479538842974, "deviation-center-line": 0.6835203696623721, "driven_lanedir_consec": 1.3249326277652522, "sim_compute_sim_state": 0.03446138837209945, "sim_compute_performance-ego": 0.00679346955852744}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.269482129507493, "get_ui_image": 0.05089135885238647, "step_physics": 0.10602851867675782, "survival_time": 14.950000000000076, "driven_lanedir": 2.092476757680246, "get_state_dump": 0.01998621384302775, "sim_render-ego": 0.009969568252563475, "get_robot_state": 0.02456791083017985, "get_duckie_state": 3.677209218343099e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.02587631146113078, "deviation-heading": 3.1367081511457204, "complete-iteration": 0.28352770566940305, "set_robot_commands": 0.007366528511047363, "deviation-center-line": 0.8918709834356909, "driven_lanedir_consec": 2.092476757680246, "sim_compute_sim_state": 0.03166408936182658, "sim_compute_performance-ego": 0.006942093372344971}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3275066038149155, "get_ui_image": 0.05131150007247925, "step_physics": 0.1126317032178243, "survival_time": 14.950000000000076, "driven_lanedir": 0.7683798594302296, "get_state_dump": 0.019550460974375405, "sim_render-ego": 0.010058860778808592, "get_robot_state": 0.024779644012451172, "get_duckie_state": 3.7185351053873696e-06, "in-drivable-lane": 10.350000000000067, "agent_compute-ego": 0.02813628037770589, "deviation-heading": 1.3071123482732223, "complete-iteration": 0.2929382371902466, "set_robot_commands": 0.007684042453765869, "deviation-center-line": 0.20011713941606069, "driven_lanedir_consec": 0.7683798594302296, "sim_compute_sim_state": 0.03161474863688151, "sim_compute_performance-ego": 0.006929090817769368}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.44859748836726, "get_ui_image": 0.05152552604675293, "step_physics": 0.11716277678807575, "survival_time": 14.950000000000076, "driven_lanedir": 1.953516873110296, "get_state_dump": 0.02032651662826538, "sim_render-ego": 0.01014921506245931, "get_robot_state": 0.024459387461344403, "get_duckie_state": 3.5913785298665363e-06, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.027646892070770264, "deviation-heading": 1.7760316172859203, "complete-iteration": 0.30384602944056194, "set_robot_commands": 0.007689046065012614, "deviation-center-line": 0.68158941581824, "driven_lanedir_consec": 1.953516873110296, "sim_compute_sim_state": 0.037595421473185224, "sim_compute_performance-ego": 0.007058425744374593}}
set_robot_commands_max0.007689046065012614
set_robot_commands_mean0.007547524142167206
set_robot_commands_median0.007567260996304422
set_robot_commands_min0.007366528511047363
sim_compute_performance-ego_max0.007058425744374593
sim_compute_performance-ego_mean0.006930769873254093
sim_compute_performance-ego_median0.00693559209505717
sim_compute_performance-ego_min0.00679346955852744
sim_compute_sim_state_max0.037595421473185224
sim_compute_sim_state_mean0.03383391196099819
sim_compute_sim_state_median0.033062738866963017
sim_compute_sim_state_min0.03161474863688151
sim_render-ego_max0.01080477973561228
sim_render-ego_mean0.010245605957360914
sim_render-ego_median0.01010403792063395
sim_render-ego_min0.009969568252563475
simulation-passed1
step_physics_max0.11716277678807575
step_physics_mean0.11126596850132256
step_physics_median0.11093628927022832
step_physics_min0.10602851867675782
survival_time_max14.950000000000076
survival_time_mean14.250000000000068
survival_time_min12.150000000000038
No reset possible
4201911356Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednoreg02-a6c0d476038a-10:01:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible