Duckietown Challenges Home Challenges Submissions

Submission 12747

Submission12747
Competingyes
Challengeaido5-LF-sim-testing
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFt-sim: 58784
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
58784LFt-simsuccessyes0:37:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.857464924533923
survival_time_median59.99999999999873
deviation-center-line_median2.8056200267238425
in-drivable-lane_median2.700000000000008


other stats
agent_compute-ego0_max0.014208842475249507
agent_compute-ego0_mean0.013663650165222882
agent_compute-ego0_median0.013830711920456564
agent_compute-ego0_min0.0127843343447289
complete-iteration_max0.27277434596808925
complete-iteration_mean0.23458333969073292
complete-iteration_median0.23669918186473524
complete-iteration_min0.19216064906537184
deviation-center-line_max3.350543704064106
deviation-center-line_mean2.3966759457160793
deviation-center-line_min0.6249200253525268
deviation-heading_max13.403862132575904
deviation-heading_mean9.732324313033857
deviation-heading_median11.541481340768318
deviation-heading_min2.4424724380228846
driven_any_max11.490499936784882
driven_any_mean9.611444014051443
driven_any_median10.659531579179536
driven_any_min5.636212961061816
driven_lanedir_consec_max11.184696103836862
driven_lanedir_consec_mean8.26849962529453
driven_lanedir_consec_min2.1743725482734093
driven_lanedir_max11.184696103836862
driven_lanedir_mean8.26849962529453
driven_lanedir_median9.857464924533923
driven_lanedir_min2.1743725482734093
get_duckie_state_max2.329593693386208e-06
get_duckie_state_mean2.2676629471074024e-06
get_duckie_state_median2.295561016018819e-06
get_duckie_state_min2.1499360630057632e-06
get_robot_state_max0.004381890499423088
get_robot_state_mean0.004227731357175733
get_robot_state_median0.004282310857199293
get_robot_state_min0.003964413214881255
get_state_dump_max0.005255280088921769
get_state_dump_mean0.005111737005196753
get_state_dump_median0.005160180333405731
get_state_dump_min0.00487130726505378
get_ui_image_max0.044964759177113456
get_ui_image_mean0.0381451351831351
get_ui_image_median0.0381594147861158
get_ui_image_min0.03129695198319536
in-drivable-lane_max19.200000000000273
in-drivable-lane_mean6.150000000000072
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.490499936784882, "get_ui_image": 0.03129695198319536, "step_physics": 0.12132825263830944, "survival_time": 59.99999999999873, "driven_lanedir": 11.184696103836862, "get_state_dump": 0.00487130726505378, "get_robot_state": 0.003964413214881255, "sim_render-ego0": 0.00391520230994435, "get_duckie_state": 2.1499360630057632e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.93096760321716, "agent_compute-ego0": 0.0127843343447289, "complete-iteration": 0.19216064906537184, "set_robot_commands": 0.0024535378051935685, "deviation-center-line": 2.52946796885712, "driven_lanedir_consec": 11.184696103836862, "sim_compute_sim_state": 0.009287602895503238, "sim_compute_performance-ego0": 0.002171139633725029}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.41099452339799, "get_ui_image": 0.044964759177113456, "step_physics": 0.18153710984667573, "survival_time": 59.99999999999873, "driven_lanedir": 9.145701896080052, "get_state_dump": 0.005115280540459956, "get_robot_state": 0.004217080529980814, "sim_render-ego0": 0.004203102769303778, "get_duckie_state": 2.274406045600834e-06, "in-drivable-lane": 5.400000000000016, "deviation-heading": 13.403862132575904, "agent_compute-ego0": 0.013560948423501551, "complete-iteration": 0.27277434596808925, "set_robot_commands": 0.002664026471597765, "deviation-center-line": 3.350543704064106, "driven_lanedir_consec": 9.145701896080052, "sim_compute_sim_state": 0.014066729517800922, "sim_compute_performance-ego0": 0.002351521651611836}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.908068634961085, "get_ui_image": 0.04222312795430993, "step_physics": 0.1706011013424863, "survival_time": 59.99999999999873, "driven_lanedir": 10.5692279529878, "get_state_dump": 0.005255280088921769, "get_robot_state": 0.004381890499423088, "sim_render-ego0": 0.00434511468174257, "get_duckie_state": 2.329593693386208e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.151995078319478, "agent_compute-ego0": 0.014208842475249507, "complete-iteration": 0.2617195172671176, "set_robot_commands": 0.002822149405372232, "deviation-center-line": 3.081772084590565, "driven_lanedir_consec": 10.5692279529878, "sim_compute_sim_state": 0.015296391305280268, "sim_compute_performance-ego0": 0.002486044123806029}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.636212961061816, "get_ui_image": 0.03409570161792167, "step_physics": 0.13645803871518666, "survival_time": 31.40000000000031, "driven_lanedir": 2.1743725482734093, "get_state_dump": 0.0052050801263515065, "get_robot_state": 0.0043475411844177735, "sim_render-ego0": 0.004303392810548622, "get_duckie_state": 2.3167159864368043e-06, "in-drivable-lane": 19.200000000000273, "deviation-heading": 2.4424724380228846, "agent_compute-ego0": 0.014100475417411574, "complete-iteration": 0.21167884646235283, "set_robot_commands": 0.0027277829726663418, "deviation-center-line": 0.6249200253525268, "driven_lanedir_consec": 2.1743725482734093, "sim_compute_sim_state": 0.007966938761724766, "sim_compute_performance-ego0": 0.002378704817003211}}
set_robot_commands_max0.002822149405372232
set_robot_commands_mean0.002666874163707477
set_robot_commands_median0.0026959047221320536
set_robot_commands_min0.0024535378051935685
sim_compute_performance-ego0_max0.002486044123806029
sim_compute_performance-ego0_mean0.002346852556536526
sim_compute_performance-ego0_median0.0023651132343075233
sim_compute_performance-ego0_min0.002171139633725029
sim_compute_sim_state_max0.015296391305280268
sim_compute_sim_state_mean0.011654415620077298
sim_compute_sim_state_median0.01167716620665208
sim_compute_sim_state_min0.007966938761724766
sim_render-ego0_max0.00434511468174257
sim_render-ego0_mean0.00419170314288483
sim_render-ego0_median0.0042532477899262
sim_render-ego0_min0.00391520230994435
simulation-passed1
step_physics_max0.18153710984667573
step_physics_mean0.15248112563566454
step_physics_median0.1535295700288365
step_physics_min0.12132825263830944
survival_time_max59.99999999999873
survival_time_mean52.84999999999913
survival_time_min31.40000000000031
No reset possible
58779LFt-simsuccessyes0:38:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58773LFt-simsuccessyes0:31:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58764LFt-simsuccessyes0:35:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
58763LFt-simhost-erroryes0:01:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible