Duckietown Challenges Home Challenges Submissions

Submission 11704

Submission11704
Competingyes
Challengeaido5-LF-sim-validation
Userbrian wong
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53987
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

53987

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53987LFv-simsuccessyes0:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.013163556655248008
agent_compute-ego0_mean0.011546036550425604
agent_compute-ego0_median0.011070713022912758
agent_compute-ego0_min0.010879163500628891
complete-iteration_max0.21184400386280483
complete-iteration_mean0.1859592986698345
complete-iteration_median0.18830891717051043
complete-iteration_min0.15537535647551218
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.5964990929712223e-06
get_duckie_state_mean1.4046562103979346e-06
get_duckie_state_median1.37155470640763e-06
get_duckie_state_min1.279016335805257e-06
get_robot_state_max0.004054652320014106
get_robot_state_mean0.003796985971343916
get_robot_state_median0.0037734594809103617
get_robot_state_min0.0035863726035408354
get_state_dump_max0.0054574476348029245
get_state_dump_mean0.004955544091985728
get_state_dump_median0.004842808795093375
get_state_dump_min0.004679111142953237
get_ui_image_max0.03486497505851414
get_ui_image_mean0.03096465212750572
get_ui_image_median0.03163292987269524
get_ui_image_min0.025727773706118267
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.029610620269292516, "step_physics": 0.10685037510304513, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004796176017085208, "get_robot_state": 0.0038750865791417374, "sim_render-ego0": 0.004023452348346951, "get_duckie_state": 1.5964990929712223e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010879163500628891, "complete-iteration": 0.1746446241306353, "set_robot_commands": 0.0023366273203982582, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.010057232047938094, "sim_compute_performance-ego0": 0.0021169517613664457}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03486497505851414, "step_physics": 0.13068553934926572, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0048894415731015415, "get_robot_state": 0.0035863726035408354, "sim_render-ego0": 0.003689654495405114, "get_duckie_state": 1.2827956158181897e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011014264562855597, "complete-iteration": 0.20197321021038553, "set_robot_commands": 0.00208186325819596, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009136518706446108, "sim_compute_performance-ego0": 0.001936954000721807}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.033655239476097956, "step_physics": 0.13822108507156372, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.0054574476348029245, "get_robot_state": 0.004054652320014106, "sim_render-ego0": 0.004300839371151394, "get_duckie_state": 1.4603137969970703e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.013163556655248008, "complete-iteration": 0.21184400386280483, "set_robot_commands": 0.002625746859444512, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008015311426586576, "sim_compute_performance-ego0": 0.0022468467553456626}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.025727773706118267, "step_physics": 0.0970814178387324, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004679111142953237, "get_robot_state": 0.0036718323826789856, "sim_render-ego0": 0.0038059080640474954, "get_duckie_state": 1.279016335805257e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01112716148296992, "complete-iteration": 0.15537535647551218, "set_robot_commands": 0.002253835399945577, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.0049601296583811445, "sim_compute_performance-ego0": 0.0019794628024101257}}
set_robot_commands_max0.002625746859444512
set_robot_commands_mean0.002324518209496077
set_robot_commands_median0.0022952313601719175
set_robot_commands_min0.00208186325819596
sim_compute_performance-ego0_max0.0022468467553456626
sim_compute_performance-ego0_mean0.00207005382996101
sim_compute_performance-ego0_median0.002048207281888286
sim_compute_performance-ego0_min0.001936954000721807
sim_compute_sim_state_max0.010057232047938094
sim_compute_sim_state_mean0.00804229795983798
sim_compute_sim_state_median0.008575915066516341
sim_compute_sim_state_min0.0049601296583811445
sim_render-ego0_max0.004300839371151394
sim_render-ego0_mean0.003954963569737739
sim_render-ego0_median0.003914680206197224
sim_render-ego0_min0.003689654495405114
simulation-passed1
step_physics_max0.13822108507156372
step_physics_mean0.11820960434065174
step_physics_median0.1187679572261554
step_physics_min0.0970814178387324
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
53984LFv-simsuccessyes0:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53983LFv-simsuccessyes0:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53951LFv-simhost-erroryes0:01:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53947LFv-simsuccessyes0:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible