Duckietown Challenges Home Challenges Submissions

Submission 4282

Submission4282
Competingyes
Challengeaido3-LF-sim-validation
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27606
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

27606

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27606step1-simulationsuccessyes0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0249961256980896
agent_compute-ego_mean0.02436052326058246
agent_compute-ego_median0.02457569945942272
agent_compute-ego_min0.023515792453990263
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.08381534539736234, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.013919380994943472, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.024927625289330117, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.008602573321415828, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.005633459641383245, "sim_compute_performance-ego": 0.008552702573629526, "sim_compute_robot_state-ego": 0.009152705852801982}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.08385746479034424, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.012838912010192872, "in-drivable-lane": 0, "agent_compute-ego": 0.0249961256980896, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.008197081089019776, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.007139682769775391, "sim_compute_performance-ego": 0.0074779272079467775, "sim_compute_robot_state-ego": 0.009612047672271728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.08169605451471665, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.013106549487394445, "in-drivable-lane": 0, "agent_compute-ego": 0.023515792453990263, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008445206810446346, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.005458993070265826, "sim_compute_performance-ego": 0.0069924031986909755, "sim_compute_robot_state-ego": 0.009518076391781078}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.07916373112162606, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.012701073630911403, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.0237873734020796, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008868092396220223, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.005176895954569832, "sim_compute_performance-ego": 0.0071609098403180235, "sim_compute_robot_state-ego": 0.008672041971175397}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.08311595700003883, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.013281410390680488, "in-drivable-lane": 0, "agent_compute-ego": 0.02457569945942272, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.008758631619540129, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.006101174788041549, "sim_compute_performance-ego": 0.0077521259134466, "sim_compute_robot_state-ego": 0.008668617768721147}}
set_robot_commands_max0.008868092396220223
set_robot_commands_mean0.008574317047328462
set_robot_commands_median0.008602573321415828
set_robot_commands_min0.008197081089019776
sim_compute_performance-ego_max0.008552702573629526
sim_compute_performance-ego_mean0.00758721374680638
sim_compute_performance-ego_median0.0074779272079467775
sim_compute_performance-ego_min0.0069924031986909755
sim_compute_robot_state-ego_max0.009612047672271728
sim_compute_robot_state-ego_mean0.009124697931350264
sim_compute_robot_state-ego_median0.009152705852801982
sim_compute_robot_state-ego_min0.008668617768721147
sim_compute_sim_state_max0.007139682769775391
sim_compute_sim_state_mean0.005902041244807169
sim_compute_sim_state_median0.005633459641383245
sim_compute_sim_state_min0.005176895954569832
sim_physics_max0.08385746479034424
sim_physics_mean0.08232971056481761
sim_physics_median0.08311595700003883
sim_physics_min0.07916373112162606
sim_render-ego_max0.013919380994943472
sim_render-ego_mean0.013169465302824538
sim_render-ego_median0.013106549487394445
sim_render-ego_min0.012701073630911403
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
25640step1-simulationsuccessno0:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25362step1-simulationerrorno0:01:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24868step1-simulationsuccessno0:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24519step1-simulationsuccessno0:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24515step1-simulationsuccessno0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible