Duckietown Challenges Home Challenges Submissions

Submission 2500

Submission2500
Competingyes
Challengeaido2-LFVI-sim-validation
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22943
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

22943

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-1-0

udem1-2-0

udem1-3-0

udem1-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22943step1-simulationsuccessyes0:22:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.16989098333932984
survival_time_median5.999999999999987
deviation-center-line_median0.09700516215369968
in-drivable-lane_median2.8499999999999948


other stats
agent_compute-ego_max0.19063714265823364
agent_compute-ego_mean0.17954617341359458
agent_compute-ego_median0.17926146189371744
agent_compute-ego_min0.1693095397949219
deviation-center-line_max0.5149326144164952
deviation-center-line_mean0.18875630734570936
deviation-center-line_min0.055176021990154915
deviation-heading_max6.03706759109609
deviation-heading_mean3.0367562823392857
deviation-heading_median2.337778188521578
deviation-heading_min0.4769187806207878
driven_any_max1.2763860438329668
driven_any_mean0.6447561517358648
driven_any_median0.5046802893128901
driven_any_min0.09611140033290728
driven_lanedir_consec_max0.46870127726085253
driven_lanedir_consec_mean0.2301678207304392
driven_lanedir_consec_min0.02938220295962002
driven_lanedir_max0.46870127726085253
driven_lanedir_mean0.2301678207304392
driven_lanedir_median0.16989098333932984
driven_lanedir_min0.02938220295962002
in-drivable-lane_max7.450000000000042
in-drivable-lane_mean3.5900000000000154
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 1.2763860438329668, "sim_physics": 0.20811249812444052, "survival_time": 14.950000000000076, "driven_lanedir": 0.46870127726085253, "sim_render-ego": 0.06639371554056804, "in-drivable-lane": 7.000000000000038, "agent_compute-ego": 0.178730898698171, "deviation-heading": 6.03706759109609, "set_robot_commands": 0.10293264150619506, "deviation-center-line": 0.2145522802595322, "driven_lanedir_consec": 0.46870127726085253, "sim_compute_sim_state": 0.043234986464182536, "sim_compute_performance-ego": 0.0734652026494344, "sim_compute_robot_state-ego": 0.07744264284769695, "sim_compute_robot_state-npc0": 0.07371064186096192, "sim_compute_robot_state-npc1": 0.0750965921084086, "sim_compute_robot_state-npc2": 0.07530850013097128, "sim_compute_robot_state-npc3": 0.07585594177246094}, "udem1-1-0": {"driven_any": 1.228587038018929, "sim_physics": 0.22931541681289672, "survival_time": 14.950000000000076, "driven_lanedir": 0.4085933010513707, "sim_render-ego": 0.06922561009724935, "in-drivable-lane": 7.450000000000042, "agent_compute-ego": 0.19063714265823364, "deviation-heading": 5.727632976660504, "set_robot_commands": 0.10236602306365966, "deviation-center-line": 0.5149326144164952, "driven_lanedir_consec": 0.4085933010513707, "sim_compute_sim_state": 0.04328161080678304, "sim_compute_performance-ego": 0.07494593540827434, "sim_compute_robot_state-ego": 0.0809173019727071, "sim_compute_robot_state-npc0": 0.0748743748664856, "sim_compute_robot_state-npc1": 0.0762978196144104, "sim_compute_robot_state-npc2": 0.07554871241251628, "sim_compute_robot_state-npc3": 0.07635698795318603}, "udem1-2-0": {"driven_any": 0.11801598718163096, "sim_physics": 0.25325515747070315, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07427133904102279, "sim_render-ego": 0.06702505111694336, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1693095397949219, "deviation-heading": 0.604383874797468, "set_robot_commands": 0.09785906791687012, "deviation-center-line": 0.09700516215369968, "driven_lanedir_consec": 0.07427133904102279, "sim_compute_sim_state": 0.04112253189086914, "sim_compute_performance-ego": 0.07145792007446289, "sim_compute_robot_state-ego": 0.0746457576751709, "sim_compute_robot_state-npc0": 0.07174093246459962, "sim_compute_robot_state-npc1": 0.07079922676086425, "sim_compute_robot_state-npc2": 0.07264791488647461, "sim_compute_robot_state-npc3": 0.0706085205078125}, "udem1-3-0": {"driven_any": 0.09611140033290728, "sim_physics": 0.23172694842020672, "survival_time": 1.5000000000000009, "driven_lanedir": 0.02938220295962002, "sim_render-ego": 0.06726459662119548, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.17979182402292887, "deviation-heading": 0.4769187806207878, "set_robot_commands": 0.09374038378397624, "deviation-center-line": 0.062115457908664795, "driven_lanedir_consec": 0.02938220295962002, "sim_compute_sim_state": 0.04054005146026611, "sim_compute_performance-ego": 0.07307710647583007, "sim_compute_robot_state-ego": 0.0797143538792928, "sim_compute_robot_state-npc0": 0.06493157545725504, "sim_compute_robot_state-npc1": 0.06878815491994222, "sim_compute_robot_state-npc2": 0.06922786235809326, "sim_compute_robot_state-npc3": 0.06872215270996093}, "udem1-4-0": {"driven_any": 0.5046802893128901, "sim_physics": 0.21552934845288593, "survival_time": 5.999999999999987, "driven_lanedir": 0.16989098333932984, "sim_render-ego": 0.06574769814809163, "in-drivable-lane": 2.8499999999999948, "agent_compute-ego": 0.17926146189371744, "deviation-heading": 2.337778188521578, "set_robot_commands": 0.10036178032557168, "deviation-center-line": 0.055176021990154915, "driven_lanedir_consec": 0.16989098333932984, "sim_compute_sim_state": 0.0414349635442098, "sim_compute_performance-ego": 0.07255013386408488, "sim_compute_robot_state-ego": 0.0783116598924001, "sim_compute_robot_state-npc0": 0.07724600632985433, "sim_compute_robot_state-npc1": 0.07342073917388917, "sim_compute_robot_state-npc2": 0.07277507781982422, "sim_compute_robot_state-npc3": 0.07234709461530049}}
set_robot_commands_max0.10293264150619506
set_robot_commands_mean0.09945197931925456
set_robot_commands_median0.10036178032557168
set_robot_commands_min0.09374038378397624
sim_compute_performance-ego_max0.07494593540827434
sim_compute_performance-ego_mean0.07309925969441732
sim_compute_performance-ego_median0.07307710647583007
sim_compute_performance-ego_min0.07145792007446289
sim_compute_robot_state-ego_max0.0809173019727071
sim_compute_robot_state-ego_mean0.07820634325345358
sim_compute_robot_state-ego_median0.0783116598924001
sim_compute_robot_state-ego_min0.0746457576751709
sim_compute_robot_state-npc0_max0.07724600632985433
sim_compute_robot_state-npc0_mean0.0725007061958313
sim_compute_robot_state-npc0_median0.07371064186096192
sim_compute_robot_state-npc0_min0.06493157545725504
sim_compute_robot_state-npc1_max0.0762978196144104
sim_compute_robot_state-npc1_mean0.07288050651550293
sim_compute_robot_state-npc1_median0.07342073917388917
sim_compute_robot_state-npc1_min0.06878815491994222
sim_compute_robot_state-npc2_max0.07554871241251628
sim_compute_robot_state-npc2_mean0.07310161352157593
sim_compute_robot_state-npc2_median0.07277507781982422
sim_compute_robot_state-npc2_min0.06922786235809326
sim_compute_robot_state-npc3_max0.07635698795318603
sim_compute_robot_state-npc3_mean0.07277813951174418
sim_compute_robot_state-npc3_median0.07234709461530049
sim_compute_robot_state-npc3_min0.06872215270996093
sim_compute_sim_state_max0.04328161080678304
sim_compute_sim_state_mean0.041922828833262135
sim_compute_sim_state_median0.0414349635442098
sim_compute_sim_state_min0.04054005146026611
sim_physics_max0.25325515747070315
sim_physics_mean0.2275878738562266
sim_physics_median0.22931541681289672
sim_physics_min0.20811249812444052
sim_render-ego_max0.06922561009724935
sim_render-ego_mean0.06713133430480958
sim_render-ego_median0.06702505111694336
sim_render-ego_min0.06574769814809163
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000028
survival_time_min1.2500000000000004
No reset possible
22939step1-simulationsuccessyes0:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21239step1-simulationsuccessno0:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20528step1-simulationsuccessno0:10:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19563step1-simulationsuccessno0:09:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18824step1-simulationsuccessno0:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18460step1-simulationsuccessno0:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17925step1-simulationerrorno0:21:08
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17791step1-simulationsuccessno0:09:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17638step1-simulationsuccessno0:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible