Duckietown Challenges Home Challenges Submissions

Evaluator 1829

ID1829
evaluatorp-1
ownerI don't have one 😀
machinef375a21b4d7c
processp-1
versiond-c:6.0.20;d-c-r:6.0.10
first heard
last heard
statusinactive
# evaluating
# success3 33204
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
332216709Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simsuccessnop-10:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4074140419109087
survival_time_median2.849999999999998
deviation-center-line_median0.14244055226826444
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04988162432398115
agent_compute-ego0_mean0.04976989769289646
agent_compute-ego0_median0.04976989769289646
agent_compute-ego0_min0.04965817106181178
agent_compute-ego1_max0.050850749015808105
agent_compute-ego1_mean0.050282515328505945
agent_compute-ego1_median0.050282515328505945
agent_compute-ego1_min0.049714281641203784
agent_compute-ego2_max0.04956751636096409
agent_compute-ego2_mean0.04861684804185858
agent_compute-ego2_median0.048616848041858576
agent_compute-ego2_min0.04766617972275306
complete-iteration_max1.18416999067579
complete-iteration_mean1.169299684428229
complete-iteration_median1.169299684428229
complete-iteration_min1.1544293781806685
deviation-center-line_max0.25746356861009595
deviation-center-line_mean0.17347596606650204
deviation-center-line_min0.12210863326281612
deviation-heading_max0.7352695890794486
deviation-heading_mean0.3664428635728385
deviation-heading_median0.33288914698563576
deviation-heading_min0.02056006962655355
driven_any_max0.42336326752252135
driven_any_mean0.4142254424285247
driven_any_median0.4142254424285242
driven_any_min0.405087617334528
driven_lanedir_consec_max0.4233119645953738
driven_lanedir_consec_mean0.40864915397776774
driven_lanedir_consec_min0.3910784225602359
driven_lanedir_max0.4233119645953738
driven_lanedir_mean0.40864915397776774
driven_lanedir_median0.4074140419109087
driven_lanedir_min0.3910784225602359
get_state_dump_max0.04881694810143832
get_state_dump_mean0.04881599706969237
get_state_dump_median0.04881599706969238
get_state_dump_min0.04881504603794643
get_ui_image_max0.10289874247142249
get_ui_image_mean0.1005494002931811
get_ui_image_median0.1005494002931811
get_ui_image_min0.09820005811493972
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.4233632675225156, "get_ui_image": 0.09820005811493972, "step_physics": 0.6164917411475346, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4206435981721941, "get_state_dump": 0.04881694810143832, "sim_render-ego0": 0.00753506298722892, "sim_render-ego1": 0.007851945942845839, "sim_render-ego2": 0.007234820004167228, "in-drivable-lane": 0.0, "deviation-heading": 0.3267517743150319, "agent_compute-ego0": 0.04965817106181178, "agent_compute-ego1": 0.049714281641203784, "agent_compute-ego2": 0.04766617972275306, "complete-iteration": 1.1544293781806685, "set_robot_commands": 0.007409325961408944, "deviation-center-line": 0.14452259290833966, "driven_lanedir_consec": 0.4206435981721941, "sim_compute_sim_state": 0.0775852737755611, "sim_compute_performance-ego0": 0.006247614992075953, "sim_compute_performance-ego1": 0.006331698647860823, "sim_compute_performance-ego2": 0.006436315076104526, "sim_compute_robot_state-ego0": 0.01198668726559343, "sim_compute_robot_state-ego1": 0.011258618584994612, "sim_compute_robot_state-ego2": 0.01134567014102278, "sim_compute_robot_state-parked0": 0.011287158933179131, "sim_compute_robot_state-parked1": 0.011074616991240405, "sim_compute_robot_state-parked2": 0.011508135960019868, "sim_compute_robot_state-parked3": 0.011096633713820884, "sim_compute_robot_state-parked4": 0.01135427787386138, "sim_compute_robot_state-parked5": 0.011192223121379984}, "udem1-0-0-ego1": {"driven_any": 0.42336326752252135, "get_ui_image": 0.09820005811493972, "step_physics": 0.6164917411475346, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4233119645953738, "get_state_dump": 0.04881694810143832, "sim_render-ego0": 0.00753506298722892, "sim_render-ego1": 0.007851945942845839, "sim_render-ego2": 0.007234820004167228, "in-drivable-lane": 0.0, "deviation-heading": 0.04359171553787261, "agent_compute-ego0": 0.04965817106181178, "agent_compute-ego1": 0.049714281641203784, "agent_compute-ego2": 0.04766617972275306, "complete-iteration": 1.1544293781806685, "set_robot_commands": 0.007409325961408944, "deviation-center-line": 0.1320594494384969, "driven_lanedir_consec": 0.4233119645953738, "sim_compute_sim_state": 0.0775852737755611, "sim_compute_performance-ego0": 0.006247614992075953, "sim_compute_performance-ego1": 0.006331698647860823, "sim_compute_performance-ego2": 0.006436315076104526, "sim_compute_robot_state-ego0": 0.01198668726559343, "sim_compute_robot_state-ego1": 0.011258618584994612, "sim_compute_robot_state-ego2": 0.01134567014102278, "sim_compute_robot_state-parked0": 0.011287158933179131, "sim_compute_robot_state-parked1": 0.011074616991240405, "sim_compute_robot_state-parked2": 0.011508135960019868, "sim_compute_robot_state-parked3": 0.011096633713820884, "sim_compute_robot_state-parked4": 0.01135427787386138, "sim_compute_robot_state-parked5": 0.011192223121379984}, "udem1-0-0-ego2": {"driven_any": 0.42336326752252, "get_ui_image": 0.09820005811493972, "step_physics": 0.6164917411475346, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.04881694810143832, "sim_render-ego0": 0.00753506298722892, "sim_render-ego1": 0.007851945942845839, "sim_render-ego2": 0.007234820004167228, "in-drivable-lane": 0.0, "deviation-heading": 0.7352695890794486, "agent_compute-ego0": 0.04965817106181178, "agent_compute-ego1": 0.049714281641203784, "agent_compute-ego2": 0.04766617972275306, "complete-iteration": 1.1544293781806685, "set_robot_commands": 0.007409325961408944, "deviation-center-line": 0.25746356861009595, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.0775852737755611, "sim_compute_performance-ego0": 0.006247614992075953, "sim_compute_performance-ego1": 0.006331698647860823, "sim_compute_performance-ego2": 0.006436315076104526, "sim_compute_robot_state-ego0": 0.01198668726559343, "sim_compute_robot_state-ego1": 0.011258618584994612, "sim_compute_robot_state-ego2": 0.01134567014102278, "sim_compute_robot_state-parked0": 0.011287158933179131, "sim_compute_robot_state-parked1": 0.011074616991240405, "sim_compute_robot_state-parked2": 0.011508135960019868, "sim_compute_robot_state-parked3": 0.011096633713820884, "sim_compute_robot_state-parked4": 0.01135427787386138, "sim_compute_robot_state-parked5": 0.011192223121379984}, "udem1-0-1-ego0": {"driven_any": 0.4050876173345329, "get_ui_image": 0.10289874247142249, "step_physics": 0.6352527950491224, "survival_time": 2.799999999999998, "driven_lanedir": 0.40203285471698536, "get_state_dump": 0.04881504603794643, "sim_render-ego0": 0.00793115156037467, "sim_render-ego1": 0.008103051355906896, "sim_render-ego2": 0.007683008909225464, "in-drivable-lane": 0.0, "deviation-heading": 0.3390265196562397, "agent_compute-ego0": 0.04988162432398115, "agent_compute-ego1": 0.050850749015808105, "agent_compute-ego2": 0.04956751636096409, "complete-iteration": 1.18416999067579, "set_robot_commands": 0.0073028675147465295, "deviation-center-line": 0.1403585116281892, "driven_lanedir_consec": 0.40203285471698536, "sim_compute_sim_state": 0.07780729447092329, "sim_compute_performance-ego0": 0.006847500801086426, "sim_compute_performance-ego1": 0.006416972194399152, "sim_compute_performance-ego2": 0.006399567638124738, "sim_compute_robot_state-ego0": 0.011888010161263602, "sim_compute_robot_state-ego1": 0.011612858091081892, "sim_compute_robot_state-ego2": 0.011512815952301024, "sim_compute_robot_state-parked0": 0.011222911732537406, "sim_compute_robot_state-parked1": 0.011170612914221629, "sim_compute_robot_state-parked2": 0.01106172800064087, "sim_compute_robot_state-parked3": 0.011076114007404872, "sim_compute_robot_state-parked4": 0.01161271333694458, "sim_compute_robot_state-parked5": 0.011809519359043666}, "udem1-0-1-ego1": {"driven_any": 0.405087617334528, "get_ui_image": 0.10289874247142249, "step_physics": 0.6352527950491224, "survival_time": 2.799999999999998, "driven_lanedir": 0.4050771045009989, "get_state_dump": 0.04881504603794643, "sim_render-ego0": 0.00793115156037467, "sim_render-ego1": 0.008103051355906896, "sim_render-ego2": 0.007683008909225464, "in-drivable-lane": 0.0, "deviation-heading": 0.02056006962655355, "agent_compute-ego0": 0.04988162432398115, "agent_compute-ego1": 0.050850749015808105, "agent_compute-ego2": 0.04956751636096409, "complete-iteration": 1.18416999067579, "set_robot_commands": 0.0073028675147465295, "deviation-center-line": 0.12210863326281612, "driven_lanedir_consec": 0.4050771045009989, "sim_compute_sim_state": 0.07780729447092329, "sim_compute_performance-ego0": 0.006847500801086426, "sim_compute_performance-ego1": 0.006416972194399152, "sim_compute_performance-ego2": 0.006399567638124738, "sim_compute_robot_state-ego0": 0.011888010161263602, "sim_compute_robot_state-ego1": 0.011612858091081892, "sim_compute_robot_state-ego2": 0.011512815952301024, "sim_compute_robot_state-parked0": 0.011222911732537406, "sim_compute_robot_state-parked1": 0.011170612914221629, "sim_compute_robot_state-parked2": 0.01106172800064087, "sim_compute_robot_state-parked3": 0.011076114007404872, "sim_compute_robot_state-parked4": 0.01161271333694458, "sim_compute_robot_state-parked5": 0.011809519359043666}, "udem1-0-1-ego2": {"driven_any": 0.4050876173345304, "get_ui_image": 0.10289874247142249, "step_physics": 0.6352527950491224, "survival_time": 2.799999999999998, "driven_lanedir": 0.3910784225602359, "get_state_dump": 0.04881504603794643, "sim_render-ego0": 0.00793115156037467, "sim_render-ego1": 0.008103051355906896, "sim_render-ego2": 0.007683008909225464, "in-drivable-lane": 0.0, "deviation-heading": 0.7334575132218842, "agent_compute-ego0": 0.04988162432398115, "agent_compute-ego1": 0.050850749015808105, "agent_compute-ego2": 0.04956751636096409, "complete-iteration": 1.18416999067579, "set_robot_commands": 0.0073028675147465295, "deviation-center-line": 0.2443430405510744, "driven_lanedir_consec": 0.3910784225602359, "sim_compute_sim_state": 0.07780729447092329, "sim_compute_performance-ego0": 0.006847500801086426, "sim_compute_performance-ego1": 0.006416972194399152, "sim_compute_performance-ego2": 0.006399567638124738, "sim_compute_robot_state-ego0": 0.011888010161263602, "sim_compute_robot_state-ego1": 0.011612858091081892, "sim_compute_robot_state-ego2": 0.011512815952301024, "sim_compute_robot_state-parked0": 0.011222911732537406, "sim_compute_robot_state-parked1": 0.011170612914221629, "sim_compute_robot_state-parked2": 0.01106172800064087, "sim_compute_robot_state-parked3": 0.011076114007404872, "sim_compute_robot_state-parked4": 0.01161271333694458, "sim_compute_robot_state-parked5": 0.011809519359043666}}
set_robot_commands_max0.007409325961408944
set_robot_commands_mean0.007356096738077736
set_robot_commands_median0.007356096738077737
set_robot_commands_min0.0073028675147465295
sim_compute_performance-ego0_max0.006847500801086426
sim_compute_performance-ego0_mean0.006547557896581189
sim_compute_performance-ego0_median0.006547557896581189
sim_compute_performance-ego0_min0.006247614992075953
sim_compute_performance-ego1_max0.006416972194399152
sim_compute_performance-ego1_mean0.006374335421129987
sim_compute_performance-ego1_median0.006374335421129988
sim_compute_performance-ego1_min0.006331698647860823
sim_compute_performance-ego2_max0.006436315076104526
sim_compute_performance-ego2_mean0.006417941357114632
sim_compute_performance-ego2_median0.006417941357114632
sim_compute_performance-ego2_min0.006399567638124738
sim_compute_robot_state-ego0_max0.01198668726559343
sim_compute_robot_state-ego0_mean0.011937348713428516
sim_compute_robot_state-ego0_median0.011937348713428516
sim_compute_robot_state-ego0_min0.011888010161263602
sim_compute_robot_state-ego1_max0.011612858091081892
sim_compute_robot_state-ego1_mean0.011435738338038253
sim_compute_robot_state-ego1_median0.011435738338038253
sim_compute_robot_state-ego1_min0.011258618584994612
sim_compute_robot_state-ego2_max0.011512815952301024
sim_compute_robot_state-ego2_mean0.011429243046661902
sim_compute_robot_state-ego2_median0.011429243046661902
sim_compute_robot_state-ego2_min0.01134567014102278
sim_compute_robot_state-parked0_max0.011287158933179131
sim_compute_robot_state-parked0_mean0.01125503533285827
sim_compute_robot_state-parked0_median0.011255035332858269
sim_compute_robot_state-parked0_min0.011222911732537406
sim_compute_robot_state-parked1_max0.011170612914221629
sim_compute_robot_state-parked1_mean0.011122614952731017
sim_compute_robot_state-parked1_median0.011122614952731017
sim_compute_robot_state-parked1_min0.011074616991240405
sim_compute_robot_state-parked2_max0.011508135960019868
sim_compute_robot_state-parked2_mean0.011284931980330369
sim_compute_robot_state-parked2_median0.011284931980330369
sim_compute_robot_state-parked2_min0.01106172800064087
sim_compute_robot_state-parked3_max0.011096633713820884
sim_compute_robot_state-parked3_mean0.011086373860612878
sim_compute_robot_state-parked3_median0.011086373860612878
sim_compute_robot_state-parked3_min0.011076114007404872
sim_compute_robot_state-parked4_max0.01161271333694458
sim_compute_robot_state-parked4_mean0.01148349560540298
sim_compute_robot_state-parked4_median0.01148349560540298
sim_compute_robot_state-parked4_min0.01135427787386138
sim_compute_robot_state-parked5_max0.011809519359043666
sim_compute_robot_state-parked5_mean0.011500871240211824
sim_compute_robot_state-parked5_median0.011500871240211824
sim_compute_robot_state-parked5_min0.011192223121379984
sim_compute_sim_state_max0.07780729447092329
sim_compute_sim_state_mean0.07769628412324218
sim_compute_sim_state_median0.0776962841232422
sim_compute_sim_state_min0.0775852737755611
sim_render-ego0_max0.00793115156037467
sim_render-ego0_mean0.007733107273801794
sim_render-ego0_median0.007733107273801795
sim_render-ego0_min0.00753506298722892
sim_render-ego1_max0.008103051355906896
sim_render-ego1_mean0.007977498649376366
sim_render-ego1_median0.007977498649376368
sim_render-ego1_min0.007851945942845839
sim_render-ego2_max0.007683008909225464
sim_render-ego2_mean0.007458914456696345
sim_render-ego2_median0.007458914456696346
sim_render-ego2_min0.007234820004167228
simulation-passed1
step_physics_max0.6352527950491224
step_physics_mean0.6258722680983285
step_physics_median0.6258722680983284
step_physics_min0.6164917411475346
survival_time_max2.8999999999999977
survival_time_mean2.8499999999999974
survival_time_min2.799999999999998
No reset possible
332176704Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessnop-10:16:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5893872065550856
survival_time_median3.999999999999994
deviation-center-line_median0.3405671835636827
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.04360066218809648
agent_compute-ego_mean0.037694768088610144
agent_compute-ego_median0.03692030446571216
agent_compute-ego_min0.03625807762145996
complete-iteration_max0.4786504596471786
complete-iteration_mean0.4444846255982347
complete-iteration_median0.4479729955758506
complete-iteration_min0.4147196230681046
deviation-center-line_max1.204564896286383
deviation-center-line_mean0.46342895834512055
deviation-center-line_min0.2306504788229662
deviation-heading_max1.0666503211617828
deviation-heading_mean0.6841002310548957
deviation-heading_median0.6026148433870786
deviation-heading_min0.5362992461648963
driven_any_max2.4156341932144825
driven_any_mean0.9525504452763264
driven_any_median0.604992967293315
driven_any_min0.2806891286227591
driven_lanedir_consec_max2.40677402316276
driven_lanedir_consec_mean0.9432381449358144
driven_lanedir_consec_min0.27031654540087136
driven_lanedir_max2.40677402316276
driven_lanedir_mean0.9432381449358144
driven_lanedir_median0.5893872065550856
driven_lanedir_min0.27031654540087136
get_state_dump_max0.03892297861052722
get_state_dump_mean0.03825716740228362
get_state_dump_median0.03822834261949511
get_state_dump_min0.03787488407558865
get_ui_image_max0.07469541629155477
get_ui_image_mean0.07290977571520965
get_ui_image_median0.07268500608310365
get_ui_image_min0.07152796685695648
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.8934118820748456, "get_ui_image": 0.07310846992160963, "step_physics": 0.15651340484619142, "survival_time": 5.749999999999988, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.038204531047655185, "sim_render-ego": 0.007316663990850034, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03645847983982252, "deviation-heading": 0.656882474004175, "complete-iteration": 0.4147196230681046, "set_robot_commands": 0.006291739836983059, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.02828414958456288, "sim_compute_performance-ego": 0.005887941692186438, "sim_compute_robot_state-ego": 0.009853199253911557, "sim_compute_robot_state-npc0": 0.01061482222183891, "sim_compute_robot_state-npc1": 0.010366951900979748, "sim_compute_robot_state-npc2": 0.0102567195892334, "sim_compute_robot_state-npc3": 0.010618852532428244, "sim_compute_robot_state-parked0": 0.01058958095052968}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.1243354067077638, "get_ui_image": 0.07349569647462217, "step_physics": 0.15225164873616678, "survival_time": 7.149999999999983, "driven_lanedir": 1.1195998711110968, "get_state_dump": 0.03801163259919707, "sim_render-ego": 0.007989259866567759, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03658185972200407, "deviation-heading": 0.6505142251604797, "complete-iteration": 0.4283568625683551, "set_robot_commands": 0.008103954208480727, "deviation-center-line": 0.7211564287113507, "driven_lanedir_consec": 1.1195998711110968, "sim_compute_sim_state": 0.030001713679387015, "sim_compute_performance-ego": 0.006785364417763023, "sim_compute_robot_state-ego": 0.012601162170196746, "sim_compute_robot_state-npc0": 0.01221018237667484, "sim_compute_robot_state-npc1": 0.012286257910561729, "sim_compute_robot_state-npc2": 0.012722175438087305, "sim_compute_robot_state-npc3": 0.012548406640966457, "sim_compute_robot_state-parked0": 0.012428178653850422}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.4128012814861064, "get_ui_image": 0.07469541629155477, "step_physics": 0.17610081593195598, "survival_time": 14.950000000000076, "driven_lanedir": 2.40677402316276, "get_state_dump": 0.03825215419133504, "sim_render-ego": 0.008304696083068847, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03702889521916707, "deviation-heading": 0.5547154616136774, "complete-iteration": 0.4556661009788513, "set_robot_commands": 0.0081946063041687, "deviation-center-line": 0.4847719485949659, "driven_lanedir_consec": 2.40677402316276, "sim_compute_sim_state": 0.030339235464731853, "sim_compute_performance-ego": 0.007016513347625732, "sim_compute_robot_state-ego": 0.012900998592376709, "sim_compute_robot_state-npc0": 0.012514597574869791, "sim_compute_robot_state-npc1": 0.01225188414255778, "sim_compute_robot_state-npc2": 0.012625532150268556, "sim_compute_robot_state-npc3": 0.012597088019053142, "sim_compute_robot_state-parked0": 0.01249086062113444}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.4156341932144825, "get_ui_image": 0.07280634721120198, "step_physics": 0.178246062596639, "survival_time": 14.950000000000076, "driven_lanedir": 2.404472913649839, "get_state_dump": 0.03828162988026937, "sim_render-ego": 0.008145328362782795, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03682042757670085, "deviation-heading": 1.0666503211617828, "complete-iteration": 0.4550183693567912, "set_robot_commands": 0.008044768969217936, "deviation-center-line": 1.204564896286383, "driven_lanedir_consec": 2.404472913649839, "sim_compute_sim_state": 0.030419610341389975, "sim_compute_performance-ego": 0.0068510659535725915, "sim_compute_robot_state-ego": 0.012862807114919026, "sim_compute_robot_state-npc0": 0.012269872029622396, "sim_compute_robot_state-npc1": 0.012192275524139404, "sim_compute_robot_state-npc2": 0.012593303521474202, "sim_compute_robot_state-npc3": 0.01253236452738444, "sim_compute_robot_state-parked0": 0.012608191172281902}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.41831076963724223, "get_ui_image": 0.07256366495500531, "step_physics": 0.16078972816467285, "survival_time": 2.849999999999998, "driven_lanedir": 0.4108296893928962, "get_state_dump": 0.037998446247033905, "sim_render-ego": 0.007765242927952816, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03702018135472348, "deviation-heading": 0.5362992461648963, "complete-iteration": 0.4310693573533443, "set_robot_commands": 0.007538753643370511, "deviation-center-line": 0.3203305456326069, "driven_lanedir_consec": 0.4108296893928962, "sim_compute_sim_state": 0.02819380007292095, "sim_compute_performance-ego": 0.006903205001563357, "sim_compute_robot_state-ego": 0.012617044281541256, "sim_compute_robot_state-npc0": 0.011646722492418791, "sim_compute_robot_state-npc1": 0.011872233005992154, "sim_compute_robot_state-npc2": 0.01204832813196015, "sim_compute_robot_state-npc3": 0.012003007688020406, "sim_compute_robot_state-parked0": 0.011762552094041256}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.4639699794262689, "get_ui_image": 0.07242753013731941, "step_physics": 0.1607935731373136, "survival_time": 3.149999999999997, "driven_lanedir": 0.45722302793598546, "get_state_dump": 0.03787488407558865, "sim_render-ego": 0.007404698265923394, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0363342042953249, "deviation-heading": 0.5406113448810147, "complete-iteration": 0.4192834997934009, "set_robot_commands": 0.0064161694239056296, "deviation-center-line": 0.36080382149475854, "driven_lanedir_consec": 0.45722302793598546, "sim_compute_sim_state": 0.029351060352628192, "sim_compute_performance-ego": 0.006197433623056563, "sim_compute_robot_state-ego": 0.010349731596689376, "sim_compute_robot_state-npc0": 0.010794514701479956, "sim_compute_robot_state-npc1": 0.01033036670987568, "sim_compute_robot_state-npc2": 0.010280836196172803, "sim_compute_robot_state-npc3": 0.010124732577611527, "sim_compute_robot_state-parked0": 0.010265497934250604}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.6050241766780463, "get_ui_image": 0.07152796685695648, "step_physics": 0.20389526784420017, "survival_time": 3.999999999999994, "driven_lanedir": 0.589507844236246, "get_state_dump": 0.03793834447860718, "sim_render-ego": 0.007554414868354797, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03625807762145996, "deviation-heading": 0.8642733412663441, "complete-iteration": 0.4636539578437805, "set_robot_commands": 0.006369760632514954, "deviation-center-line": 0.2576256594799858, "driven_lanedir_consec": 0.589507844236246, "sim_compute_sim_state": 0.03159729242324829, "sim_compute_performance-ego": 0.005909639596939087, "sim_compute_robot_state-ego": 0.010297465324401857, "sim_compute_robot_state-npc0": 0.010613036155700684, "sim_compute_robot_state-npc1": 0.010361304879188538, "sim_compute_robot_state-npc2": 0.010126617550849915, "sim_compute_robot_state-npc3": 0.01015913188457489, "sim_compute_robot_state-parked0": 0.01071278154850006}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.6049617579085835, "get_ui_image": 0.07247154414653778, "step_physics": 0.20637224316596983, "survival_time": 3.999999999999994, "driven_lanedir": 0.5892665688739251, "get_state_dump": 0.03832597732543945, "sim_render-ego": 0.007892611622810363, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03710390031337738, "deviation-heading": 0.8657135393860103, "complete-iteration": 0.4786504596471786, "set_robot_commands": 0.007360482215881347, "deviation-center-line": 0.2579568712120166, "driven_lanedir_consec": 0.5892665688739251, "sim_compute_sim_state": 0.03246351480484009, "sim_compute_performance-ego": 0.006411433219909668, "sim_compute_robot_state-ego": 0.011822879314422607, "sim_compute_robot_state-npc0": 0.011629292368888856, "sim_compute_robot_state-npc1": 0.011818614602088927, "sim_compute_robot_state-npc2": 0.011435019969940185, "sim_compute_robot_state-npc3": 0.011636096239089963, "sim_compute_robot_state-parked0": 0.01156914234161377}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.2806891286227591, "get_ui_image": 0.0736163302165706, "step_physics": 0.1790793988762832, "survival_time": 2.0500000000000007, "driven_lanedir": 0.27031654540087136, "get_state_dump": 0.03892297861052722, "sim_render-ego": 0.007741148878888386, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03974099275542469, "deviation-heading": 0.5535604282281631, "complete-iteration": 0.4409276217949099, "set_robot_commands": 0.0061924399399175874, "deviation-center-line": 0.2306504788229662, "driven_lanedir_consec": 0.27031654540087136, "sim_compute_sim_state": 0.02818841468997118, "sim_compute_performance-ego": 0.005883507612274914, "sim_compute_robot_state-ego": 0.009928104354114068, "sim_compute_robot_state-npc0": 0.010563303784626284, "sim_compute_robot_state-npc1": 0.010242776172917065, "sim_compute_robot_state-npc2": 0.01016254541350574, "sim_compute_robot_state-npc3": 0.009913549190614282, "sim_compute_robot_state-parked0": 0.010419700203872308}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.30636587700716567, "get_ui_image": 0.07238479094071822, "step_physics": 0.1823402751575817, "survival_time": 2.2, "driven_lanedir": 0.29687463006242387, "get_state_dump": 0.03876109556718306, "sim_render-ego": 0.008261138742620295, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04360066218809648, "deviation-heading": 0.5517819286824133, "complete-iteration": 0.4575004035776312, "set_robot_commands": 0.00727512619712136, "deviation-center-line": 0.2522058286254507, "driven_lanedir_consec": 0.29687463006242387, "sim_compute_sim_state": 0.028346782380884342, "sim_compute_performance-ego": 0.006574256853623824, "sim_compute_robot_state-ego": 0.01176874204115434, "sim_compute_robot_state-npc0": 0.011622163382443514, "sim_compute_robot_state-npc1": 0.01113692738793113, "sim_compute_robot_state-npc2": 0.011359556154771284, "sim_compute_robot_state-npc3": 0.011852231892672453, "sim_compute_robot_state-parked0": 0.011874925006519665}}
set_robot_commands_max0.0081946063041687
set_robot_commands_mean0.007178780137156181
set_robot_commands_median0.007317804206501353
set_robot_commands_min0.0061924399399175874
sim_compute_performance-ego_max0.007016513347625732
sim_compute_performance-ego_mean0.006442036131851519
sim_compute_performance-ego_median0.0064928450367667465
sim_compute_performance-ego_min0.005883507612274914
sim_compute_robot_state-ego_max0.012900998592376709
sim_compute_robot_state-ego_mean0.011500213404372754
sim_compute_robot_state-ego_median0.011795810677788477
sim_compute_robot_state-ego_min0.009853199253911557
sim_compute_robot_state-npc0_max0.012514597574869791
sim_compute_robot_state-npc0_mean0.011447850708856405
sim_compute_robot_state-npc0_median0.011625727875666184
sim_compute_robot_state-npc0_min0.010563303784626284
sim_compute_robot_state-npc1_max0.012286257910561729
sim_compute_robot_state-npc1_mean0.011285959223623215
sim_compute_robot_state-npc1_median0.01147777099501003
sim_compute_robot_state-npc1_min0.010242776172917065
sim_compute_robot_state-npc2_max0.012722175438087305
sim_compute_robot_state-npc2_mean0.011361063411626354
sim_compute_robot_state-npc2_median0.011397288062355734
sim_compute_robot_state-npc2_min0.010126617550849915
sim_compute_robot_state-npc3_max0.012597088019053142
sim_compute_robot_state-npc3_mean0.01139854611924158
sim_compute_robot_state-npc3_median0.011744164065881208
sim_compute_robot_state-npc3_min0.009913549190614282
sim_compute_robot_state-parked0_max0.012608191172281902
sim_compute_robot_state-parked0_mean0.011472141052659411
sim_compute_robot_state-parked0_median0.011665847217827511
sim_compute_robot_state-parked0_min0.010265497934250604
sim_compute_sim_state_max0.03246351480484009
sim_compute_sim_state_mean0.02971855737945648
sim_compute_sim_state_median0.029676387016007603
sim_compute_sim_state_min0.02818841468997118
sim_render-ego_max0.008304696083068847
sim_render-ego_mean0.007837520360981948
sim_render-ego_median0.00782892727538159
sim_render-ego_min0.007316663990850034
simulation-passed1
step_physics_max0.20637224316596983
step_physics_mean0.17563824184569743
step_physics_median0.1771734392642975
step_physics_min0.15225164873616678
survival_time_max14.950000000000076
survival_time_mean6.105000000000011
survival_time_min2.0500000000000007
No reset possible
332046702Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessnop-10:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6388165354293047
survival_time_median4.424999999999992
deviation-center-line_median0.3153989973391188
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02676063378651937
agent_compute-ego_mean0.02470268233312485
agent_compute-ego_median0.024362564452213215
agent_compute-ego_min0.02251259485880534
complete-iteration_max0.2805786048664766
complete-iteration_mean0.2700939867675996
complete-iteration_median0.2744726861491267
complete-iteration_min0.25177026617115944
deviation-center-line_max0.7211564287113507
deviation-center-line_mean0.3743550903795346
deviation-center-line_min0.15178280698704444
deviation-heading_max1.6736272862255483
deviation-heading_mean0.8004840261313284
deviation-heading_median0.7130741874442019
deviation-heading_min0.58521495143993
driven_any_max2.0515906246939823
driven_any_mean0.9029981451636352
driven_any_median0.6715116911915197
driven_any_min0.40700915015393097
driven_lanedir_consec_max1.9971503152693917
driven_lanedir_consec_mean0.8835098784359403
driven_lanedir_consec_min0.3930396696545979
driven_lanedir_max1.9971503152693917
driven_lanedir_mean0.8835098784359403
driven_lanedir_median0.6388165354293047
driven_lanedir_min0.3930396696545979
get_state_dump_max0.020191710570762897
get_state_dump_mean0.01873504033083284
get_state_dump_median0.018344174610095076
get_state_dump_min0.017327628352425316
get_ui_image_max0.049262862456472295
get_ui_image_mean0.04790568388110353
get_ui_image_median0.04806425070369637
get_ui_image_min0.04587161143620809
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.8934118820748456, "get_ui_image": 0.04861671820930813, "step_physics": 0.11601921993753184, "survival_time": 5.749999999999988, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.01800748990929645, "sim_render-ego": 0.007303557188614555, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023584651947021484, "deviation-heading": 0.656882474004175, "complete-iteration": 0.2767272866290549, "set_robot_commands": 0.007003313562144404, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.027308155142742655, "sim_compute_performance-ego": 0.0062671080879543135, "sim_compute_robot_state-ego": 0.011484647833782693, "sim_compute_robot_state-parked0": 0.010915235851121986}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.1243354067077638, "get_ui_image": 0.04797255075894869, "step_physics": 0.11499949768706635, "survival_time": 7.149999999999983, "driven_lanedir": 1.1195998711110968, "get_state_dump": 0.01803663060381696, "sim_render-ego": 0.007528288381083028, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024113720113580876, "deviation-heading": 0.6505142251604797, "complete-iteration": 0.27868968956953993, "set_robot_commands": 0.00735538989513904, "deviation-center-line": 0.7211564287113507, "driven_lanedir_consec": 1.1195998711110968, "sim_compute_sim_state": 0.02924667871915377, "sim_compute_performance-ego": 0.006453750850437405, "sim_compute_robot_state-ego": 0.01162629027466674, "sim_compute_robot_state-parked0": 0.011141501940213716}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.40700915015393097, "get_ui_image": 0.04815595064844404, "step_physics": 0.11403922523771014, "survival_time": 2.799999999999998, "driven_lanedir": 0.3930396696545979, "get_state_dump": 0.017857304641178677, "sim_render-ego": 0.007244599717003959, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023981388126100813, "deviation-heading": 0.7284876503363212, "complete-iteration": 0.2751399150916508, "set_robot_commands": 0.006908544472285679, "deviation-center-line": 0.23712613734717297, "driven_lanedir_consec": 0.3930396696545979, "sim_compute_sim_state": 0.027808998312268934, "sim_compute_performance-ego": 0.006224981376102993, "sim_compute_robot_state-ego": 0.011431975024087089, "sim_compute_robot_state-parked0": 0.011275453226906911}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.4198153024925418, "get_ui_image": 0.049262862456472295, "step_physics": 0.10752685864766438, "survival_time": 2.849999999999998, "driven_lanedir": 0.40650856227629273, "get_state_dump": 0.018247127532958984, "sim_render-ego": 0.0068743898157487835, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02251259485880534, "deviation-heading": 0.7179759677504282, "complete-iteration": 0.2667165806418971, "set_robot_commands": 0.006817784225731565, "deviation-center-line": 0.2477697800930977, "driven_lanedir_consec": 0.40650856227629273, "sim_compute_sim_state": 0.027892300957127625, "sim_compute_performance-ego": 0.006004730860392253, "sim_compute_robot_state-ego": 0.010708248406125788, "sim_compute_robot_state-parked0": 0.010659807606747276}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.6664569066662387, "get_ui_image": 0.04878044941208579, "step_physics": 0.11229643496600064, "survival_time": 4.399999999999992, "driven_lanedir": 0.6333603789539877, "get_state_dump": 0.017327628352425316, "sim_render-ego": 0.007033616304397583, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02299895069815896, "deviation-heading": 0.8506768384301183, "complete-iteration": 0.27406039292162115, "set_robot_commands": 0.0067092180252075195, "deviation-center-line": 0.15178280698704444, "driven_lanedir_consec": 0.6333603789539877, "sim_compute_sim_state": 0.03159778768366033, "sim_compute_performance-ego": 0.0060562924905256795, "sim_compute_robot_state-ego": 0.01091212576085871, "sim_compute_robot_state-parked0": 0.010138013146140358}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.6765664757168006, "get_ui_image": 0.0491258723012517, "step_physics": 0.10509366131900402, "survival_time": 4.449999999999992, "driven_lanedir": 0.6442726919046217, "get_state_dump": 0.018441221687231172, "sim_render-ego": 0.0076255048258920734, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02461140879084555, "deviation-heading": 0.8399321482251177, "complete-iteration": 0.2748849793766322, "set_robot_commands": 0.007201760002736295, "deviation-center-line": 0.15718782326038716, "driven_lanedir_consec": 0.6442726919046217, "sim_compute_sim_state": 0.03333469723047835, "sim_compute_performance-ego": 0.0065169200468599125, "sim_compute_robot_state-ego": 0.011387723215510336, "sim_compute_robot_state-parked0": 0.011321102635244305}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.0515906246939823, "get_ui_image": 0.04754509925842285, "step_physics": 0.11086408858205758, "survival_time": 12.750000000000046, "driven_lanedir": 1.9971503152693917, "get_state_dump": 0.01892706366146312, "sim_render-ego": 0.00788726432650697, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02569763800677131, "deviation-heading": 1.6736272862255483, "complete-iteration": 0.2805786048664766, "set_robot_commands": 0.007581716425278608, "deviation-center-line": 0.666931576993234, "driven_lanedir_consec": 1.9971503152693917, "sim_compute_sim_state": 0.031351245618334, "sim_compute_performance-ego": 0.006621159759222292, "sim_compute_robot_state-ego": 0.011981620975569185, "sim_compute_robot_state-parked0": 0.011890848010194069}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9308964588316329, "get_ui_image": 0.047269527117411295, "step_physics": 0.10280628303686776, "survival_time": 12.000000000000036, "driven_lanedir": 1.911167536931632, "get_state_dump": 0.02014351785182953, "sim_render-ego": 0.007467806339263916, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02662131190299988, "deviation-heading": 0.7081724071379757, "complete-iteration": 0.26917373538017275, "set_robot_commands": 0.006403495868047078, "deviation-center-line": 0.3865752511340999, "driven_lanedir_consec": 1.911167536931632, "sim_compute_sim_state": 0.030671945214271544, "sim_compute_performance-ego": 0.006305599212646484, "sim_compute_robot_state-ego": 0.01054036517937978, "sim_compute_robot_state-parked0": 0.010699349641799926}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.44035587203439863, "get_ui_image": 0.04587161143620809, "step_physics": 0.08693976402282715, "survival_time": 2.9999999999999973, "driven_lanedir": 0.43191271492616456, "get_state_dump": 0.020170708497365315, "sim_render-ego": 0.007845242818196615, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02676063378651937, "deviation-heading": 0.58521495143993, "complete-iteration": 0.25319841702779133, "set_robot_commands": 0.007425093650817871, "deviation-center-line": 0.32241767324619974, "driven_lanedir_consec": 0.43191271492616456, "sim_compute_sim_state": 0.02771491607030233, "sim_compute_performance-ego": 0.0067811250686645504, "sim_compute_robot_state-ego": 0.011846665541330974, "sim_compute_robot_state-parked0": 0.011600116888682049}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.4195433722642192, "get_ui_image": 0.04645619721248232, "step_physics": 0.08983448045007114, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4105707077995184, "get_state_dump": 0.020191710570762897, "sim_render-ego": 0.007238207192256533, "in-drivable-lane": 0.0, "agent_compute-ego": 0.026144525100444925, "deviation-heading": 0.5933563126031889, "complete-iteration": 0.25177026617115944, "set_robot_commands": 0.006415737086328967, "deviation-center-line": 0.3083803214320379, "driven_lanedir_consec": 0.4105707077995184, "sim_compute_sim_state": 0.02748585569447485, "sim_compute_performance-ego": 0.0061380698763090985, "sim_compute_robot_state-ego": 0.010810486201582283, "sim_compute_robot_state-parked0": 0.010812981375332535}}
set_robot_commands_max0.007581716425278608
set_robot_commands_mean0.006982205321371703
set_robot_commands_median0.0069559290172150415
set_robot_commands_min0.006403495868047078
sim_compute_performance-ego_max0.0067811250686645504
sim_compute_performance-ego_mean0.006336973762911498
sim_compute_performance-ego_median0.006286353650300398
sim_compute_performance-ego_min0.006004730860392253
sim_compute_robot_state-ego_max0.011981620975569185
sim_compute_robot_state-ego_mean0.011273014841289355
sim_compute_robot_state-ego_median0.011409849119798712
sim_compute_robot_state-ego_min0.01054036517937978
sim_compute_robot_state-parked0_max0.011890848010194069
sim_compute_robot_state-parked0_mean0.011045441032238316
sim_compute_robot_state-parked0_median0.011028368895667853
sim_compute_robot_state-parked0_min0.010138013146140358
sim_compute_sim_state_max0.03333469723047835
sim_compute_sim_state_mean0.02944125806428144
sim_compute_sim_state_median0.028569489838140696
sim_compute_sim_state_min0.027308155142742655
sim_render-ego_max0.00788726432650697
sim_render-ego_mean0.0074048476908964
sim_render-ego_median0.0073856817639392355
sim_render-ego_min0.0068743898157487835
simulation-passed1
step_physics_max0.11601921993753184
step_physics_mean0.10604195138868013
step_physics_median0.10919547361486098
step_physics_min0.08693976402282715
survival_time_max12.750000000000046
survival_time_mean5.805000000000003
survival_time_min2.799999999999998
No reset possible