Duckietown Challenges Home Challenges Submissions

Evaluator 1725

ID1725
evaluatorp-1
ownerI don't have one 😀
machinebf26da76fdf6
processp-1
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success6 32929
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
329866648Anthony Courchesne 🇨🇦challenge-aido_LF-template-randomaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4838163264350306
survival_time_median1.7000000000000008
deviation-center-line_median0.08751730474052305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03004129116351788
agent_compute-ego_mean0.02958767756262932
agent_compute-ego_median0.029352675784717907
agent_compute-ego_min0.029279540796748927
deviation-center-line_max0.10683019887032848
deviation-center-line_mean0.08719800587294524
deviation-center-line_min0.07065220523066396
deviation-heading_max0.5050851849885492
deviation-heading_mean0.37472646794797326
deviation-heading_median0.3711400756311837
deviation-heading_min0.242154099114489
driven_any_max1.224736399271231
driven_any_mean0.7001682289165533
driven_any_median0.6334906616120762
driven_any_min0.311949329092399
driven_lanedir_consec_max0.6642632200434848
driven_lanedir_consec_mean0.47031102562542887
driven_lanedir_consec_min0.28855079430839536
driven_lanedir_max0.6642632200434848
driven_lanedir_mean0.47031102562542887
driven_lanedir_median0.4838163264350306
driven_lanedir_min0.28855079430839536
in-drivable-lane_max1.5999999999999963
in-drivable-lane_mean0.4499999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.06291843377626859, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.01283118358025184, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.03004129116351788, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.008611646982339712, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.005384115072397085, "sim_compute_performance-ego": 0.007577258806962233, "sim_compute_robot_state-ego": 0.009223571190467248}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.311949329092399, "sim_physics": 0.06769340038299561, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3030566281970668, "sim_render-ego": 0.013266932964324952, "in-drivable-lane": 0, "agent_compute-ego": 0.02931489944458008, "deviation-heading": 0.242154099114489, "set_robot_commands": 0.008656585216522216, "deviation-center-line": 0.08751730474052305, "driven_lanedir_consec": 0.3030566281970668, "sim_compute_sim_state": 0.005714988708496094, "sim_compute_performance-ego": 0.007618904113769531, "sim_compute_robot_state-ego": 0.009033131599426269}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6334906616120762, "sim_physics": 0.06465058466967415, "survival_time": 1.7000000000000008, "driven_lanedir": 0.6118681591431665, "sim_render-ego": 0.013050443985882927, "in-drivable-lane": 0, "agent_compute-ego": 0.02994998062358183, "deviation-heading": 0.3711400756311837, "set_robot_commands": 0.008308445706087, "deviation-center-line": 0.10683019887032848, "driven_lanedir_consec": 0.6118681591431665, "sim_compute_sim_state": 0.005408525466918945, "sim_compute_performance-ego": 0.007342682165258071, "sim_compute_robot_state-ego": 0.009501211783465215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.224736399271231, "sim_physics": 0.06340157790262191, "survival_time": 3.049999999999997, "driven_lanedir": 0.4838163264350306, "sim_render-ego": 0.013137715761778784, "in-drivable-lane": 1.5999999999999963, "agent_compute-ego": 0.029279540796748927, "deviation-heading": 0.29149367303980006, "set_robot_commands": 0.008402656336299708, "deviation-center-line": 0.10020114979294129, "driven_lanedir_consec": 0.4838163264350306, "sim_compute_sim_state": 0.005493668259167281, "sim_compute_performance-ego": 0.007373602663884397, "sim_compute_robot_state-ego": 0.009228475758286774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.32277514619816383, "sim_physics": 0.06572209705005992, "survival_time": 1.1000000000000003, "driven_lanedir": 0.28855079430839536, "sim_render-ego": 0.013220223513516512, "in-drivable-lane": 0, "agent_compute-ego": 0.029352675784717907, "deviation-heading": 0.4637593069658444, "set_robot_commands": 0.00830553878437389, "deviation-center-line": 0.07078917073026944, "driven_lanedir_consec": 0.28855079430839536, "sim_compute_sim_state": 0.0057090412486683235, "sim_compute_performance-ego": 0.007335521958091043, "sim_compute_robot_state-ego": 0.009112022139809347}}
set_robot_commands_max0.008656585216522216
set_robot_commands_mean0.008456974605124503
set_robot_commands_median0.008402656336299708
set_robot_commands_min0.00830553878437389
sim_compute_performance-ego_max0.007618904113769531
sim_compute_performance-ego_mean0.007449593941593055
sim_compute_performance-ego_median0.007373602663884397
sim_compute_performance-ego_min0.007335521958091043
sim_compute_robot_state-ego_max0.009501211783465215
sim_compute_robot_state-ego_mean0.009219682494290973
sim_compute_robot_state-ego_median0.009223571190467248
sim_compute_robot_state-ego_min0.009033131599426269
sim_compute_sim_state_max0.005714988708496094
sim_compute_sim_state_mean0.005542067751129546
sim_compute_sim_state_median0.005493668259167281
sim_compute_sim_state_min0.005384115072397085
sim_physics_max0.06769340038299561
sim_physics_mean0.06487721875632405
sim_physics_median0.06465058466967415
sim_physics_min0.06291843377626859
sim_render-ego_max0.013266932964324952
sim_render-ego_mean0.013101299961151005
sim_render-ego_median0.013137715761778784
sim_render-ego_min0.01283118358025184
simulation-passed1
survival_time_max3.049999999999997
survival_time_mean1.8899999999999997
survival_time_min1.0000000000000002
No reset possible
329846647Frank (Chude) Qian 🇨🇦TF version fix 1645 TF Distributeaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:13:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.362685377050909
survival_time_median14.950000000000076
deviation-center-line_median0.8034299659806212
in-drivable-lane_median0.9000000000000128


other stats
agent_compute-ego_max0.08344465494155884
agent_compute-ego_mean0.0802818423906962
agent_compute-ego_median0.0794454010327657
agent_compute-ego_min0.07836427291234334
deviation-center-line_max0.9603606728769568
deviation-center-line_mean0.7990861457585187
deviation-center-line_min0.6530620184275024
deviation-heading_max3.623621060235672
deviation-heading_mean2.857230098672251
deviation-heading_median3.0169020482709628
deviation-heading_min2.1257926543669474
driven_any_max6.226348400720197
driven_any_mean5.280240430213635
driven_any_median5.095632143573122
driven_any_min4.8214515229947335
driven_lanedir_consec_max5.882901701284578
driven_lanedir_consec_mean4.724909398225399
driven_lanedir_consec_min3.719285271699436
driven_lanedir_max5.882901701284578
driven_lanedir_mean4.724909398225399
driven_lanedir_median4.362685377050909
driven_lanedir_min3.719285271699436
in-drivable-lane_max4.650000000000029
in-drivable-lane_mean1.5000000000000138
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.8214515229947335, "sim_physics": 0.06257371107737224, "survival_time": 14.950000000000076, "driven_lanedir": 4.362685377050909, "sim_render-ego": 0.01229592482248942, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.08093262831370036, "deviation-heading": 3.0169020482709628, "set_robot_commands": 0.008186850547790527, "deviation-center-line": 0.6530620184275024, "driven_lanedir_consec": 4.362685377050909, "sim_compute_sim_state": 0.005842316150665283, "sim_compute_performance-ego": 0.007403268019358317, "sim_compute_robot_state-ego": 0.009525651931762696}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.095632143573122, "sim_physics": 0.062017238934834795, "survival_time": 14.950000000000076, "driven_lanedir": 3.719285271699436, "sim_render-ego": 0.01230031172434489, "in-drivable-lane": 4.650000000000029, "agent_compute-ego": 0.07922225475311279, "deviation-heading": 3.093828871202242, "set_robot_commands": 0.008059782187143961, "deviation-center-line": 0.7270638780799004, "driven_lanedir_consec": 3.719285271699436, "sim_compute_sim_state": 0.005826632976531982, "sim_compute_performance-ego": 0.007114324569702148, "sim_compute_robot_state-ego": 0.009504546324412028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.226348400720197, "sim_physics": 0.061032188733418785, "survival_time": 14.950000000000076, "driven_lanedir": 5.882901701284578, "sim_render-ego": 0.01220048745473226, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.0794454010327657, "deviation-heading": 2.1257926543669474, "set_robot_commands": 0.008101348082224529, "deviation-center-line": 0.9603606728769568, "driven_lanedir_consec": 5.882901701284578, "sim_compute_sim_state": 0.00585533618927002, "sim_compute_performance-ego": 0.007066418329874674, "sim_compute_robot_state-ego": 0.009405059814453123}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.846610275474301, "sim_physics": 0.06203916072845459, "survival_time": 14.950000000000076, "driven_lanedir": 4.332760625855778, "sim_render-ego": 0.01213311513264974, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.07836427291234334, "deviation-heading": 3.623621060235672, "set_robot_commands": 0.008108445803324382, "deviation-center-line": 0.8515141934276127, "driven_lanedir_consec": 4.332760625855778, "sim_compute_sim_state": 0.0058411979675292965, "sim_compute_performance-ego": 0.007055607636769613, "sim_compute_robot_state-ego": 0.00966403643290202}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.41115980830582, "sim_physics": 0.0626822559038798, "survival_time": 14.950000000000076, "driven_lanedir": 5.326914015236295, "sim_render-ego": 0.01216525157292684, "in-drivable-lane": 0, "agent_compute-ego": 0.08344465494155884, "deviation-heading": 2.426005859285432, "set_robot_commands": 0.008018915653228759, "deviation-center-line": 0.8034299659806212, "driven_lanedir_consec": 5.326914015236295, "sim_compute_sim_state": 0.0062881557146708175, "sim_compute_performance-ego": 0.006997771263122558, "sim_compute_robot_state-ego": 0.009613357384999592}}
set_robot_commands_max0.008186850547790527
set_robot_commands_mean0.008095068454742432
set_robot_commands_median0.008101348082224529
set_robot_commands_min0.008018915653228759
sim_compute_performance-ego_max0.007403268019358317
sim_compute_performance-ego_mean0.007127477963765462
sim_compute_performance-ego_median0.007066418329874674
sim_compute_performance-ego_min0.006997771263122558
sim_compute_robot_state-ego_max0.00966403643290202
sim_compute_robot_state-ego_mean0.009542530377705891
sim_compute_robot_state-ego_median0.009525651931762696
sim_compute_robot_state-ego_min0.009405059814453123
sim_compute_sim_state_max0.0062881557146708175
sim_compute_sim_state_mean0.005930727799733479
sim_compute_sim_state_median0.005842316150665283
sim_compute_sim_state_min0.005826632976531982
sim_physics_max0.0626822559038798
sim_physics_mean0.06206891107559204
sim_physics_median0.06203916072845459
sim_physics_min0.061032188733418785
sim_render-ego_max0.01230031172434489
sim_render-ego_mean0.012219018141428627
sim_render-ego_median0.01220048745473226
sim_render-ego_min0.01213311513264974
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
329496626Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2063674131565216
survival_time_median14.950000000000076
deviation-center-line_median0.7200402498978065
in-drivable-lane_median0


other stats
agent_compute-ego_max0.031632034146055886
agent_compute-ego_mean0.030397103739433544
agent_compute-ego_median0.030130475759506226
agent_compute-ego_min0.029726893107096353
deviation-center-line_max0.9525640864440648
deviation-center-line_mean0.5875744358926684
deviation-center-line_min0.1380429743855582
deviation-heading_max3.9794252287681218
deviation-heading_mean1.9769720753003155
deviation-heading_median1.2019678511367002
deviation-heading_min1.0807071324614124
driven_any_max2.3491572733929074
driven_any_mean1.801119337071172
driven_any_median2.34906999252695
driven_any_min0.7261871569313669
driven_lanedir_consec_max2.335547735354421
driven_lanedir_consec_mean1.7393900511005511
driven_lanedir_consec_min0.6582588609889365
driven_lanedir_max2.335547735354421
driven_lanedir_mean1.7393900511005511
driven_lanedir_median2.2063674131565216
driven_lanedir_min0.6582588609889365
in-drivable-lane_max0.14999999999999947
in-drivable-lane_mean0.029999999999999895
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7261871569313669, "sim_physics": 0.06300774885683644, "survival_time": 4.899999999999991, "driven_lanedir": 0.6582588609889365, "sim_render-ego": 0.012351456953554735, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.031632034146055886, "deviation-heading": 1.0807071324614124, "set_robot_commands": 0.008320608917547732, "deviation-center-line": 0.1380429743855582, "driven_lanedir_consec": 0.6582588609889365, "sim_compute_sim_state": 0.005519820719349141, "sim_compute_performance-ego": 0.007521517422734474, "sim_compute_robot_state-ego": 0.00934037140437535}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.349078758969293, "sim_physics": 0.06191121975580851, "survival_time": 14.950000000000076, "driven_lanedir": 2.290846471385404, "sim_render-ego": 0.012057279745737712, "in-drivable-lane": 0, "agent_compute-ego": 0.030053040981292724, "deviation-heading": 2.442275361467299, "set_robot_commands": 0.008345126310984293, "deviation-center-line": 0.7200402498978065, "driven_lanedir_consec": 2.290846471385404, "sim_compute_sim_state": 0.005549708207448324, "sim_compute_performance-ego": 0.007052388985951742, "sim_compute_robot_state-ego": 0.009354326725006103}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34906999252695, "sim_physics": 0.062453543345133464, "survival_time": 14.950000000000076, "driven_lanedir": 2.2063674131565216, "sim_render-ego": 0.0119899582862854, "in-drivable-lane": 0, "agent_compute-ego": 0.029726893107096353, "deviation-heading": 3.9794252287681218, "set_robot_commands": 0.008423243363698324, "deviation-center-line": 0.9525640864440648, "driven_lanedir_consec": 2.2063674131565216, "sim_compute_sim_state": 0.005528101126352946, "sim_compute_performance-ego": 0.007112970352172851, "sim_compute_robot_state-ego": 0.00923231840133667}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2321035035353425, "sim_physics": 0.06160251796245575, "survival_time": 7.99999999999998, "driven_lanedir": 1.2059297746174724, "sim_render-ego": 0.012076963484287264, "in-drivable-lane": 0, "agent_compute-ego": 0.030130475759506226, "deviation-heading": 1.2019678511367002, "set_robot_commands": 0.00838398039340973, "deviation-center-line": 0.3930677372481761, "driven_lanedir_consec": 1.2059297746174724, "sim_compute_sim_state": 0.005455733835697174, "sim_compute_performance-ego": 0.007003979384899139, "sim_compute_robot_state-ego": 0.00939827859401703}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491572733929074, "sim_physics": 0.06228650410970052, "survival_time": 14.950000000000076, "driven_lanedir": 2.335547735354421, "sim_render-ego": 0.01215248425801595, "in-drivable-lane": 0, "agent_compute-ego": 0.03044307470321655, "deviation-heading": 1.1804848026680443, "set_robot_commands": 0.008369777202606201, "deviation-center-line": 0.7341571314877363, "driven_lanedir_consec": 2.335547735354421, "sim_compute_sim_state": 0.005552587509155274, "sim_compute_performance-ego": 0.007133468786875407, "sim_compute_robot_state-ego": 0.009363749821980794}}
set_robot_commands_max0.008423243363698324
set_robot_commands_mean0.008368547237649257
set_robot_commands_median0.008369777202606201
set_robot_commands_min0.008320608917547732
sim_compute_performance-ego_max0.007521517422734474
sim_compute_performance-ego_mean0.007164864986526723
sim_compute_performance-ego_median0.007112970352172851
sim_compute_performance-ego_min0.007003979384899139
sim_compute_robot_state-ego_max0.00939827859401703
sim_compute_robot_state-ego_mean0.009337808989343188
sim_compute_robot_state-ego_median0.009354326725006103
sim_compute_robot_state-ego_min0.00923231840133667
sim_compute_sim_state_max0.005552587509155274
sim_compute_sim_state_mean0.005521190279600572
sim_compute_sim_state_median0.005528101126352946
sim_compute_sim_state_min0.005455733835697174
sim_physics_max0.06300774885683644
sim_physics_mean0.062252306805986944
sim_physics_median0.06228650410970052
sim_physics_min0.06160251796245575
sim_render-ego_max0.012351456953554735
sim_render-ego_mean0.012125628545576212
sim_render-ego_median0.012076963484287264
sim_render-ego_min0.0119899582862854
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.55000000000004
survival_time_min4.899999999999991
No reset possible
329346618Charlie Gauthier 🇨🇦challenge-aido_LF-template-pytorchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:13:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.37841623649249767
survival_time_median14.950000000000076
deviation-center-line_median0.16784776756601946
in-drivable-lane_median7.550000000000044


other stats
agent_compute-ego_max0.3525928280183247
agent_compute-ego_mean0.3410468951846872
agent_compute-ego_median0.3389851101239522
agent_compute-ego_min0.3292643348375956
deviation-center-line_max0.8300160369365349
deviation-center-line_mean0.37016104069634326
deviation-center-line_min0.13627201295904123
deviation-heading_max5.685073683511478
deviation-heading_mean4.006917345481744
deviation-heading_median5.316317322184466
deviation-heading_min1.3300023640587424
driven_any_max1.3542928605810003
driven_any_mean0.8963690687691386
driven_any_median1.2272094666241071
driven_any_min0.20120275579398636
driven_lanedir_consec_max0.3895771603708582
driven_lanedir_consec_mean0.27571887207764967
driven_lanedir_consec_min0.07900119177410936
driven_lanedir_max0.3895771603708582
driven_lanedir_mean0.27571887207764967
driven_lanedir_median0.37841623649249767
driven_lanedir_min0.07900119177410936
in-drivable-lane_max8.350000000000051
in-drivable-lane_mean5.490000000000026
in-drivable-lane_min1.3499999999999992
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3727714821799214, "sim_physics": 0.05506710495267596, "survival_time": 5.599999999999988, "driven_lanedir": 0.14587803733799987, "sim_render-ego": 0.011649927922657555, "in-drivable-lane": 2.499999999999995, "agent_compute-ego": 0.3525928280183247, "deviation-heading": 2.3416002187619065, "set_robot_commands": 0.005126895649092538, "deviation-center-line": 0.14431092138980334, "driven_lanedir_consec": 0.14587803733799987, "sim_compute_sim_state": 0.0030059793165751864, "sim_compute_performance-ego": 0.007156912769590106, "sim_compute_robot_state-ego": 0.00862315935747964}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20120275579398636, "sim_physics": 0.06100514158606529, "survival_time": 3.1999999999999966, "driven_lanedir": 0.07900119177410936, "sim_render-ego": 0.012033194303512572, "in-drivable-lane": 1.3499999999999992, "agent_compute-ego": 0.34604280814528465, "deviation-heading": 1.3300023640587424, "set_robot_commands": 0.005343731492757797, "deviation-center-line": 0.13627201295904123, "driven_lanedir_consec": 0.07900119177410936, "sim_compute_sim_state": 0.0029520243406295776, "sim_compute_performance-ego": 0.006894450634717941, "sim_compute_robot_state-ego": 0.00817958265542984}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3542928605810003, "sim_physics": 0.05677622397740682, "survival_time": 14.950000000000076, "driven_lanedir": 0.3857217344127832, "sim_render-ego": 0.011807506879170737, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.3383493947982788, "deviation-heading": 5.685073683511478, "set_robot_commands": 0.005439372062683106, "deviation-center-line": 0.8300160369365349, "driven_lanedir_consec": 0.3857217344127832, "sim_compute_sim_state": 0.0031032331784566244, "sim_compute_performance-ego": 0.006698904037475586, "sim_compute_robot_state-ego": 0.008411296208699544}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3263687786666782, "sim_physics": 0.05721946398417155, "survival_time": 14.950000000000076, "driven_lanedir": 0.3895771603708582, "sim_render-ego": 0.011712363560994466, "in-drivable-lane": 7.700000000000043, "agent_compute-ego": 0.3292643348375956, "deviation-heading": 5.361593138892128, "set_robot_commands": 0.005496806303660075, "deviation-center-line": 0.16784776756601946, "driven_lanedir_consec": 0.3895771603708582, "sim_compute_sim_state": 0.0031170010566711425, "sim_compute_performance-ego": 0.0067515269915262854, "sim_compute_robot_state-ego": 0.008392982482910157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2272094666241071, "sim_physics": 0.05891865253448486, "survival_time": 14.950000000000076, "driven_lanedir": 0.37841623649249767, "sim_render-ego": 0.011708484490712484, "in-drivable-lane": 8.350000000000051, "agent_compute-ego": 0.3389851101239522, "deviation-heading": 5.316317322184466, "set_robot_commands": 0.005356034437815348, "deviation-center-line": 0.5723584646303174, "driven_lanedir_consec": 0.37841623649249767, "sim_compute_sim_state": 0.0030760844548543293, "sim_compute_performance-ego": 0.006533662478129069, "sim_compute_robot_state-ego": 0.008272103468577067}}
set_robot_commands_max0.005496806303660075
set_robot_commands_mean0.005352567989201773
set_robot_commands_median0.005356034437815348
set_robot_commands_min0.005126895649092538
sim_compute_performance-ego_max0.007156912769590106
sim_compute_performance-ego_mean0.006807091382287797
sim_compute_performance-ego_median0.0067515269915262854
sim_compute_performance-ego_min0.006533662478129069
sim_compute_robot_state-ego_max0.00862315935747964
sim_compute_robot_state-ego_mean0.00837582483461925
sim_compute_robot_state-ego_median0.008392982482910157
sim_compute_robot_state-ego_min0.00817958265542984
sim_compute_sim_state_max0.0031170010566711425
sim_compute_sim_state_mean0.003050864469437372
sim_compute_sim_state_median0.0030760844548543293
sim_compute_sim_state_min0.0029520243406295776
sim_physics_max0.06100514158606529
sim_physics_mean0.0577973174069609
sim_physics_median0.05721946398417155
sim_physics_min0.05506710495267596
sim_render-ego_max0.012033194303512572
sim_render-ego_mean0.011782295431409564
sim_render-ego_median0.011712363560994466
sim_render-ego_min0.011649927922657555
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.730000000000045
survival_time_min3.1999999999999966
No reset possible
329336617Charlie Gauthier 🇨🇦Baseline solution using reinforcement learningaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13393769667229605
survival_time_median1.3500000000000003
deviation-center-line_median0.07370185629387059
in-drivable-lane_median0


other stats
agent_compute-ego_max0.4573785066604614
agent_compute-ego_mean0.28791065785755465
agent_compute-ego_median0.35660250527518134
agent_compute-ego_min0.08486691805032584
deviation-center-line_max0.09326837185758802
deviation-center-line_mean0.07620331382605751
deviation-center-line_min0.05576300732571014
deviation-heading_max0.9036085314820728
deviation-heading_mean0.8057954130216025
deviation-heading_median0.8067620095894383
deviation-heading_min0.6883891256299283
driven_any_max0.26312549170040056
driven_any_mean0.19247107747823183
driven_any_median0.19208209459354253
driven_any_min0.12173430535776358
driven_lanedir_consec_max0.18634775787413416
driven_lanedir_consec_mean0.13532340043299523
driven_lanedir_consec_min0.08517430215813215
driven_lanedir_max0.18634775787413416
driven_lanedir_mean0.13532340043299523
driven_lanedir_median0.13393769667229605
driven_lanedir_min0.08517430215813215
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.020000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19127393803259743, "sim_physics": 0.06454786547908077, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14072789019921972, "sim_render-ego": 0.010451599403663915, "in-drivable-lane": 0, "agent_compute-ego": 0.42814408408270943, "deviation-heading": 0.8067620095894383, "set_robot_commands": 0.005473437132658782, "deviation-center-line": 0.07184183984248121, "driven_lanedir_consec": 0.14072789019921972, "sim_compute_sim_state": 0.003141588634914822, "sim_compute_performance-ego": 0.006495979097154405, "sim_compute_robot_state-ego": 0.008189316149111147}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.12173430535776358, "sim_physics": 0.05849900028922341, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08517430215813215, "sim_render-ego": 0.011699904095042835, "in-drivable-lane": 0, "agent_compute-ego": 0.4573785066604614, "deviation-heading": 0.6883891256299283, "set_robot_commands": 0.005467653274536133, "deviation-center-line": 0.09326837185758802, "driven_lanedir_consec": 0.08517430215813215, "sim_compute_sim_state": 0.00279269435188987, "sim_compute_performance-ego": 0.006655508821660822, "sim_compute_robot_state-ego": 0.008247776464982466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26312549170040056, "sim_physics": 0.05722505705697196, "survival_time": 1.7500000000000009, "driven_lanedir": 0.18634775787413416, "sim_render-ego": 0.012382827486310689, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.35660250527518134, "deviation-heading": 0.9036085314820728, "set_robot_commands": 0.005120706558227539, "deviation-center-line": 0.08644149381063752, "driven_lanedir_consec": 0.18634775787413416, "sim_compute_sim_state": 0.0029173374176025392, "sim_compute_performance-ego": 0.0069636413029262, "sim_compute_robot_state-ego": 0.00867919921875}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1941395577068553, "sim_physics": 0.06066733393175849, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13393769667229605, "sim_render-ego": 0.01237919412810227, "in-drivable-lane": 0, "agent_compute-ego": 0.11256127521909516, "deviation-heading": 0.7565932457023197, "set_robot_commands": 0.006058717596119848, "deviation-center-line": 0.05576300732571014, "driven_lanedir_consec": 0.13393769667229605, "sim_compute_sim_state": 0.0035976130386878706, "sim_compute_performance-ego": 0.006960202907693797, "sim_compute_robot_state-ego": 0.009035529761478818}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19208209459354253, "sim_physics": 0.06252186114971454, "survival_time": 1.3000000000000005, "driven_lanedir": 0.13042935526119415, "sim_render-ego": 0.012342370473421536, "in-drivable-lane": 0, "agent_compute-ego": 0.08486691805032584, "deviation-heading": 0.8736241527042533, "set_robot_commands": 0.006286437694842999, "deviation-center-line": 0.07370185629387059, "driven_lanedir_consec": 0.13042935526119415, "sim_compute_sim_state": 0.003757320917569674, "sim_compute_performance-ego": 0.006944097005403959, "sim_compute_robot_state-ego": 0.009956139784592848}}
set_robot_commands_max0.006286437694842999
set_robot_commands_mean0.00568139045127706
set_robot_commands_median0.005473437132658782
set_robot_commands_min0.005120706558227539
sim_compute_performance-ego_max0.0069636413029262
sim_compute_performance-ego_mean0.006803885826967837
sim_compute_performance-ego_median0.006944097005403959
sim_compute_performance-ego_min0.006495979097154405
sim_compute_robot_state-ego_max0.009956139784592848
sim_compute_robot_state-ego_mean0.008821592275783056
sim_compute_robot_state-ego_median0.00867919921875
sim_compute_robot_state-ego_min0.008189316149111147
sim_compute_sim_state_max0.003757320917569674
sim_compute_sim_state_mean0.0032413108721329547
sim_compute_sim_state_median0.003141588634914822
sim_compute_sim_state_min0.00279269435188987
sim_physics_max0.06454786547908077
sim_physics_mean0.06069222358134983
sim_physics_median0.06066733393175849
sim_physics_min0.05722505705697196
sim_render-ego_max0.012382827486310689
sim_render-ego_mean0.011851179117308248
sim_render-ego_median0.012342370473421536
sim_render-ego_min0.010451599403663915
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.3900000000000006
survival_time_min1.1000000000000003
No reset possible
329296616Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:05:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12502185201929894
survival_time_median1.3500000000000003
deviation-center-line_median0.07344814276108995
in-drivable-lane_median0


other stats
agent_compute-ego_max0.3280868870871408
agent_compute-ego_mean0.2489217747098936
agent_compute-ego_median0.23420304265515557
agent_compute-ego_min0.2001633025981762
deviation-center-line_max0.09725236669397869
deviation-center-line_mean0.07331128227305286
deviation-center-line_min0.05344850423721536
deviation-heading_max1.0739485433006002
deviation-heading_mean0.8219101693931066
deviation-heading_median0.8669513435979145
deviation-heading_min0.5654265474479029
driven_any_max0.1930478456395661
driven_any_mean0.17120455546202756
driven_any_median0.16246761278329294
driven_any_min0.15837600354178924
driven_lanedir_consec_max0.12920505712050412
driven_lanedir_consec_mean0.10908022637924282
driven_lanedir_consec_min0.06487277219974708
driven_lanedir_max0.12920505712050412
driven_lanedir_mean0.10908022637924282
driven_lanedir_median0.12502185201929894
driven_lanedir_min0.06487277219974708
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.16246761278329294, "sim_physics": 0.06239038467407226, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09982948746386731, "sim_render-ego": 0.011488037109375, "in-drivable-lane": 0, "agent_compute-ego": 0.2566406440734863, "deviation-heading": 0.8669513435979145, "set_robot_commands": 0.005109548568725586, "deviation-center-line": 0.0634844518332879, "driven_lanedir_consec": 0.09982948746386731, "sim_compute_sim_state": 0.003276634216308594, "sim_compute_performance-ego": 0.006806812286376953, "sim_compute_robot_state-ego": 0.008316383361816407}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15837600354178924, "sim_physics": 0.059567039663141426, "survival_time": 1.1000000000000003, "driven_lanedir": 0.12647196309279662, "sim_render-ego": 0.01174131306734952, "in-drivable-lane": 0, "agent_compute-ego": 0.22551499713550915, "deviation-heading": 0.5654265474479029, "set_robot_commands": 0.005495450713417747, "deviation-center-line": 0.09725236669397869, "driven_lanedir_consec": 0.12647196309279662, "sim_compute_sim_state": 0.003440716049887917, "sim_compute_performance-ego": 0.006571043621410023, "sim_compute_robot_state-ego": 0.008372046730735085}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1609796608896998, "sim_physics": 0.058878972612578295, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06487277219974708, "sim_render-ego": 0.012229516588408372, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.23420304265515557, "deviation-heading": 1.0739485433006002, "set_robot_commands": 0.005411542695144127, "deviation-center-line": 0.07892294583969243, "driven_lanedir_consec": 0.06487277219974708, "sim_compute_sim_state": 0.0032132987318367794, "sim_compute_performance-ego": 0.006917854835247171, "sim_compute_robot_state-ego": 0.009291089814284751}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18115165445578985, "sim_physics": 0.05869219984327044, "survival_time": 1.4000000000000006, "driven_lanedir": 0.12920505712050412, "sim_render-ego": 0.012863218784332275, "in-drivable-lane": 0, "agent_compute-ego": 0.3280868870871408, "deviation-heading": 0.6840932957298967, "set_robot_commands": 0.005756531442914691, "deviation-center-line": 0.05344850423721536, "driven_lanedir_consec": 0.12920505712050412, "sim_compute_sim_state": 0.003287545272282192, "sim_compute_performance-ego": 0.0070288266454424176, "sim_compute_robot_state-ego": 0.009776617799486432}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1930478456395661, "sim_physics": 0.05917223294576009, "survival_time": 1.3500000000000003, "driven_lanedir": 0.12502185201929894, "sim_render-ego": 0.01305042372809516, "in-drivable-lane": 0, "agent_compute-ego": 0.2001633025981762, "deviation-heading": 0.919131116889218, "set_robot_commands": 0.005591825202659324, "deviation-center-line": 0.07344814276108995, "driven_lanedir_consec": 0.12502185201929894, "sim_compute_sim_state": 0.003499066388165509, "sim_compute_performance-ego": 0.007097606305722837, "sim_compute_robot_state-ego": 0.00954125545642994}}
set_robot_commands_max0.005756531442914691
set_robot_commands_mean0.005472979724572296
set_robot_commands_median0.005495450713417747
set_robot_commands_min0.005109548568725586
sim_compute_performance-ego_max0.007097606305722837
sim_compute_performance-ego_mean0.0068844287388398805
sim_compute_performance-ego_median0.006917854835247171
sim_compute_performance-ego_min0.006571043621410023
sim_compute_robot_state-ego_max0.009776617799486432
sim_compute_robot_state-ego_mean0.009059478632550523
sim_compute_robot_state-ego_median0.009291089814284751
sim_compute_robot_state-ego_min0.008316383361816407
sim_compute_sim_state_max0.003499066388165509
sim_compute_sim_state_mean0.0033434521316961984
sim_compute_sim_state_median0.003287545272282192
sim_compute_sim_state_min0.0032132987318367794
sim_physics_max0.06239038467407226
sim_physics_mean0.059740165947764504
sim_physics_median0.05917223294576009
sim_physics_min0.05869219984327044
sim_render-ego_max0.01305042372809516
sim_render-ego_mean0.012274501855512066
sim_render-ego_median0.012229516588408372
sim_render-ego_min0.011488037109375
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.3100000000000005
survival_time_min1.1000000000000003
No reset possible