Duckietown Challenges Home Challenges Submissions

Evaluator 537

ID537
evaluatornutonomy-P50-5849
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-5849
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success7 17135
# timeout1 17124
# failed
# error4 17119
# aborted7 17129
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171882252Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerroryesnutonomy-P50-58490:30:53
Timeout: Waited 180 [...]
Timeout:

Waited 1803.6370005607605 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171812269Andrea Censi 🇨🇭Solution templateaido2_LFV_r1-v4step1-simulationabortedyesnutonomy-P50-58490:09:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07706819220287044
agent_compute-ego_mean0.0760943354637106
agent_compute-ego_median0.07614714758736747
agent_compute-ego_min0.07550797392340268
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014762177186853746, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.032125616774839515, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07550797392340268, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04638754620271571, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.019275149878333595, "sim_compute_performance-ego": 0.03305663080776439, "sim_compute_robot_state-ego": 0.17487922836752498, "sim_compute_robot_state-npc0": 0.0336641038165373, "sim_compute_robot_state-npc1": 0.03335954161251292, "sim_compute_robot_state-npc2": 0.03310798196231618, "sim_compute_robot_state-npc3": 0.03344241661183974}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014655362992059616, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.031876681342957514, "in-drivable-lane": 0, "agent_compute-ego": 0.07614714758736747, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04626201447986421, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018802517936343237, "sim_compute_performance-ego": 0.03271453721182687, "sim_compute_robot_state-ego": 0.04646347061036125, "sim_compute_robot_state-npc0": 0.03369352552625868, "sim_compute_robot_state-npc1": 0.03334036327543713, "sim_compute_robot_state-npc2": 0.03347139509897384, "sim_compute_robot_state-npc3": 0.03376166782681904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0014916640061598558, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03252247663644644, "in-drivable-lane": 0, "agent_compute-ego": 0.07554019414461575, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04655792529766376, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01866010152376615, "sim_compute_performance-ego": 0.03298428975618803, "sim_compute_robot_state-ego": 0.044980569986196664, "sim_compute_robot_state-npc0": 0.033653901173518255, "sim_compute_robot_state-npc1": 0.033478025289682245, "sim_compute_robot_state-npc2": 0.033159784170297475, "sim_compute_robot_state-npc3": 0.033443197837242714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0014937243810514123, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03206893583623374, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07706819220287044, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04646545212443282, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018706909040125404, "sim_compute_performance-ego": 0.03340404208113507, "sim_compute_robot_state-ego": 0.045504444982947374, "sim_compute_robot_state-npc0": 0.03373261486611715, "sim_compute_robot_state-npc1": 0.03351197010133325, "sim_compute_robot_state-npc2": 0.03329661997353158, "sim_compute_robot_state-npc3": 0.03364214373797905}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0014646172523498536, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03249918937683106, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07620816946029663, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.046327519416809085, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018773396015167237, "sim_compute_performance-ego": 0.03291619062423706, "sim_compute_robot_state-ego": 0.04530252933502197, "sim_compute_robot_state-npc0": 0.033846604824066165, "sim_compute_robot_state-npc1": 0.03362612009048462, "sim_compute_robot_state-npc2": 0.03340879201889038, "sim_compute_robot_state-npc3": 0.033754591941833494}}
set_robot_commands_max0.04655792529766376
set_robot_commands_mean0.046400091504297115
set_robot_commands_median0.04638754620271571
set_robot_commands_min0.04626201447986421
sim_compute_performance-ego_max0.03340404208113507
sim_compute_performance-ego_mean0.03301513809623029
sim_compute_performance-ego_median0.03298428975618803
sim_compute_performance-ego_min0.03271453721182687
sim_compute_robot_state-ego_max0.17487922836752498
sim_compute_robot_state-ego_mean0.07142604865641045
sim_compute_robot_state-ego_median0.045504444982947374
sim_compute_robot_state-ego_min0.044980569986196664
sim_compute_robot_state-npc0_max0.033846604824066165
sim_compute_robot_state-npc0_mean0.03371815004129951
sim_compute_robot_state-npc0_median0.03369352552625868
sim_compute_robot_state-npc0_min0.033653901173518255
sim_compute_robot_state-npc1_max0.03362612009048462
sim_compute_robot_state-npc1_mean0.033463204073890036
sim_compute_robot_state-npc1_median0.033478025289682245
sim_compute_robot_state-npc1_min0.03334036327543713
sim_compute_robot_state-npc2_max0.03347139509897384
sim_compute_robot_state-npc2_mean0.033288914644801895
sim_compute_robot_state-npc2_median0.03329661997353158
sim_compute_robot_state-npc2_min0.03310798196231618
sim_compute_robot_state-npc3_max0.03376166782681904
sim_compute_robot_state-npc3_mean0.03360880359114281
sim_compute_robot_state-npc3_median0.03364214373797905
sim_compute_robot_state-npc3_min0.03344241661183974
sim_compute_sim_state_max0.019275149878333595
sim_compute_sim_state_mean0.018843614878747125
sim_compute_sim_state_median0.018773396015167237
sim_compute_sim_state_min0.01866010152376615
sim_physics_max0.0014937243810514123
sim_physics_mean0.0014783519314904917
sim_physics_median0.0014762177186853746
sim_physics_min0.0014646172523498536
sim_render-ego_max0.03252247663644644
sim_render-ego_mean0.03221857999346166
sim_render-ego_median0.032125616774839515
sim_render-ego_min0.031876681342957514
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171742286Andrea Censi 🇨🇭Minimal agentaido2_LFVI_r1-v4step1-simulationsuccessyesnutonomy-P50-58490:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.07631754875183105
agent_compute-ego_mean0.07584918305653372
agent_compute-ego_median0.07581065563445395
agent_compute-ego_min0.07547764217152315
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0014636269931135506, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.032300797824201914, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07568215994999326, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.04622732030934301, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018652669314680428, "sim_compute_performance-ego": 0.03240336220839928, "sim_compute_robot_state-ego": 0.10638790623895052, "sim_compute_robot_state-npc0": 0.03353539006463412, "sim_compute_robot_state-npc1": 0.033196110560976225, "sim_compute_robot_state-npc2": 0.033239517540767274, "sim_compute_robot_state-npc3": 0.0335301843182794}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0014905965689456823, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.034252018639535614, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0759579087748672, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.04639783772555264, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.01855175422899651, "sim_compute_performance-ego": 0.03275048371517297, "sim_compute_robot_state-ego": 0.04682607361764619, "sim_compute_robot_state-npc0": 0.033440597129590584, "sim_compute_robot_state-npc1": 0.033744064244357025, "sim_compute_robot_state-npc2": 0.033171249158454666, "sim_compute_robot_state-npc3": 0.03332898833534934}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.001460899697973373, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.03229300772890131, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07581065563445395, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04736743582055924, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.018615664319789157, "sim_compute_performance-ego": 0.032694801371148295, "sim_compute_robot_state-ego": 0.04810395900239336, "sim_compute_robot_state-npc0": 0.03359165090195676, "sim_compute_robot_state-npc1": 0.0331771525930851, "sim_compute_robot_state-npc2": 0.03307489131359344, "sim_compute_robot_state-npc3": 0.0333564966282946}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0014544907738180722, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03231317015255199, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07631754875183105, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.0463235153871424, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.018997663610121784, "sim_compute_performance-ego": 0.03261614687302533, "sim_compute_robot_state-ego": 0.0477872231427361, "sim_compute_robot_state-npc0": 0.03343502773958094, "sim_compute_robot_state-npc1": 0.03318642728468951, "sim_compute_robot_state-npc2": 0.03308435608358944, "sim_compute_robot_state-npc3": 0.03475031852722168}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0014843379749971278, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.032036139684564924, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07547764217152315, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.04772067771238439, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.01872180840548347, "sim_compute_performance-ego": 0.03274516848956838, "sim_compute_robot_state-ego": 0.04719219488256118, "sim_compute_robot_state-npc0": 0.03341654819600722, "sim_compute_robot_state-npc1": 0.03332254465888528, "sim_compute_robot_state-npc2": 0.033164627411786246, "sim_compute_robot_state-npc3": 0.03340716922984404}}
set_robot_commands_max0.04772067771238439
set_robot_commands_mean0.04680735739099634
set_robot_commands_median0.04639783772555264
set_robot_commands_min0.04622732030934301
sim_compute_performance-ego_max0.03275048371517297
sim_compute_performance-ego_mean0.032641992531462855
sim_compute_performance-ego_median0.032694801371148295
sim_compute_performance-ego_min0.03240336220839928
sim_compute_robot_state-ego_max0.10638790623895052
sim_compute_robot_state-ego_mean0.05925947137685746
sim_compute_robot_state-ego_median0.0477872231427361
sim_compute_robot_state-ego_min0.04682607361764619
sim_compute_robot_state-npc0_max0.03359165090195676
sim_compute_robot_state-npc0_mean0.03348384280635393
sim_compute_robot_state-npc0_median0.033440597129590584
sim_compute_robot_state-npc0_min0.03341654819600722
sim_compute_robot_state-npc1_max0.033744064244357025
sim_compute_robot_state-npc1_mean0.033325259868398634
sim_compute_robot_state-npc1_median0.033196110560976225
sim_compute_robot_state-npc1_min0.0331771525930851
sim_compute_robot_state-npc2_max0.033239517540767274
sim_compute_robot_state-npc2_mean0.033146928301638214
sim_compute_robot_state-npc2_median0.033164627411786246
sim_compute_robot_state-npc2_min0.03307489131359344
sim_compute_robot_state-npc3_max0.03475031852722168
sim_compute_robot_state-npc3_mean0.03367463140779782
sim_compute_robot_state-npc3_median0.03340716922984404
sim_compute_robot_state-npc3_min0.03332898833534934
sim_compute_sim_state_max0.018997663610121784
sim_compute_sim_state_mean0.01870791197581427
sim_compute_sim_state_median0.018652669314680428
sim_compute_sim_state_min0.01855175422899651
sim_physics_max0.0014905965689456823
sim_physics_mean0.0014707904017695612
sim_physics_median0.0014636269931135506
sim_physics_min0.0014544907738180722
sim_render-ego_max0.034252018639535614
sim_render-ego_mean0.032639026805951155
sim_render-ego_median0.032300797824201914
sim_render-ego_min0.032036139684564924
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171702293Andrea Censi 🇨🇭Minimal agentaido2_LFVI_r1-v4step1-simulationsuccessyesnutonomy-P50-58490:11:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.07828737750197902
agent_compute-ego_mean0.07676037190858452
agent_compute-ego_median0.07656666110543643
agent_compute-ego_min0.07590890211217544
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0014798197252997036, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.03250889778137207, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07599182951039281, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.04641186451089793, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018604030280277645, "sim_compute_performance-ego": 0.03259072139345366, "sim_compute_robot_state-ego": 0.10588787177513384, "sim_compute_robot_state-npc0": 0.03364472718074404, "sim_compute_robot_state-npc1": 0.03316087229498502, "sim_compute_robot_state-npc2": 0.033147073614186257, "sim_compute_robot_state-npc3": 0.03339916590986581}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0014788020740855825, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.032391866048177086, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.07828737750197902, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.04682979800484397, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.01867953575018681, "sim_compute_performance-ego": 0.032982472217444214, "sim_compute_robot_state-ego": 0.04707208907965458, "sim_compute_robot_state-npc0": 0.033713521379413025, "sim_compute_robot_state-npc1": 0.03381280104319254, "sim_compute_robot_state-npc2": 0.033086599725665466, "sim_compute_robot_state-npc3": 0.033320166847922585}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.001506861220014856, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.03240635547232121, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07704708931293894, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04658472537994385, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.018631853955857296, "sim_compute_performance-ego": 0.03273191857845225, "sim_compute_robot_state-ego": 0.04789680876630418, "sim_compute_robot_state-npc0": 0.03368024876777162, "sim_compute_robot_state-npc1": 0.03331094092511116, "sim_compute_robot_state-npc2": 0.03314949603790932, "sim_compute_robot_state-npc3": 0.03341184017506051}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.00149839345146628, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03232073503382066, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07590890211217544, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.048116423101986154, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.018988802853752585, "sim_compute_performance-ego": 0.032653284072875974, "sim_compute_robot_state-ego": 0.04807809941908892, "sim_compute_robot_state-npc0": 0.03369444678811466, "sim_compute_robot_state-npc1": 0.0331659288967357, "sim_compute_robot_state-npc2": 0.03308916091918945, "sim_compute_robot_state-npc3": 0.03334452965680291}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0014945128384758445, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.032581984996795654, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07656666110543643, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.04868121708140654, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.01875375649508308, "sim_compute_performance-ego": 0.03331587595098159, "sim_compute_robot_state-ego": 0.047048267196206486, "sim_compute_robot_state-npc0": 0.033759025966419894, "sim_compute_robot_state-npc1": 0.03351500104455387, "sim_compute_robot_state-npc2": 0.0332757970866035, "sim_compute_robot_state-npc3": 0.033642982735353356}}
set_robot_commands_max0.04868121708140654
set_robot_commands_mean0.04732480561581569
set_robot_commands_median0.04682979800484397
set_robot_commands_min0.04641186451089793
sim_compute_performance-ego_max0.03331587595098159
sim_compute_performance-ego_mean0.03285485444264154
sim_compute_performance-ego_median0.03273191857845225
sim_compute_performance-ego_min0.03259072139345366
sim_compute_robot_state-ego_max0.10588787177513384
sim_compute_robot_state-ego_mean0.0591966272472776
sim_compute_robot_state-ego_median0.04789680876630418
sim_compute_robot_state-ego_min0.047048267196206486
sim_compute_robot_state-npc0_max0.033759025966419894
sim_compute_robot_state-npc0_mean0.03369839401649265
sim_compute_robot_state-npc0_median0.03369444678811466
sim_compute_robot_state-npc0_min0.03364472718074404
sim_compute_robot_state-npc1_max0.03381280104319254
sim_compute_robot_state-npc1_mean0.03339310884091566
sim_compute_robot_state-npc1_median0.03331094092511116
sim_compute_robot_state-npc1_min0.03316087229498502
sim_compute_robot_state-npc2_max0.0332757970866035
sim_compute_robot_state-npc2_mean0.0331496254767108
sim_compute_robot_state-npc2_median0.033147073614186257
sim_compute_robot_state-npc2_min0.033086599725665466
sim_compute_robot_state-npc3_max0.033642982735353356
sim_compute_robot_state-npc3_mean0.03342373706500103
sim_compute_robot_state-npc3_median0.03339916590986581
sim_compute_robot_state-npc3_min0.033320166847922585
sim_compute_sim_state_max0.018988802853752585
sim_compute_sim_state_mean0.018731595867031485
sim_compute_sim_state_median0.01867953575018681
sim_compute_sim_state_min0.018604030280277645
sim_physics_max0.001506861220014856
sim_physics_mean0.0014916778618684532
sim_physics_median0.0014945128384758445
sim_physics_min0.0014788020740855825
sim_render-ego_max0.032581984996795654
sim_render-ego_mean0.032441967866497334
sim_render-ego_median0.03240635547232121
sim_render-ego_min0.03232073503382066
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171682304Andrea Censi 🇨🇭Minimal agentaido2_LF_r2-v4step1-simulationsuccessyesnutonomy-P50-58490:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07810876136872827
agent_compute-ego_mean0.07687530681128803
agent_compute-ego_median0.07662056741260347
agent_compute-ego_min0.07641434302696815
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015059183625613945, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03219486685360179, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07660231520147885, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.046800634440253765, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018662954078001136, "sim_compute_performance-ego": 0.033605810473946965, "sim_compute_robot_state-ego": 0.1751603063415079}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015288042643713572, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.0340259832049173, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07662056741260347, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04697196067325653, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.01868521977984716, "sim_compute_performance-ego": 0.03398631111023918, "sim_compute_robot_state-ego": 0.04000114637707907}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0015138516059288612, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03235052915719839, "in-drivable-lane": 0, "agent_compute-ego": 0.07641434302696815, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04800580098078801, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.018769022134634165, "sim_compute_performance-ego": 0.033585005540114184, "sim_compute_robot_state-ego": 0.04001879692077637}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015229190268167636, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032257382462664345, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07810876136872827, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04689712059207079, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01878103105033316, "sim_compute_performance-ego": 0.03376832822474038, "sim_compute_robot_state-ego": 0.040285311094144495}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.001498422622680664, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.03312928438186646, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07663054704666138, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046857035160064696, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.018720502853393554, "sim_compute_performance-ego": 0.033865969181060794, "sim_compute_robot_state-ego": 0.04026498556137085}}
set_robot_commands_max0.04800580098078801
set_robot_commands_mean0.047106510369286765
set_robot_commands_median0.04689712059207079
set_robot_commands_min0.046800634440253765
sim_compute_performance-ego_max0.03398631111023918
sim_compute_performance-ego_mean0.033762284906020304
sim_compute_performance-ego_median0.03376832822474038
sim_compute_performance-ego_min0.033585005540114184
sim_compute_robot_state-ego_max0.1751603063415079
sim_compute_robot_state-ego_mean0.06714610925897574
sim_compute_robot_state-ego_median0.04026498556137085
sim_compute_robot_state-ego_min0.04000114637707907
sim_compute_sim_state_max0.01878103105033316
sim_compute_sim_state_mean0.018723745979241833
sim_compute_sim_state_median0.018720502853393554
sim_compute_sim_state_min0.018662954078001136
sim_physics_max0.0015288042643713572
sim_physics_mean0.001513983176471808
sim_physics_median0.0015138516059288612
sim_physics_min0.001498422622680664
sim_render-ego_max0.0340259832049173
sim_render-ego_mean0.03279160921204966
sim_render-ego_median0.03235052915719839
sim_render-ego_min0.03219486685360179
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171662305Andrea Censi 🇨🇭Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesnutonomy-P50-58490:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07609513927908505
agent_compute-ego_mean0.07577490238911797
agent_compute-ego_median0.0758683967590332
agent_compute-ego_min0.07523613884335473
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014873497626360726, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.031977460664861346, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07609513927908505, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04623278098947862, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01905967207515941, "sim_compute_performance-ego": 0.03298173581852632, "sim_compute_robot_state-ego": 0.17276647511650534, "sim_compute_robot_state-npc0": 0.03332474301843082, "sim_compute_robot_state-npc1": 0.03328318455640007, "sim_compute_robot_state-npc2": 0.03315379339105943, "sim_compute_robot_state-npc3": 0.033730598057017606}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.001543722455463712, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03181245213463193, "in-drivable-lane": 0, "agent_compute-ego": 0.07523613884335473, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04628039163256448, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018548238845098583, "sim_compute_performance-ego": 0.032618734571668834, "sim_compute_robot_state-ego": 0.046474101051451666, "sim_compute_robot_state-npc0": 0.03346389437478686, "sim_compute_robot_state-npc1": 0.033350857477339485, "sim_compute_robot_state-npc2": 0.033074216237143864, "sim_compute_robot_state-npc3": 0.03321971590556796}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0015037793379563552, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03211207756629357, "in-drivable-lane": 0, "agent_compute-ego": 0.07577246519235464, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04811518742487981, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01856262133671687, "sim_compute_performance-ego": 0.03276462188133827, "sim_compute_robot_state-ego": 0.04495434394249549, "sim_compute_robot_state-npc0": 0.034241764362041766, "sim_compute_robot_state-npc1": 0.03343481650719276, "sim_compute_robot_state-npc2": 0.03317414063673753, "sim_compute_robot_state-npc3": 0.03333921065697303}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015033628882431403, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03247117705461455, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07590237187176216, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04675098454079977, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01875987576275337, "sim_compute_performance-ego": 0.03347052597418064, "sim_compute_robot_state-ego": 0.04533387393486209, "sim_compute_robot_state-npc0": 0.03388534231883723, "sim_compute_robot_state-npc1": 0.03390679708341273, "sim_compute_robot_state-npc2": 0.03347545426066329, "sim_compute_robot_state-npc3": 0.033722301808799184}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0014706778526306153, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03242829084396362, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0758683967590332, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04609720230102539, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018639745712280272, "sim_compute_performance-ego": 0.03310199499130249, "sim_compute_robot_state-ego": 0.04458147764205933, "sim_compute_robot_state-npc0": 0.03364508628845215, "sim_compute_robot_state-npc1": 0.0333996844291687, "sim_compute_robot_state-npc2": 0.033185951709747315, "sim_compute_robot_state-npc3": 0.03347230672836304}}
set_robot_commands_max0.04811518742487981
set_robot_commands_mean0.046695309377749614
set_robot_commands_median0.04628039163256448
set_robot_commands_min0.04609720230102539
sim_compute_performance-ego_max0.03347052597418064
sim_compute_performance-ego_mean0.0329875226474033
sim_compute_performance-ego_median0.03298173581852632
sim_compute_performance-ego_min0.032618734571668834
sim_compute_robot_state-ego_max0.17276647511650534
sim_compute_robot_state-ego_mean0.07082205433747478
sim_compute_robot_state-ego_median0.04533387393486209
sim_compute_robot_state-ego_min0.04458147764205933
sim_compute_robot_state-npc0_max0.034241764362041766
sim_compute_robot_state-npc0_mean0.033712166072509764
sim_compute_robot_state-npc0_median0.03364508628845215
sim_compute_robot_state-npc0_min0.03332474301843082
sim_compute_robot_state-npc1_max0.03390679708341273
sim_compute_robot_state-npc1_mean0.03347506801070275
sim_compute_robot_state-npc1_median0.0333996844291687
sim_compute_robot_state-npc1_min0.03328318455640007
sim_compute_robot_state-npc2_max0.03347545426066329
sim_compute_robot_state-npc2_mean0.03321271124707029
sim_compute_robot_state-npc2_median0.03317414063673753
sim_compute_robot_state-npc2_min0.033074216237143864
sim_compute_robot_state-npc3_max0.033730598057017606
sim_compute_robot_state-npc3_mean0.033496826631344165
sim_compute_robot_state-npc3_median0.03347230672836304
sim_compute_robot_state-npc3_min0.03321971590556796
sim_compute_sim_state_max0.01905967207515941
sim_compute_sim_state_mean0.018714030746401704
sim_compute_sim_state_median0.018639745712280272
sim_compute_sim_state_min0.018548238845098583
sim_physics_max0.001543722455463712
sim_physics_mean0.001501778459385979
sim_physics_median0.0015033628882431403
sim_physics_min0.0014706778526306153
sim_render-ego_max0.03247117705461455
sim_render-ego_mean0.032160291652873
sim_render-ego_median0.03211207756629357
sim_render-ego_min0.03181245213463193
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171642262Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerroryesnutonomy-P50-58490:00:43
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171602316Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesnutonomy-P50-58490:07:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1889327024068811
survival_time_median1.3500000000000003
deviation-center-line_median0.07930110646342275
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10562616128187911
agent_compute-ego_mean0.10426284493980828
agent_compute-ego_median0.10447671678331164
agent_compute-ego_min0.10302206448146276
deviation-center-line_max0.08637207771856689
deviation-center-line_mean0.08043176208297143
deviation-center-line_min0.07768715335965017
deviation-heading_max0.7560020895565267
deviation-heading_mean0.7012478099149824
deviation-heading_median0.7041554170496334
deviation-heading_min0.6563074448529416
driven_any_max0.24379195497535736
driven_any_mean0.23107259326918625
driven_any_median0.23110384454558772
driven_any_min0.2212341045831002
driven_lanedir_consec_max0.20321244067472088
driven_lanedir_consec_mean0.18805342377703055
driven_lanedir_consec_min0.17277119420330234
driven_lanedir_max0.20321244067472088
driven_lanedir_mean0.18805342377703055
driven_lanedir_median0.1889327024068811
driven_lanedir_min0.17277119420330234
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2315603497426763, "sim_physics": 0.0014290809631347656, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19052930465595488, "sim_render-ego": 0.032666949125436634, "in-drivable-lane": 0, "agent_compute-ego": 0.10562616128187911, "deviation-heading": 0.6563074448529416, "set_robot_commands": 0.048172602286705606, "deviation-center-line": 0.07768715335965017, "driven_lanedir_consec": 0.19052930465595488, "sim_compute_sim_state": 0.01917397975921631, "sim_compute_performance-ego": 0.03374328980079064, "sim_compute_robot_state-ego": 0.4110114207634559}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23110384454558772, "sim_physics": 0.001494790826525007, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1889327024068811, "sim_render-ego": 0.03168929474694388, "in-drivable-lane": 0, "agent_compute-ego": 0.10302206448146276, "deviation-heading": 0.7272051642922797, "set_robot_commands": 0.047078345503125875, "deviation-center-line": 0.08637207771856689, "driven_lanedir_consec": 0.1889327024068811, "sim_compute_sim_state": 0.019199149949210032, "sim_compute_performance-ego": 0.0335243855203901, "sim_compute_robot_state-ego": 0.0399353163582938}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24379195497535736, "sim_physics": 0.0014904907771519252, "survival_time": 1.4000000000000006, "driven_lanedir": 0.20321244067472088, "sim_render-ego": 0.032170619283403666, "in-drivable-lane": 0, "agent_compute-ego": 0.10311371088027954, "deviation-heading": 0.6625689338235301, "set_robot_commands": 0.05058394159589495, "deviation-center-line": 0.0791768746457932, "driven_lanedir_consec": 0.20321244067472088, "sim_compute_sim_state": 0.019092346940721785, "sim_compute_performance-ego": 0.0339882458959307, "sim_compute_robot_state-ego": 0.04053327015468052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.0015634430779351129, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.03356183016741717, "in-drivable-lane": 0, "agent_compute-ego": 0.10447671678331164, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.04768821045204445, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.01938915252685547, "sim_compute_performance-ego": 0.034060531192355685, "sim_compute_robot_state-ego": 0.04180775748358832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.001507299917715567, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.033399599569815176, "in-drivable-lane": 0, "agent_compute-ego": 0.10507557127210829, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.04748947532088668, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.01931741502549913, "sim_compute_performance-ego": 0.03430034496166088, "sim_compute_robot_state-ego": 0.04077381557888455}}
set_robot_commands_max0.05058394159589495
set_robot_commands_mean0.048202515031731515
set_robot_commands_median0.04768821045204445
set_robot_commands_min0.047078345503125875
sim_compute_performance-ego_max0.03430034496166088
sim_compute_performance-ego_mean0.0339233594742256
sim_compute_performance-ego_median0.0339882458959307
sim_compute_performance-ego_min0.0335243855203901
sim_compute_robot_state-ego_max0.4110114207634559
sim_compute_robot_state-ego_mean0.1148123160677806
sim_compute_robot_state-ego_median0.04077381557888455
sim_compute_robot_state-ego_min0.0399353163582938
sim_compute_sim_state_max0.01938915252685547
sim_compute_sim_state_mean0.019234408840300542
sim_compute_sim_state_median0.019199149949210032
sim_compute_sim_state_min0.019092346940721785
sim_physics_max0.0015634430779351129
sim_physics_mean0.0014970211124924757
sim_physics_median0.001494790826525007
sim_physics_min0.0014290809631347656
sim_render-ego_max0.03356183016741717
sim_render-ego_mean0.03269765857860331
sim_render-ego_median0.032666949125436634
sim_render-ego_min0.03168929474694388
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3600000000000003
survival_time_min1.3000000000000005
No reset possible
171562322Bhairav MehtaBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationabortedyesnutonomy-P50-58490:07:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18115448860868355
survival_time_median2.6499999999999986
deviation-center-line_median0.07130941208466557
in-drivable-lane_median1.2499999999999991


other stats
agent_compute-ego_max0.08548740104392723
agent_compute-ego_mean0.08360005027850591
agent_compute-ego_median0.08312222642718621
agent_compute-ego_min0.08290476412386508
deviation-center-line_max0.13054586090860865
deviation-center-line_mean0.07758188488958014
deviation-center-line_min0.046894931925083094
deviation-heading_max4.553788058129419
deviation-heading_mean1.6839894722513862
deviation-heading_median1.066927048944359
deviation-heading_min0.686127211701689
driven_any_max2.190232673825663
driven_any_mean0.8327911013903446
driven_any_median0.543949815241968
driven_any_min0.3818078306559801
driven_lanedir_consec_max0.6272349062546385
driven_lanedir_consec_mean0.25652428459555965
driven_lanedir_consec_min0.1044210468949689
driven_lanedir_max0.6272349062546385
driven_lanedir_mean0.25652428459555965
driven_lanedir_median0.18115448860868355
driven_lanedir_min0.1044210468949689
in-drivable-lane_max5.900000000000017
in-drivable-lane_mean2.130000000000003
in-drivable-lane_min0.9500000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.190232673825663, "sim_physics": 0.0015846796524830351, "survival_time": 11.700000000000031, "driven_lanedir": 0.6272349062546385, "sim_render-ego": 0.03203771664546086, "in-drivable-lane": 5.900000000000017, "agent_compute-ego": 0.08346324700575608, "deviation-heading": 4.553788058129419, "set_robot_commands": 0.046495592492258445, "deviation-center-line": 0.13054586090860865, "driven_lanedir_consec": 0.6272349062546385, "sim_compute_sim_state": 0.01854965727553408, "sim_compute_performance-ego": 0.03329387281694983, "sim_compute_robot_state-ego": 0.07903645894466302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3818078306559801, "sim_physics": 0.0014860243410677522, "survival_time": 1.850000000000001, "driven_lanedir": 0.1044210468949689, "sim_render-ego": 0.03184560182932261, "in-drivable-lane": 0.9500000000000004, "agent_compute-ego": 0.08290476412386508, "deviation-heading": 0.686127211701689, "set_robot_commands": 0.04636118218705461, "deviation-center-line": 0.046894931925083094, "driven_lanedir_consec": 0.1044210468949689, "sim_compute_sim_state": 0.01847454019494959, "sim_compute_performance-ego": 0.03310313740292111, "sim_compute_robot_state-ego": 0.039510778478673986}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4962957893277826, "sim_physics": 0.0015758413534898025, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1736030292291466, "sim_render-ego": 0.03246523783757137, "in-drivable-lane": 1.2499999999999991, "agent_compute-ego": 0.083022612791795, "deviation-heading": 1.0371483598111588, "set_robot_commands": 0.046908754568833574, "deviation-center-line": 0.07130941208466557, "driven_lanedir_consec": 0.1736030292291466, "sim_compute_sim_state": 0.018793821334838867, "sim_compute_performance-ego": 0.03361853269430307, "sim_compute_robot_state-ego": 0.04010574175761296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.543949815241968, "sim_physics": 0.001498582228174749, "survival_time": 2.6499999999999986, "driven_lanedir": 0.18115448860868355, "sim_render-ego": 0.03227497046848513, "in-drivable-lane": 1.2499999999999991, "agent_compute-ego": 0.08312222642718621, "deviation-heading": 1.0759566826703049, "set_robot_commands": 0.04648380459479566, "deviation-center-line": 0.0592082218341978, "driven_lanedir_consec": 0.18115448860868355, "sim_compute_sim_state": 0.01852653161534723, "sim_compute_performance-ego": 0.0334918184100457, "sim_compute_robot_state-ego": 0.04005707434888156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5516693979003289, "sim_physics": 0.0014663095827455873, "survival_time": 2.6999999999999984, "driven_lanedir": 0.19620795199036056, "sim_render-ego": 0.03253434322498463, "in-drivable-lane": 1.299999999999999, "agent_compute-ego": 0.08548740104392723, "deviation-heading": 1.066927048944359, "set_robot_commands": 0.04653683415165654, "deviation-center-line": 0.0799509976953455, "driven_lanedir_consec": 0.19620795199036056, "sim_compute_sim_state": 0.01872071071907326, "sim_compute_performance-ego": 0.03349661385571515, "sim_compute_robot_state-ego": 0.0405782593621148}}
set_robot_commands_max0.046908754568833574
set_robot_commands_mean0.04655723359891976
set_robot_commands_median0.046495592492258445
set_robot_commands_min0.04636118218705461
sim_compute_performance-ego_max0.03361853269430307
sim_compute_performance-ego_mean0.03340079503598697
sim_compute_performance-ego_median0.0334918184100457
sim_compute_performance-ego_min0.03310313740292111
sim_compute_robot_state-ego_max0.07903645894466302
sim_compute_robot_state-ego_mean0.04785766257838926
sim_compute_robot_state-ego_median0.04010574175761296
sim_compute_robot_state-ego_min0.039510778478673986
sim_compute_sim_state_max0.018793821334838867
sim_compute_sim_state_mean0.01861305222794861
sim_compute_sim_state_median0.01854965727553408
sim_compute_sim_state_min0.01847454019494959
sim_physics_max0.0015846796524830351
sim_physics_mean0.0015222874315921852
sim_physics_median0.001498582228174749
sim_physics_min0.0014663095827455873
sim_render-ego_max0.03253434322498463
sim_render-ego_mean0.03223157400116492
sim_render-ego_median0.03227497046848513
sim_render-ego_min0.03184560182932261
simulation-passed1
survival_time_max11.700000000000031
survival_time_mean4.300000000000006
survival_time_min1.850000000000001
No reset possible
171552323Bhairav MehtaBaseline solution using reinforcement learningaido2_LF_r2-v4step1-simulationabortedyesnutonomy-P50-58490:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05473638591926244
survival_time_median0.49999999999999994
deviation-center-line_median0.0089486865008137
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.09593832492828368
agent_compute-ego_mean0.08684422969818115
agent_compute-ego_median0.08406383991241455
agent_compute-ego_min0.08145204457369717
deviation-center-line_max0.014733408168211786
deviation-center-line_mean0.009409321629201675
deviation-center-line_min0.0059662334726055056
deviation-heading_max0.2445646188879276
deviation-heading_mean0.20946671583087123
deviation-heading_median0.21535424800480113
deviation-heading_min0.17777697259888925
driven_any_max0.1761417001795484
driven_any_mean0.1600707906514049
driven_any_median0.16207425545510706
driven_any_min0.14448409514249394
driven_lanedir_consec_max0.0779747750116071
driven_lanedir_consec_mean0.05861877483043432
driven_lanedir_consec_min0.036703134282384475
driven_lanedir_max0.0779747750116071
driven_lanedir_mean0.05861877483043432
driven_lanedir_median0.05473638591926244
driven_lanedir_min0.036703134282384475
in-drivable-lane_max0.24999999999999992
in-drivable-lane_mean0.21999999999999992
in-drivable-lane_min0.19999999999999996
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14448409514249394, "sim_physics": 0.0014087200164794925, "survival_time": 0.49999999999999994, "driven_lanedir": 0.036703134282384475, "sim_render-ego": 0.032400107383728026, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.09593832492828368, "deviation-heading": 0.17777697259888925, "set_robot_commands": 0.046068334579467775, "deviation-center-line": 0.0059662334726055056, "driven_lanedir_consec": 0.036703134282384475, "sim_compute_sim_state": 0.018449878692626952, "sim_compute_performance-ego": 0.033046817779541014, "sim_compute_robot_state-ego": 0.9880016565322876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16615415032425562, "sim_physics": 0.0015700513666326349, "survival_time": 0.5499999999999999, "driven_lanedir": 0.04928311137353014, "sim_render-ego": 0.03160682591524991, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.08216175166043369, "deviation-heading": 0.2209449278957702, "set_robot_commands": 0.0476429895921187, "deviation-center-line": 0.0089486865008137, "driven_lanedir_consec": 0.04928311137353014, "sim_compute_sim_state": 0.01887460188432173, "sim_compute_performance-ego": 0.033066207712346855, "sim_compute_robot_state-ego": 0.041065887971357865}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1761417001795484, "sim_physics": 0.001553210345181552, "survival_time": 0.5499999999999999, "driven_lanedir": 0.0779747750116071, "sim_render-ego": 0.031295147809115326, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.08145204457369717, "deviation-heading": 0.2445646188879276, "set_robot_commands": 0.0475135933269154, "deviation-center-line": 0.014733408168211786, "driven_lanedir_consec": 0.0779747750116071, "sim_compute_sim_state": 0.018722035668113014, "sim_compute_performance-ego": 0.03351729566400701, "sim_compute_robot_state-ego": 0.04120570963079279}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1514997521556194, "sim_physics": 0.001444697380065918, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05473638591926244, "sim_render-ego": 0.03264262676239014, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.08406383991241455, "deviation-heading": 0.21535424800480113, "set_robot_commands": 0.05447640419006348, "deviation-center-line": 0.008380462057484012, "driven_lanedir_consec": 0.05473638591926244, "sim_compute_sim_state": 0.018655872344970705, "sim_compute_performance-ego": 0.03323361873626709, "sim_compute_robot_state-ego": 0.041795086860656736}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16207425545510706, "sim_physics": 0.0014670610427856446, "survival_time": 0.49999999999999994, "driven_lanedir": 0.07439646756538743, "sim_render-ego": 0.03255157470703125, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.09060518741607666, "deviation-heading": 0.1886928117669681, "set_robot_commands": 0.0462385892868042, "deviation-center-line": 0.009017817946893363, "driven_lanedir_consec": 0.07439646756538743, "sim_compute_sim_state": 0.018586039543151855, "sim_compute_performance-ego": 0.03311524391174316, "sim_compute_robot_state-ego": 0.04164764881134033}}
set_robot_commands_max0.05447640419006348
set_robot_commands_mean0.04838798219507391
set_robot_commands_median0.0475135933269154
set_robot_commands_min0.046068334579467775
sim_compute_performance-ego_max0.03351729566400701
sim_compute_performance-ego_mean0.03319583676078103
sim_compute_performance-ego_median0.03311524391174316
sim_compute_performance-ego_min0.033046817779541014
sim_compute_robot_state-ego_max0.9880016565322876
sim_compute_robot_state-ego_mean0.23074319796128703
sim_compute_robot_state-ego_median0.04164764881134033
sim_compute_robot_state-ego_min0.041065887971357865
sim_compute_sim_state_max0.01887460188432173
sim_compute_sim_state_mean0.01865768562663685
sim_compute_sim_state_median0.018655872344970705
sim_compute_sim_state_min0.018449878692626952
sim_physics_max0.0015700513666326349
sim_physics_mean0.0014887480302290482
sim_physics_median0.0014670610427856446
sim_physics_min0.0014087200164794925
sim_render-ego_max0.03264262676239014
sim_render-ego_mean0.032099256515502925
sim_render-ego_median0.032400107383728026
sim_render-ego_min0.031295147809115326
simulation-passed1
survival_time_max0.5499999999999999
survival_time_mean0.5199999999999999
survival_time_min0.49999999999999994
No reset possible
171512336Rami Al-Naim 🇷🇺Minimal agentaido2_LF_r2-v4step1-simulationsuccessyesnutonomy-P50-58490:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07671950212339075
agent_compute-ego_mean0.0759552534146999
agent_compute-ego_median0.07588176516925588
agent_compute-ego_min0.0753469429318867
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014509137939004335, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03215740358128267, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07588176516925588, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04652148485183716, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01858125364079195, "sim_compute_performance-ego": 0.03377151138642255, "sim_compute_robot_state-ego": 0.17377720860873952}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015145521315317306, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.033956868307931085, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0753469429318867, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04668748189532568, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.018609958981710768, "sim_compute_performance-ego": 0.03384125043475439, "sim_compute_robot_state-ego": 0.03952298088679238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.001515663587130033, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03202271828284631, "in-drivable-lane": 0, "agent_compute-ego": 0.07583981660696176, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04770916058466985, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.018947920432457556, "sim_compute_performance-ego": 0.03347595288203313, "sim_compute_robot_state-ego": 0.04059020189138559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015236197448358303, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032119701548320494, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07671950212339075, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0463784874939337, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018572368272920935, "sim_compute_performance-ego": 0.03344099114580852, "sim_compute_robot_state-ego": 0.040175987452995485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.001513187885284424, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.032426881790161136, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0759882402420044, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046328163146972655, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.018584063053131105, "sim_compute_performance-ego": 0.03335740804672241, "sim_compute_robot_state-ego": 0.040138704776763914}}
set_robot_commands_max0.04770916058466985
set_robot_commands_mean0.046724955594547805
set_robot_commands_median0.04652148485183716
set_robot_commands_min0.046328163146972655
sim_compute_performance-ego_max0.03384125043475439
sim_compute_performance-ego_mean0.0335774227791482
sim_compute_performance-ego_median0.03347595288203313
sim_compute_performance-ego_min0.03335740804672241
sim_compute_robot_state-ego_max0.17377720860873952
sim_compute_robot_state-ego_mean0.06684101672333538
sim_compute_robot_state-ego_median0.040175987452995485
sim_compute_robot_state-ego_min0.03952298088679238
sim_compute_sim_state_max0.018947920432457556
sim_compute_sim_state_mean0.018659112876202463
sim_compute_sim_state_median0.018584063053131105
sim_compute_sim_state_min0.018572368272920935
sim_physics_max0.0015236197448358303
sim_physics_mean0.0015035874285364904
sim_physics_median0.0015145521315317306
sim_physics_min0.0014509137939004335
sim_render-ego_max0.033956868307931085
sim_render-ego_mean0.03253671470210834
sim_render-ego_median0.03215740358128267
sim_render-ego_min0.03202271828284631
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171482245Andrea Censi 🇨🇭Solution templateaido2_LFV_r1-v4step1-simulationabortedyesnutonomy-P50-58490:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.0777306842803955
agent_compute-ego_mean0.0765102293764927
agent_compute-ego_median0.07642972760084199
agent_compute-ego_min0.07560280140708475
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015008098938885856, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03190849458470064, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07560280140708475, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04623513712602503, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01906638986924115, "sim_compute_performance-ego": 0.03303309749154484, "sim_compute_robot_state-ego": 0.17605488791185267, "sim_compute_robot_state-npc0": 0.034055225989397836, "sim_compute_robot_state-npc1": 0.033434135072371536, "sim_compute_robot_state-npc2": 0.03319835662841797, "sim_compute_robot_state-npc3": 0.03336257443708532}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014334633236839658, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.031766043768988714, "in-drivable-lane": 0, "agent_compute-ego": 0.07679041226704915, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04618613303653778, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018697644036913676, "sim_compute_performance-ego": 0.03253160582648383, "sim_compute_robot_state-ego": 0.04662562551952544, "sim_compute_robot_state-npc0": 0.0336777028583345, "sim_compute_robot_state-npc1": 0.033316858231075226, "sim_compute_robot_state-npc2": 0.033281871250697544, "sim_compute_robot_state-npc3": 0.033542205416967}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.001451231883122371, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.032555690178504355, "in-drivable-lane": 0, "agent_compute-ego": 0.0759975213270921, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04625717309805063, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.0186646608205942, "sim_compute_performance-ego": 0.032796243520883415, "sim_compute_robot_state-ego": 0.0449036011329064, "sim_compute_robot_state-npc0": 0.033568503306462216, "sim_compute_robot_state-npc1": 0.033282166260939376, "sim_compute_robot_state-npc2": 0.033282907192523664, "sim_compute_robot_state-npc3": 0.03349476960989145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001477729983446075, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03218076578000697, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07642972760084199, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.046600527879668445, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01878787250053592, "sim_compute_performance-ego": 0.03353912946654529, "sim_compute_robot_state-ego": 0.04537484994748744, "sim_compute_robot_state-npc0": 0.03371574820541754, "sim_compute_robot_state-npc1": 0.033502817153930664, "sim_compute_robot_state-npc2": 0.03326777423300394, "sim_compute_robot_state-npc3": 0.03356817001249732}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001511070728302002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03274590969085693, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0777306842803955, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04640714168548584, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018750176429748536, "sim_compute_performance-ego": 0.0331725287437439, "sim_compute_robot_state-ego": 0.045352585315704345, "sim_compute_robot_state-npc0": 0.03375988483428955, "sim_compute_robot_state-npc1": 0.03339580535888672, "sim_compute_robot_state-npc2": 0.033349070549011234, "sim_compute_robot_state-npc3": 0.033623011112213136}}
set_robot_commands_max0.046600527879668445
set_robot_commands_mean0.046337222565153546
set_robot_commands_median0.04625717309805063
set_robot_commands_min0.04618613303653778
sim_compute_performance-ego_max0.03353912946654529
sim_compute_performance-ego_mean0.03301452100984025
sim_compute_performance-ego_median0.03303309749154484
sim_compute_performance-ego_min0.03253160582648383
sim_compute_robot_state-ego_max0.17605488791185267
sim_compute_robot_state-ego_mean0.07166230996549526
sim_compute_robot_state-ego_median0.04537484994748744
sim_compute_robot_state-ego_min0.0449036011329064
sim_compute_robot_state-npc0_max0.034055225989397836
sim_compute_robot_state-npc0_mean0.033755413038780324
sim_compute_robot_state-npc0_median0.03371574820541754
sim_compute_robot_state-npc0_min0.033568503306462216
sim_compute_robot_state-npc1_max0.033502817153930664
sim_compute_robot_state-npc1_mean0.0333863564154407
sim_compute_robot_state-npc1_median0.03339580535888672
sim_compute_robot_state-npc1_min0.033282166260939376
sim_compute_robot_state-npc2_max0.033349070549011234
sim_compute_robot_state-npc2_mean0.03327599597073087
sim_compute_robot_state-npc2_median0.033281871250697544
sim_compute_robot_state-npc2_min0.03319835662841797
sim_compute_robot_state-npc3_max0.033623011112213136
sim_compute_robot_state-npc3_mean0.033518146117730845
sim_compute_robot_state-npc3_median0.033542205416967
sim_compute_robot_state-npc3_min0.03336257443708532
sim_compute_sim_state_max0.01906638986924115
sim_compute_sim_state_mean0.018793348731406697
sim_compute_sim_state_median0.018750176429748536
sim_compute_sim_state_min0.0186646608205942
sim_physics_max0.001511070728302002
sim_physics_mean0.0014748611624886
sim_physics_median0.001477729983446075
sim_physics_min0.0014334633236839658
sim_render-ego_max0.03274590969085693
sim_render-ego_mean0.03223138080061152
sim_render-ego_median0.03218076578000697
sim_render-ego_min0.031766043768988714
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171452331Egor ZamotaevTemplate for ROS Submissionaido2_LF_r2-v4step1-simulationerroryesnutonomy-P50-58490:03:56
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171372322Bhairav MehtaBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationabortednonutonomy-P50-58490:05:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171352327Konstantin ChaikaMinimal agentaido2_LF_r2-v4step1-simulationsuccessnonutonomy-P50-58490:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07739021429201452
agent_compute-ego_mean0.07644201471927935
agent_compute-ego_median0.07603667274353997
agent_compute-ego_min0.07578539114732008
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015071525293238023, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03234335604835959, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0758900011287016, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04622111600988051, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018954999306622672, "sim_compute_performance-ego": 0.0336530138464535, "sim_compute_robot_state-ego": 0.17709599873598883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015026917533269004, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.03225303831554595, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07603667274353997, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04626207503061446, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.01873316462077792, "sim_compute_performance-ego": 0.033575523467290966, "sim_compute_robot_state-ego": 0.04044793522547162}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0014811332409198467, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03248905768761268, "in-drivable-lane": 0, "agent_compute-ego": 0.07578539114732008, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.047732001084547775, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.0188906742976262, "sim_compute_performance-ego": 0.03389719816354605, "sim_compute_robot_state-ego": 0.04046789682828463}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015366600780952267, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03235008658432379, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07739021429201452, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.046683919139024685, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.019261206068643708, "sim_compute_performance-ego": 0.034021772989412634, "sim_compute_robot_state-ego": 0.040784515985628454}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0014835667610168456, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.03295272350311279, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07710779428482056, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046556632518768314, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.01885375738143921, "sim_compute_performance-ego": 0.03377082824707031, "sim_compute_robot_state-ego": 0.04024990320205688}}
set_robot_commands_max0.047732001084547775
set_robot_commands_mean0.04669114875656715
set_robot_commands_median0.046556632518768314
set_robot_commands_min0.04622111600988051
sim_compute_performance-ego_max0.034021772989412634
sim_compute_performance-ego_mean0.03378366734275469
sim_compute_performance-ego_median0.03377082824707031
sim_compute_performance-ego_min0.033575523467290966
sim_compute_robot_state-ego_max0.17709599873598883
sim_compute_robot_state-ego_mean0.06780924999548607
sim_compute_robot_state-ego_median0.04046789682828463
sim_compute_robot_state-ego_min0.04024990320205688
sim_compute_sim_state_max0.019261206068643708
sim_compute_sim_state_mean0.018938760335021943
sim_compute_sim_state_median0.0188906742976262
sim_compute_sim_state_min0.01873316462077792
sim_physics_max0.0015366600780952267
sim_physics_mean0.0015022408725365243
sim_physics_median0.0015026917533269004
sim_physics_min0.0014811332409198467
sim_render-ego_max0.03295272350311279
sim_render-ego_mean0.03247765242779096
sim_render-ego_median0.03235008658432379
sim_render-ego_min0.03225303831554595
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171332328Konstantin ChaikaMinimal agentaido2_LFV_r1-v4step1-simulationabortednonutonomy-P50-58490:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.07682305429039932
agent_compute-ego_mean0.07585495369680312
agent_compute-ego_median0.07568262955721687
agent_compute-ego_min0.07509771225944398
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.001437534304226146, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03207673745996812, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07568262955721687, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.046403990072362566, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018678773851955637, "sim_compute_performance-ego": 0.03292810916900635, "sim_compute_robot_state-ego": 0.17474586472791784, "sim_compute_robot_state-npc0": 0.033588072832892925, "sim_compute_robot_state-npc1": 0.03317405897028306, "sim_compute_robot_state-npc2": 0.032983671216403734, "sim_compute_robot_state-npc3": 0.03337537541108973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014924813830663288, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03153861893547906, "in-drivable-lane": 0, "agent_compute-ego": 0.07509771225944398, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04606204562717014, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018693269245208255, "sim_compute_performance-ego": 0.032375782255142455, "sim_compute_robot_state-ego": 0.046671326198275125, "sim_compute_robot_state-npc0": 0.03347234120444646, "sim_compute_robot_state-npc1": 0.03322814002869621, "sim_compute_robot_state-npc2": 0.03334362166268485, "sim_compute_robot_state-npc3": 0.03346109390258789}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0015221265646127554, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.032479106462918794, "in-drivable-lane": 0, "agent_compute-ego": 0.07542308660653921, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04661436814528245, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.018776831260094277, "sim_compute_performance-ego": 0.03296650006220891, "sim_compute_robot_state-ego": 0.04501069509066069, "sim_compute_robot_state-npc0": 0.03351532862736629, "sim_compute_robot_state-npc1": 0.033123372151301456, "sim_compute_robot_state-npc2": 0.03324283819932204, "sim_compute_robot_state-npc3": 0.03361071439889761}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001487205668193538, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03222137253458907, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07682305429039932, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0468829259639833, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.019169054380277308, "sim_compute_performance-ego": 0.033163088123972825, "sim_compute_robot_state-ego": 0.045342520969669994, "sim_compute_robot_state-npc0": 0.033836806692728184, "sim_compute_robot_state-npc1": 0.03348980008102045, "sim_compute_robot_state-npc2": 0.03341694285229939, "sim_compute_robot_state-npc3": 0.03377562906683945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001472015380859375, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.033674035072326663, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07624828577041626, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04657958745956421, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018577423095703125, "sim_compute_performance-ego": 0.03315036535263061, "sim_compute_robot_state-ego": 0.04526285171508789, "sim_compute_robot_state-npc0": 0.033771843910217286, "sim_compute_robot_state-npc1": 0.03367128372192383, "sim_compute_robot_state-npc2": 0.03328863859176636, "sim_compute_robot_state-npc3": 0.03349982261657715}}
set_robot_commands_max0.0468829259639833
set_robot_commands_mean0.046508583453672536
set_robot_commands_median0.04657958745956421
set_robot_commands_min0.04606204562717014
sim_compute_performance-ego_max0.033163088123972825
sim_compute_performance-ego_mean0.03291676899259223
sim_compute_performance-ego_median0.03296650006220891
sim_compute_performance-ego_min0.032375782255142455
sim_compute_robot_state-ego_max0.17474586472791784
sim_compute_robot_state-ego_mean0.0714066517403223
sim_compute_robot_state-ego_median0.045342520969669994
sim_compute_robot_state-ego_min0.04501069509066069
sim_compute_robot_state-npc0_max0.033836806692728184
sim_compute_robot_state-npc0_mean0.033636878653530225
sim_compute_robot_state-npc0_median0.033588072832892925
sim_compute_robot_state-npc0_min0.03347234120444646
sim_compute_robot_state-npc1_max0.03367128372192383
sim_compute_robot_state-npc1_mean0.033337330990644995
sim_compute_robot_state-npc1_median0.03322814002869621
sim_compute_robot_state-npc1_min0.033123372151301456
sim_compute_robot_state-npc2_max0.03341694285229939
sim_compute_robot_state-npc2_mean0.03325514250449528
sim_compute_robot_state-npc2_median0.03328863859176636
sim_compute_robot_state-npc2_min0.032983671216403734
sim_compute_robot_state-npc3_max0.03377562906683945
sim_compute_robot_state-npc3_mean0.03354452707919836
sim_compute_robot_state-npc3_median0.03349982261657715
sim_compute_robot_state-npc3_min0.03337537541108973
sim_compute_sim_state_max0.019169054380277308
sim_compute_sim_state_mean0.01877907036664772
sim_compute_sim_state_median0.018693269245208255
sim_compute_sim_state_min0.018577423095703125
sim_physics_max0.0015221265646127554
sim_physics_mean0.0014822726601916286
sim_physics_median0.001487205668193538
sim_physics_min0.001437534304226146
sim_render-ego_max0.033674035072326663
sim_render-ego_mean0.03239797409305634
sim_render-ego_median0.03222137253458907
sim_render-ego_min0.03153861893547906
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171292324Nikhil Khedekar 🇮🇳PredictorLastaido2-PREDstep1-simulationabortednonutonomy-P50-58490:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12269842301218904
error_L20.022717973746273348


No reset possible
171242328Konstantin ChaikaMinimal agentaido2_LFV_r1-v4step1-simulationtimeoutnonutonomy-P50-5849----No reset possible
171192320FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornonutonomy-P50-58490:06:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible