Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17188
2252
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error yes nutonomy-P50-5849
2019-04-11 17:23:53+00:00 2019-04-11 17:54:46+00:00 0:30:53 Timeout:
Waited 180 [...] Timeout:
Waited 1803.6370005607605 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17181
2269
Andrea Censi 🇨🇭Solution template aido2_LFV_r1-v4
step1-simulation aborted yes nutonomy-P50-5849
2019-04-11 17:13:45+00:00 2019-04-11 17:23:38+00:00 0:09:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07706819220287044 agent_compute-ego_mean 0.0760943354637106 agent_compute-ego_median 0.07614714758736747 agent_compute-ego_min 0.07550797392340268 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014762177186853746, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.032125616774839515, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07550797392340268, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04638754620271571, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.019275149878333595, "sim_compute_performance-ego": 0.03305663080776439, "sim_compute_robot_state-ego": 0.17487922836752498, "sim_compute_robot_state-npc0": 0.0336641038165373, "sim_compute_robot_state-npc1": 0.03335954161251292, "sim_compute_robot_state-npc2": 0.03310798196231618, "sim_compute_robot_state-npc3": 0.03344241661183974}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014655362992059616, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.031876681342957514, "in-drivable-lane": 0, "agent_compute-ego": 0.07614714758736747, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04626201447986421, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018802517936343237, "sim_compute_performance-ego": 0.03271453721182687, "sim_compute_robot_state-ego": 0.04646347061036125, "sim_compute_robot_state-npc0": 0.03369352552625868, "sim_compute_robot_state-npc1": 0.03334036327543713, "sim_compute_robot_state-npc2": 0.03347139509897384, "sim_compute_robot_state-npc3": 0.03376166782681904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0014916640061598558, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03252247663644644, "in-drivable-lane": 0, "agent_compute-ego": 0.07554019414461575, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04655792529766376, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01866010152376615, "sim_compute_performance-ego": 0.03298428975618803, "sim_compute_robot_state-ego": 0.044980569986196664, "sim_compute_robot_state-npc0": 0.033653901173518255, "sim_compute_robot_state-npc1": 0.033478025289682245, "sim_compute_robot_state-npc2": 0.033159784170297475, "sim_compute_robot_state-npc3": 0.033443197837242714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0014937243810514123, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03206893583623374, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07706819220287044, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04646545212443282, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018706909040125404, "sim_compute_performance-ego": 0.03340404208113507, "sim_compute_robot_state-ego": 0.045504444982947374, "sim_compute_robot_state-npc0": 0.03373261486611715, "sim_compute_robot_state-npc1": 0.03351197010133325, "sim_compute_robot_state-npc2": 0.03329661997353158, "sim_compute_robot_state-npc3": 0.03364214373797905}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0014646172523498536, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03249918937683106, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07620816946029663, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.046327519416809085, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018773396015167237, "sim_compute_performance-ego": 0.03291619062423706, "sim_compute_robot_state-ego": 0.04530252933502197, "sim_compute_robot_state-npc0": 0.033846604824066165, "sim_compute_robot_state-npc1": 0.03362612009048462, "sim_compute_robot_state-npc2": 0.03340879201889038, "sim_compute_robot_state-npc3": 0.033754591941833494}}set_robot_commands_max 0.04655792529766376 set_robot_commands_mean 0.046400091504297115 set_robot_commands_median 0.04638754620271571 set_robot_commands_min 0.04626201447986421 sim_compute_performance-ego_max 0.03340404208113507 sim_compute_performance-ego_mean 0.03301513809623029 sim_compute_performance-ego_median 0.03298428975618803 sim_compute_performance-ego_min 0.03271453721182687 sim_compute_robot_state-ego_max 0.17487922836752498 sim_compute_robot_state-ego_mean 0.07142604865641045 sim_compute_robot_state-ego_median 0.045504444982947374 sim_compute_robot_state-ego_min 0.044980569986196664 sim_compute_robot_state-npc0_max 0.033846604824066165 sim_compute_robot_state-npc0_mean 0.03371815004129951 sim_compute_robot_state-npc0_median 0.03369352552625868 sim_compute_robot_state-npc0_min 0.033653901173518255 sim_compute_robot_state-npc1_max 0.03362612009048462 sim_compute_robot_state-npc1_mean 0.033463204073890036 sim_compute_robot_state-npc1_median 0.033478025289682245 sim_compute_robot_state-npc1_min 0.03334036327543713 sim_compute_robot_state-npc2_max 0.03347139509897384 sim_compute_robot_state-npc2_mean 0.033288914644801895 sim_compute_robot_state-npc2_median 0.03329661997353158 sim_compute_robot_state-npc2_min 0.03310798196231618 sim_compute_robot_state-npc3_max 0.03376166782681904 sim_compute_robot_state-npc3_mean 0.03360880359114281 sim_compute_robot_state-npc3_median 0.03364214373797905 sim_compute_robot_state-npc3_min 0.03344241661183974 sim_compute_sim_state_max 0.019275149878333595 sim_compute_sim_state_mean 0.018843614878747125 sim_compute_sim_state_median 0.018773396015167237 sim_compute_sim_state_min 0.01866010152376615 sim_physics_max 0.0014937243810514123 sim_physics_mean 0.0014783519314904917 sim_physics_median 0.0014762177186853746 sim_physics_min 0.0014646172523498536 sim_render-ego_max 0.03252247663644644 sim_render-ego_mean 0.03221857999346166 sim_render-ego_median 0.032125616774839515 sim_render-ego_min 0.031876681342957514 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17174
2286
Andrea Censi 🇨🇭Minimal agent aido2_LFVI_r1-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 17:01:46+00:00 2019-04-11 17:13:07+00:00 0:11:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.72155331423772 survival_time_median 4.249999999999993 deviation-center-line_median 0.15741823007542524 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.07631754875183105 agent_compute-ego_mean 0.07584918305653372 agent_compute-ego_median 0.07581065563445395 agent_compute-ego_min 0.07547764217152315 deviation-center-line_max 0.32861340027620084 deviation-center-line_mean 0.16720563088123774 deviation-center-line_min 0.08372346350452832 deviation-heading_max 1.6095487863912878 deviation-heading_mean 0.7416120746207572 deviation-heading_median 0.6111580236941071 deviation-heading_min 0.3663194255812494 driven_any_max 2.174849274549989 driven_any_mean 1.370290316170529 driven_any_median 1.2632550932005688 driven_any_min 0.9890108043245008 driven_lanedir_consec_max 1.0300199271670714 driven_lanedir_consec_mean 0.7679244191832472 driven_lanedir_consec_min 0.523101221541693 driven_lanedir_max 1.0586376106182156 driven_lanedir_mean 0.773647955873476 driven_lanedir_median 0.72155331423772 driven_lanedir_min 0.523101221541693 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.7699999999999938 in-drivable-lane_min 0.1999999999999993 per-episodes details {"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0014636269931135506, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.032300797824201914, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07568215994999326, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.04622732030934301, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018652669314680428, "sim_compute_performance-ego": 0.03240336220839928, "sim_compute_robot_state-ego": 0.10638790623895052, "sim_compute_robot_state-npc0": 0.03353539006463412, "sim_compute_robot_state-npc1": 0.033196110560976225, "sim_compute_robot_state-npc2": 0.033239517540767274, "sim_compute_robot_state-npc3": 0.0335301843182794}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0014905965689456823, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.034252018639535614, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0759579087748672, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.04639783772555264, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.01855175422899651, "sim_compute_performance-ego": 0.03275048371517297, "sim_compute_robot_state-ego": 0.04682607361764619, "sim_compute_robot_state-npc0": 0.033440597129590584, "sim_compute_robot_state-npc1": 0.033744064244357025, "sim_compute_robot_state-npc2": 0.033171249158454666, "sim_compute_robot_state-npc3": 0.03332898833534934}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.001460899697973373, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.03229300772890131, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07581065563445395, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04736743582055924, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.018615664319789157, "sim_compute_performance-ego": 0.032694801371148295, "sim_compute_robot_state-ego": 0.04810395900239336, "sim_compute_robot_state-npc0": 0.03359165090195676, "sim_compute_robot_state-npc1": 0.0331771525930851, "sim_compute_robot_state-npc2": 0.03307489131359344, "sim_compute_robot_state-npc3": 0.0333564966282946}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0014544907738180722, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03231317015255199, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07631754875183105, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.0463235153871424, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.018997663610121784, "sim_compute_performance-ego": 0.03261614687302533, "sim_compute_robot_state-ego": 0.0477872231427361, "sim_compute_robot_state-npc0": 0.03343502773958094, "sim_compute_robot_state-npc1": 0.03318642728468951, "sim_compute_robot_state-npc2": 0.03308435608358944, "sim_compute_robot_state-npc3": 0.03475031852722168}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0014843379749971278, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.032036139684564924, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07547764217152315, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.04772067771238439, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.01872180840548347, "sim_compute_performance-ego": 0.03274516848956838, "sim_compute_robot_state-ego": 0.04719219488256118, "sim_compute_robot_state-npc0": 0.03341654819600722, "sim_compute_robot_state-npc1": 0.03332254465888528, "sim_compute_robot_state-npc2": 0.033164627411786246, "sim_compute_robot_state-npc3": 0.03340716922984404}}set_robot_commands_max 0.04772067771238439 set_robot_commands_mean 0.04680735739099634 set_robot_commands_median 0.04639783772555264 set_robot_commands_min 0.04622732030934301 sim_compute_performance-ego_max 0.03275048371517297 sim_compute_performance-ego_mean 0.032641992531462855 sim_compute_performance-ego_median 0.032694801371148295 sim_compute_performance-ego_min 0.03240336220839928 sim_compute_robot_state-ego_max 0.10638790623895052 sim_compute_robot_state-ego_mean 0.05925947137685746 sim_compute_robot_state-ego_median 0.0477872231427361 sim_compute_robot_state-ego_min 0.04682607361764619 sim_compute_robot_state-npc0_max 0.03359165090195676 sim_compute_robot_state-npc0_mean 0.03348384280635393 sim_compute_robot_state-npc0_median 0.033440597129590584 sim_compute_robot_state-npc0_min 0.03341654819600722 sim_compute_robot_state-npc1_max 0.033744064244357025 sim_compute_robot_state-npc1_mean 0.033325259868398634 sim_compute_robot_state-npc1_median 0.033196110560976225 sim_compute_robot_state-npc1_min 0.0331771525930851 sim_compute_robot_state-npc2_max 0.033239517540767274 sim_compute_robot_state-npc2_mean 0.033146928301638214 sim_compute_robot_state-npc2_median 0.033164627411786246 sim_compute_robot_state-npc2_min 0.03307489131359344 sim_compute_robot_state-npc3_max 0.03475031852722168 sim_compute_robot_state-npc3_mean 0.03367463140779782 sim_compute_robot_state-npc3_median 0.03340716922984404 sim_compute_robot_state-npc3_min 0.03332898833534934 sim_compute_sim_state_max 0.018997663610121784 sim_compute_sim_state_mean 0.01870791197581427 sim_compute_sim_state_median 0.018652669314680428 sim_compute_sim_state_min 0.01855175422899651 sim_physics_max 0.0014905965689456823 sim_physics_mean 0.0014707904017695612 sim_physics_median 0.0014636269931135506 sim_physics_min 0.0014544907738180722 sim_render-ego_max 0.034252018639535614 sim_render-ego_mean 0.032639026805951155 sim_render-ego_median 0.032300797824201914 sim_render-ego_min 0.032036139684564924 simulation-passed 1 survival_time_max 7.249999999999982 survival_time_mean 4.579999999999992 survival_time_min 3.2999999999999963
No reset possible 17170
2293
Andrea Censi 🇨🇭Minimal agent aido2_LFVI_r1-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 16:49:58+00:00 2019-04-11 17:01:39+00:00 0:11:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.72155331423772 survival_time_median 4.249999999999993 deviation-center-line_median 0.15741823007542524 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.07828737750197902 agent_compute-ego_mean 0.07676037190858452 agent_compute-ego_median 0.07656666110543643 agent_compute-ego_min 0.07590890211217544 deviation-center-line_max 0.32861340027620084 deviation-center-line_mean 0.16720563088123774 deviation-center-line_min 0.08372346350452832 deviation-heading_max 1.6095487863912878 deviation-heading_mean 0.7416120746207572 deviation-heading_median 0.6111580236941071 deviation-heading_min 0.3663194255812494 driven_any_max 2.174849274549989 driven_any_mean 1.370290316170529 driven_any_median 1.2632550932005688 driven_any_min 0.9890108043245008 driven_lanedir_consec_max 1.0300199271670714 driven_lanedir_consec_mean 0.7679244191832472 driven_lanedir_consec_min 0.523101221541693 driven_lanedir_max 1.0586376106182156 driven_lanedir_mean 0.773647955873476 driven_lanedir_median 0.72155331423772 driven_lanedir_min 0.523101221541693 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.7699999999999938 in-drivable-lane_min 0.1999999999999993 per-episodes details {"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0014798197252997036, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.03250889778137207, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.07599182951039281, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.04641186451089793, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.018604030280277645, "sim_compute_performance-ego": 0.03259072139345366, "sim_compute_robot_state-ego": 0.10588787177513384, "sim_compute_robot_state-npc0": 0.03364472718074404, "sim_compute_robot_state-npc1": 0.03316087229498502, "sim_compute_robot_state-npc2": 0.033147073614186257, "sim_compute_robot_state-npc3": 0.03339916590986581}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.0014788020740855825, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.032391866048177086, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.07828737750197902, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.04682979800484397, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.01867953575018681, "sim_compute_performance-ego": 0.032982472217444214, "sim_compute_robot_state-ego": 0.04707208907965458, "sim_compute_robot_state-npc0": 0.033713521379413025, "sim_compute_robot_state-npc1": 0.03381280104319254, "sim_compute_robot_state-npc2": 0.033086599725665466, "sim_compute_robot_state-npc3": 0.033320166847922585}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.001506861220014856, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.03240635547232121, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.07704708931293894, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.04658472537994385, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.018631853955857296, "sim_compute_performance-ego": 0.03273191857845225, "sim_compute_robot_state-ego": 0.04789680876630418, "sim_compute_robot_state-npc0": 0.03368024876777162, "sim_compute_robot_state-npc1": 0.03331094092511116, "sim_compute_robot_state-npc2": 0.03314949603790932, "sim_compute_robot_state-npc3": 0.03341184017506051}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.00149839345146628, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.03232073503382066, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07590890211217544, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.048116423101986154, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.018988802853752585, "sim_compute_performance-ego": 0.032653284072875974, "sim_compute_robot_state-ego": 0.04807809941908892, "sim_compute_robot_state-npc0": 0.03369444678811466, "sim_compute_robot_state-npc1": 0.0331659288967357, "sim_compute_robot_state-npc2": 0.03308916091918945, "sim_compute_robot_state-npc3": 0.03334452965680291}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0014945128384758445, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.032581984996795654, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07656666110543643, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.04868121708140654, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.01875375649508308, "sim_compute_performance-ego": 0.03331587595098159, "sim_compute_robot_state-ego": 0.047048267196206486, "sim_compute_robot_state-npc0": 0.033759025966419894, "sim_compute_robot_state-npc1": 0.03351500104455387, "sim_compute_robot_state-npc2": 0.0332757970866035, "sim_compute_robot_state-npc3": 0.033642982735353356}}set_robot_commands_max 0.04868121708140654 set_robot_commands_mean 0.04732480561581569 set_robot_commands_median 0.04682979800484397 set_robot_commands_min 0.04641186451089793 sim_compute_performance-ego_max 0.03331587595098159 sim_compute_performance-ego_mean 0.03285485444264154 sim_compute_performance-ego_median 0.03273191857845225 sim_compute_performance-ego_min 0.03259072139345366 sim_compute_robot_state-ego_max 0.10588787177513384 sim_compute_robot_state-ego_mean 0.0591966272472776 sim_compute_robot_state-ego_median 0.04789680876630418 sim_compute_robot_state-ego_min 0.047048267196206486 sim_compute_robot_state-npc0_max 0.033759025966419894 sim_compute_robot_state-npc0_mean 0.03369839401649265 sim_compute_robot_state-npc0_median 0.03369444678811466 sim_compute_robot_state-npc0_min 0.03364472718074404 sim_compute_robot_state-npc1_max 0.03381280104319254 sim_compute_robot_state-npc1_mean 0.03339310884091566 sim_compute_robot_state-npc1_median 0.03331094092511116 sim_compute_robot_state-npc1_min 0.03316087229498502 sim_compute_robot_state-npc2_max 0.0332757970866035 sim_compute_robot_state-npc2_mean 0.0331496254767108 sim_compute_robot_state-npc2_median 0.033147073614186257 sim_compute_robot_state-npc2_min 0.033086599725665466 sim_compute_robot_state-npc3_max 0.033642982735353356 sim_compute_robot_state-npc3_mean 0.03342373706500103 sim_compute_robot_state-npc3_median 0.03339916590986581 sim_compute_robot_state-npc3_min 0.033320166847922585 sim_compute_sim_state_max 0.018988802853752585 sim_compute_sim_state_mean 0.018731595867031485 sim_compute_sim_state_median 0.01867953575018681 sim_compute_sim_state_min 0.018604030280277645 sim_physics_max 0.001506861220014856 sim_physics_mean 0.0014916778618684532 sim_physics_median 0.0014945128384758445 sim_physics_min 0.0014788020740855825 sim_render-ego_max 0.032581984996795654 sim_render-ego_mean 0.032441967866497334 sim_render-ego_median 0.03240635547232121 sim_render-ego_min 0.03232073503382066 simulation-passed 1 survival_time_max 7.249999999999982 survival_time_mean 4.579999999999992 survival_time_min 3.2999999999999963
No reset possible 17168
2304
Andrea Censi 🇨🇭Minimal agent aido2_LF_r2-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 16:43:27+00:00 2019-04-11 16:49:45+00:00 0:06:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07810876136872827 agent_compute-ego_mean 0.07687530681128803 agent_compute-ego_median 0.07662056741260347 agent_compute-ego_min 0.07641434302696815 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015059183625613945, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03219486685360179, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07660231520147885, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.046800634440253765, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018662954078001136, "sim_compute_performance-ego": 0.033605810473946965, "sim_compute_robot_state-ego": 0.1751603063415079}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015288042643713572, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.0340259832049173, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07662056741260347, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04697196067325653, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.01868521977984716, "sim_compute_performance-ego": 0.03398631111023918, "sim_compute_robot_state-ego": 0.04000114637707907}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0015138516059288612, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03235052915719839, "in-drivable-lane": 0, "agent_compute-ego": 0.07641434302696815, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04800580098078801, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.018769022134634165, "sim_compute_performance-ego": 0.033585005540114184, "sim_compute_robot_state-ego": 0.04001879692077637}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015229190268167636, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032257382462664345, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07810876136872827, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04689712059207079, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01878103105033316, "sim_compute_performance-ego": 0.03376832822474038, "sim_compute_robot_state-ego": 0.040285311094144495}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.001498422622680664, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.03312928438186646, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07663054704666138, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046857035160064696, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.018720502853393554, "sim_compute_performance-ego": 0.033865969181060794, "sim_compute_robot_state-ego": 0.04026498556137085}}set_robot_commands_max 0.04800580098078801 set_robot_commands_mean 0.047106510369286765 set_robot_commands_median 0.04689712059207079 set_robot_commands_min 0.046800634440253765 sim_compute_performance-ego_max 0.03398631111023918 sim_compute_performance-ego_mean 0.033762284906020304 sim_compute_performance-ego_median 0.03376832822474038 sim_compute_performance-ego_min 0.033585005540114184 sim_compute_robot_state-ego_max 0.1751603063415079 sim_compute_robot_state-ego_mean 0.06714610925897574 sim_compute_robot_state-ego_median 0.04026498556137085 sim_compute_robot_state-ego_min 0.04000114637707907 sim_compute_sim_state_max 0.01878103105033316 sim_compute_sim_state_mean 0.018723745979241833 sim_compute_sim_state_median 0.018720502853393554 sim_compute_sim_state_min 0.018662954078001136 sim_physics_max 0.0015288042643713572 sim_physics_mean 0.001513983176471808 sim_physics_median 0.0015138516059288612 sim_physics_min 0.001498422622680664 sim_render-ego_max 0.0340259832049173 sim_render-ego_mean 0.03279160921204966 sim_render-ego_median 0.03235052915719839 sim_render-ego_min 0.03219486685360179 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17166
2305
Andrea Censi 🇨🇭Minimal agent aido2_LFV_r1-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 16:33:13+00:00 2019-04-11 16:42:57+00:00 0:09:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07609513927908505 agent_compute-ego_mean 0.07577490238911797 agent_compute-ego_median 0.0758683967590332 agent_compute-ego_min 0.07523613884335473 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014873497626360726, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.031977460664861346, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07609513927908505, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04623278098947862, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01905967207515941, "sim_compute_performance-ego": 0.03298173581852632, "sim_compute_robot_state-ego": 0.17276647511650534, "sim_compute_robot_state-npc0": 0.03332474301843082, "sim_compute_robot_state-npc1": 0.03328318455640007, "sim_compute_robot_state-npc2": 0.03315379339105943, "sim_compute_robot_state-npc3": 0.033730598057017606}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.001543722455463712, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03181245213463193, "in-drivable-lane": 0, "agent_compute-ego": 0.07523613884335473, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04628039163256448, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018548238845098583, "sim_compute_performance-ego": 0.032618734571668834, "sim_compute_robot_state-ego": 0.046474101051451666, "sim_compute_robot_state-npc0": 0.03346389437478686, "sim_compute_robot_state-npc1": 0.033350857477339485, "sim_compute_robot_state-npc2": 0.033074216237143864, "sim_compute_robot_state-npc3": 0.03321971590556796}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0015037793379563552, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.03211207756629357, "in-drivable-lane": 0, "agent_compute-ego": 0.07577246519235464, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04811518742487981, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.01856262133671687, "sim_compute_performance-ego": 0.03276462188133827, "sim_compute_robot_state-ego": 0.04495434394249549, "sim_compute_robot_state-npc0": 0.034241764362041766, "sim_compute_robot_state-npc1": 0.03343481650719276, "sim_compute_robot_state-npc2": 0.03317414063673753, "sim_compute_robot_state-npc3": 0.03333921065697303}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015033628882431403, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03247117705461455, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07590237187176216, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.04675098454079977, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01875987576275337, "sim_compute_performance-ego": 0.03347052597418064, "sim_compute_robot_state-ego": 0.04533387393486209, "sim_compute_robot_state-npc0": 0.03388534231883723, "sim_compute_robot_state-npc1": 0.03390679708341273, "sim_compute_robot_state-npc2": 0.03347545426066329, "sim_compute_robot_state-npc3": 0.033722301808799184}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0014706778526306153, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03242829084396362, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0758683967590332, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04609720230102539, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018639745712280272, "sim_compute_performance-ego": 0.03310199499130249, "sim_compute_robot_state-ego": 0.04458147764205933, "sim_compute_robot_state-npc0": 0.03364508628845215, "sim_compute_robot_state-npc1": 0.0333996844291687, "sim_compute_robot_state-npc2": 0.033185951709747315, "sim_compute_robot_state-npc3": 0.03347230672836304}}set_robot_commands_max 0.04811518742487981 set_robot_commands_mean 0.046695309377749614 set_robot_commands_median 0.04628039163256448 set_robot_commands_min 0.04609720230102539 sim_compute_performance-ego_max 0.03347052597418064 sim_compute_performance-ego_mean 0.0329875226474033 sim_compute_performance-ego_median 0.03298173581852632 sim_compute_performance-ego_min 0.032618734571668834 sim_compute_robot_state-ego_max 0.17276647511650534 sim_compute_robot_state-ego_mean 0.07082205433747478 sim_compute_robot_state-ego_median 0.04533387393486209 sim_compute_robot_state-ego_min 0.04458147764205933 sim_compute_robot_state-npc0_max 0.034241764362041766 sim_compute_robot_state-npc0_mean 0.033712166072509764 sim_compute_robot_state-npc0_median 0.03364508628845215 sim_compute_robot_state-npc0_min 0.03332474301843082 sim_compute_robot_state-npc1_max 0.03390679708341273 sim_compute_robot_state-npc1_mean 0.03347506801070275 sim_compute_robot_state-npc1_median 0.0333996844291687 sim_compute_robot_state-npc1_min 0.03328318455640007 sim_compute_robot_state-npc2_max 0.03347545426066329 sim_compute_robot_state-npc2_mean 0.03321271124707029 sim_compute_robot_state-npc2_median 0.03317414063673753 sim_compute_robot_state-npc2_min 0.033074216237143864 sim_compute_robot_state-npc3_max 0.033730598057017606 sim_compute_robot_state-npc3_mean 0.033496826631344165 sim_compute_robot_state-npc3_median 0.03347230672836304 sim_compute_robot_state-npc3_min 0.03321971590556796 sim_compute_sim_state_max 0.01905967207515941 sim_compute_sim_state_mean 0.018714030746401704 sim_compute_sim_state_median 0.018639745712280272 sim_compute_sim_state_min 0.018548238845098583 sim_physics_max 0.001543722455463712 sim_physics_mean 0.001501778459385979 sim_physics_median 0.0015033628882431403 sim_physics_min 0.0014706778526306153 sim_render-ego_max 0.03247117705461455 sim_render-ego_mean 0.032160291652873 sim_render-ego_median 0.03211207756629357 sim_render-ego_min 0.03181245213463193 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17164
2262
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error yes nutonomy-P50-5849
2019-04-11 16:31:31+00:00 2019-04-11 16:32:14+00:00 0:00:43 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17160
2316
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 16:22:40+00:00 2019-04-11 16:30:38+00:00 0:07:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1889327024068811 survival_time_median 1.3500000000000003 deviation-center-line_median 0.07930110646342275 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10562616128187911 agent_compute-ego_mean 0.10426284493980828 agent_compute-ego_median 0.10447671678331164 agent_compute-ego_min 0.10302206448146276 deviation-center-line_max 0.08637207771856689 deviation-center-line_mean 0.08043176208297143 deviation-center-line_min 0.07768715335965017 deviation-heading_max 0.7560020895565267 deviation-heading_mean 0.7012478099149824 deviation-heading_median 0.7041554170496334 deviation-heading_min 0.6563074448529416 driven_any_max 0.24379195497535736 driven_any_mean 0.23107259326918625 driven_any_median 0.23110384454558772 driven_any_min 0.2212341045831002 driven_lanedir_consec_max 0.20321244067472088 driven_lanedir_consec_mean 0.18805342377703055 driven_lanedir_consec_min 0.17277119420330234 driven_lanedir_max 0.20321244067472088 driven_lanedir_mean 0.18805342377703055 driven_lanedir_median 0.1889327024068811 driven_lanedir_min 0.17277119420330234 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2315603497426763, "sim_physics": 0.0014290809631347656, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19052930465595488, "sim_render-ego": 0.032666949125436634, "in-drivable-lane": 0, "agent_compute-ego": 0.10562616128187911, "deviation-heading": 0.6563074448529416, "set_robot_commands": 0.048172602286705606, "deviation-center-line": 0.07768715335965017, "driven_lanedir_consec": 0.19052930465595488, "sim_compute_sim_state": 0.01917397975921631, "sim_compute_performance-ego": 0.03374328980079064, "sim_compute_robot_state-ego": 0.4110114207634559}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23110384454558772, "sim_physics": 0.001494790826525007, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1889327024068811, "sim_render-ego": 0.03168929474694388, "in-drivable-lane": 0, "agent_compute-ego": 0.10302206448146276, "deviation-heading": 0.7272051642922797, "set_robot_commands": 0.047078345503125875, "deviation-center-line": 0.08637207771856689, "driven_lanedir_consec": 0.1889327024068811, "sim_compute_sim_state": 0.019199149949210032, "sim_compute_performance-ego": 0.0335243855203901, "sim_compute_robot_state-ego": 0.0399353163582938}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24379195497535736, "sim_physics": 0.0014904907771519252, "survival_time": 1.4000000000000006, "driven_lanedir": 0.20321244067472088, "sim_render-ego": 0.032170619283403666, "in-drivable-lane": 0, "agent_compute-ego": 0.10311371088027954, "deviation-heading": 0.6625689338235301, "set_robot_commands": 0.05058394159589495, "deviation-center-line": 0.0791768746457932, "driven_lanedir_consec": 0.20321244067472088, "sim_compute_sim_state": 0.019092346940721785, "sim_compute_performance-ego": 0.0339882458959307, "sim_compute_robot_state-ego": 0.04053327015468052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.0015634430779351129, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.03356183016741717, "in-drivable-lane": 0, "agent_compute-ego": 0.10447671678331164, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.04768821045204445, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.01938915252685547, "sim_compute_performance-ego": 0.034060531192355685, "sim_compute_robot_state-ego": 0.04180775748358832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.001507299917715567, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.033399599569815176, "in-drivable-lane": 0, "agent_compute-ego": 0.10507557127210829, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.04748947532088668, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.01931741502549913, "sim_compute_performance-ego": 0.03430034496166088, "sim_compute_robot_state-ego": 0.04077381557888455}}set_robot_commands_max 0.05058394159589495 set_robot_commands_mean 0.048202515031731515 set_robot_commands_median 0.04768821045204445 set_robot_commands_min 0.047078345503125875 sim_compute_performance-ego_max 0.03430034496166088 sim_compute_performance-ego_mean 0.0339233594742256 sim_compute_performance-ego_median 0.0339882458959307 sim_compute_performance-ego_min 0.0335243855203901 sim_compute_robot_state-ego_max 0.4110114207634559 sim_compute_robot_state-ego_mean 0.1148123160677806 sim_compute_robot_state-ego_median 0.04077381557888455 sim_compute_robot_state-ego_min 0.0399353163582938 sim_compute_sim_state_max 0.01938915252685547 sim_compute_sim_state_mean 0.019234408840300542 sim_compute_sim_state_median 0.019199149949210032 sim_compute_sim_state_min 0.019092346940721785 sim_physics_max 0.0015634430779351129 sim_physics_mean 0.0014970211124924757 sim_physics_median 0.001494790826525007 sim_physics_min 0.0014290809631347656 sim_render-ego_max 0.03356183016741717 sim_render-ego_mean 0.03269765857860331 sim_render-ego_median 0.032666949125436634 sim_render-ego_min 0.03168929474694388 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.3600000000000003 survival_time_min 1.3000000000000005
No reset possible 17156
2322
Bhairav Mehta Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation aborted yes nutonomy-P50-5849
2019-04-11 16:14:28+00:00 2019-04-11 16:21:40+00:00 0:07:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.18115448860868355 survival_time_median 2.6499999999999986 deviation-center-line_median 0.07130941208466557 in-drivable-lane_median 1.2499999999999991
other stats agent_compute-ego_max 0.08548740104392723 agent_compute-ego_mean 0.08360005027850591 agent_compute-ego_median 0.08312222642718621 agent_compute-ego_min 0.08290476412386508 deviation-center-line_max 0.13054586090860865 deviation-center-line_mean 0.07758188488958014 deviation-center-line_min 0.046894931925083094 deviation-heading_max 4.553788058129419 deviation-heading_mean 1.6839894722513862 deviation-heading_median 1.066927048944359 deviation-heading_min 0.686127211701689 driven_any_max 2.190232673825663 driven_any_mean 0.8327911013903446 driven_any_median 0.543949815241968 driven_any_min 0.3818078306559801 driven_lanedir_consec_max 0.6272349062546385 driven_lanedir_consec_mean 0.25652428459555965 driven_lanedir_consec_min 0.1044210468949689 driven_lanedir_max 0.6272349062546385 driven_lanedir_mean 0.25652428459555965 driven_lanedir_median 0.18115448860868355 driven_lanedir_min 0.1044210468949689 in-drivable-lane_max 5.900000000000017 in-drivable-lane_mean 2.130000000000003 in-drivable-lane_min 0.9500000000000004 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.190232673825663, "sim_physics": 0.0015846796524830351, "survival_time": 11.700000000000031, "driven_lanedir": 0.6272349062546385, "sim_render-ego": 0.03203771664546086, "in-drivable-lane": 5.900000000000017, "agent_compute-ego": 0.08346324700575608, "deviation-heading": 4.553788058129419, "set_robot_commands": 0.046495592492258445, "deviation-center-line": 0.13054586090860865, "driven_lanedir_consec": 0.6272349062546385, "sim_compute_sim_state": 0.01854965727553408, "sim_compute_performance-ego": 0.03329387281694983, "sim_compute_robot_state-ego": 0.07903645894466302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3818078306559801, "sim_physics": 0.0014860243410677522, "survival_time": 1.850000000000001, "driven_lanedir": 0.1044210468949689, "sim_render-ego": 0.03184560182932261, "in-drivable-lane": 0.9500000000000004, "agent_compute-ego": 0.08290476412386508, "deviation-heading": 0.686127211701689, "set_robot_commands": 0.04636118218705461, "deviation-center-line": 0.046894931925083094, "driven_lanedir_consec": 0.1044210468949689, "sim_compute_sim_state": 0.01847454019494959, "sim_compute_performance-ego": 0.03310313740292111, "sim_compute_robot_state-ego": 0.039510778478673986}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4962957893277826, "sim_physics": 0.0015758413534898025, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1736030292291466, "sim_render-ego": 0.03246523783757137, "in-drivable-lane": 1.2499999999999991, "agent_compute-ego": 0.083022612791795, "deviation-heading": 1.0371483598111588, "set_robot_commands": 0.046908754568833574, "deviation-center-line": 0.07130941208466557, "driven_lanedir_consec": 0.1736030292291466, "sim_compute_sim_state": 0.018793821334838867, "sim_compute_performance-ego": 0.03361853269430307, "sim_compute_robot_state-ego": 0.04010574175761296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.543949815241968, "sim_physics": 0.001498582228174749, "survival_time": 2.6499999999999986, "driven_lanedir": 0.18115448860868355, "sim_render-ego": 0.03227497046848513, "in-drivable-lane": 1.2499999999999991, "agent_compute-ego": 0.08312222642718621, "deviation-heading": 1.0759566826703049, "set_robot_commands": 0.04648380459479566, "deviation-center-line": 0.0592082218341978, "driven_lanedir_consec": 0.18115448860868355, "sim_compute_sim_state": 0.01852653161534723, "sim_compute_performance-ego": 0.0334918184100457, "sim_compute_robot_state-ego": 0.04005707434888156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5516693979003289, "sim_physics": 0.0014663095827455873, "survival_time": 2.6999999999999984, "driven_lanedir": 0.19620795199036056, "sim_render-ego": 0.03253434322498463, "in-drivable-lane": 1.299999999999999, "agent_compute-ego": 0.08548740104392723, "deviation-heading": 1.066927048944359, "set_robot_commands": 0.04653683415165654, "deviation-center-line": 0.0799509976953455, "driven_lanedir_consec": 0.19620795199036056, "sim_compute_sim_state": 0.01872071071907326, "sim_compute_performance-ego": 0.03349661385571515, "sim_compute_robot_state-ego": 0.0405782593621148}}set_robot_commands_max 0.046908754568833574 set_robot_commands_mean 0.04655723359891976 set_robot_commands_median 0.046495592492258445 set_robot_commands_min 0.04636118218705461 sim_compute_performance-ego_max 0.03361853269430307 sim_compute_performance-ego_mean 0.03340079503598697 sim_compute_performance-ego_median 0.0334918184100457 sim_compute_performance-ego_min 0.03310313740292111 sim_compute_robot_state-ego_max 0.07903645894466302 sim_compute_robot_state-ego_mean 0.04785766257838926 sim_compute_robot_state-ego_median 0.04010574175761296 sim_compute_robot_state-ego_min 0.039510778478673986 sim_compute_sim_state_max 0.018793821334838867 sim_compute_sim_state_mean 0.01861305222794861 sim_compute_sim_state_median 0.01854965727553408 sim_compute_sim_state_min 0.01847454019494959 sim_physics_max 0.0015846796524830351 sim_physics_mean 0.0015222874315921852 sim_physics_median 0.001498582228174749 sim_physics_min 0.0014663095827455873 sim_render-ego_max 0.03253434322498463 sim_render-ego_mean 0.03223157400116492 sim_render-ego_median 0.03227497046848513 sim_render-ego_min 0.03184560182932261 simulation-passed 1 survival_time_max 11.700000000000031 survival_time_mean 4.300000000000006 survival_time_min 1.850000000000001
No reset possible 17155
2323
Bhairav Mehta Baseline solution using reinforcement learning aido2_LF_r2-v4
step1-simulation aborted yes nutonomy-P50-5849
2019-04-11 16:10:39+00:00 2019-04-11 16:14:15+00:00 0:03:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.05473638591926244 survival_time_median 0.49999999999999994 deviation-center-line_median 0.0089486865008137 in-drivable-lane_median 0.19999999999999996
other stats agent_compute-ego_max 0.09593832492828368 agent_compute-ego_mean 0.08684422969818115 agent_compute-ego_median 0.08406383991241455 agent_compute-ego_min 0.08145204457369717 deviation-center-line_max 0.014733408168211786 deviation-center-line_mean 0.009409321629201675 deviation-center-line_min 0.0059662334726055056 deviation-heading_max 0.2445646188879276 deviation-heading_mean 0.20946671583087123 deviation-heading_median 0.21535424800480113 deviation-heading_min 0.17777697259888925 driven_any_max 0.1761417001795484 driven_any_mean 0.1600707906514049 driven_any_median 0.16207425545510706 driven_any_min 0.14448409514249394 driven_lanedir_consec_max 0.0779747750116071 driven_lanedir_consec_mean 0.05861877483043432 driven_lanedir_consec_min 0.036703134282384475 driven_lanedir_max 0.0779747750116071 driven_lanedir_mean 0.05861877483043432 driven_lanedir_median 0.05473638591926244 driven_lanedir_min 0.036703134282384475 in-drivable-lane_max 0.24999999999999992 in-drivable-lane_mean 0.21999999999999992 in-drivable-lane_min 0.19999999999999996 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14448409514249394, "sim_physics": 0.0014087200164794925, "survival_time": 0.49999999999999994, "driven_lanedir": 0.036703134282384475, "sim_render-ego": 0.032400107383728026, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.09593832492828368, "deviation-heading": 0.17777697259888925, "set_robot_commands": 0.046068334579467775, "deviation-center-line": 0.0059662334726055056, "driven_lanedir_consec": 0.036703134282384475, "sim_compute_sim_state": 0.018449878692626952, "sim_compute_performance-ego": 0.033046817779541014, "sim_compute_robot_state-ego": 0.9880016565322876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16615415032425562, "sim_physics": 0.0015700513666326349, "survival_time": 0.5499999999999999, "driven_lanedir": 0.04928311137353014, "sim_render-ego": 0.03160682591524991, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.08216175166043369, "deviation-heading": 0.2209449278957702, "set_robot_commands": 0.0476429895921187, "deviation-center-line": 0.0089486865008137, "driven_lanedir_consec": 0.04928311137353014, "sim_compute_sim_state": 0.01887460188432173, "sim_compute_performance-ego": 0.033066207712346855, "sim_compute_robot_state-ego": 0.041065887971357865}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1761417001795484, "sim_physics": 0.001553210345181552, "survival_time": 0.5499999999999999, "driven_lanedir": 0.0779747750116071, "sim_render-ego": 0.031295147809115326, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.08145204457369717, "deviation-heading": 0.2445646188879276, "set_robot_commands": 0.0475135933269154, "deviation-center-line": 0.014733408168211786, "driven_lanedir_consec": 0.0779747750116071, "sim_compute_sim_state": 0.018722035668113014, "sim_compute_performance-ego": 0.03351729566400701, "sim_compute_robot_state-ego": 0.04120570963079279}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1514997521556194, "sim_physics": 0.001444697380065918, "survival_time": 0.49999999999999994, "driven_lanedir": 0.05473638591926244, "sim_render-ego": 0.03264262676239014, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.08406383991241455, "deviation-heading": 0.21535424800480113, "set_robot_commands": 0.05447640419006348, "deviation-center-line": 0.008380462057484012, "driven_lanedir_consec": 0.05473638591926244, "sim_compute_sim_state": 0.018655872344970705, "sim_compute_performance-ego": 0.03323361873626709, "sim_compute_robot_state-ego": 0.041795086860656736}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16207425545510706, "sim_physics": 0.0014670610427856446, "survival_time": 0.49999999999999994, "driven_lanedir": 0.07439646756538743, "sim_render-ego": 0.03255157470703125, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.09060518741607666, "deviation-heading": 0.1886928117669681, "set_robot_commands": 0.0462385892868042, "deviation-center-line": 0.009017817946893363, "driven_lanedir_consec": 0.07439646756538743, "sim_compute_sim_state": 0.018586039543151855, "sim_compute_performance-ego": 0.03311524391174316, "sim_compute_robot_state-ego": 0.04164764881134033}}set_robot_commands_max 0.05447640419006348 set_robot_commands_mean 0.04838798219507391 set_robot_commands_median 0.0475135933269154 set_robot_commands_min 0.046068334579467775 sim_compute_performance-ego_max 0.03351729566400701 sim_compute_performance-ego_mean 0.03319583676078103 sim_compute_performance-ego_median 0.03311524391174316 sim_compute_performance-ego_min 0.033046817779541014 sim_compute_robot_state-ego_max 0.9880016565322876 sim_compute_robot_state-ego_mean 0.23074319796128703 sim_compute_robot_state-ego_median 0.04164764881134033 sim_compute_robot_state-ego_min 0.041065887971357865 sim_compute_sim_state_max 0.01887460188432173 sim_compute_sim_state_mean 0.01865768562663685 sim_compute_sim_state_median 0.018655872344970705 sim_compute_sim_state_min 0.018449878692626952 sim_physics_max 0.0015700513666326349 sim_physics_mean 0.0014887480302290482 sim_physics_median 0.0014670610427856446 sim_physics_min 0.0014087200164794925 sim_render-ego_max 0.03264262676239014 sim_render-ego_mean 0.032099256515502925 sim_render-ego_median 0.032400107383728026 sim_render-ego_min 0.031295147809115326 simulation-passed 1 survival_time_max 0.5499999999999999 survival_time_mean 0.5199999999999999 survival_time_min 0.49999999999999994
No reset possible 17151
2336
Rami Al-Naim 🇷🇺Minimal agent aido2_LF_r2-v4
step1-simulation success yes nutonomy-P50-5849
2019-04-11 16:03:25+00:00 2019-04-11 16:09:47+00:00 0:06:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07671950212339075 agent_compute-ego_mean 0.0759552534146999 agent_compute-ego_median 0.07588176516925588 agent_compute-ego_min 0.0753469429318867 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0014509137939004335, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03215740358128267, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07588176516925588, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04652148485183716, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01858125364079195, "sim_compute_performance-ego": 0.03377151138642255, "sim_compute_robot_state-ego": 0.17377720860873952}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015145521315317306, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.033956868307931085, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0753469429318867, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04668748189532568, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.018609958981710768, "sim_compute_performance-ego": 0.03384125043475439, "sim_compute_robot_state-ego": 0.03952298088679238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.001515663587130033, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03202271828284631, "in-drivable-lane": 0, "agent_compute-ego": 0.07583981660696176, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04770916058466985, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.018947920432457556, "sim_compute_performance-ego": 0.03347595288203313, "sim_compute_robot_state-ego": 0.04059020189138559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015236197448358303, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.032119701548320494, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07671950212339075, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0463784874939337, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.018572368272920935, "sim_compute_performance-ego": 0.03344099114580852, "sim_compute_robot_state-ego": 0.040175987452995485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.001513187885284424, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.032426881790161136, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0759882402420044, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046328163146972655, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.018584063053131105, "sim_compute_performance-ego": 0.03335740804672241, "sim_compute_robot_state-ego": 0.040138704776763914}}set_robot_commands_max 0.04770916058466985 set_robot_commands_mean 0.046724955594547805 set_robot_commands_median 0.04652148485183716 set_robot_commands_min 0.046328163146972655 sim_compute_performance-ego_max 0.03384125043475439 sim_compute_performance-ego_mean 0.0335774227791482 sim_compute_performance-ego_median 0.03347595288203313 sim_compute_performance-ego_min 0.03335740804672241 sim_compute_robot_state-ego_max 0.17377720860873952 sim_compute_robot_state-ego_mean 0.06684101672333538 sim_compute_robot_state-ego_median 0.040175987452995485 sim_compute_robot_state-ego_min 0.03952298088679238 sim_compute_sim_state_max 0.018947920432457556 sim_compute_sim_state_mean 0.018659112876202463 sim_compute_sim_state_median 0.018584063053131105 sim_compute_sim_state_min 0.018572368272920935 sim_physics_max 0.0015236197448358303 sim_physics_mean 0.0015035874285364904 sim_physics_median 0.0015145521315317306 sim_physics_min 0.0014509137939004335 sim_render-ego_max 0.033956868307931085 sim_render-ego_mean 0.03253671470210834 sim_render-ego_median 0.03215740358128267 sim_render-ego_min 0.03202271828284631 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17148
2245
Andrea Censi 🇨🇭Solution template aido2_LFV_r1-v4
step1-simulation aborted yes nutonomy-P50-5849
2019-04-11 15:52:23+00:00 2019-04-11 16:02:17+00:00 0:09:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.0777306842803955 agent_compute-ego_mean 0.0765102293764927 agent_compute-ego_median 0.07642972760084199 agent_compute-ego_min 0.07560280140708475 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015008098938885856, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03190849458470064, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07560280140708475, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04623513712602503, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.01906638986924115, "sim_compute_performance-ego": 0.03303309749154484, "sim_compute_robot_state-ego": 0.17605488791185267, "sim_compute_robot_state-npc0": 0.034055225989397836, "sim_compute_robot_state-npc1": 0.033434135072371536, "sim_compute_robot_state-npc2": 0.03319835662841797, "sim_compute_robot_state-npc3": 0.03336257443708532}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014334633236839658, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.031766043768988714, "in-drivable-lane": 0, "agent_compute-ego": 0.07679041226704915, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04618613303653778, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018697644036913676, "sim_compute_performance-ego": 0.03253160582648383, "sim_compute_robot_state-ego": 0.04662562551952544, "sim_compute_robot_state-npc0": 0.0336777028583345, "sim_compute_robot_state-npc1": 0.033316858231075226, "sim_compute_robot_state-npc2": 0.033281871250697544, "sim_compute_robot_state-npc3": 0.033542205416967}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.001451231883122371, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.032555690178504355, "in-drivable-lane": 0, "agent_compute-ego": 0.0759975213270921, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04625717309805063, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.0186646608205942, "sim_compute_performance-ego": 0.032796243520883415, "sim_compute_robot_state-ego": 0.0449036011329064, "sim_compute_robot_state-npc0": 0.033568503306462216, "sim_compute_robot_state-npc1": 0.033282166260939376, "sim_compute_robot_state-npc2": 0.033282907192523664, "sim_compute_robot_state-npc3": 0.03349476960989145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001477729983446075, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03218076578000697, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07642972760084199, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.046600527879668445, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.01878787250053592, "sim_compute_performance-ego": 0.03353912946654529, "sim_compute_robot_state-ego": 0.04537484994748744, "sim_compute_robot_state-npc0": 0.03371574820541754, "sim_compute_robot_state-npc1": 0.033502817153930664, "sim_compute_robot_state-npc2": 0.03326777423300394, "sim_compute_robot_state-npc3": 0.03356817001249732}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001511070728302002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.03274590969085693, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0777306842803955, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04640714168548584, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018750176429748536, "sim_compute_performance-ego": 0.0331725287437439, "sim_compute_robot_state-ego": 0.045352585315704345, "sim_compute_robot_state-npc0": 0.03375988483428955, "sim_compute_robot_state-npc1": 0.03339580535888672, "sim_compute_robot_state-npc2": 0.033349070549011234, "sim_compute_robot_state-npc3": 0.033623011112213136}}set_robot_commands_max 0.046600527879668445 set_robot_commands_mean 0.046337222565153546 set_robot_commands_median 0.04625717309805063 set_robot_commands_min 0.04618613303653778 sim_compute_performance-ego_max 0.03353912946654529 sim_compute_performance-ego_mean 0.03301452100984025 sim_compute_performance-ego_median 0.03303309749154484 sim_compute_performance-ego_min 0.03253160582648383 sim_compute_robot_state-ego_max 0.17605488791185267 sim_compute_robot_state-ego_mean 0.07166230996549526 sim_compute_robot_state-ego_median 0.04537484994748744 sim_compute_robot_state-ego_min 0.0449036011329064 sim_compute_robot_state-npc0_max 0.034055225989397836 sim_compute_robot_state-npc0_mean 0.033755413038780324 sim_compute_robot_state-npc0_median 0.03371574820541754 sim_compute_robot_state-npc0_min 0.033568503306462216 sim_compute_robot_state-npc1_max 0.033502817153930664 sim_compute_robot_state-npc1_mean 0.0333863564154407 sim_compute_robot_state-npc1_median 0.03339580535888672 sim_compute_robot_state-npc1_min 0.033282166260939376 sim_compute_robot_state-npc2_max 0.033349070549011234 sim_compute_robot_state-npc2_mean 0.03327599597073087 sim_compute_robot_state-npc2_median 0.033281871250697544 sim_compute_robot_state-npc2_min 0.03319835662841797 sim_compute_robot_state-npc3_max 0.033623011112213136 sim_compute_robot_state-npc3_mean 0.033518146117730845 sim_compute_robot_state-npc3_median 0.033542205416967 sim_compute_robot_state-npc3_min 0.03336257443708532 sim_compute_sim_state_max 0.01906638986924115 sim_compute_sim_state_mean 0.018793348731406697 sim_compute_sim_state_median 0.018750176429748536 sim_compute_sim_state_min 0.0186646608205942 sim_physics_max 0.001511070728302002 sim_physics_mean 0.0014748611624886 sim_physics_median 0.001477729983446075 sim_physics_min 0.0014334633236839658 sim_render-ego_max 0.03274590969085693 sim_render-ego_mean 0.03223138080061152 sim_render-ego_median 0.03218076578000697 sim_render-ego_min 0.031766043768988714 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17145
2331
Egor Zamotaev Template for ROS Submission aido2_LF_r2-v4
step1-simulation error yes nutonomy-P50-5849
2019-04-11 15:47:45+00:00 2019-04-11 15:51:41+00:00 0:03:56 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17137
2322
Bhairav Mehta Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation aborted no nutonomy-P50-5849
2019-04-10 17:04:23+00:00 2019-04-10 17:09:29+00:00 0:05:06 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 404, in <module>
wrap(cie)
File "experiment_manager.py", line 393, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 176, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17135
2327
Konstantin Chaika Minimal agent aido2_LF_r2-v4
step1-simulation success no nutonomy-P50-5849
2019-04-10 16:57:58+00:00 2019-04-10 17:04:16+00:00 0:06:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07739021429201452 agent_compute-ego_mean 0.07644201471927935 agent_compute-ego_median 0.07603667274353997 agent_compute-ego_min 0.07578539114732008 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0015071525293238023, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03234335604835959, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.0758900011287016, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.04622111600988051, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018954999306622672, "sim_compute_performance-ego": 0.0336530138464535, "sim_compute_robot_state-ego": 0.17709599873598883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0015026917533269004, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.03225303831554595, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07603667274353997, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.04626207503061446, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.01873316462077792, "sim_compute_performance-ego": 0.033575523467290966, "sim_compute_robot_state-ego": 0.04044793522547162}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0014811332409198467, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.03248905768761268, "in-drivable-lane": 0, "agent_compute-ego": 0.07578539114732008, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.047732001084547775, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.0188906742976262, "sim_compute_performance-ego": 0.03389719816354605, "sim_compute_robot_state-ego": 0.04046789682828463}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0015366600780952267, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03235008658432379, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07739021429201452, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.046683919139024685, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.019261206068643708, "sim_compute_performance-ego": 0.034021772989412634, "sim_compute_robot_state-ego": 0.040784515985628454}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0014835667610168456, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.03295272350311279, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07710779428482056, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.046556632518768314, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.01885375738143921, "sim_compute_performance-ego": 0.03377082824707031, "sim_compute_robot_state-ego": 0.04024990320205688}}set_robot_commands_max 0.047732001084547775 set_robot_commands_mean 0.04669114875656715 set_robot_commands_median 0.046556632518768314 set_robot_commands_min 0.04622111600988051 sim_compute_performance-ego_max 0.034021772989412634 sim_compute_performance-ego_mean 0.03378366734275469 sim_compute_performance-ego_median 0.03377082824707031 sim_compute_performance-ego_min 0.033575523467290966 sim_compute_robot_state-ego_max 0.17709599873598883 sim_compute_robot_state-ego_mean 0.06780924999548607 sim_compute_robot_state-ego_median 0.04046789682828463 sim_compute_robot_state-ego_min 0.04024990320205688 sim_compute_sim_state_max 0.019261206068643708 sim_compute_sim_state_mean 0.018938760335021943 sim_compute_sim_state_median 0.0188906742976262 sim_compute_sim_state_min 0.01873316462077792 sim_physics_max 0.0015366600780952267 sim_physics_mean 0.0015022408725365243 sim_physics_median 0.0015026917533269004 sim_physics_min 0.0014811332409198467 sim_render-ego_max 0.03295272350311279 sim_render-ego_mean 0.03247765242779096 sim_render-ego_median 0.03235008658432379 sim_render-ego_min 0.03225303831554595 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17133
2328
Konstantin Chaika Minimal agent aido2_LFV_r1-v4
step1-simulation aborted no nutonomy-P50-5849
2019-04-10 16:48:06+00:00 2019-04-10 16:57:51+00:00 0:09:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.07682305429039932 agent_compute-ego_mean 0.07585495369680312 agent_compute-ego_median 0.07568262955721687 agent_compute-ego_min 0.07509771225944398 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.001437534304226146, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.03207673745996812, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.07568262955721687, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.046403990072362566, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.018678773851955637, "sim_compute_performance-ego": 0.03292810916900635, "sim_compute_robot_state-ego": 0.17474586472791784, "sim_compute_robot_state-npc0": 0.033588072832892925, "sim_compute_robot_state-npc1": 0.03317405897028306, "sim_compute_robot_state-npc2": 0.032983671216403734, "sim_compute_robot_state-npc3": 0.03337537541108973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0014924813830663288, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.03153861893547906, "in-drivable-lane": 0, "agent_compute-ego": 0.07509771225944398, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.04606204562717014, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.018693269245208255, "sim_compute_performance-ego": 0.032375782255142455, "sim_compute_robot_state-ego": 0.046671326198275125, "sim_compute_robot_state-npc0": 0.03347234120444646, "sim_compute_robot_state-npc1": 0.03322814002869621, "sim_compute_robot_state-npc2": 0.03334362166268485, "sim_compute_robot_state-npc3": 0.03346109390258789}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0015221265646127554, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.032479106462918794, "in-drivable-lane": 0, "agent_compute-ego": 0.07542308660653921, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.04661436814528245, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.018776831260094277, "sim_compute_performance-ego": 0.03296650006220891, "sim_compute_robot_state-ego": 0.04501069509066069, "sim_compute_robot_state-npc0": 0.03351532862736629, "sim_compute_robot_state-npc1": 0.033123372151301456, "sim_compute_robot_state-npc2": 0.03324283819932204, "sim_compute_robot_state-npc3": 0.03361071439889761}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.001487205668193538, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.03222137253458907, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.07682305429039932, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0468829259639833, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.019169054380277308, "sim_compute_performance-ego": 0.033163088123972825, "sim_compute_robot_state-ego": 0.045342520969669994, "sim_compute_robot_state-npc0": 0.033836806692728184, "sim_compute_robot_state-npc1": 0.03348980008102045, "sim_compute_robot_state-npc2": 0.03341694285229939, "sim_compute_robot_state-npc3": 0.03377562906683945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.001472015380859375, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.033674035072326663, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.07624828577041626, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.04657958745956421, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.018577423095703125, "sim_compute_performance-ego": 0.03315036535263061, "sim_compute_robot_state-ego": 0.04526285171508789, "sim_compute_robot_state-npc0": 0.033771843910217286, "sim_compute_robot_state-npc1": 0.03367128372192383, "sim_compute_robot_state-npc2": 0.03328863859176636, "sim_compute_robot_state-npc3": 0.03349982261657715}}set_robot_commands_max 0.0468829259639833 set_robot_commands_mean 0.046508583453672536 set_robot_commands_median 0.04657958745956421 set_robot_commands_min 0.04606204562717014 sim_compute_performance-ego_max 0.033163088123972825 sim_compute_performance-ego_mean 0.03291676899259223 sim_compute_performance-ego_median 0.03296650006220891 sim_compute_performance-ego_min 0.032375782255142455 sim_compute_robot_state-ego_max 0.17474586472791784 sim_compute_robot_state-ego_mean 0.0714066517403223 sim_compute_robot_state-ego_median 0.045342520969669994 sim_compute_robot_state-ego_min 0.04501069509066069 sim_compute_robot_state-npc0_max 0.033836806692728184 sim_compute_robot_state-npc0_mean 0.033636878653530225 sim_compute_robot_state-npc0_median 0.033588072832892925 sim_compute_robot_state-npc0_min 0.03347234120444646 sim_compute_robot_state-npc1_max 0.03367128372192383 sim_compute_robot_state-npc1_mean 0.033337330990644995 sim_compute_robot_state-npc1_median 0.03322814002869621 sim_compute_robot_state-npc1_min 0.033123372151301456 sim_compute_robot_state-npc2_max 0.03341694285229939 sim_compute_robot_state-npc2_mean 0.03325514250449528 sim_compute_robot_state-npc2_median 0.03328863859176636 sim_compute_robot_state-npc2_min 0.032983671216403734 sim_compute_robot_state-npc3_max 0.03377562906683945 sim_compute_robot_state-npc3_mean 0.03354452707919836 sim_compute_robot_state-npc3_median 0.03349982261657715 sim_compute_robot_state-npc3_min 0.03337537541108973 sim_compute_sim_state_max 0.019169054380277308 sim_compute_sim_state_mean 0.01877907036664772 sim_compute_sim_state_median 0.018693269245208255 sim_compute_sim_state_min 0.018577423095703125 sim_physics_max 0.0015221265646127554 sim_physics_mean 0.0014822726601916286 sim_physics_median 0.001487205668193538 sim_physics_min 0.001437534304226146 sim_render-ego_max 0.033674035072326663 sim_render-ego_mean 0.03239797409305634 sim_render-ego_median 0.03222137253458907 sim_render-ego_min 0.03153861893547906 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17129
2324
Nikhil Khedekar 🇮🇳PredictorLast aido2-PRED
step1-simulation aborted no nutonomy-P50-5849
2019-04-10 16:47:23+00:00 2019-04-10 16:47:54+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12269842301218904 error_L2 0.022717973746273348
No reset possible 17124
2328
Konstantin Chaika Minimal agent aido2_LFV_r1-v4
step1-simulation timeout no nutonomy-P50-5849
2019-04-10 16:17:36+00:00 - - - - No reset possible 17119
2320
FANG MEIYI 🇸🇬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no nutonomy-P50-5849
2019-04-09 16:09:18+00:00 2019-04-09 16:15:32+00:00 0:06:14 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 404, in <module>
wrap(cie)
File "experiment_manager.py", line 393, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 176, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible