Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17193
2328
Konstantin Chaika Minimal agent aido2_LFV_r1-v4
step1-simulation success yes idsc-rudolf-14710
2019-04-11 17:53:08+00:00 2019-04-11 18:04:41+00:00 0:11:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.15795698620024182 agent_compute-ego_mean 0.15102817429671306 agent_compute-ego_median 0.1501464476952186 agent_compute-ego_min 0.14647515731699326 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003071048680473777, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.05848222970962525, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14647515731699326, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07566538628409891, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.032386783291311824, "sim_compute_performance-ego": 0.057791457456700945, "sim_compute_robot_state-ego": 0.24746328592300415, "sim_compute_robot_state-npc0": 0.07140189759871539, "sim_compute_robot_state-npc1": 0.061660461566027475, "sim_compute_robot_state-npc2": 0.05880205420886769, "sim_compute_robot_state-npc3": 0.05908383692012114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003188549526154049, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.061942108093746125, "in-drivable-lane": 0, "agent_compute-ego": 0.15795698620024182, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07723188400268555, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03231135247245667, "sim_compute_performance-ego": 0.06035579196990482, "sim_compute_robot_state-ego": 0.07719072841462635, "sim_compute_robot_state-npc0": 0.07427268936520531, "sim_compute_robot_state-npc1": 0.0647933975098625, "sim_compute_robot_state-npc2": 0.06244606820363847, "sim_compute_robot_state-npc3": 0.06088092213585263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003089303236741286, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.059612362201397234, "in-drivable-lane": 0, "agent_compute-ego": 0.1501464476952186, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07637227865365835, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.0337443315065824, "sim_compute_performance-ego": 0.06052375206580529, "sim_compute_robot_state-ego": 0.07541304735036997, "sim_compute_robot_state-npc0": 0.0707864834712102, "sim_compute_robot_state-npc1": 0.06323108673095704, "sim_compute_robot_state-npc2": 0.06075441653911884, "sim_compute_robot_state-npc3": 0.06142604534442608}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003121794723882908, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.05836812461294779, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14900673017269228, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07764499071167737, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03262964399849496, "sim_compute_performance-ego": 0.05995242479370862, "sim_compute_robot_state-ego": 0.0757583234368301, "sim_compute_robot_state-npc0": 0.07022844000560481, "sim_compute_robot_state-npc1": 0.06183791160583496, "sim_compute_robot_state-npc2": 0.06046853705150325, "sim_compute_robot_state-npc3": 0.060115244330429446}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0029378366470336915, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.05921672344207764, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1515555500984192, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07852548599243164, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03203061580657959, "sim_compute_performance-ego": 0.059820151329040526, "sim_compute_robot_state-ego": 0.07467261075973511, "sim_compute_robot_state-npc0": 0.07048568725585938, "sim_compute_robot_state-npc1": 0.06404245376586915, "sim_compute_robot_state-npc2": 0.05966479301452637, "sim_compute_robot_state-npc3": 0.05932865619659424}}set_robot_commands_max 0.07852548599243164 set_robot_commands_mean 0.07708800512891037 set_robot_commands_median 0.07723188400268555 set_robot_commands_min 0.07566538628409891 sim_compute_performance-ego_max 0.06052375206580529 sim_compute_performance-ego_mean 0.05968871552303203 sim_compute_performance-ego_median 0.05995242479370862 sim_compute_performance-ego_min 0.057791457456700945 sim_compute_robot_state-ego_max 0.24746328592300415 sim_compute_robot_state-ego_mean 0.11009959917691314 sim_compute_robot_state-ego_median 0.0757583234368301 sim_compute_robot_state-ego_min 0.07467261075973511 sim_compute_robot_state-npc0_max 0.07427268936520531 sim_compute_robot_state-npc0_mean 0.07143503953931903 sim_compute_robot_state-npc0_median 0.0707864834712102 sim_compute_robot_state-npc0_min 0.07022844000560481 sim_compute_robot_state-npc1_max 0.0647933975098625 sim_compute_robot_state-npc1_mean 0.06311306223571023 sim_compute_robot_state-npc1_median 0.06323108673095704 sim_compute_robot_state-npc1_min 0.061660461566027475 sim_compute_robot_state-npc2_max 0.06244606820363847 sim_compute_robot_state-npc2_mean 0.06042717380353092 sim_compute_robot_state-npc2_median 0.06046853705150325 sim_compute_robot_state-npc2_min 0.05880205420886769 sim_compute_robot_state-npc3_max 0.06142604534442608 sim_compute_robot_state-npc3_mean 0.06016694098548471 sim_compute_robot_state-npc3_median 0.060115244330429446 sim_compute_robot_state-npc3_min 0.05908383692012114 sim_compute_sim_state_max 0.0337443315065824 sim_compute_sim_state_mean 0.03262054541508509 sim_compute_sim_state_median 0.032386783291311824 sim_compute_sim_state_min 0.03203061580657959 sim_physics_max 0.003188549526154049 sim_physics_mean 0.003081706562857142 sim_physics_median 0.003089303236741286 sim_physics_min 0.0029378366470336915 sim_render-ego_max 0.061942108093746125 sim_render-ego_mean 0.0595243096119588 sim_render-ego_median 0.05921672344207764 sim_render-ego_min 0.05836812461294779 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17189
2251
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error yes idsc-rudolf-14710
2019-04-11 17:25:20+00:00 2019-04-11 17:25:58+00:00 0:00:38 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17187
2259
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error yes idsc-rudolf-14710
2019-04-11 17:23:22+00:00 2019-04-11 17:24:10+00:00 0:00:48 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17184
2260
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error yes idsc-rudolf-14710
2019-04-11 17:21:36+00:00 2019-04-11 17:22:13+00:00 0:00:37 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17179
2274
Andrea Censi Β π¨πSolution template aido2_LF_r2-v4
step1-simulation success yes idsc-rudolf-14710
2019-04-11 17:13:45+00:00 2019-04-11 17:20:58+00:00 0:07:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.15802546826804556 agent_compute-ego_mean 0.15400796075210005 agent_compute-ego_median 0.15507365740262546 agent_compute-ego_min 0.15029484272003174 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0035273082116070915, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07074875340742223, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15510188130771413, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07960655408747055, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043531954288482666, "sim_compute_performance-ego": 0.06995923378888298, "sim_compute_robot_state-ego": 0.2672942701508017}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0033820394485715834, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07048966392638191, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.1515439540620834, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07791074117024739, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04336022952246287, "sim_compute_performance-ego": 0.06992990251571413, "sim_compute_robot_state-ego": 0.07747689126029847}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.003409741475031926, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07316273909348708, "in-drivable-lane": 0, "agent_compute-ego": 0.15507365740262546, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07968624921945425, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04469312887925368, "sim_compute_performance-ego": 0.07166186112623948, "sim_compute_robot_state-ego": 0.08088872982905461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003636935862099252, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07109042493308462, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15802546826804556, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07895466467229331, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.043736719503635314, "sim_compute_performance-ego": 0.07222929524212349, "sim_compute_robot_state-ego": 0.08159367340367014}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003357553482055664, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.0714106273651123, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15029484272003174, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.0775247859954834, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04196627140045166, "sim_compute_performance-ego": 0.06776957035064697, "sim_compute_robot_state-ego": 0.07649435043334961}}set_robot_commands_max 0.07968624921945425 set_robot_commands_mean 0.07873659902898979 set_robot_commands_median 0.07895466467229331 set_robot_commands_min 0.0775247859954834 sim_compute_performance-ego_max 0.07222929524212349 sim_compute_performance-ego_mean 0.07030997260472141 sim_compute_performance-ego_median 0.06995923378888298 sim_compute_performance-ego_min 0.06776957035064697 sim_compute_robot_state-ego_max 0.2672942701508017 sim_compute_robot_state-ego_mean 0.11674958301543492 sim_compute_robot_state-ego_median 0.08088872982905461 sim_compute_robot_state-ego_min 0.07649435043334961 sim_compute_sim_state_max 0.04469312887925368 sim_compute_sim_state_mean 0.04345766071885724 sim_compute_sim_state_median 0.043531954288482666 sim_compute_sim_state_min 0.04196627140045166 sim_physics_max 0.003636935862099252 sim_physics_mean 0.003462715695873104 sim_physics_median 0.003409741475031926 sim_physics_min 0.003357553482055664 sim_render-ego_max 0.07316273909348708 sim_render-ego_mean 0.07138044174509764 sim_render-ego_median 0.07109042493308462 sim_render-ego_min 0.07048966392638191 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17173
2287
Andrea Censi Β π¨πMinimal agent aido2_LFV_r1-v4
step1-simulation success yes idsc-rudolf-14710
2019-04-11 17:01:22+00:00 2019-04-11 17:13:25+00:00 0:12:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.1636971973237537 agent_compute-ego_mean 0.15843592058021802 agent_compute-ego_median 0.1579430543459379 agent_compute-ego_min 0.15373497500139124 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003246808753294103, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07113661836175357, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15373497500139124, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07629096508026123, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03857779152253095, "sim_compute_performance-ego": 0.06616872549057007, "sim_compute_robot_state-ego": 0.2596869714119855, "sim_compute_robot_state-npc0": 0.07560201252208036, "sim_compute_robot_state-npc1": 0.06906621596392463, "sim_compute_robot_state-npc2": 0.06800340203677907, "sim_compute_robot_state-npc3": 0.06700613919426412}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0035517367105635388, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.07077924788944305, "in-drivable-lane": 0, "agent_compute-ego": 0.1636971973237537, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.0791312020922464, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.04094453085036505, "sim_compute_performance-ego": 0.0694576482924204, "sim_compute_robot_state-ego": 0.08746650862315344, "sim_compute_robot_state-npc0": 0.07449008926512703, "sim_compute_robot_state-npc1": 0.07143374851771764, "sim_compute_robot_state-npc2": 0.06991424257793123, "sim_compute_robot_state-npc3": 0.07114928109305245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0035014702723576473, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07386067463801457, "in-drivable-lane": 0, "agent_compute-ego": 0.1579430543459379, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07788833471444936, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.04143975698030912, "sim_compute_performance-ego": 0.0708040714263916, "sim_compute_robot_state-ego": 0.08597372862008902, "sim_compute_robot_state-npc0": 0.07513786829434908, "sim_compute_robot_state-npc1": 0.07241366092975322, "sim_compute_robot_state-npc2": 0.07348304161658654, "sim_compute_robot_state-npc3": 0.07320134089543269}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0034508414384795396, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07187300484354903, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16172442494369135, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.0782162590724666, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04040067079590588, "sim_compute_performance-ego": 0.06656036435103999, "sim_compute_robot_state-ego": 0.08112279380240091, "sim_compute_robot_state-npc0": 0.07637807218039908, "sim_compute_robot_state-npc1": 0.07261875780617319, "sim_compute_robot_state-npc2": 0.07053420311067163, "sim_compute_robot_state-npc3": 0.0710057688922417}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.003428969383239746, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07066843748092651, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1550799512863159, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07740355968475342, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03966011047363281, "sim_compute_performance-ego": 0.06839191675186157, "sim_compute_robot_state-ego": 0.08190892457962036, "sim_compute_robot_state-npc0": 0.07668123483657836, "sim_compute_robot_state-npc1": 0.07277400016784669, "sim_compute_robot_state-npc2": 0.07021082401275634, "sim_compute_robot_state-npc3": 0.06952412366867065}}set_robot_commands_max 0.0791312020922464 set_robot_commands_mean 0.0777860641288354 set_robot_commands_median 0.07788833471444936 set_robot_commands_min 0.07629096508026123 sim_compute_performance-ego_max 0.0708040714263916 sim_compute_performance-ego_mean 0.06827654526245673 sim_compute_performance-ego_median 0.06839191675186157 sim_compute_performance-ego_min 0.06616872549057007 sim_compute_robot_state-ego_max 0.2596869714119855 sim_compute_robot_state-ego_mean 0.11923178540744986 sim_compute_robot_state-ego_median 0.08597372862008902 sim_compute_robot_state-ego_min 0.08112279380240091 sim_compute_robot_state-npc0_max 0.07668123483657836 sim_compute_robot_state-npc0_mean 0.0756578554197068 sim_compute_robot_state-npc0_median 0.07560201252208036 sim_compute_robot_state-npc0_min 0.07449008926512703 sim_compute_robot_state-npc1_max 0.07277400016784669 sim_compute_robot_state-npc1_mean 0.07166127667708308 sim_compute_robot_state-npc1_median 0.07241366092975322 sim_compute_robot_state-npc1_min 0.06906621596392463 sim_compute_robot_state-npc2_max 0.07348304161658654 sim_compute_robot_state-npc2_mean 0.07042914267094495 sim_compute_robot_state-npc2_median 0.07021082401275634 sim_compute_robot_state-npc2_min 0.06800340203677907 sim_compute_robot_state-npc3_max 0.07320134089543269 sim_compute_robot_state-npc3_mean 0.07037733074873233 sim_compute_robot_state-npc3_median 0.0710057688922417 sim_compute_robot_state-npc3_min 0.06700613919426412 sim_compute_sim_state_max 0.04143975698030912 sim_compute_sim_state_mean 0.04020457212454877 sim_compute_sim_state_median 0.04040067079590588 sim_compute_sim_state_min 0.03857779152253095 sim_physics_max 0.0035517367105635388 sim_physics_mean 0.003435965311586915 sim_physics_median 0.0034508414384795396 sim_physics_min 0.003246808753294103 sim_render-ego_max 0.07386067463801457 sim_render-ego_mean 0.07166359664273735 sim_render-ego_median 0.07113661836175357 sim_render-ego_min 0.07066843748092651 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17163
2278
Peter Almasi Β ππΊPyTorch template aido2_LF_r2-v4
step1-simulation error yes idsc-rudolf-14710
2019-04-11 16:29:56+00:00 2019-04-11 17:00:35+00:00 0:30:39 Timeout:
Waited 180 [...] Timeout:
Waited 1800.5973994731903 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17161
2317
Julian Zilly Baseline solution using imitation learning from logs aido2_LFV_r1-v4
step1-simulation aborted yes idsc-rudolf-14710
2019-04-11 16:22:43+00:00 2019-04-11 16:28:24+00:00 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.18482147694429377 survival_time_median 1.3500000000000003 deviation-center-line_median 0.07930110646342275 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.20802868264062063 agent_compute-ego_mean 0.20466805170549815 agent_compute-ego_median 0.2053148393277769 agent_compute-ego_min 0.19809741444057888 deviation-center-line_max 0.08127908680916048 deviation-center-line_mean 0.07918150249538727 deviation-center-line_min 0.07737627556794356 deviation-heading_max 0.7560020895565267 deviation-heading_mean 0.711349846335019 deviation-heading_median 0.7041554170496334 deviation-heading_min 0.6682793112362134 driven_any_max 0.2352841531174228 driven_any_mean 0.22743933786850615 driven_any_median 0.22767271249920948 driven_any_min 0.2212341045831002 driven_lanedir_consec_max 0.19496743190808097 driven_lanedir_consec_mean 0.18342031941798145 driven_lanedir_consec_min 0.17277119420330234 driven_lanedir_max 0.19496743190808097 driven_lanedir_mean 0.18342031941798145 driven_lanedir_median 0.18482147694429377 driven_lanedir_min 0.17277119420330234 in-drivable-lane_max 0 in-drivable-lane_mean 0 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22865935960749104, "sim_physics": 0.0031164884567260742, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18709291320561183, "sim_render-ego": 0.059344777694115274, "in-drivable-lane": 0, "agent_compute-ego": 0.20484454815204328, "deviation-heading": 0.6682793112362134, "set_robot_commands": 0.07583436599144569, "deviation-center-line": 0.07737627556794356, "driven_lanedir_consec": 0.18709291320561183, "sim_compute_sim_state": 0.030993076471182015, "sim_compute_performance-ego": 0.05991734908177303, "sim_compute_robot_state-ego": 0.5231165060630212, "sim_compute_robot_state-npc0": 0.07049338634197529, "sim_compute_robot_state-npc1": 0.06447376654698299, "sim_compute_robot_state-npc2": 0.06049237801478459, "sim_compute_robot_state-npc3": 0.059898706582876354}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2352841531174228, "sim_physics": 0.002974910395486014, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19496743190808097, "sim_render-ego": 0.06001504829951695, "in-drivable-lane": 0, "agent_compute-ego": 0.20802868264062063, "deviation-heading": 0.6849903779871328, "set_robot_commands": 0.07754295212881905, "deviation-center-line": 0.07832944540898547, "driven_lanedir_consec": 0.19496743190808097, "sim_compute_sim_state": 0.03319082089832851, "sim_compute_performance-ego": 0.06218096188136509, "sim_compute_robot_state-ego": 0.0769677928515843, "sim_compute_robot_state-npc0": 0.07446396350860596, "sim_compute_robot_state-npc1": 0.06416330167225429, "sim_compute_robot_state-npc2": 0.0648206387247358, "sim_compute_robot_state-npc3": 0.06535436425890241}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.003262422702930592, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.06128157509697808, "in-drivable-lane": 0, "agent_compute-ego": 0.20705477396647137, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.08021480065804941, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.03338091461746781, "sim_compute_performance-ego": 0.06085843510097928, "sim_compute_robot_state-ego": 0.07907555721424243, "sim_compute_robot_state-npc0": 0.07247027644404659, "sim_compute_robot_state-npc1": 0.06398753766660337, "sim_compute_robot_state-npc2": 0.06067716633832013, "sim_compute_robot_state-npc3": 0.06162038555851689}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.003059722759105541, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.05862428523876049, "in-drivable-lane": 0, "agent_compute-ego": 0.2053148393277769, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.07702516626428675, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.0320688353644477, "sim_compute_performance-ego": 0.05975359457510489, "sim_compute_robot_state-ego": 0.08256358570522732, "sim_compute_robot_state-npc0": 0.07099843908239294, "sim_compute_robot_state-npc1": 0.06265450406957555, "sim_compute_robot_state-npc2": 0.060212930043538414, "sim_compute_robot_state-npc3": 0.06015416427894875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22434635953530724, "sim_physics": 0.0031121660161901404, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17744858082861825, "sim_render-ego": 0.0653892887963189, "in-drivable-lane": 0, "agent_compute-ego": 0.19809741444057888, "deviation-heading": 0.7433220358455889, "set_robot_commands": 0.07544015955041956, "deviation-center-line": 0.08127908680916048, "driven_lanedir_consec": 0.17744858082861825, "sim_compute_sim_state": 0.03358817983556677, "sim_compute_performance-ego": 0.06119290987650553, "sim_compute_robot_state-ego": 0.07575459833498355, "sim_compute_robot_state-npc0": 0.07718936602274577, "sim_compute_robot_state-npc1": 0.06608495005854854, "sim_compute_robot_state-npc2": 0.0616367569676152, "sim_compute_robot_state-npc3": 0.06104056923477738}}set_robot_commands_max 0.08021480065804941 set_robot_commands_mean 0.07721148891860409 set_robot_commands_median 0.07702516626428675 set_robot_commands_min 0.07544015955041956 sim_compute_performance-ego_max 0.06218096188136509 sim_compute_performance-ego_mean 0.06078065010314556 sim_compute_performance-ego_median 0.06085843510097928 sim_compute_performance-ego_min 0.05975359457510489 sim_compute_robot_state-ego_max 0.5231165060630212 sim_compute_robot_state-ego_mean 0.16749560803381175 sim_compute_robot_state-ego_median 0.07907555721424243 sim_compute_robot_state-ego_min 0.07575459833498355 sim_compute_robot_state-npc0_max 0.07718936602274577 sim_compute_robot_state-npc0_mean 0.07312308627995331 sim_compute_robot_state-npc0_median 0.07247027644404659 sim_compute_robot_state-npc0_min 0.07049338634197529 sim_compute_robot_state-npc1_max 0.06608495005854854 sim_compute_robot_state-npc1_mean 0.06427281200279295 sim_compute_robot_state-npc1_median 0.06416330167225429 sim_compute_robot_state-npc1_min 0.06265450406957555 sim_compute_robot_state-npc2_max 0.0648206387247358 sim_compute_robot_state-npc2_mean 0.06156797401779883 sim_compute_robot_state-npc2_median 0.06067716633832013 sim_compute_robot_state-npc2_min 0.060212930043538414 sim_compute_robot_state-npc3_max 0.06535436425890241 sim_compute_robot_state-npc3_mean 0.06161363798280437 sim_compute_robot_state-npc3_median 0.06104056923477738 sim_compute_robot_state-npc3_min 0.059898706582876354 sim_compute_sim_state_max 0.03358817983556677 sim_compute_sim_state_mean 0.032644365437398556 sim_compute_sim_state_median 0.03319082089832851 sim_compute_sim_state_min 0.030993076471182015 sim_physics_max 0.003262422702930592 sim_physics_mean 0.0031051420660876726 sim_physics_median 0.0031121660161901404 sim_physics_min 0.002974910395486014 sim_render-ego_max 0.0653892887963189 sim_render-ego_mean 0.060930995025137935 sim_render-ego_median 0.06001504829951695 sim_render-ego_min 0.05862428523876049 simulation-passed 1 survival_time_max 1.4000000000000006 survival_time_mean 1.3500000000000003 survival_time_min 1.3000000000000005
No reset possible 17159
2319
FANG MEIYI Β πΈπ¬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation success yes idsc-rudolf-14710
2019-04-11 16:18:50+00:00 2019-04-11 16:21:58+00:00 0:03:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.09419855929319844 survival_time_median 0.65 deviation-center-line_median 0.024398298032740247 in-drivable-lane_median 0.09999999999999998
other stats agent_compute-ego_max 0.16524457931518555 agent_compute-ego_mean 0.15472414448691807 agent_compute-ego_median 0.15227554394648626 agent_compute-ego_min 0.1476463187824596 deviation-center-line_max 0.0628032172006529 deviation-center-line_mean 0.029992680318809917 deviation-center-line_min 0.007093610227727502 deviation-heading_max 0.5188310793819214 deviation-heading_mean 0.3329327354329177 deviation-heading_median 0.28263420392485217 deviation-heading_min 0.22951461988336885 driven_any_max 0.5707216696146715 driven_any_mean 0.3974774231962924 driven_any_median 0.37412013163993807 driven_any_min 0.23119697229429292 driven_lanedir_consec_max 0.2667790289000642 driven_lanedir_consec_mean 0.14041720895656892 driven_lanedir_consec_min 0.08166532262384874 driven_lanedir_max 0.3007930426776575 driven_lanedir_mean 0.1669351845684384 driven_lanedir_median 0.09464906999322364 driven_lanedir_min 0.08166532262384874 in-drivable-lane_max 0.5500000000000003 in-drivable-lane_mean 0.16000000000000006 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.55479429313413, "sim_physics": 0.003348210278679343, "survival_time": 0.8500000000000002, "driven_lanedir": 0.09464906999322364, "sim_render-ego": 0.07221592173856847, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.16524457931518555, "deviation-heading": 0.24255146657121804, "set_robot_commands": 0.08178368736715878, "deviation-center-line": 0.024398298032740247, "driven_lanedir_consec": 0.09419855929319844, "sim_compute_sim_state": 0.044889393974752986, "sim_compute_performance-ego": 0.07068286222570083, "sim_compute_robot_state-ego": 0.9283556236940272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23119697229429292, "sim_physics": 0.0035001635551452637, "survival_time": 0.4, "driven_lanedir": 0.08166532262384874, "sim_render-ego": 0.06485801935195923, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1577812135219574, "deviation-heading": 0.22951461988336885, "set_robot_commands": 0.08149966597557068, "deviation-center-line": 0.007093610227727502, "driven_lanedir_consec": 0.08166532262384874, "sim_compute_sim_state": 0.04578918218612671, "sim_compute_performance-ego": 0.06944122910499573, "sim_compute_robot_state-ego": 0.08190849423408508}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5707216696146715, "sim_physics": 0.0031714579638312847, "survival_time": 0.8500000000000002, "driven_lanedir": 0.3007930426776575, "sim_render-ego": 0.07036398438846364, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.15067306686850154, "deviation-heading": 0.5188310793819214, "set_robot_commands": 0.08183886023128734, "deviation-center-line": 0.0628032172006529, "driven_lanedir_consec": 0.16865367531833542, "sim_compute_sim_state": 0.04437577023225672, "sim_compute_performance-ego": 0.06416763978845932, "sim_compute_robot_state-ego": 0.08258150605594411}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.37412013163993807, "sim_physics": 0.002990282498873197, "survival_time": 0.65, "driven_lanedir": 0.2667790289000642, "sim_render-ego": 0.06332643215472882, "in-drivable-lane": 0, "agent_compute-ego": 0.15227554394648626, "deviation-heading": 0.3911323074032279, "set_robot_commands": 0.07685694327721229, "deviation-center-line": 0.04135458884199785, "driven_lanedir_consec": 0.2667790289000642, "sim_compute_sim_state": 0.04291604115412785, "sim_compute_performance-ego": 0.06420073142418495, "sim_compute_robot_state-ego": 0.08287910314706656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2565540492984296, "sim_physics": 0.003465977582064542, "survival_time": 0.5499999999999999, "driven_lanedir": 0.09078945864739783, "sim_render-ego": 0.08152075247331099, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.1476463187824596, "deviation-heading": 0.28263420392485217, "set_robot_commands": 0.07697890021584251, "deviation-center-line": 0.014313687290931076, "driven_lanedir_consec": 0.09078945864739783, "sim_compute_sim_state": 0.04537073048678311, "sim_compute_performance-ego": 0.06742349537936124, "sim_compute_robot_state-ego": 0.08544529568065297}}set_robot_commands_max 0.08183886023128734 set_robot_commands_mean 0.07979161141341433 set_robot_commands_median 0.08149966597557068 set_robot_commands_min 0.07685694327721229 sim_compute_performance-ego_max 0.07068286222570083 sim_compute_performance-ego_mean 0.0671831915845404 sim_compute_performance-ego_median 0.06742349537936124 sim_compute_performance-ego_min 0.06416763978845932 sim_compute_robot_state-ego_max 0.9283556236940272 sim_compute_robot_state-ego_mean 0.2522340045623552 sim_compute_robot_state-ego_median 0.08287910314706656 sim_compute_robot_state-ego_min 0.08190849423408508 sim_compute_sim_state_max 0.04578918218612671 sim_compute_sim_state_mean 0.04466822360680947 sim_compute_sim_state_median 0.044889393974752986 sim_compute_sim_state_min 0.04291604115412785 sim_physics_max 0.0035001635551452637 sim_physics_mean 0.003295218375718726 sim_physics_median 0.003348210278679343 sim_physics_min 0.002990282498873197 sim_render-ego_max 0.08152075247331099 sim_render-ego_mean 0.07045702202140622 sim_render-ego_median 0.07036398438846364 sim_render-ego_min 0.06332643215472882 simulation-passed 1 survival_time_max 0.8500000000000002 survival_time_mean 0.66 survival_time_min 0.4
No reset possible 17147
2332
Konstantin Chaika ROS-based Lane Following aido2_LF_r2-v4
step1-simulation error yes idsc-rudolf-14710
2019-04-11 15:48:01+00:00 2019-04-11 16:18:43+00:00 0:30:42 Timeout:
Waited 180 [...] Timeout:
Waited 1803.9206442832947 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17134
2332
Konstantin Chaika ROS-based Lane Following aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-14710
2019-04-10 16:51:41+00:00 2019-04-10 17:22:19+00:00 0:30:38 Timeout:
Waited 180 [...] Timeout:
Waited 1800.1963920593262 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17127
2332
Konstantin Chaika ROS-based Lane Following aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-14710
2019-04-10 16:19:55+00:00 2019-04-10 16:51:35+00:00 0:31:40 Timeout:
Waited 180 [...] Timeout:
Waited 1803.929328918457 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17126
2326
Konstantin Chaika PredictorLast aido2-PRED
step1-simulation success no idsc-rudolf-14710
2019-04-10 16:19:07+00:00 2019-04-10 16:19:35+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10783251262778495 error_L2 0.01920160032484337
No reset possible 17121
2331
Egor Zamotaev Template for ROS Submission aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-14710
2019-04-10 16:17:20+00:00 2019-04-10 16:18:48+00:00 0:01:28 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17116
2320
FANG MEIYI Β πΈπ¬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-14710
2019-04-09 16:08:39+00:00 2019-04-09 16:12:14+00:00 0:03:35 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 404, in <module>
wrap(cie)
File "experiment_manager.py", line 393, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 176, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
File "experiment_manager.py", line 89, in main
raise Exception(msg) # XXX
Exception: Too many failures: 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible