Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 23750
3760
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-21 20:21:57+00:00 2019-05-21 20:48:20+00:00 0:26:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0784719073372124 survival_time_median 9.700000000000005 deviation-center-line_median 0.583110362891347 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2631992999712626 agent_compute-ego_mean 0.2517970474771228 agent_compute-ego_median 0.2586921041116774 agent_compute-ego_min 0.2206054970070168 deviation-center-line_max 1.0048645425095442 deviation-center-line_mean 0.5862363148504832 deviation-center-line_min 0.27296775129615297 deviation-heading_max 2.3041595595447433 deviation-heading_mean 1.9108819811563464 deviation-heading_median 1.9578685097330464 deviation-heading_min 1.187351601477849 driven_any_max 2.075355301231588 driven_any_mean 1.2736023805757026 driven_any_median 1.109214448836218 driven_any_min 0.5086722131812776 driven_lanedir_consec_max 2.053209724700958 driven_lanedir_consec_mean 1.160486163009136 driven_lanedir_consec_min 0.4720449630306436 driven_lanedir_max 2.053209724700958 driven_lanedir_mean 1.160486163009136 driven_lanedir_median 1.0784719073372124 driven_lanedir_min 0.4720449630306436 in-drivable-lane_max 2.7000000000000384 in-drivable-lane_mean 0.5400000000000077 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5086722131812776, "sim_physics": 0.15921807877811384, "survival_time": 4.049999999999994, "driven_lanedir": 0.4720449630306436, "sim_render-ego": 0.05331638124254015, "in-drivable-lane": 0, "agent_compute-ego": 0.2206054970070168, "deviation-heading": 1.187351601477849, "set_robot_commands": 0.0853724597412863, "deviation-center-line": 0.27296775129615297, "driven_lanedir_consec": 0.4720449630306436, "sim_compute_sim_state": 0.03523095154467924, "sim_compute_performance-ego": 0.06060127858762388, "sim_compute_robot_state-ego": 0.06618822945488824, "sim_compute_robot_state-npc0": 0.06088822270617073, "sim_compute_robot_state-npc1": 0.06129996276196138, "sim_compute_robot_state-npc2": 0.06318708702369973, "sim_compute_robot_state-npc3": 0.06280864609612359}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.075355301231588, "sim_physics": 0.17254042307535808, "survival_time": 14.950000000000076, "driven_lanedir": 2.053209724700958, "sim_render-ego": 0.06495882511138916, "in-drivable-lane": 0, "agent_compute-ego": 0.2631992999712626, "deviation-heading": 1.9578685097330464, "set_robot_commands": 0.09892650127410887, "deviation-center-line": 1.0048645425095442, "driven_lanedir_consec": 2.053209724700958, "sim_compute_sim_state": 0.039872778256734215, "sim_compute_performance-ego": 0.0702991795539856, "sim_compute_robot_state-ego": 0.07774390776952107, "sim_compute_robot_state-npc0": 0.07242823123931885, "sim_compute_robot_state-npc1": 0.0707525928815206, "sim_compute_robot_state-npc2": 0.07047090609868367, "sim_compute_robot_state-npc3": 0.07072603940963745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0594455331375507, "sim_physics": 0.1709532422839471, "survival_time": 7.94999999999998, "driven_lanedir": 0.9956735042689502, "sim_render-ego": 0.06602687955652393, "in-drivable-lane": 0, "agent_compute-ego": 0.2586921041116774, "deviation-heading": 2.3041595595447433, "set_robot_commands": 0.09733743337715196, "deviation-center-line": 0.583110362891347, "driven_lanedir_consec": 0.9956735042689502, "sim_compute_sim_state": 0.04059388952435187, "sim_compute_performance-ego": 0.07054622218293964, "sim_compute_robot_state-ego": 0.07659660345353421, "sim_compute_robot_state-npc0": 0.070886123105415, "sim_compute_robot_state-npc1": 0.07021084971397927, "sim_compute_robot_state-npc2": 0.06915025741049328, "sim_compute_robot_state-npc3": 0.07085771530679187}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6153244064918788, "sim_physics": 0.16244792178332568, "survival_time": 12.550000000000043, "driven_lanedir": 1.203030715707916, "sim_render-ego": 0.06306203617992628, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.2628714895818338, "deviation-heading": 2.2483305996102327, "set_robot_commands": 0.09716525875714672, "deviation-center-line": 0.6638259000856481, "driven_lanedir_consec": 1.203030715707916, "sim_compute_sim_state": 0.03987383272543371, "sim_compute_performance-ego": 0.06951016258908457, "sim_compute_robot_state-ego": 0.07635468030830779, "sim_compute_robot_state-npc0": 0.07140225433258421, "sim_compute_robot_state-npc1": 0.06995861368825236, "sim_compute_robot_state-npc2": 0.06997828559571528, "sim_compute_robot_state-npc3": 0.06964351646453736}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.109214448836218, "sim_physics": 0.16659812951825329, "survival_time": 9.700000000000005, "driven_lanedir": 1.0784719073372124, "sim_render-ego": 0.06313981960729226, "in-drivable-lane": 0, "agent_compute-ego": 0.2536168467138231, "deviation-heading": 1.8566996354158596, "set_robot_commands": 0.09605063482658152, "deviation-center-line": 0.4064130174697237, "driven_lanedir_consec": 1.0784719073372124, "sim_compute_sim_state": 0.03892563913286347, "sim_compute_performance-ego": 0.0690227132482627, "sim_compute_robot_state-ego": 0.07474204191227549, "sim_compute_robot_state-npc0": 0.06999771865372806, "sim_compute_robot_state-npc1": 0.07066537793149653, "sim_compute_robot_state-npc2": 0.0727755372057256, "sim_compute_robot_state-npc3": 0.06925670756507166}}set_robot_commands_max 0.09892650127410887 set_robot_commands_mean 0.09497045759525506 set_robot_commands_median 0.09716525875714672 set_robot_commands_min 0.0853724597412863 sim_compute_performance-ego_max 0.07054622218293964 sim_compute_performance-ego_mean 0.06799591123237927 sim_compute_performance-ego_median 0.06951016258908457 sim_compute_performance-ego_min 0.06060127858762388 sim_compute_robot_state-ego_max 0.07774390776952107 sim_compute_robot_state-ego_mean 0.07432509257970536 sim_compute_robot_state-ego_median 0.07635468030830779 sim_compute_robot_state-ego_min 0.06618822945488824 sim_compute_robot_state-npc0_max 0.07242823123931885 sim_compute_robot_state-npc0_mean 0.06912051000744338 sim_compute_robot_state-npc0_median 0.070886123105415 sim_compute_robot_state-npc0_min 0.06088822270617073 sim_compute_robot_state-npc1_max 0.0707525928815206 sim_compute_robot_state-npc1_mean 0.06857747939544202 sim_compute_robot_state-npc1_median 0.07021084971397927 sim_compute_robot_state-npc1_min 0.06129996276196138 sim_compute_robot_state-npc2_max 0.0727755372057256 sim_compute_robot_state-npc2_mean 0.06911241466686352 sim_compute_robot_state-npc2_median 0.06997828559571528 sim_compute_robot_state-npc2_min 0.06318708702369973 sim_compute_robot_state-npc3_max 0.07085771530679187 sim_compute_robot_state-npc3_mean 0.06865852496843239 sim_compute_robot_state-npc3_median 0.06964351646453736 sim_compute_robot_state-npc3_min 0.06280864609612359 sim_compute_sim_state_max 0.04059388952435187 sim_compute_sim_state_mean 0.0388994182368125 sim_compute_sim_state_median 0.039872778256734215 sim_compute_sim_state_min 0.03523095154467924 sim_physics_max 0.17254042307535808 sim_physics_mean 0.16635155908779958 sim_physics_median 0.16659812951825329 sim_physics_min 0.15921807877811384 sim_render-ego_max 0.06602687955652393 sim_render-ego_mean 0.06210078833953436 sim_render-ego_median 0.06313981960729226 sim_render-ego_min 0.05331638124254015 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.84000000000002 survival_time_min 4.049999999999994
No reset possible 23741
3749
sebastian glatz aido2-LFV-sim-testing
step1-simulation success yes ip-172-31-40-253-3847
2019-05-21 20:02:15+00:00 2019-05-21 20:14:55+00:00 0:12:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.47061816984274774 survival_time_median 2.4499999999999993 deviation-center-line_median 0.09047885846140293 in-drivable-lane_median 0.7999999999999974
other stats agent_compute-ego_max 0.09514439105987547 agent_compute-ego_mean 0.09060751436777892 agent_compute-ego_median 0.09021308245482268 agent_compute-ego_min 0.08942995071411133 deviation-center-line_max 0.1743913456502906 deviation-center-line_mean 0.11122054568266285 deviation-center-line_min 0.05649185041622204 deviation-heading_max 0.8583234710357402 deviation-heading_mean 0.371509805944231 deviation-heading_median 0.3477435217829391 deviation-heading_min 0.1892537419842091 driven_any_max 1.6169932854589035 driven_any_mean 0.8549136794030617 driven_any_median 0.9441796518284096 driven_any_min 0.28668385087664994 driven_lanedir_consec_max 1.2433038249708377 driven_lanedir_consec_mean 0.5622432991481365 driven_lanedir_consec_min 0.24216121529728207 driven_lanedir_max 1.2433038249708377 driven_lanedir_mean 0.5622432991481365 driven_lanedir_median 0.47061816984274774 driven_lanedir_min 0.24216121529728207 in-drivable-lane_max 1.3499999999999996 in-drivable-lane_mean 0.5899999999999992 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08748391381016483, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03752420566700123, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.09025235087783248, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05577951448935049, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02332131509427671, "sim_compute_performance-ego": 0.040444767033612286, "sim_compute_robot_state-ego": 0.04233121871948242, "sim_compute_robot_state-npc0": 0.041774891040943285, "sim_compute_robot_state-npc1": 0.040584546548348886, "sim_compute_robot_state-npc2": 0.040428629627934205, "sim_compute_robot_state-npc3": 0.0404201657683761}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.0981775951385498, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.03592100143432617, "in-drivable-lane": 0, "agent_compute-ego": 0.08942995071411133, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.05541240692138672, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.023043909072875977, "sim_compute_performance-ego": 0.03880617141723633, "sim_compute_robot_state-ego": 0.04225399971008301, "sim_compute_robot_state-npc0": 0.04153904914855957, "sim_compute_robot_state-npc1": 0.040848388671875, "sim_compute_robot_state-npc2": 0.03966206550598145, "sim_compute_robot_state-npc3": 0.04017415046691895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.09457143043216906, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03650746220036557, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09054377204493472, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.05556058256249679, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.023163610383083944, "sim_compute_performance-ego": 0.0403082527612385, "sim_compute_robot_state-ego": 0.0418965220451355, "sim_compute_robot_state-npc0": 0.04117516781154432, "sim_compute_robot_state-npc1": 0.04084874768006174, "sim_compute_robot_state-npc2": 0.04021407428540682, "sim_compute_robot_state-npc3": 0.04007307479256078}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.09552646286879914, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03683512723898586, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09067580669741088, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05535458009454269, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.02294215371337118, "sim_compute_performance-ego": 0.03959648216827006, "sim_compute_robot_state-ego": 0.04197724861434744, "sim_compute_robot_state-npc0": 0.04198651675936542, "sim_compute_robot_state-npc1": 0.04054591323755964, "sim_compute_robot_state-npc2": 0.0401321785359443, "sim_compute_robot_state-npc3": 0.04044062578225437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09059114967073711, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.03723647764750889, "in-drivable-lane": 0, "agent_compute-ego": 0.09514439105987547, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05560668877192906, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023453056812286377, "sim_compute_performance-ego": 0.03978008883340018, "sim_compute_robot_state-ego": 0.04237709726606097, "sim_compute_robot_state-npc0": 0.0412551930972508, "sim_compute_robot_state-npc1": 0.04037027699606759, "sim_compute_robot_state-npc2": 0.0399661660194397, "sim_compute_robot_state-npc3": 0.03985844339643206}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08637514820805302, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.036958389812045626, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.09012735773015904, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.055496154008088286, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.02328871797632288, "sim_compute_performance-ego": 0.041944419896161114, "sim_compute_robot_state-ego": 0.04197420455791332, "sim_compute_robot_state-npc0": 0.04122307123961272, "sim_compute_robot_state-npc1": 0.040752940707736544, "sim_compute_robot_state-npc2": 0.04007095760769314, "sim_compute_robot_state-npc3": 0.03985007603963216}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.09105575526202168, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0367216843145865, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.09021308245482268, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05507029427422418, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.023038387298583984, "sim_compute_performance-ego": 0.040052974665606464, "sim_compute_robot_state-ego": 0.04187914177223488, "sim_compute_robot_state-npc0": 0.04157529053864656, "sim_compute_robot_state-npc1": 0.04035830056225812, "sim_compute_robot_state-npc2": 0.04037393022466589, "sim_compute_robot_state-npc3": 0.040435596748634624}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.10635848575168186, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03675602277119954, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.09115617540147568, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05582051806979709, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.02300056881374783, "sim_compute_performance-ego": 0.040228409237331814, "sim_compute_robot_state-ego": 0.04270912276373969, "sim_compute_robot_state-npc0": 0.04163814650641547, "sim_compute_robot_state-npc1": 0.04096650547451443, "sim_compute_robot_state-npc2": 0.04036630524529351, "sim_compute_robot_state-npc3": 0.040565872192382814}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.0883156216662863, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03691837062006411, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.09026378652323848, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05486440140268077, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022995658542798912, "sim_compute_performance-ego": 0.04002698608066725, "sim_compute_robot_state-ego": 0.04217061270838198, "sim_compute_robot_state-npc0": 0.0410450437794561, "sim_compute_robot_state-npc1": 0.0412386707637621, "sim_compute_robot_state-npc2": 0.04094730252804964, "sim_compute_robot_state-npc3": 0.040587150532266365}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.09971698760986328, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.04504415512084961, "in-drivable-lane": 0, "agent_compute-ego": 0.09007116794586181, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05503795623779297, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02306151866912842, "sim_compute_performance-ego": 0.042254490852355955, "sim_compute_robot_state-ego": 0.041920838356018064, "sim_compute_robot_state-npc0": 0.041054797172546384, "sim_compute_robot_state-npc1": 0.040208659172058105, "sim_compute_robot_state-npc2": 0.04039183616638184, "sim_compute_robot_state-npc3": 0.03978763580322266}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10898665189743044, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.037787222862243654, "in-drivable-lane": 0, "agent_compute-ego": 0.09013986587524414, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.055128955841064455, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.02345423698425293, "sim_compute_performance-ego": 0.04016985893249512, "sim_compute_robot_state-ego": 0.04151029586791992, "sim_compute_robot_state-npc0": 0.041510927677154544, "sim_compute_robot_state-npc1": 0.04127770662307739, "sim_compute_robot_state-npc2": 0.040328586101531984, "sim_compute_robot_state-npc3": 0.04024840593338013}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.09234875126888878, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03608061137952303, "in-drivable-lane": 0, "agent_compute-ego": 0.0898680561467221, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05530545586033871, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02278765879179302, "sim_compute_performance-ego": 0.039542976178620994, "sim_compute_robot_state-ego": 0.04179305779306512, "sim_compute_robot_state-npc0": 0.04081004544308311, "sim_compute_robot_state-npc1": 0.04019466199372944, "sim_compute_robot_state-npc2": 0.04045890506945158, "sim_compute_robot_state-npc3": 0.03983122424075478}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08525107383728027, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03671358585357666, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08981899261474609, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.054349212646484374, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.023401570320129395, "sim_compute_performance-ego": 0.03927504062652588, "sim_compute_robot_state-ego": 0.04173075675964356, "sim_compute_robot_state-npc0": 0.04141705513000488, "sim_compute_robot_state-npc1": 0.04052660942077637, "sim_compute_robot_state-npc2": 0.04108050346374512, "sim_compute_robot_state-npc3": 0.04014220237731934}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1062504920092496, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.037087451327930794, "in-drivable-lane": 0, "agent_compute-ego": 0.0916083509271795, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05489619211717085, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02337890321558172, "sim_compute_performance-ego": 0.040123159235174, "sim_compute_robot_state-ego": 0.04211744395169345, "sim_compute_robot_state-npc0": 0.04152271964333274, "sim_compute_robot_state-npc1": 0.04062561555342241, "sim_compute_robot_state-npc2": 0.040090571750294075, "sim_compute_robot_state-npc3": 0.03974735736846924}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10130530474137286, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03745815218711386, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.0897996085030692, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.055346284593854635, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.022533864391093353, "sim_compute_performance-ego": 0.040027594079776685, "sim_compute_robot_state-ego": 0.042368883989295184, "sim_compute_robot_state-npc0": 0.04158479340222417, "sim_compute_robot_state-npc1": 0.04063973621446259, "sim_compute_robot_state-npc2": 0.03994781630379813, "sim_compute_robot_state-npc3": 0.040493590491158624}}set_robot_commands_max 0.05582051806979709 set_robot_commands_mean 0.055268613192746806 set_robot_commands_median 0.055346284593854635 set_robot_commands_min 0.054349212646484374 sim_compute_performance-ego_max 0.042254490852355955 sim_compute_performance-ego_mean 0.040172111466564846 sim_compute_performance-ego_median 0.040052974665606464 sim_compute_performance-ego_min 0.03880617141723633 sim_compute_robot_state-ego_max 0.04270912276373969 sim_compute_robot_state-ego_mean 0.04206736299166763 sim_compute_robot_state-ego_median 0.04197724861434744 sim_compute_robot_state-ego_min 0.04151029586791992 sim_compute_robot_state-npc0_max 0.04198651675936542 sim_compute_robot_state-npc0_mean 0.041407513892676016 sim_compute_robot_state-npc0_median 0.041510927677154544 sim_compute_robot_state-npc0_min 0.04081004544308311 sim_compute_robot_state-npc1_max 0.04127770662307739 sim_compute_robot_state-npc1_mean 0.04066581864131402 sim_compute_robot_state-npc1_median 0.04062561555342241 sim_compute_robot_state-npc1_min 0.04019466199372944 sim_compute_robot_state-npc2_max 0.04108050346374512 sim_compute_robot_state-npc2_mean 0.04029732189570743 sim_compute_robot_state-npc2_median 0.040328586101531984 sim_compute_robot_state-npc2_min 0.03966206550598145 sim_compute_robot_state-npc3_max 0.040587150532266365 sim_compute_robot_state-npc3_mean 0.040177038128917535 sim_compute_robot_state-npc3_median 0.04017415046691895 sim_compute_robot_state-npc3_min 0.03974735736846924 sim_compute_sim_state_max 0.02345423698425293 sim_compute_sim_state_mean 0.02312434200528845 sim_compute_sim_state_median 0.02306151866912842 sim_compute_sim_state_min 0.022533864391093353 sim_physics_max 0.10898665189743044 sim_physics_mean 0.09548765494483652 sim_physics_median 0.09457143043216906 sim_physics_min 0.08525107383728027 sim_render-ego_max 0.04504415512084961 sim_render-ego_mean 0.03743666136248807 sim_render-ego_median 0.03691837062006411 sim_render-ego_min 0.03592100143432617 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2366666666666655 survival_time_min 0.9500000000000004
No reset possible 23714
3740
jiang peng LF sim test - wh aido2-LFV-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-21 16:43:59+00:00 2019-05-21 16:57:30+00:00 0:13:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2680825948255388 survival_time_median 6.999999999999983 deviation-center-line_median 0.4036830621352199 in-drivable-lane_median 1.5000000000000062
other stats agent_compute-ego_max 0.10107710659503936 agent_compute-ego_mean 0.10044021550246648 agent_compute-ego_median 0.10067240851266045 agent_compute-ego_min 0.0995094100634257 deviation-center-line_max 1.308331987214011 deviation-center-line_mean 0.6972254173307504 deviation-center-line_min 0.20950118463033576 deviation-heading_max 4.5969498233482575 deviation-heading_mean 2.010237308221182 deviation-heading_median 1.892141705539839 deviation-heading_min 0.33994119971330583 driven_any_max 5.199519768748244 driven_any_mean 2.51269819192411 driven_any_median 1.6411861839802668 driven_any_min 1.063437507534733 driven_lanedir_consec_max 4.652405255926178 driven_lanedir_consec_mean 2.0198113231986587 driven_lanedir_consec_min 0.5727761043013953 driven_lanedir_max 4.652405255926178 driven_lanedir_mean 2.0220034311216644 driven_lanedir_median 1.2790431344405675 driven_lanedir_min 0.5727761043013953 in-drivable-lane_max 5.099999999999982 in-drivable-lane_mean 2.069999999999999 in-drivable-lane_min 0.7499999999999973 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.063437507534733, "sim_physics": 0.08189107860837663, "survival_time": 6.999999999999983, "driven_lanedir": 0.5727761043013953, "sim_render-ego": 0.03602158171789987, "in-drivable-lane": 5.099999999999982, "agent_compute-ego": 0.10067240851266045, "deviation-heading": 0.33994119971330583, "set_robot_commands": 0.05622274875640869, "deviation-center-line": 0.20950118463033576, "driven_lanedir_consec": 0.5727761043013953, "sim_compute_sim_state": 0.022980138233729772, "sim_compute_performance-ego": 0.04000005892344883, "sim_compute_robot_state-ego": 0.04173712730407715, "sim_compute_robot_state-npc0": 0.04093869243349347, "sim_compute_robot_state-npc1": 0.04012874705450875, "sim_compute_robot_state-npc2": 0.0398763826915196, "sim_compute_robot_state-npc3": 0.04009952204568046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.199519768748244, "sim_physics": 0.0881436276435852, "survival_time": 14.950000000000076, "driven_lanedir": 4.652405255926178, "sim_render-ego": 0.03625224510828654, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.10101362546284992, "deviation-heading": 2.5813805813860555, "set_robot_commands": 0.05822129329045614, "deviation-center-line": 1.308331987214011, "driven_lanedir_consec": 4.652405255926178, "sim_compute_sim_state": 0.022829655011494955, "sim_compute_performance-ego": 0.039620129267374675, "sim_compute_robot_state-ego": 0.041133146286010745, "sim_compute_robot_state-npc0": 0.040894046624501544, "sim_compute_robot_state-npc1": 0.03995526870091756, "sim_compute_robot_state-npc2": 0.03976868391036987, "sim_compute_robot_state-npc3": 0.039664711157480874}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.610185720421281, "sim_physics": 0.0922094076871872, "survival_time": 3.999999999999994, "driven_lanedir": 1.2653212214549727, "sim_render-ego": 0.03626855611801147, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.10107710659503936, "deviation-heading": 0.6407732311184526, "set_robot_commands": 0.0554614007472992, "deviation-center-line": 0.29305616254275557, "driven_lanedir_consec": 1.2653212214549727, "sim_compute_sim_state": 0.023196595907211303, "sim_compute_performance-ego": 0.0398299902677536, "sim_compute_robot_state-ego": 0.0412327766418457, "sim_compute_robot_state-npc0": 0.04110535085201263, "sim_compute_robot_state-npc1": 0.04060029685497284, "sim_compute_robot_state-npc2": 0.03999173939228058, "sim_compute_robot_state-npc3": 0.04017433226108551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6411861839802668, "sim_physics": 0.08639048139254252, "survival_time": 5.999999999999987, "driven_lanedir": 1.2790431344405675, "sim_render-ego": 0.035730590422948204, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.0995094100634257, "deviation-heading": 1.892141705539839, "set_robot_commands": 0.05609984000523885, "deviation-center-line": 0.4036830621352199, "driven_lanedir_consec": 1.2680825948255388, "sim_compute_sim_state": 0.022533241907755533, "sim_compute_performance-ego": 0.039103613297144575, "sim_compute_robot_state-ego": 0.04090777039527893, "sim_compute_robot_state-npc0": 0.04031384785970052, "sim_compute_robot_state-npc1": 0.03964723149935404, "sim_compute_robot_state-npc2": 0.039785073200861616, "sim_compute_robot_state-npc3": 0.03908820748329163}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.049161778936024, "sim_physics": 0.08222603877385458, "survival_time": 14.950000000000076, "driven_lanedir": 2.3404714394852077, "sim_render-ego": 0.03577154556910197, "in-drivable-lane": 1.5000000000000062, "agent_compute-ego": 0.09992852687835692, "deviation-heading": 4.5969498233482575, "set_robot_commands": 0.05537312746047974, "deviation-center-line": 1.27155469013143, "driven_lanedir_consec": 2.3404714394852077, "sim_compute_sim_state": 0.02266944408416748, "sim_compute_performance-ego": 0.03907036383946737, "sim_compute_robot_state-ego": 0.041365419228871665, "sim_compute_robot_state-npc0": 0.04028188784917196, "sim_compute_robot_state-npc1": 0.039699108600616456, "sim_compute_robot_state-npc2": 0.0394242246945699, "sim_compute_robot_state-npc3": 0.039424532254536945}}set_robot_commands_max 0.05822129329045614 set_robot_commands_mean 0.05627568205197653 set_robot_commands_median 0.05609984000523885 set_robot_commands_min 0.05537312746047974 sim_compute_performance-ego_max 0.04000005892344883 sim_compute_performance-ego_mean 0.03952483111903781 sim_compute_performance-ego_median 0.039620129267374675 sim_compute_performance-ego_min 0.03907036383946737 sim_compute_robot_state-ego_max 0.04173712730407715 sim_compute_robot_state-ego_mean 0.04127524797121683 sim_compute_robot_state-ego_median 0.0412327766418457 sim_compute_robot_state-ego_min 0.04090777039527893 sim_compute_robot_state-npc0_max 0.04110535085201263 sim_compute_robot_state-npc0_mean 0.04070676512377602 sim_compute_robot_state-npc0_median 0.040894046624501544 sim_compute_robot_state-npc0_min 0.04028188784917196 sim_compute_robot_state-npc1_max 0.04060029685497284 sim_compute_robot_state-npc1_mean 0.04000613054207393 sim_compute_robot_state-npc1_median 0.03995526870091756 sim_compute_robot_state-npc1_min 0.03964723149935404 sim_compute_robot_state-npc2_max 0.03999173939228058 sim_compute_robot_state-npc2_mean 0.03976922077792032 sim_compute_robot_state-npc2_median 0.039785073200861616 sim_compute_robot_state-npc2_min 0.0394242246945699 sim_compute_robot_state-npc3_max 0.04017433226108551 sim_compute_robot_state-npc3_mean 0.039690261040415085 sim_compute_robot_state-npc3_median 0.039664711157480874 sim_compute_robot_state-npc3_min 0.03908820748329163 sim_compute_sim_state_max 0.023196595907211303 sim_compute_sim_state_mean 0.02284181502887181 sim_compute_sim_state_median 0.022829655011494955 sim_compute_sim_state_min 0.022533241907755533 sim_physics_max 0.0922094076871872 sim_physics_mean 0.08617212682110922 sim_physics_median 0.08639048139254252 sim_physics_min 0.08189107860837663 sim_render-ego_max 0.03626855611801147 sim_render-ego_mean 0.036008903787249615 sim_render-ego_median 0.03602158171789987 sim_render-ego_min 0.035730590422948204 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.380000000000024 survival_time_min 3.999999999999994
No reset possible 23700
3730
jiang peng LF sim test - wh aido2-LFV-sim-testing
step1-simulation error yes ip-172-31-40-253-3847
2019-05-21 15:46:59+00:00 2019-05-21 16:00:50+00:00 0:13:51 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23686
3723
jiang peng Second test -RGB- TH-jp aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-21 15:12:50+00:00 2019-05-21 15:24:59+00:00 0:12:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.12384362556172056 survival_time_median 14.950000000000076 deviation-center-line_median 0.44968712428343416 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.10367570241292318 agent_compute-ego_mean 0.10248382086980908 agent_compute-ego_median 0.1022684939702352 agent_compute-ego_min 0.10192000309626262 deviation-center-line_max 0.8955570411533516 deviation-center-line_mean 0.506008282026704 deviation-center-line_min 0.14766215279886277 deviation-heading_max 4.258856738101937 deviation-heading_mean 2.581976201641489 deviation-heading_median 2.79893897512231 deviation-heading_min 0.6848851153488514 driven_any_max 0.9727403914838488 driven_any_mean 0.4131260690736247 driven_any_median 0.15866560527590537 driven_any_min 0.0978495400597368 driven_lanedir_consec_max 0.9662462913344538 driven_lanedir_consec_mean 0.40330875778998954 driven_lanedir_consec_min 0.0961501857959215 driven_lanedir_max 0.9662462913344538 driven_lanedir_mean 0.40330875778998954 driven_lanedir_median 0.12384362556172056 driven_lanedir_min 0.0961501857959215 in-drivable-lane_max 0.15000000000000013 in-drivable-lane_mean 0.030000000000000027 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.0978495400597368, "sim_physics": 0.0545974866549174, "survival_time": 14.950000000000076, "driven_lanedir": 0.0961501857959215, "sim_render-ego": 0.036753011544545494, "in-drivable-lane": 0, "agent_compute-ego": 0.10367570241292318, "deviation-heading": 3.01318674835583, "set_robot_commands": 0.05502467155456543, "deviation-center-line": 0.8955570411533516, "driven_lanedir_consec": 0.0961501857959215, "sim_compute_sim_state": 0.023402520815531413, "sim_compute_performance-ego": 0.03956474542617798, "sim_compute_robot_state-ego": 0.041250795523325605}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.10206542241109312, "sim_physics": 0.05326637983322144, "survival_time": 14.950000000000076, "driven_lanedir": 0.1008171932334786, "sim_render-ego": 0.036115954717000326, "in-drivable-lane": 0, "agent_compute-ego": 0.1022684939702352, "deviation-heading": 2.154013431278516, "set_robot_commands": 0.05528174956639608, "deviation-center-line": 0.2406555536076634, "driven_lanedir_consec": 0.1008171932334786, "sim_compute_sim_state": 0.023339441617329915, "sim_compute_performance-ego": 0.03952980120976766, "sim_compute_robot_state-ego": 0.041354459126790366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15866560527590537, "sim_physics": 0.05533323969159808, "survival_time": 1.7500000000000009, "driven_lanedir": 0.12384362556172056, "sim_render-ego": 0.03538871492658343, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.10235740797860282, "deviation-heading": 0.6848851153488514, "set_robot_commands": 0.05469413484845843, "deviation-center-line": 0.14766215279886277, "driven_lanedir_consec": 0.12384362556172056, "sim_compute_sim_state": 0.02359170232500349, "sim_compute_performance-ego": 0.0407703059060233, "sim_compute_robot_state-ego": 0.04114536557878767}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7343093861375396, "sim_physics": 0.055194002787272135, "survival_time": 14.950000000000076, "driven_lanedir": 0.729486493024373, "sim_render-ego": 0.03639833132425944, "in-drivable-lane": 0, "agent_compute-ego": 0.10219749689102171, "deviation-heading": 2.79893897512231, "set_robot_commands": 0.05500343084335327, "deviation-center-line": 0.44968712428343416, "driven_lanedir_consec": 0.729486493024373, "sim_compute_sim_state": 0.023314042886098223, "sim_compute_performance-ego": 0.039305177529652915, "sim_compute_robot_state-ego": 0.041023983160654705}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9727403914838488, "sim_physics": 0.054979663689931235, "survival_time": 14.950000000000076, "driven_lanedir": 0.9662462913344538, "sim_render-ego": 0.03634351889292399, "in-drivable-lane": 0, "agent_compute-ego": 0.10192000309626262, "deviation-heading": 4.258856738101937, "set_robot_commands": 0.05508118391036987, "deviation-center-line": 0.7964795382902085, "driven_lanedir_consec": 0.9662462913344538, "sim_compute_sim_state": 0.02325332005818685, "sim_compute_performance-ego": 0.039422608216603594, "sim_compute_robot_state-ego": 0.041205250422159834}}set_robot_commands_max 0.05528174956639608 set_robot_commands_mean 0.05501703414462862 set_robot_commands_median 0.05502467155456543 set_robot_commands_min 0.05469413484845843 sim_compute_performance-ego_max 0.0407703059060233 sim_compute_performance-ego_mean 0.03971852765764509 sim_compute_performance-ego_median 0.03952980120976766 sim_compute_performance-ego_min 0.039305177529652915 sim_compute_robot_state-ego_max 0.041354459126790366 sim_compute_robot_state-ego_mean 0.04119597076234364 sim_compute_robot_state-ego_median 0.041205250422159834 sim_compute_robot_state-ego_min 0.041023983160654705 sim_compute_sim_state_max 0.02359170232500349 sim_compute_sim_state_mean 0.02338020554042998 sim_compute_sim_state_median 0.023339441617329915 sim_compute_sim_state_min 0.02325332005818685 sim_physics_max 0.05533323969159808 sim_physics_mean 0.05467415453138806 sim_physics_median 0.054979663689931235 sim_physics_min 0.05326637983322144 sim_render-ego_max 0.036753011544545494 sim_render-ego_mean 0.03619990628106253 sim_render-ego_median 0.03634351889292399 sim_render-ego_min 0.03538871492658343 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.310000000000064 survival_time_min 1.7500000000000009
No reset possible 23683
3722
jiang peng LF sim test - wh aido2-LF-sim-testing
step1-simulation failed yes ip-172-31-40-253-3847
2019-05-21 15:10:22+00:00 2019-05-21 15:11:05+00:00 0:00:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 297, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 60, in on_received_get_commands
|| action = self.compute_action(self.current_image)
|| File "solution.py", line 47, in compute_action
|| if action[0]<1e-2:
|| UnboundLocalError: local variable 'action' referenced before assignment
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 441, in <module>
wrap(cie)
File "experiment_manager.py", line 429, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 301, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23670
3714
jiang peng final test - wh aido2-LF-sim-testing
step1-simulation error yes ip-172-31-40-253-3847
2019-05-21 14:40:23+00:00 2019-05-21 15:01:15+00:00 0:20:52 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23594
3695
Manfred Diaz challenge-aido_LF-template-tensorflow aido2-LFV-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-20 20:44:12+00:00 2019-05-20 20:51:50+00:00 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.38570501583005834 survival_time_median 2.7499999999999982 deviation-center-line_median 0.1830200250640151 in-drivable-lane_median 0.34999999999999876
other stats agent_compute-ego_max 0.08930998715487394 agent_compute-ego_mean 0.08801351755843988 agent_compute-ego_median 0.08868340106859599 agent_compute-ego_min 0.08660580831415512 deviation-center-line_max 0.4868109247638323 deviation-center-line_mean 0.23367544172047375 deviation-center-line_min 0.11241981500944132 deviation-heading_max 2.2570729896243744 deviation-heading_mean 1.2799310618260402 deviation-heading_median 0.9007141503429875 deviation-heading_min 0.4273218245473685 driven_any_max 1.7152054523730864 driven_any_mean 0.7583494004211413 driven_any_median 0.6223920953526237 driven_any_min 0.3634098801461044 driven_lanedir_consec_max 1.1037466669788063 driven_lanedir_consec_mean 0.5266538564659718 driven_lanedir_consec_min 0.27868395075345886 driven_lanedir_max 1.1037466669788063 driven_lanedir_mean 0.5462544273542824 driven_lanedir_median 0.38570501583005834 driven_lanedir_min 0.3431156367839603 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.5399999999999985 in-drivable-lane_min 0.05000000000000005 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6527377780557704, "sim_physics": 0.09486011591824618, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5220180119835756, "sim_render-ego": 0.03764090538024902, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.08930998715487394, "deviation-heading": 0.9007141503429875, "set_robot_commands": 0.05767260464754972, "deviation-center-line": 0.16864171606822467, "driven_lanedir_consec": 0.5220180119835756, "sim_compute_sim_state": 0.02331348332491788, "sim_compute_performance-ego": 0.040728096528486774, "sim_compute_robot_state-ego": 0.04293740879405628, "sim_compute_robot_state-npc0": 0.04207406477494673, "sim_compute_robot_state-npc1": 0.04054034406488592, "sim_compute_robot_state-npc2": 0.040583220395174896, "sim_compute_robot_state-npc3": 0.04070664752613414}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4380017961781212, "sim_physics": 0.09457332246443804, "survival_time": 1.7000000000000008, "driven_lanedir": 0.38570501583005834, "sim_render-ego": 0.03667309003717759, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08660580831415512, "deviation-heading": 0.6368370883593325, "set_robot_commands": 0.05621025842778823, "deviation-center-line": 0.11241981500944132, "driven_lanedir_consec": 0.38570501583005834, "sim_compute_sim_state": 0.023149756824269015, "sim_compute_performance-ego": 0.04042929761550006, "sim_compute_robot_state-ego": 0.042383397326749915, "sim_compute_robot_state-npc0": 0.04287139107199276, "sim_compute_robot_state-npc1": 0.041289020987117994, "sim_compute_robot_state-npc2": 0.040540120180915386, "sim_compute_robot_state-npc3": 0.040253372753367704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3634098801461044, "sim_physics": 0.09803730088311272, "survival_time": 1.850000000000001, "driven_lanedir": 0.3431156367839603, "sim_render-ego": 0.03741579442410856, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.08670350667592641, "deviation-heading": 0.4273218245473685, "set_robot_commands": 0.05557182028486922, "deviation-center-line": 0.1830200250640151, "driven_lanedir_consec": 0.3431156367839603, "sim_compute_sim_state": 0.023157583700644004, "sim_compute_performance-ego": 0.040481032551945864, "sim_compute_robot_state-ego": 0.04291528624457282, "sim_compute_robot_state-npc0": 0.04228154388633934, "sim_compute_robot_state-npc1": 0.04097740070239918, "sim_compute_robot_state-npc2": 0.04066821046777674, "sim_compute_robot_state-npc3": 0.04122836525375779}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7152054523730864, "sim_physics": 0.08862238387538962, "survival_time": 7.299999999999982, "driven_lanedir": 1.1037466669788063, "sim_render-ego": 0.037102473925237786, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08868340106859599, "deviation-heading": 2.2570729896243744, "set_robot_commands": 0.05571769688227405, "deviation-center-line": 0.4868109247638323, "driven_lanedir_consec": 1.1037466669788063, "sim_compute_sim_state": 0.023634703191992356, "sim_compute_performance-ego": 0.04045876574842897, "sim_compute_robot_state-ego": 0.04228884226655307, "sim_compute_robot_state-npc0": 0.04192583201682731, "sim_compute_robot_state-npc1": 0.04103748929010679, "sim_compute_robot_state-npc2": 0.040568704474462224, "sim_compute_robot_state-npc3": 0.04069275725377749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6223920953526237, "sim_physics": 0.0965369032390082, "survival_time": 3.349999999999996, "driven_lanedir": 0.3766868051950114, "sim_render-ego": 0.03726253224842584, "in-drivable-lane": 0.3999999999999993, "agent_compute-ego": 0.0887648845786479, "deviation-heading": 2.1777092562561373, "set_robot_commands": 0.056640963056194246, "deviation-center-line": 0.21748472769685528, "driven_lanedir_consec": 0.27868395075345886, "sim_compute_sim_state": 0.023236025625200413, "sim_compute_performance-ego": 0.04084755769416468, "sim_compute_robot_state-ego": 0.04229061639131005, "sim_compute_robot_state-npc0": 0.0413450767744833, "sim_compute_robot_state-npc1": 0.040435556155532154, "sim_compute_robot_state-npc2": 0.04037141088229507, "sim_compute_robot_state-npc3": 0.04031317269624169}}set_robot_commands_max 0.05767260464754972 set_robot_commands_mean 0.05636266865973509 set_robot_commands_median 0.05621025842778823 set_robot_commands_min 0.05557182028486922 sim_compute_performance-ego_max 0.04084755769416468 sim_compute_performance-ego_mean 0.04058895002770527 sim_compute_performance-ego_median 0.040481032551945864 sim_compute_performance-ego_min 0.04042929761550006 sim_compute_robot_state-ego_max 0.04293740879405628 sim_compute_robot_state-ego_mean 0.04256311020464843 sim_compute_robot_state-ego_median 0.042383397326749915 sim_compute_robot_state-ego_min 0.04228884226655307 sim_compute_robot_state-npc0_max 0.04287139107199276 sim_compute_robot_state-npc0_mean 0.042099581704917885 sim_compute_robot_state-npc0_median 0.04207406477494673 sim_compute_robot_state-npc0_min 0.0413450767744833 sim_compute_robot_state-npc1_max 0.041289020987117994 sim_compute_robot_state-npc1_mean 0.04085596224000841 sim_compute_robot_state-npc1_median 0.04097740070239918 sim_compute_robot_state-npc1_min 0.040435556155532154 sim_compute_robot_state-npc2_max 0.04066821046777674 sim_compute_robot_state-npc2_mean 0.040546333280124865 sim_compute_robot_state-npc2_median 0.040568704474462224 sim_compute_robot_state-npc2_min 0.04037141088229507 sim_compute_robot_state-npc3_max 0.04122836525375779 sim_compute_robot_state-npc3_mean 0.04063886309665576 sim_compute_robot_state-npc3_median 0.04069275725377749 sim_compute_robot_state-npc3_min 0.040253372753367704 sim_compute_sim_state_max 0.023634703191992356 sim_compute_sim_state_mean 0.023298310533404733 sim_compute_sim_state_median 0.023236025625200413 sim_compute_sim_state_min 0.023149756824269015 sim_physics_max 0.09803730088311272 sim_physics_mean 0.09452600527603897 sim_physics_median 0.09486011591824618 sim_physics_min 0.08862238387538962 sim_render-ego_max 0.03764090538024902 sim_render-ego_mean 0.03721895920303976 sim_render-ego_median 0.03726253224842584 sim_render-ego_min 0.03667309003717759 simulation-passed 1 survival_time_max 7.299999999999982 survival_time_mean 3.389999999999996 survival_time_min 1.7000000000000008
No reset possible 23458
3651
FANG MEIYI 🇸🇬test aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-20 03:15:32+00:00 2019-05-20 03:28:58+00:00 0:13:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8874164793480672 survival_time_median 12.600000000000044 deviation-center-line_median 0.6842255228273263 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.13195606281882838 agent_compute-ego_mean 0.11412451851020688 agent_compute-ego_median 0.1213131129184616 agent_compute-ego_min 0.09275409910413954 deviation-center-line_max 0.8267650336018489 deviation-center-line_mean 0.6247884434850932 deviation-center-line_min 0.2424943523562899 deviation-heading_max 3.0487774791766435 deviation-heading_mean 1.9022308954172975 deviation-heading_median 2.0024219416340188 deviation-heading_min 0.8181291229215135 driven_any_max 3.639865283486979 driven_any_mean 2.5740402434858716 driven_any_median 2.619807800990891 driven_any_min 1.172981649357779 driven_lanedir_consec_max 3.616658755239362 driven_lanedir_consec_mean 2.36970188436488 driven_lanedir_consec_min 1.1532591823184015 driven_lanedir_max 3.616658755239362 driven_lanedir_mean 2.36970188436488 driven_lanedir_median 1.8874164793480672 driven_lanedir_min 1.1532591823184015 in-drivable-lane_max 2.9000000000000377 in-drivable-lane_mean 0.6300000000000082 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.619807800990891, "sim_physics": 0.05963221618107387, "survival_time": 12.600000000000044, "driven_lanedir": 1.8448913073393731, "sim_render-ego": 0.03661983259140499, "in-drivable-lane": 2.9000000000000377, "agent_compute-ego": 0.09275409910413954, "deviation-heading": 3.0487774791766435, "set_robot_commands": 0.05511638664063953, "deviation-center-line": 0.8267650336018489, "driven_lanedir_consec": 1.8448913073393731, "sim_compute_sim_state": 0.023373998346782863, "sim_compute_performance-ego": 0.03952610019653562, "sim_compute_robot_state-ego": 0.04152825238212707}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.639865283486979, "sim_physics": 0.05605815966924032, "survival_time": 14.950000000000076, "driven_lanedir": 3.616658755239362, "sim_render-ego": 0.0367551040649414, "in-drivable-lane": 0, "agent_compute-ego": 0.09292973359425864, "deviation-heading": 1.2762923266136157, "set_robot_commands": 0.05713132460912069, "deviation-center-line": 0.6529553897960417, "driven_lanedir_consec": 3.616658755239362, "sim_compute_sim_state": 0.024109305540720626, "sim_compute_performance-ego": 0.04042894601821899, "sim_compute_robot_state-ego": 0.04201446771621704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.395490148597132, "sim_physics": 0.0763342539469401, "survival_time": 14.950000000000076, "driven_lanedir": 3.3462836975791967, "sim_render-ego": 0.04617169698079427, "in-drivable-lane": 0, "agent_compute-ego": 0.13166958411534627, "deviation-heading": 2.0024219416340188, "set_robot_commands": 0.0691435448328654, "deviation-center-line": 0.7175019188439589, "driven_lanedir_consec": 3.3462836975791967, "sim_compute_sim_state": 0.02934378703435262, "sim_compute_performance-ego": 0.04976915677388509, "sim_compute_robot_state-ego": 0.05306248664855957}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.172981649357779, "sim_physics": 0.07902510366707205, "survival_time": 5.349999999999989, "driven_lanedir": 1.1532591823184015, "sim_render-ego": 0.04785667178786804, "in-drivable-lane": 0, "agent_compute-ego": 0.1213131129184616, "deviation-heading": 0.8181291229215135, "set_robot_commands": 0.07279393606096785, "deviation-center-line": 0.2424943523562899, "driven_lanedir_consec": 1.1532591823184015, "sim_compute_sim_state": 0.030984637893248942, "sim_compute_performance-ego": 0.05424531375136331, "sim_compute_robot_state-ego": 0.054710655568916106}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0420563349965772, "sim_physics": 0.08299718656037983, "survival_time": 9.5, "driven_lanedir": 1.8874164793480672, "sim_render-ego": 0.05058938704038921, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.13195606281882838, "deviation-heading": 2.365533606740696, "set_robot_commands": 0.07868105612303081, "deviation-center-line": 0.6842255228273263, "driven_lanedir_consec": 1.8874164793480672, "sim_compute_sim_state": 0.03192770732076545, "sim_compute_performance-ego": 0.05530772711101331, "sim_compute_robot_state-ego": 0.05888144342522872}}set_robot_commands_max 0.07868105612303081 set_robot_commands_mean 0.06657324965332485 set_robot_commands_median 0.0691435448328654 set_robot_commands_min 0.05511638664063953 sim_compute_performance-ego_max 0.05530772711101331 sim_compute_performance-ego_mean 0.047855448770203264 sim_compute_performance-ego_median 0.04976915677388509 sim_compute_performance-ego_min 0.03952610019653562 sim_compute_robot_state-ego_max 0.05888144342522872 sim_compute_robot_state-ego_mean 0.050039461148209695 sim_compute_robot_state-ego_median 0.05306248664855957 sim_compute_robot_state-ego_min 0.04152825238212707 sim_compute_sim_state_max 0.03192770732076545 sim_compute_sim_state_mean 0.0279478872271741 sim_compute_sim_state_median 0.02934378703435262 sim_compute_sim_state_min 0.023373998346782863 sim_physics_max 0.08299718656037983 sim_physics_mean 0.07080938400494123 sim_physics_median 0.0763342539469401 sim_physics_min 0.05605815966924032 sim_render-ego_max 0.05058938704038921 sim_render-ego_mean 0.04359853849307958 sim_render-ego_median 0.04617169698079427 sim_render-ego_min 0.03661983259140499 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.470000000000038 survival_time_min 5.349999999999989
No reset possible 23454
3648
Tony Hsu 🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation aborted yes ip-172-31-40-253-3847
2019-05-20 02:48:42+00:00 2019-05-20 03:01:57+00:00 0:13:15 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23324
3598
Victor Adolfo Romero Cano 🇨🇴aido2-LFV-sim-validation
step1-simulation success yes ip-172-31-40-253-3847
2019-05-18 16:27:41+00:00 2019-05-18 16:36:29+00:00 0:08:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.1636180111340114 agent_compute-ego_mean 0.15548824175908274 agent_compute-ego_median 0.15149415293826332 agent_compute-ego_min 0.1499622344970703 deviation-center-line_max 0.1743913456502906 deviation-center-line_mean 0.12651756552531995 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599273 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811214 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589035 driven_any_mean 1.0272530755098266 driven_any_median 1.0243289631429708 driven_any_min 0.4119037580118998 driven_lanedir_consec_max 1.2433038249708377 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708377 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17393668051119204, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06465643423574942, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16225831596939652, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09827004538642035, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03938384409304018, "sim_compute_performance-ego": 0.06887352466583252, "sim_compute_robot_state-ego": 0.07642809549967448, "sim_compute_robot_state-npc0": 0.06765392974570945, "sim_compute_robot_state-npc1": 0.06832265853881836, "sim_compute_robot_state-npc2": 0.07012453344133165, "sim_compute_robot_state-npc3": 0.07100137074788411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17327096939086914, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06263805389404296, "in-drivable-lane": 0, "agent_compute-ego": 0.1499622344970703, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09258023262023926, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.037319364547729494, "sim_compute_performance-ego": 0.06942743301391602, "sim_compute_robot_state-ego": 0.06968855857849121, "sim_compute_robot_state-npc0": 0.06899770736694336, "sim_compute_robot_state-npc1": 0.06941263198852539, "sim_compute_robot_state-npc2": 0.06937885284423828, "sim_compute_robot_state-npc3": 0.06940648078918457}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17156648949572914, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05980373370020013, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1501084942566721, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09378794619911596, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03906741895173725, "sim_compute_performance-ego": 0.06440149169219167, "sim_compute_robot_state-ego": 0.07138939280258982, "sim_compute_robot_state-npc0": 0.06736151481929578, "sim_compute_robot_state-npc1": 0.06616758045397307, "sim_compute_robot_state-npc2": 0.06731074734737999, "sim_compute_robot_state-npc3": 0.06791826925779644}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1879996680006196, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06025430220591871, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15149415293826332, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09718008886409712, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04088437104526954, "sim_compute_performance-ego": 0.06881147698511052, "sim_compute_robot_state-ego": 0.07447367378428013, "sim_compute_robot_state-npc0": 0.06951101822189137, "sim_compute_robot_state-npc1": 0.06808224509033976, "sim_compute_robot_state-npc2": 0.0681146338016172, "sim_compute_robot_state-npc3": 0.06964153579518764}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1737396206174578, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06514853239059448, "in-drivable-lane": 0, "agent_compute-ego": 0.1636180111340114, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0961583001273019, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03866051776068551, "sim_compute_performance-ego": 0.07107406854629517, "sim_compute_robot_state-ego": 0.0726250410079956, "sim_compute_robot_state-npc0": 0.07096328054155622, "sim_compute_robot_state-npc1": 0.07279522929872785, "sim_compute_robot_state-npc2": 0.07091809170586723, "sim_compute_robot_state-npc3": 0.0687963536807469}}set_robot_commands_max 0.09827004538642035 set_robot_commands_mean 0.0955953226394349 set_robot_commands_median 0.0961583001273019 set_robot_commands_min 0.09258023262023926 sim_compute_performance-ego_max 0.07107406854629517 sim_compute_performance-ego_mean 0.06851759898066918 sim_compute_performance-ego_median 0.06887352466583252 sim_compute_performance-ego_min 0.06440149169219167 sim_compute_robot_state-ego_max 0.07642809549967448 sim_compute_robot_state-ego_mean 0.07292095233460624 sim_compute_robot_state-ego_median 0.0726250410079956 sim_compute_robot_state-ego_min 0.06968855857849121 sim_compute_robot_state-npc0_max 0.07096328054155622 sim_compute_robot_state-npc0_mean 0.06889749013907924 sim_compute_robot_state-npc0_median 0.06899770736694336 sim_compute_robot_state-npc0_min 0.06736151481929578 sim_compute_robot_state-npc1_max 0.07279522929872785 sim_compute_robot_state-npc1_mean 0.06895606907407689 sim_compute_robot_state-npc1_median 0.06832265853881836 sim_compute_robot_state-npc1_min 0.06616758045397307 sim_compute_robot_state-npc2_max 0.07091809170586723 sim_compute_robot_state-npc2_mean 0.06916937182808687 sim_compute_robot_state-npc2_median 0.06937885284423828 sim_compute_robot_state-npc2_min 0.06731074734737999 sim_compute_robot_state-npc3_max 0.07100137074788411 sim_compute_robot_state-npc3_mean 0.06935280205415992 sim_compute_robot_state-npc3_median 0.06940648078918457 sim_compute_robot_state-npc3_min 0.06791826925779644 sim_compute_sim_state_max 0.04088437104526954 sim_compute_sim_state_mean 0.0390631032796924 sim_compute_sim_state_median 0.03906741895173725 sim_compute_sim_state_min 0.037319364547729494 sim_physics_max 0.1879996680006196 sim_physics_mean 0.17610268560317355 sim_physics_median 0.1737396206174578 sim_physics_min 0.17156648949572914 sim_render-ego_max 0.06514853239059448 sim_render-ego_mean 0.06250021128530114 sim_render-ego_median 0.06263805389404296 sim_render-ego_min 0.05980373370020013 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 23321
3592
Victor Adolfo Romero Cano 🇨🇴PredictorLast aido2-PRED
step1-simulation success no ip-172-31-40-253-3847
2019-05-18 14:23:56+00:00 2019-05-18 14:24:27+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.09793558761413096 error_L2 0.014616395845197337
No reset possible 23290
3507
Bea Baselines 🐤challenge-aido_LF-template-pytorch aido2-LF-sim-validation
step1-simulation error yes ip-172-31-40-253-3847
2019-05-17 20:50:05+00:00 2019-05-17 21:00:27+00:00 0:10:22 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23162
3563
Bhairav Mehta Baseline solution using reinforcement learning aido2-LFV-sim-testing
step1-simulation error yes ip-172-31-40-253-3847
2019-05-17 16:13:20+00:00 2019-05-17 16:15:01+00:00 0:01:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible