Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 219073346Anastasiya Nikolskaya JetBrains Research aido2-LFVI-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-12 18:01:56+00:00 2019-05-12 18:28:11+00:00 0:26:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0260224694976454 survival_time_median 13.500000000000057 deviation-center-line_median 0.9683246898699872 in-drivable-lane_median 0.350000000000005
other stats agent_compute-ego_max 0.08242962916692098 agent_compute-ego_mean 0.08144963303897768 agent_compute-ego_median 0.08172798156738281 agent_compute-ego_min 0.08003872315088909 deviation-center-line_max 1.2182778429890082 deviation-center-line_mean 0.8230267104977231 deviation-center-line_min 0.2304731305579763 deviation-heading_max 3.024002612278028 deviation-heading_mean 2.4273839701648785 deviation-heading_median 2.7095001555136946 deviation-heading_min 0.8068018724906076 driven_any_max 2.7226754275488636 driven_any_mean 1.8289676902151848 driven_any_median 2.160710991385699 driven_any_min 0.4459223795620415 driven_lanedir_consec_max 2.4480652680929316 driven_lanedir_consec_mean 1.653111855280064 driven_lanedir_consec_min 0.41503011554870595 driven_lanedir_max 2.4499789358235744 driven_lanedir_mean 1.6571657762572198 driven_lanedir_median 2.042496052802986 driven_lanedir_min 0.41503011554870595 in-drivable-lane_max 1.7499999999999938 in-drivable-lane_mean 0.7600000000000046 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 2.5742167902100164, "sim_physics": 0.17727487166722616, "survival_time": 14.950000000000076, "driven_lanedir": 2.26815146021571, "sim_render-ego": 0.05767717917760213, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.08242962916692098, "deviation-heading": 3.024002612278028, "set_robot_commands": 0.10803252061208088, "deviation-center-line": 1.088819762077229, "driven_lanedir_consec": 2.266269106365916, "sim_compute_sim_state": 0.03736922343571981, "sim_compute_performance-ego": 0.06580804824829102, "sim_compute_robot_state-ego": 0.07064603408177694, "sim_compute_robot_state-npc0": 0.0720514980951945, "sim_compute_robot_state-npc1": 0.06670829931894938, "sim_compute_robot_state-npc2": 0.06439212719599406, "sim_compute_robot_state-npc3": 0.0637549901008606}, "udem1-1-0": {"driven_any": 2.160710991385699, "sim_physics": 0.17977740941224274, "survival_time": 13.500000000000057, "driven_lanedir": 2.042496052802986, "sim_render-ego": 0.05930353888758907, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.08175544208950467, "deviation-heading": 2.7095001555136946, "set_robot_commands": 0.10914401213328044, "deviation-center-line": 0.9683246898699872, "driven_lanedir_consec": 2.0260224694976454, "sim_compute_sim_state": 0.0364048613442315, "sim_compute_performance-ego": 0.06416229406992595, "sim_compute_robot_state-ego": 0.06822551268118399, "sim_compute_robot_state-npc0": 0.07263597912258572, "sim_compute_robot_state-npc1": 0.06634324038470232, "sim_compute_robot_state-npc2": 0.06475919087727865, "sim_compute_robot_state-npc3": 0.06409245155475758}, "udem1-2-0": {"driven_any": 0.4459223795620415, "sim_physics": 0.20251540277825028, "survival_time": 3.049999999999997, "driven_lanedir": 0.41503011554870595, "sim_render-ego": 0.058640085282872935, "in-drivable-lane": 0, "agent_compute-ego": 0.08129638922019083, "deviation-heading": 0.8068018724906076, "set_robot_commands": 0.10594461784988152, "deviation-center-line": 0.2304731305579763, "driven_lanedir_consec": 0.41503011554870595, "sim_compute_sim_state": 0.03642096284960137, "sim_compute_performance-ego": 0.06306314077533659, "sim_compute_robot_state-ego": 0.06725007197895988, "sim_compute_robot_state-npc0": 0.07326463793144851, "sim_compute_robot_state-npc1": 0.06704760379478579, "sim_compute_robot_state-npc2": 0.0643281623965404, "sim_compute_robot_state-npc3": 0.06816478244593886}, "udem1-3-0": {"driven_any": 1.2413128623693026, "sim_physics": 0.19242328114625884, "survival_time": 8.199999999999982, "driven_lanedir": 1.1101723168951223, "sim_render-ego": 0.05954196249566427, "in-drivable-lane": 0, "agent_compute-ego": 0.08172798156738281, "deviation-heading": 2.97471635867676, "set_robot_commands": 0.106523739128578, "deviation-center-line": 0.6092381269944149, "driven_lanedir_consec": 1.1101723168951223, "sim_compute_sim_state": 0.036154688858404394, "sim_compute_performance-ego": 0.06490727023380559, "sim_compute_robot_state-ego": 0.06914085295142197, "sim_compute_robot_state-npc0": 0.07244709497544824, "sim_compute_robot_state-npc1": 0.0692186282902229, "sim_compute_robot_state-npc2": 0.06468541883840793, "sim_compute_robot_state-npc3": 0.06505935948069502}, "udem1-4-0": {"driven_any": 2.7226754275488636, "sim_physics": 0.17756142218907675, "survival_time": 14.950000000000076, "driven_lanedir": 2.4499789358235744, "sim_render-ego": 0.05702354749043782, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.08003872315088909, "deviation-heading": 2.621898851865302, "set_robot_commands": 0.10714065551757812, "deviation-center-line": 1.2182778429890082, "driven_lanedir_consec": 2.4480652680929316, "sim_compute_sim_state": 0.03682503859202067, "sim_compute_performance-ego": 0.06175843636194865, "sim_compute_robot_state-ego": 0.06713260173797607, "sim_compute_robot_state-npc0": 0.07239644606908162, "sim_compute_robot_state-npc1": 0.06834288756052653, "sim_compute_robot_state-npc2": 0.06558867613474528, "sim_compute_robot_state-npc3": 0.06465954462687175}}set_robot_commands_max 0.10914401213328044 set_robot_commands_mean 0.1073571090482798 set_robot_commands_median 0.10714065551757812 set_robot_commands_min 0.10594461784988152 sim_compute_performance-ego_max 0.06580804824829102 sim_compute_performance-ego_mean 0.06393983793786157 sim_compute_performance-ego_median 0.06416229406992595 sim_compute_performance-ego_min 0.06175843636194865 sim_compute_robot_state-ego_max 0.07064603408177694 sim_compute_robot_state-ego_mean 0.06847901468626377 sim_compute_robot_state-ego_median 0.06822551268118399 sim_compute_robot_state-ego_min 0.06713260173797607 sim_compute_robot_state-npc0_max 0.07326463793144851 sim_compute_robot_state-npc0_mean 0.07255913123875171 sim_compute_robot_state-npc0_median 0.07244709497544824 sim_compute_robot_state-npc0_min 0.0720514980951945 sim_compute_robot_state-npc1_max 0.0692186282902229 sim_compute_robot_state-npc1_mean 0.06753213186983739 sim_compute_robot_state-npc1_median 0.06704760379478579 sim_compute_robot_state-npc1_min 0.06634324038470232 sim_compute_robot_state-npc2_max 0.06558867613474528 sim_compute_robot_state-npc2_mean 0.06475071508859327 sim_compute_robot_state-npc2_median 0.06468541883840793 sim_compute_robot_state-npc2_min 0.0643281623965404 sim_compute_robot_state-npc3_max 0.06816478244593886 sim_compute_robot_state-npc3_mean 0.06514622564182476 sim_compute_robot_state-npc3_median 0.06465954462687175 sim_compute_robot_state-npc3_min 0.0637549901008606 sim_compute_sim_state_max 0.03736922343571981 sim_compute_sim_state_mean 0.03663495501599555 sim_compute_sim_state_median 0.03642096284960137 sim_compute_sim_state_min 0.036154688858404394 sim_physics_max 0.20251540277825028 sim_physics_mean 0.18591047743861097 sim_physics_median 0.17977740941224274 sim_physics_min 0.17727487166722616 sim_render-ego_max 0.05954196249566427 sim_render-ego_mean 0.058437262666833245 sim_render-ego_median 0.058640085282872935 sim_render-ego_min 0.05702354749043782 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.93000000000004 survival_time_min 3.049999999999997
No reset possible 219033343Anastasiya Nikolskaya JetBrains Research aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-38-104-51972019-05-12 17:35:40+00:00 2019-05-12 18:01:34+00:00 0:25:54 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3343/step1-simulation-ip-172-31-38-104-5197-job21903/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 218243301jiang peng Second test - TH-jp aido2-LF-sim-validationstep1-simulation host-error no ip-172-31-38-104-51972019-05-08 15:50:45+00:00 2019-05-08 16:00:59+00:00 0:10:14 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3301/step1-simulation-ip-172-31-38-104-5197-job21824/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 218173296jiang peng Third test - TH aido2-LF-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-08 15:00:51+00:00 2019-05-08 15:15:41+00:00 0:14:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.1809595844475407 survival_time_median 14.950000000000076 deviation-center-line_median 0.9330764711462172 in-drivable-lane_median 2.549999999999991
other stats agent_compute-ego_max 0.10151201963424684 agent_compute-ego_mean 0.10120250638326007 agent_compute-ego_median 0.10140568176905314 agent_compute-ego_min 0.10025413354237876 deviation-center-line_max 1.2972656050385445 deviation-center-line_mean 1.003541776059705 deviation-center-line_min 0.6994148946189701 deviation-heading_max 3.9608969195564088 deviation-heading_mean 2.895539669243423 deviation-heading_median 2.7946171305526017 deviation-heading_min 2.220101574863344 driven_any_max 3.4982747714473343 driven_any_mean 2.4211883097531386 driven_any_median 2.4790203778985425 driven_any_min 0.7829732809241864 driven_lanedir_consec_max 3.4398693754119662 driven_lanedir_consec_mean 2.1767209374051957 driven_lanedir_consec_min 0.7744686931872476 driven_lanedir_max 3.4398693754119662 driven_lanedir_mean 2.252046399240645 driven_lanedir_median 2.235232816322172 driven_lanedir_min 0.7744686931872476 in-drivable-lane_max 5.950000000000084 in-drivable-lane_mean 2.840000000000019 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.066075886606429, "sim_physics": 0.059428006013234454, "survival_time": 14.950000000000076, "driven_lanedir": 1.873431031853096, "sim_render-ego": 0.03645070155461629, "in-drivable-lane": 5.700000000000019, "agent_compute-ego": 0.10151201963424684, "deviation-heading": 3.9608969195564088, "set_robot_commands": 0.05566086451212565, "deviation-center-line": 1.174555757008702, "driven_lanedir_consec": 1.5510769545504792, "sim_compute_sim_state": 0.0239279580116272, "sim_compute_performance-ego": 0.03975734313329061, "sim_compute_robot_state-ego": 0.041986351807912194}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7829732809241864, "sim_physics": 0.05277527650197347, "survival_time": 14.950000000000076, "driven_lanedir": 0.7744686931872476, "sim_render-ego": 0.036327910423278806, "in-drivable-lane": 0, "agent_compute-ego": 0.10025413354237876, "deviation-heading": 2.624950508028493, "set_robot_commands": 0.055914162794748944, "deviation-center-line": 0.6994148946189701, "driven_lanedir_consec": 0.7744686931872476, "sim_compute_sim_state": 0.02391575256983439, "sim_compute_performance-ego": 0.03977577050526937, "sim_compute_robot_state-ego": 0.042046062151590985}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.4982747714473343, "sim_physics": 0.06233551263809204, "survival_time": 14.950000000000076, "driven_lanedir": 3.4398693754119662, "sim_render-ego": 0.03668109178543091, "in-drivable-lane": 0, "agent_compute-ego": 0.10147260030110676, "deviation-heading": 2.7946171305526017, "set_robot_commands": 0.05541056156158447, "deviation-center-line": 1.2972656050385445, "driven_lanedir_consec": 3.4398693754119662, "sim_compute_sim_state": 0.023826092878977457, "sim_compute_performance-ego": 0.04091724793116252, "sim_compute_robot_state-ego": 0.041762107213338215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.279597231889202, "sim_physics": 0.05993807951609294, "survival_time": 14.950000000000076, "driven_lanedir": 2.9372300794287436, "sim_render-ego": 0.03666571458180745, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.10140568176905314, "deviation-heading": 2.877132213216268, "set_robot_commands": 0.05589641571044922, "deviation-center-line": 0.9133961524860906, "driven_lanedir_consec": 2.9372300794287436, "sim_compute_sim_state": 0.0236415966351827, "sim_compute_performance-ego": 0.03978380839029948, "sim_compute_robot_state-ego": 0.04217204570770264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.4790203778985425, "sim_physics": 0.05759679396947225, "survival_time": 14.950000000000076, "driven_lanedir": 2.235232816322172, "sim_render-ego": 0.03632041295369466, "in-drivable-lane": 5.950000000000084, "agent_compute-ego": 0.10136809666951498, "deviation-heading": 2.220101574863344, "set_robot_commands": 0.0563749090830485, "deviation-center-line": 0.9330764711462172, "driven_lanedir_consec": 2.1809595844475407, "sim_compute_sim_state": 0.023926120599110923, "sim_compute_performance-ego": 0.04025616645812989, "sim_compute_robot_state-ego": 0.04164817094802856}}set_robot_commands_max 0.0563749090830485 set_robot_commands_mean 0.055851382732391354 set_robot_commands_median 0.05589641571044922 set_robot_commands_min 0.05541056156158447 sim_compute_performance-ego_max 0.04091724793116252 sim_compute_performance-ego_mean 0.04009806728363037 sim_compute_performance-ego_median 0.03978380839029948 sim_compute_performance-ego_min 0.03975734313329061 sim_compute_robot_state-ego_max 0.04217204570770264 sim_compute_robot_state-ego_mean 0.04192294756571452 sim_compute_robot_state-ego_median 0.041986351807912194 sim_compute_robot_state-ego_min 0.04164817094802856 sim_compute_sim_state_max 0.0239279580116272 sim_compute_sim_state_mean 0.023847504138946533 sim_compute_sim_state_median 0.02391575256983439 sim_compute_sim_state_min 0.0236415966351827 sim_physics_max 0.06233551263809204 sim_physics_mean 0.058414733727773026 sim_physics_median 0.059428006013234454 sim_physics_min 0.05277527650197347 sim_render-ego_max 0.03668109178543091 sim_render-ego_mean 0.03648916625976563 sim_render-ego_median 0.03645070155461629 sim_render-ego_min 0.03632041295369466 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 218103290Artem Ioselevskii SSegm aido2-LF-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-08 14:34:52+00:00 2019-05-08 14:41:44+00:00 0:06:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.245312221291034 survival_time_median 6.749999999999984 deviation-center-line_median 0.5899901914242152 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06211113770802816 agent_compute-ego_mean 0.060242506339979206 agent_compute-ego_median 0.060193196932474775 agent_compute-ego_min 0.05846657046565303 deviation-center-line_max 0.7616335138828174 deviation-center-line_mean 0.45350552991875226 deviation-center-line_min 0.1518910348475689 deviation-heading_max 1.643458986499187 deviation-heading_mean 0.8425124884772301 deviation-heading_median 0.6580635420496679 deviation-heading_min 0.3312013373137933 driven_any_max 3.563152332647007 driven_any_mean 1.508233710431475 driven_any_median 1.5692588656998054 driven_any_min 0.28525236953070116 driven_lanedir_consec_max 1.7579452643647036 driven_lanedir_consec_mean 1.0496054243672734 driven_lanedir_consec_min 0.27867367159364864 driven_lanedir_max 1.7579452643647036 driven_lanedir_mean 1.0496054243672734 driven_lanedir_median 1.245312221291034 driven_lanedir_min 0.27867367159364864 in-drivable-lane_max 7.100000000000015 in-drivable-lane_mean 1.7700000000000018 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.563152332647007, "sim_physics": 0.06563249270121256, "survival_time": 14.950000000000076, "driven_lanedir": 1.7579452643647036, "sim_render-ego": 0.03850720723470052, "in-drivable-lane": 7.100000000000015, "agent_compute-ego": 0.06211113770802816, "deviation-heading": 1.643458986499187, "set_robot_commands": 0.05776745875676473, "deviation-center-line": 0.7616335138828174, "driven_lanedir_consec": 1.7579452643647036, "sim_compute_sim_state": 0.02452166557312012, "sim_compute_performance-ego": 0.04124339660008748, "sim_compute_robot_state-ego": 0.04649798154830933}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5692588656998054, "sim_physics": 0.06533454259236654, "survival_time": 6.749999999999984, "driven_lanedir": 1.5428454586113922, "sim_render-ego": 0.037257521240799514, "in-drivable-lane": 0, "agent_compute-ego": 0.05846657046565303, "deviation-heading": 1.1723063458649865, "set_robot_commands": 0.05832111393963849, "deviation-center-line": 0.6085511952793496, "driven_lanedir_consec": 1.5428454586113922, "sim_compute_sim_state": 0.02493650471722638, "sim_compute_performance-ego": 0.04122960832383898, "sim_compute_robot_state-ego": 0.042819671277646666}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28525236953070116, "sim_physics": 0.06471941471099854, "survival_time": 1.5000000000000009, "driven_lanedir": 0.27867367159364864, "sim_render-ego": 0.037269337972005205, "in-drivable-lane": 0, "agent_compute-ego": 0.060193196932474775, "deviation-heading": 0.3312013373137933, "set_robot_commands": 0.058217914899190266, "deviation-center-line": 0.1518910348475689, "driven_lanedir_consec": 0.27867367159364864, "sim_compute_sim_state": 0.02445824146270752, "sim_compute_performance-ego": 0.04112595717112223, "sim_compute_robot_state-ego": 0.04278605779012045}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4441874759893948, "sim_physics": 0.06840653197709905, "survival_time": 2.1500000000000004, "driven_lanedir": 0.4232505059755894, "sim_render-ego": 0.03847562435061433, "in-drivable-lane": 0, "agent_compute-ego": 0.05850314539532329, "deviation-heading": 0.6580635420496679, "set_robot_commands": 0.057481466337691904, "deviation-center-line": 0.15546171415981058, "driven_lanedir_consec": 0.4232505059755894, "sim_compute_sim_state": 0.02513289451599121, "sim_compute_performance-ego": 0.04104479523592217, "sim_compute_robot_state-ego": 0.04384539293688397}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6793175082904672, "sim_physics": 0.062084500988324486, "survival_time": 7.199999999999982, "driven_lanedir": 1.245312221291034, "sim_render-ego": 0.03820246954758962, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.061938481198416814, "deviation-heading": 0.4075322306585158, "set_robot_commands": 0.058164035280545555, "deviation-center-line": 0.5899901914242152, "driven_lanedir_consec": 1.245312221291034, "sim_compute_sim_state": 0.024774619274669223, "sim_compute_performance-ego": 0.04101823270320892, "sim_compute_robot_state-ego": 0.04385629958576626}}set_robot_commands_max 0.05832111393963849 set_robot_commands_mean 0.05799039784276618 set_robot_commands_median 0.058164035280545555 set_robot_commands_min 0.057481466337691904 sim_compute_performance-ego_max 0.04124339660008748 sim_compute_performance-ego_mean 0.04113239800683595 sim_compute_performance-ego_median 0.04112595717112223 sim_compute_performance-ego_min 0.04101823270320892 sim_compute_robot_state-ego_max 0.04649798154830933 sim_compute_robot_state-ego_mean 0.043961080627745334 sim_compute_robot_state-ego_median 0.04384539293688397 sim_compute_robot_state-ego_min 0.04278605779012045 sim_compute_sim_state_max 0.02513289451599121 sim_compute_sim_state_mean 0.024764785108742898 sim_compute_sim_state_median 0.024774619274669223 sim_compute_sim_state_min 0.02445824146270752 sim_physics_max 0.06840653197709905 sim_physics_mean 0.06523549659400023 sim_physics_median 0.06533454259236654 sim_physics_min 0.062084500988324486 sim_render-ego_max 0.03850720723470052 sim_render-ego_mean 0.03794243206914184 sim_render-ego_median 0.03820246954758962 sim_render-ego_min 0.037257521240799514 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 6.510000000000008 survival_time_min 1.5000000000000009
No reset possible 218073287Artem Ioselevskii SSegm aido2-LF-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-08 14:19:43+00:00 2019-05-08 14:26:49+00:00 0:07:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9969370282744182 survival_time_median 4.6499999999999915 deviation-center-line_median 0.44719758862297665 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06448085333711358 agent_compute-ego_mean 0.06116712887549856 agent_compute-ego_median 0.05981993219655031 agent_compute-ego_min 0.05811599493026733 deviation-center-line_max 0.6696556635757891 deviation-center-line_mean 0.421457167429949 deviation-center-line_min 0.20386812503646193 deviation-heading_max 1.3337051513596678 deviation-heading_mean 0.9300565051583822 deviation-heading_median 1.1044631218857572 deviation-heading_min 0.3285310277534297 driven_any_max 1.8382675492672056 driven_any_mean 1.1144367775250077 driven_any_median 1.0439608031135272 driven_any_min 0.39527416537663074 driven_lanedir_consec_max 1.5987480244822203 driven_lanedir_consec_mean 0.9903009539162012 driven_lanedir_consec_min 0.3903227604675581 driven_lanedir_max 1.5987480244822203 driven_lanedir_mean 0.9903009539162012 driven_lanedir_median 0.9969370282744182 driven_lanedir_min 0.3903227604675581 in-drivable-lane_max 1.8999999999999932 in-drivable-lane_mean 0.3799999999999986 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0439608031135272, "sim_physics": 0.06249321660687847, "survival_time": 4.6499999999999915, "driven_lanedir": 0.9969370282744182, "sim_render-ego": 0.039432687144125664, "in-drivable-lane": 0, "agent_compute-ego": 0.06448085333711358, "deviation-heading": 1.1044631218857572, "set_robot_commands": 0.058772469079622656, "deviation-center-line": 0.44719758862297665, "driven_lanedir_consec": 0.9969370282744182, "sim_compute_sim_state": 0.02641781171162923, "sim_compute_performance-ego": 0.04579541503742177, "sim_compute_robot_state-ego": 0.04578142268683321}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8382675492672056, "sim_physics": 0.0622882098908637, "survival_time": 7.84999999999998, "driven_lanedir": 1.3300462622627334, "sim_render-ego": 0.038219470127372986, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.05981993219655031, "deviation-heading": 1.3337051513596678, "set_robot_commands": 0.05989179489718881, "deviation-center-line": 0.5488489388372433, "driven_lanedir_consec": 1.3300462622627334, "sim_compute_sim_state": 0.0257783589089752, "sim_compute_performance-ego": 0.04296965507944678, "sim_compute_robot_state-ego": 0.04532734451779894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.39527416537663074, "sim_physics": 0.06230533428681202, "survival_time": 1.950000000000001, "driven_lanedir": 0.3903227604675581, "sim_render-ego": 0.038777742630396135, "in-drivable-lane": 0, "agent_compute-ego": 0.05900656259976901, "deviation-heading": 0.3285310277534297, "set_robot_commands": 0.05812907830262796, "deviation-center-line": 0.20386812503646193, "driven_lanedir_consec": 0.3903227604675581, "sim_compute_sim_state": 0.026474457520705003, "sim_compute_performance-ego": 0.044119773766933344, "sim_compute_robot_state-ego": 0.04473718618735289}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6520815950029263, "sim_physics": 0.06494191884994507, "survival_time": 2.9999999999999973, "driven_lanedir": 0.635450694094077, "sim_render-ego": 0.03937665224075317, "in-drivable-lane": 0, "agent_compute-ego": 0.05811599493026733, "deviation-heading": 0.6640261641510526, "set_robot_commands": 0.05820441643397013, "deviation-center-line": 0.23771552107727367, "driven_lanedir_consec": 0.635450694094077, "sim_compute_sim_state": 0.025830360253651936, "sim_compute_performance-ego": 0.04203578233718872, "sim_compute_robot_state-ego": 0.04771926005681356}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6425997748647478, "sim_physics": 0.059927478749701314, "survival_time": 7.049999999999983, "driven_lanedir": 1.5987480244822203, "sim_render-ego": 0.03946013822623178, "in-drivable-lane": 0, "agent_compute-ego": 0.06441230131379257, "deviation-heading": 1.219557060642004, "set_robot_commands": 0.06029796600341797, "deviation-center-line": 0.6696556635757891, "driven_lanedir_consec": 1.5987480244822203, "sim_compute_sim_state": 0.02581598065423627, "sim_compute_performance-ego": 0.042577802712190235, "sim_compute_robot_state-ego": 0.04553444842074779}}set_robot_commands_max 0.06029796600341797 set_robot_commands_mean 0.059059144943365505 set_robot_commands_median 0.058772469079622656 set_robot_commands_min 0.05812907830262796 sim_compute_performance-ego_max 0.04579541503742177 sim_compute_performance-ego_mean 0.04349968578663617 sim_compute_performance-ego_median 0.04296965507944678 sim_compute_performance-ego_min 0.04203578233718872 sim_compute_robot_state-ego_max 0.04771926005681356 sim_compute_robot_state-ego_mean 0.045819932373909286 sim_compute_robot_state-ego_median 0.04553444842074779 sim_compute_robot_state-ego_min 0.04473718618735289 sim_compute_sim_state_max 0.026474457520705003 sim_compute_sim_state_mean 0.02606339380983953 sim_compute_sim_state_median 0.025830360253651936 sim_compute_sim_state_min 0.0257783589089752 sim_physics_max 0.06494191884994507 sim_physics_mean 0.06239123167684012 sim_physics_median 0.06230533428681202 sim_physics_min 0.059927478749701314 sim_render-ego_max 0.03946013822623178 sim_render-ego_mean 0.03905333807377595 sim_render-ego_median 0.03937665224075317 sim_render-ego_min 0.038219470127372986 simulation-passed 1 survival_time_max 7.84999999999998 survival_time_mean 4.899999999999991 survival_time_min 1.950000000000001
No reset possible 218063286jiang peng Third test - TH aido2-LF-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-08 12:33:56+00:00 2019-05-08 12:47:23+00:00 0:13:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.9312504437467366 survival_time_median 14.950000000000076 deviation-center-line_median 0.5462897844541998 in-drivable-lane_median 2.0499999999999945
other stats agent_compute-ego_max 0.10302567720413208 agent_compute-ego_mean 0.10219132724309075 agent_compute-ego_median 0.10207924524943034 agent_compute-ego_min 0.10151226758956908 deviation-center-line_max 1.3206904740170988 deviation-center-line_mean 0.6132451825251566 deviation-center-line_min 0.16109875479219685 deviation-heading_max 3.097174001799396 deviation-heading_mean 2.254513884343197 deviation-heading_median 2.9035938506085888 deviation-heading_min 0.2258590011013018 driven_any_max 4.57876084952741 driven_any_mean 2.6607926424545147 driven_any_median 3.223474675734697 driven_any_min 0.8413004213212789 driven_lanedir_consec_max 3.5676050267066133 driven_lanedir_consec_mean 2.291930870901634 driven_lanedir_consec_min 0.5790448647581994 driven_lanedir_max 3.5676050267066133 driven_lanedir_mean 2.291930870901634 driven_lanedir_median 2.9312504437467366 driven_lanedir_min 0.5790448647581994 in-drivable-lane_max 10.350000000000088 in-drivable-lane_mean 3.7200000000000166 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.034248313127441, "sim_physics": 0.06174731254577637, "survival_time": 3.649999999999995, "driven_lanedir": 0.5790448647581994, "sim_render-ego": 0.03649173044178584, "in-drivable-lane": 2.0499999999999945, "agent_compute-ego": 0.10201111231764702, "deviation-heading": 0.2258590011013018, "set_robot_commands": 0.05629421586859716, "deviation-center-line": 0.16109875479219685, "driven_lanedir_consec": 0.5790448647581994, "sim_compute_sim_state": 0.024024101152811964, "sim_compute_performance-ego": 0.04064400555336312, "sim_compute_robot_state-ego": 0.04269941212379769}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8413004213212789, "sim_physics": 0.05730685631434123, "survival_time": 14.950000000000076, "driven_lanedir": 0.8252061021145911, "sim_render-ego": 0.03638471364974975, "in-drivable-lane": 10.350000000000088, "agent_compute-ego": 0.10151226758956908, "deviation-heading": 2.9950103028548862, "set_robot_commands": 0.05554370323816935, "deviation-center-line": 0.17595608142944064, "driven_lanedir_consec": 0.8252061021145911, "sim_compute_sim_state": 0.023710166613260905, "sim_compute_performance-ego": 0.04002067963282267, "sim_compute_robot_state-ego": 0.042213606834411624}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.57876084952741, "sim_physics": 0.056459177335103354, "survival_time": 14.950000000000076, "driven_lanedir": 3.556547917182028, "sim_render-ego": 0.03668731689453125, "in-drivable-lane": 1.7500000000000195, "agent_compute-ego": 0.10207924524943034, "deviation-heading": 3.097174001799396, "set_robot_commands": 0.05627216418584187, "deviation-center-line": 1.3206904740170988, "driven_lanedir_consec": 3.556547917182028, "sim_compute_sim_state": 0.023631950219472248, "sim_compute_performance-ego": 0.04051006317138672, "sim_compute_robot_state-ego": 0.042022239367167154}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.6261789525617463, "sim_physics": 0.06370323737462362, "survival_time": 14.950000000000076, "driven_lanedir": 3.5676050267066133, "sim_render-ego": 0.036708392302195234, "in-drivable-lane": 0, "agent_compute-ego": 0.10302567720413208, "deviation-heading": 2.9035938506085888, "set_robot_commands": 0.055312599341074624, "deviation-center-line": 0.8621908179328466, "driven_lanedir_consec": 3.5676050267066133, "sim_compute_sim_state": 0.024041947523752848, "sim_compute_performance-ego": 0.0400405756632487, "sim_compute_robot_state-ego": 0.04183306614557902}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.223474675734697, "sim_physics": 0.05624890724817912, "survival_time": 14.950000000000076, "driven_lanedir": 2.9312504437467366, "sim_render-ego": 0.03669161637624105, "in-drivable-lane": 4.449999999999984, "agent_compute-ego": 0.1023283338546753, "deviation-heading": 2.050932265351813, "set_robot_commands": 0.055780813694000245, "deviation-center-line": 0.5462897844541998, "driven_lanedir_consec": 2.9312504437467366, "sim_compute_sim_state": 0.02366994301478068, "sim_compute_performance-ego": 0.03996647516886393, "sim_compute_robot_state-ego": 0.04310044685999553}}set_robot_commands_max 0.05629421586859716 set_robot_commands_mean 0.055840699265536656 set_robot_commands_median 0.055780813694000245 set_robot_commands_min 0.055312599341074624 sim_compute_performance-ego_max 0.04064400555336312 sim_compute_performance-ego_mean 0.04023635983793703 sim_compute_performance-ego_median 0.0400405756632487 sim_compute_performance-ego_min 0.03996647516886393 sim_compute_robot_state-ego_max 0.04310044685999553 sim_compute_robot_state-ego_mean 0.04237375426619021 sim_compute_robot_state-ego_median 0.042213606834411624 sim_compute_robot_state-ego_min 0.04183306614557902 sim_compute_sim_state_max 0.024041947523752848 sim_compute_sim_state_mean 0.023815621704815725 sim_compute_sim_state_median 0.023710166613260905 sim_compute_sim_state_min 0.023631950219472248 sim_physics_max 0.06370323737462362 sim_physics_mean 0.05909309816360474 sim_physics_median 0.05730685631434123 sim_physics_min 0.05624890724817912 sim_render-ego_max 0.036708392302195234 sim_render-ego_mean 0.03659275393290063 sim_render-ego_median 0.03668731689453125 sim_render-ego_min 0.03638471364974975 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.69000000000006 survival_time_min 3.649999999999995
No reset possible 217983278Sean Lu challenge-aido_LF-template-random aido2-PREDstep1-simulation error no ip-172-31-38-104-51972019-05-08 06:43:49+00:00 2019-05-08 06:44:04+00:00 0:00:15 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 24, in check_compatible_protocol
raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: Type <class 'aido_schemas.schemas.Duckiebot1Observations'>
is not a subclass of <class 'float'>
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 75, in <module>
main(cie)
File "experiment_manager.py", line 26, in main
agent_ci._get_node_protocol()
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 84, in _get_node_protocol
check_compatible_protocol(self.node_protocol, self.expect_protocol)
File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 42, in check_compatible_protocol
raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217883270jiang peng First test - TH aido2-LF-sim-validationstep1-simulation success no ip-172-31-38-104-51972019-05-08 02:00:30+00:00 2019-05-08 02:13:54+00:00 0:13:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.962662180122743 survival_time_median 14.950000000000076 deviation-center-line_median 1.251627150144976 in-drivable-lane_median 0.5000000000000071
other stats agent_compute-ego_max 0.10401176770528156 agent_compute-ego_mean 0.10248616154053632 agent_compute-ego_median 0.10227426926294962 agent_compute-ego_min 0.10117379744847615 deviation-center-line_max 1.3475495008023284 deviation-center-line_mean 1.0327160581595416 deviation-center-line_min 0.10344154498123376 deviation-heading_max 3.754419095494972 deviation-heading_mean 2.987233847020975 deviation-heading_median 3.3345298068869145 deviation-heading_min 1.7253348096529062 driven_any_max 4.749577232845539 driven_any_mean 3.345574959566838 driven_any_median 3.9679385440840047 driven_any_min 0.6737929787523291 driven_lanedir_consec_max 4.495975818487773 driven_lanedir_consec_mean 2.799638193317395 driven_lanedir_consec_min 0.6248601681226336 driven_lanedir_max 4.495975818487773 driven_lanedir_mean 2.799638193317395 driven_lanedir_median 2.962662180122743 driven_lanedir_min 0.6248601681226336 in-drivable-lane_max 2.550000000000036 in-drivable-lane_mean 1.1000000000000116 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6737929787523291, "sim_physics": 0.06158925505245433, "survival_time": 4.249999999999993, "driven_lanedir": 0.6248601681226336, "sim_render-ego": 0.03704725153305951, "in-drivable-lane": 0, "agent_compute-ego": 0.10286712085499485, "deviation-heading": 1.7253348096529062, "set_robot_commands": 0.055742586360258216, "deviation-center-line": 0.10344154498123376, "driven_lanedir_consec": 0.6248601681226336, "sim_compute_sim_state": 0.02355490852804745, "sim_compute_performance-ego": 0.040602496091057275, "sim_compute_robot_state-ego": 0.04263254614437328}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.749577232845539, "sim_physics": 0.06213391145070394, "survival_time": 14.950000000000076, "driven_lanedir": 4.495975818487773, "sim_render-ego": 0.03636629660924276, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.10227426926294962, "deviation-heading": 2.756159912296996, "set_robot_commands": 0.0574079155921936, "deviation-center-line": 1.3475495008023284, "driven_lanedir_consec": 4.495975818487773, "sim_compute_sim_state": 0.023713600635528565, "sim_compute_performance-ego": 0.03976532856623332, "sim_compute_robot_state-ego": 0.041981107393900555}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.138276018588197, "sim_physics": 0.05945501327514648, "survival_time": 14.950000000000076, "driven_lanedir": 2.962662180122743, "sim_render-ego": 0.03634506066640218, "in-drivable-lane": 2.1000000000000165, "agent_compute-ego": 0.10401176770528156, "deviation-heading": 3.3345298068869145, "set_robot_commands": 0.0562838093439738, "deviation-center-line": 1.3272585113324644, "driven_lanedir_consec": 2.962662180122743, "sim_compute_sim_state": 0.023449246883392335, "sim_compute_performance-ego": 0.03933348417282104, "sim_compute_robot_state-ego": 0.041505792140960694}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.198290023564118, "sim_physics": 0.05829646587371826, "survival_time": 14.950000000000076, "driven_lanedir": 2.845132892503824, "sim_render-ego": 0.03650328874588013, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.1021038524309794, "deviation-heading": 3.365725610773086, "set_robot_commands": 0.05544989983240763, "deviation-center-line": 1.1337035835367053, "driven_lanedir_consec": 2.845132892503824, "sim_compute_sim_state": 0.023628992239634196, "sim_compute_performance-ego": 0.03943651994069417, "sim_compute_robot_state-ego": 0.041265918413798015}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.9679385440840047, "sim_physics": 0.060108976364135744, "survival_time": 14.950000000000076, "driven_lanedir": 3.0695599073500004, "sim_render-ego": 0.036154402097066246, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.10117379744847615, "deviation-heading": 3.754419095494972, "set_robot_commands": 0.055532019138336185, "deviation-center-line": 1.251627150144976, "driven_lanedir_consec": 3.0695599073500004, "sim_compute_sim_state": 0.023527543544769287, "sim_compute_performance-ego": 0.039580246607462566, "sim_compute_robot_state-ego": 0.04142395257949829}}set_robot_commands_max 0.0574079155921936 set_robot_commands_mean 0.056083246053433886 set_robot_commands_median 0.055742586360258216 set_robot_commands_min 0.05544989983240763 sim_compute_performance-ego_max 0.040602496091057275 sim_compute_performance-ego_mean 0.039743615075653674 sim_compute_performance-ego_median 0.039580246607462566 sim_compute_performance-ego_min 0.03933348417282104 sim_compute_robot_state-ego_max 0.04263254614437328 sim_compute_robot_state-ego_mean 0.04176186333450617 sim_compute_robot_state-ego_median 0.041505792140960694 sim_compute_robot_state-ego_min 0.041265918413798015 sim_compute_sim_state_max 0.023713600635528565 sim_compute_sim_state_mean 0.02357485836627437 sim_compute_sim_state_median 0.02355490852804745 sim_compute_sim_state_min 0.023449246883392335 sim_physics_max 0.06213391145070394 sim_physics_mean 0.06031672440323175 sim_physics_median 0.060108976364135744 sim_physics_min 0.05829646587371826 sim_render-ego_max 0.03704725153305951 sim_render-ego_mean 0.03648325993033016 sim_render-ego_median 0.03636629660924276 sim_render-ego_min 0.036154402097066246 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.81000000000006 survival_time_min 4.249999999999993
No reset possible 217842412jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-38-104-51972019-05-07 23:00:41+00:00 2019-05-08 00:01:21+00:00 1:00:40 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-38-104-5197-job21784/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217762373Liam Paull minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-38-104-51972019-05-07 22:01:10+00:00 2019-05-07 22:41:09+00:00 0:39:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.637258234942822 survival_time_median 7.199999999999982 deviation-center-line_median 0.41059891008830585 in-drivable-lane_median 1.699999999999994
other stats agent_compute-ego_max 0.12444753558547408 agent_compute-ego_mean 0.10597544501475616 agent_compute-ego_median 0.09641361236572266 agent_compute-ego_min 0.0912401202722644 deviation-center-line_max 0.9349599376168654 deviation-center-line_mean 0.4387555178222911 deviation-center-line_min 0.17941317297639486 deviation-heading_max 4.374417856296392 deviation-heading_mean 1.5940974384060418 deviation-heading_median 1.0234199155419084 deviation-heading_min 0.4336566898932428 driven_any_max 2.1860208965398997 driven_any_mean 1.068337512713888 driven_any_median 1.0253513500538094 driven_any_min 0.3424596765232271 driven_lanedir_consec_max 1.8538963171887557 driven_lanedir_consec_mean 0.6976649549765142 driven_lanedir_consec_min 0.3024072802283877 driven_lanedir_max 1.8539439248016505 driven_lanedir_mean 0.7124823821349586 driven_lanedir_median 0.637258234942822 driven_lanedir_min 0.3024072802283877 in-drivable-lane_max 7.600000000000008 in-drivable-lane_mean 1.933333333333337 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.147318099452331, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.05043673726309717, "in-drivable-lane": 0, "agent_compute-ego": 0.1229483163462276, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.07439413956836262, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.030951242531295373, "sim_compute_performance-ego": 0.0542981730098218, "sim_compute_robot_state-ego": 0.05773317497388451, "sim_compute_robot_state-npc0": 0.055990546150545106, "sim_compute_robot_state-npc1": 0.05611648918253131, "sim_compute_robot_state-npc2": 0.0538843986207405, "sim_compute_robot_state-npc3": 0.05425494751044079}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.1492237084441715, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.04830803970495859, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.12228242887390985, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.07433734006351894, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03062424725956387, "sim_compute_performance-ego": 0.05373051928149329, "sim_compute_robot_state-ego": 0.058020078473620944, "sim_compute_robot_state-npc0": 0.05646707945399814, "sim_compute_robot_state-npc1": 0.052929624915122986, "sim_compute_robot_state-npc2": 0.053181115123960704, "sim_compute_robot_state-npc3": 0.05338652100827959}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1482563947067886, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.04901115034447342, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.12209647796193109, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.07446199557820304, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.031160224656589696, "sim_compute_performance-ego": 0.05501381881901475, "sim_compute_robot_state-ego": 0.05848697560732482, "sim_compute_robot_state-npc0": 0.055600369562868214, "sim_compute_robot_state-npc1": 0.055194604592245136, "sim_compute_robot_state-npc2": 0.0547354739220416, "sim_compute_robot_state-npc3": 0.05463958959110447}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.1481666858990987, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.04909159501393636, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.12104962666829427, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.07406087239583334, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.030115707715352377, "sim_compute_performance-ego": 0.05332125345865885, "sim_compute_robot_state-ego": 0.056074363390604655, "sim_compute_robot_state-npc0": 0.05383043845494588, "sim_compute_robot_state-npc1": 0.053819074630737304, "sim_compute_robot_state-npc2": 0.05410200516382853, "sim_compute_robot_state-npc3": 0.05427823543548584}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.15058963387100785, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.049315549709178785, "in-drivable-lane": 0, "agent_compute-ego": 0.12444753558547408, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.07688694088547318, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.030773825115627713, "sim_compute_performance-ego": 0.05360101770471643, "sim_compute_robot_state-ego": 0.05860055817498101, "sim_compute_robot_state-npc0": 0.056665252756189416, "sim_compute_robot_state-npc1": 0.054868861480995464, "sim_compute_robot_state-npc2": 0.05595586476502595, "sim_compute_robot_state-npc3": 0.054239997157344115}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.14454288998986506, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.048693661477155745, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.12017616800441865, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.07259607466922444, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.031307373836541634, "sim_compute_performance-ego": 0.05263041235079431, "sim_compute_robot_state-ego": 0.05723497822026538, "sim_compute_robot_state-npc0": 0.05449273631830884, "sim_compute_robot_state-npc1": 0.05396203782148422, "sim_compute_robot_state-npc2": 0.05358261667239438, "sim_compute_robot_state-npc3": 0.05273733928704717}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.1576556968688965, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.04866838773091634, "in-drivable-lane": 0, "agent_compute-ego": 0.11762386957804362, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.07570171038309734, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.027738523483276368, "sim_compute_performance-ego": 0.05132144927978516, "sim_compute_robot_state-ego": 0.05430218060811361, "sim_compute_robot_state-npc0": 0.05112982114156087, "sim_compute_robot_state-npc1": 0.049871606826782225, "sim_compute_robot_state-npc2": 0.04904301643371582, "sim_compute_robot_state-npc3": 0.04993259429931641}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.11546245051754846, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.03677473631170061, "in-drivable-lane": 0, "agent_compute-ego": 0.09190201262633006, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.056542484296692744, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.023436693681610957, "sim_compute_performance-ego": 0.040070108241505094, "sim_compute_robot_state-ego": 0.04206955432891846, "sim_compute_robot_state-npc0": 0.04104870557785034, "sim_compute_robot_state-npc1": 0.04187227454450396, "sim_compute_robot_state-npc2": 0.0399970379140642, "sim_compute_robot_state-npc3": 0.039813659257358976}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.1032514031051744, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.03692982551899362, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.0912401202722644, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.055881637208005215, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.023129128395242893, "sim_compute_performance-ego": 0.03967174908793565, "sim_compute_robot_state-ego": 0.042238551674159706, "sim_compute_robot_state-npc0": 0.04146865750035496, "sim_compute_robot_state-npc1": 0.04037554044250055, "sim_compute_robot_state-npc2": 0.040138112737777384, "sim_compute_robot_state-npc3": 0.04038561996838725}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.12005008517445384, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.03771417457740624, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.0921051718971946, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.05580944614810544, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.022959540773938587, "sim_compute_performance-ego": 0.04042852675164496, "sim_compute_robot_state-ego": 0.04389688018318656, "sim_compute_robot_state-npc0": 0.04159653436887514, "sim_compute_robot_state-npc1": 0.04099852555281632, "sim_compute_robot_state-npc2": 0.04013910493650637, "sim_compute_robot_state-npc3": 0.04037655150140082}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.10848328700432412, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.03783354392418495, "in-drivable-lane": 0, "agent_compute-ego": 0.09641361236572266, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.05589890938538771, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.023034806434924785, "sim_compute_performance-ego": 0.039951058534475475, "sim_compute_robot_state-ego": 0.042251376005319446, "sim_compute_robot_state-npc0": 0.04174610743155846, "sim_compute_robot_state-npc1": 0.04038831820854774, "sim_compute_robot_state-npc2": 0.04034577883206881, "sim_compute_robot_state-npc3": 0.03995190216944768}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.11034995762269888, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.03759124029928179, "in-drivable-lane": 0, "agent_compute-ego": 0.0916753384604383, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.05739672148405616, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.0236455967177206, "sim_compute_performance-ego": 0.040104898054208325, "sim_compute_robot_state-ego": 0.04352773125491925, "sim_compute_robot_state-npc0": 0.04200686269731664, "sim_compute_robot_state-npc1": 0.040421283067162354, "sim_compute_robot_state-npc2": 0.040847038155171406, "sim_compute_robot_state-npc3": 0.04031022626962235}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.11073416975600207, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.03716073819060824, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.09179015064713966, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.0561051202650687, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.023218806110211272, "sim_compute_performance-ego": 0.03979868675345805, "sim_compute_robot_state-ego": 0.0422749163499519, "sim_compute_robot_state-npc0": 0.04171343703768147, "sim_compute_robot_state-npc1": 0.04052927956652286, "sim_compute_robot_state-npc2": 0.04096881667179848, "sim_compute_robot_state-npc3": 0.040233124547929905}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.10528029354525284, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.03722393680626238, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0922886485784826, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.055859481784659375, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.02332903801555365, "sim_compute_performance-ego": 0.041848624256295215, "sim_compute_robot_state-ego": 0.04208516570883737, "sim_compute_robot_state-npc0": 0.04114523907782326, "sim_compute_robot_state-npc1": 0.04053245128040582, "sim_compute_robot_state-npc2": 0.040227661670093805, "sim_compute_robot_state-npc3": 0.04000354988474242}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.11713608942533794, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.037189863230052744, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.09159219735547117, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.05561053125481857, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.02334122751888476, "sim_compute_performance-ego": 0.04003093117161801, "sim_compute_robot_state-ego": 0.04240281174057409, "sim_compute_robot_state-npc0": 0.041375266878228435, "sim_compute_robot_state-npc1": 0.04076440240207471, "sim_compute_robot_state-npc2": 0.04028433404470745, "sim_compute_robot_state-npc3": 0.040613921065079536}}set_robot_commands_max 0.07688694088547318 set_robot_commands_mean 0.06476956035803379 set_robot_commands_median 0.05739672148405616 set_robot_commands_min 0.05561053125481857 sim_compute_performance-ego_max 0.05501381881901475 sim_compute_performance-ego_mean 0.04638808178369503 sim_compute_performance-ego_median 0.041848624256295215 sim_compute_performance-ego_min 0.03967174908793565 sim_compute_robot_state-ego_max 0.05860055817498101 sim_compute_robot_state-ego_mean 0.049413286446310795 sim_compute_robot_state-ego_median 0.04389688018318656 sim_compute_robot_state-ego_min 0.04206955432891846 sim_compute_robot_state-npc0_max 0.056665252756189416 sim_compute_robot_state-npc0_mean 0.04775180362720702 sim_compute_robot_state-npc0_median 0.04200686269731664 sim_compute_robot_state-npc0_min 0.04104870557785034 sim_compute_robot_state-npc1_max 0.05611648918253131 sim_compute_robot_state-npc1_mean 0.0468429583009622 sim_compute_robot_state-npc1_median 0.04187227454450396 sim_compute_robot_state-npc1_min 0.04037554044250055 sim_compute_robot_state-npc2_max 0.05595586476502595 sim_compute_robot_state-npc2_mean 0.046495491710926366 sim_compute_robot_state-npc2_median 0.04096881667179848 sim_compute_robot_state-npc2_min 0.0399970379140642 sim_compute_robot_state-npc3_max 0.05463958959110447 sim_compute_robot_state-npc3_mean 0.04634385193019915 sim_compute_robot_state-npc3_median 0.040613921065079536 sim_compute_robot_state-npc3_min 0.039813659257358976 sim_compute_sim_state_max 0.031307373836541634 sim_compute_sim_state_mean 0.026584398816422303 sim_compute_sim_state_median 0.0236455967177206 sim_compute_sim_state_min 0.022959540773938587 sim_physics_max 0.1576556968688965 sim_physics_mean 0.12910005635886346 sim_physics_median 0.12005008517445384 sim_physics_min 0.1032514031051744 sim_render-ego_max 0.05043673726309717 sim_render-ego_mean 0.04279621200681379 sim_render-ego_median 0.03783354392418495 sim_render-ego_min 0.03677473631170061 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.47 survival_time_min 2.5999999999999988
No reset possible 217692379Liam Paull minimal_agent_python2 (Python 2) aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-38-104-51972019-05-07 21:51:36+00:00 2019-05-07 22:00:32+00:00 0:08:56 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2379/step1-simulation-ip-172-31-38-104-5197-job21769/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217652406Victor Guerra Baseline solution using reinforcement learning aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-38-104-51972019-05-07 21:33:16+00:00 2019-05-07 21:51:28+00:00 0:18:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.0962389913175008 survival_time_median 1.2500000000000004 deviation-center-line_median 0.07759013087944029 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.20247073607011276 agent_compute-ego_mean 0.18151868569412508 agent_compute-ego_median 0.17721396998355263 agent_compute-ego_min 0.16433323057074295 deviation-center-line_max 0.09670747025968186 deviation-center-line_mean 0.07159261761349336 deviation-center-line_min 0.0427925405641753 deviation-heading_max 0.8976309831781835 deviation-heading_mean 0.6634683821359139 deviation-heading_median 0.6956856389986282 deviation-heading_min 0.44084234840657355 driven_any_max 0.25772357319187783 driven_any_mean 0.17080228847831622 driven_any_median 0.164172273746567 driven_any_min 0.12383115729166085 driven_lanedir_consec_max 0.12931242376022634 driven_lanedir_consec_mean 0.0997047290263542 driven_lanedir_consec_min 0.07001556708398726 driven_lanedir_max 0.12931242376022634 driven_lanedir_mean 0.0997047290263542 driven_lanedir_median 0.0962389913175008 driven_lanedir_min 0.07001556708398726 in-drivable-lane_max 0.5500000000000005 in-drivable-lane_mean 0.15333333333333346 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.20613054465161176, "sim_physics": 0.19642836047757056, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08447495625637291, "sim_render-ego": 0.0615357352841285, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.17048097425891506, "deviation-heading": 0.770077467021996, "set_robot_commands": 0.09702817855342742, "deviation-center-line": 0.0654513006534869, "driven_lanedir_consec": 0.08447495625637291, "sim_compute_sim_state": 0.04179000085399997, "sim_compute_performance-ego": 0.0663608274152202, "sim_compute_robot_state-ego": 0.07739820018891365, "sim_compute_robot_state-npc0": 0.07091312254628827, "sim_compute_robot_state-npc1": 0.07359114769966371, "sim_compute_robot_state-npc2": 0.07256330982331306, "sim_compute_robot_state-npc3": 0.07109763545374717}, "udem1-1-0": {"driven_any": 0.2109505172143357, "sim_physics": 0.26767131776520703, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0791131842177033, "sim_render-ego": 0.0735453547853412, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.20247073607011276, "deviation-heading": 0.814612723441908, "set_robot_commands": 0.1090350223310066, "deviation-center-line": 0.057404892402144074, "driven_lanedir_consec": 0.0791131842177033, "sim_compute_sim_state": 0.0418826522249164, "sim_compute_performance-ego": 0.07918820959148985, "sim_compute_robot_state-ego": 0.08889851425633286, "sim_compute_robot_state-npc0": 0.07607303243694884, "sim_compute_robot_state-npc1": 0.07515556884534431, "sim_compute_robot_state-npc2": 0.07398642193187367, "sim_compute_robot_state-npc3": 0.07347952235828746}, "udem1-2-0": {"driven_any": 0.14509550351153325, "sim_physics": 0.26828075538982044, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11441479914513364, "sim_render-ego": 0.06417518312280829, "in-drivable-lane": 0, "agent_compute-ego": 0.17387921159917658, "deviation-heading": 0.44084234840657355, "set_robot_commands": 0.10240814902565697, "deviation-center-line": 0.09670747025968186, "driven_lanedir_consec": 0.11441479914513364, "sim_compute_sim_state": 0.042049592191522774, "sim_compute_performance-ego": 0.06620905616066673, "sim_compute_robot_state-ego": 0.06993479078466242, "sim_compute_robot_state-npc0": 0.07365804368799383, "sim_compute_robot_state-npc1": 0.0709157098423351, "sim_compute_robot_state-npc2": 0.0671519474549727, "sim_compute_robot_state-npc3": 0.07168490236455743}, "udem1-3-0": {"driven_any": 0.13132871005618993, "sim_physics": 0.2235485532067039, "survival_time": 1.1000000000000003, "driven_lanedir": 0.0962389913175008, "sim_render-ego": 0.06433437087319115, "in-drivable-lane": 0, "agent_compute-ego": 0.17400133609771729, "deviation-heading": 0.4989057466932687, "set_robot_commands": 0.09332909367301248, "deviation-center-line": 0.09294334651861368, "driven_lanedir_consec": 0.0962389913175008, "sim_compute_sim_state": 0.03973513299768621, "sim_compute_performance-ego": 0.07648359645496715, "sim_compute_robot_state-ego": 0.07350405779751865, "sim_compute_robot_state-npc0": 0.06858888539400967, "sim_compute_robot_state-npc1": 0.06524783914739435, "sim_compute_robot_state-npc2": 0.06976453824476762, "sim_compute_robot_state-npc3": 0.07220294258811256}, "udem1-4-0": {"driven_any": 0.13596371723055736, "sim_physics": 0.2042379081249237, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07001556708398726, "sim_render-ego": 0.06412869691848755, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17859284083048502, "deviation-heading": 0.7688853366314157, "set_robot_commands": 0.10851346453030904, "deviation-center-line": 0.046046253130128854, "driven_lanedir_consec": 0.07001556708398726, "sim_compute_sim_state": 0.04180724422136942, "sim_compute_performance-ego": 0.06885005036989848, "sim_compute_robot_state-ego": 0.0767381489276886, "sim_compute_robot_state-npc0": 0.07281030217806499, "sim_compute_robot_state-npc1": 0.07299571235974629, "sim_compute_robot_state-npc2": 0.06865827242533366, "sim_compute_robot_state-npc3": 0.06894789139429729}, "udem1-5-0": {"driven_any": 0.22190560877365495, "sim_physics": 0.22495145267910427, "survival_time": 1.800000000000001, "driven_lanedir": 0.08477894376243444, "sim_render-ego": 0.06829673051834106, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.19954870144526163, "deviation-heading": 0.6956856389986282, "set_robot_commands": 0.1046152909596761, "deviation-center-line": 0.049088842021322174, "driven_lanedir_consec": 0.08477894376243444, "sim_compute_sim_state": 0.04536506864759657, "sim_compute_performance-ego": 0.07839494943618774, "sim_compute_robot_state-ego": 0.08708901537789239, "sim_compute_robot_state-npc0": 0.07338760958777533, "sim_compute_robot_state-npc1": 0.07087247901492649, "sim_compute_robot_state-npc2": 0.07333846886952718, "sim_compute_robot_state-npc3": 0.07428205675548977}, "udem1-6-0": {"driven_any": 0.1425704351051151, "sim_physics": 0.2538093545220115, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10715105957855409, "sim_render-ego": 0.05843438885428689, "in-drivable-lane": 0, "agent_compute-ego": 0.170571045442061, "deviation-heading": 0.5070271679676811, "set_robot_commands": 0.10128408128565008, "deviation-center-line": 0.07759013087944029, "driven_lanedir_consec": 0.10715105957855409, "sim_compute_sim_state": 0.04039782827550715, "sim_compute_performance-ego": 0.07151345773176714, "sim_compute_robot_state-ego": 0.07608204538171942, "sim_compute_robot_state-npc0": 0.06929805062033913, "sim_compute_robot_state-npc1": 0.07134778933091597, "sim_compute_robot_state-npc2": 0.07153910940343683, "sim_compute_robot_state-npc3": 0.06988730213858864}, "udem1-7-0": {"driven_any": 0.16548654744888783, "sim_physics": 0.23622456550598145, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12931242376022634, "sim_render-ego": 0.0703575611114502, "in-drivable-lane": 0, "agent_compute-ego": 0.1889551067352295, "deviation-heading": 0.5659911551225252, "set_robot_commands": 0.10055143356323244, "deviation-center-line": 0.09301539275698816, "driven_lanedir_consec": 0.12931242376022634, "sim_compute_sim_state": 0.04273883819580078, "sim_compute_performance-ego": 0.07284202575683593, "sim_compute_robot_state-ego": 0.07869058609008789, "sim_compute_robot_state-npc0": 0.07009878158569335, "sim_compute_robot_state-npc1": 0.0756136131286621, "sim_compute_robot_state-npc2": 0.07579811096191406, "sim_compute_robot_state-npc3": 0.07230621337890625}, "udem1-8-0": {"driven_any": 0.2061233393036059, "sim_physics": 0.20077289640903473, "survival_time": 1.6000000000000008, "driven_lanedir": 0.11480115355753195, "sim_render-ego": 0.0634574294090271, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17626474052667618, "deviation-heading": 0.7319908390847298, "set_robot_commands": 0.10086823254823685, "deviation-center-line": 0.0427925405641753, "driven_lanedir_consec": 0.11480115355753195, "sim_compute_sim_state": 0.0408330038189888, "sim_compute_performance-ego": 0.07027438282966614, "sim_compute_robot_state-ego": 0.07008552551269531, "sim_compute_robot_state-npc0": 0.07088673859834671, "sim_compute_robot_state-npc1": 0.07703444361686707, "sim_compute_robot_state-npc2": 0.07129140943288803, "sim_compute_robot_state-npc3": 0.07310602068901062}, "udem1-9-0": {"driven_any": 0.17675668315385967, "sim_physics": 0.27484339714050293, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10715555461973136, "sim_render-ego": 0.07148017883300781, "in-drivable-lane": 0, "agent_compute-ego": 0.19364540100097655, "deviation-heading": 0.8976309831781835, "set_robot_commands": 0.10277716636657716, "deviation-center-line": 0.06623973261300371, "driven_lanedir_consec": 0.10715555461973136, "sim_compute_sim_state": 0.04435953140258789, "sim_compute_performance-ego": 0.07556445121765137, "sim_compute_robot_state-ego": 0.08621987342834472, "sim_compute_robot_state-npc0": 0.07449367523193359, "sim_compute_robot_state-npc1": 0.07317439079284668, "sim_compute_robot_state-npc2": 0.07180294990539551, "sim_compute_robot_state-npc3": 0.07523188591003419}, "udem1-10-0": {"driven_any": 0.1446809202748365, "sim_physics": 0.2261676029725508, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07773595494783447, "sim_render-ego": 0.06236787275834517, "in-drivable-lane": 0, "agent_compute-ego": 0.1664685227654197, "deviation-heading": 0.841452621227347, "set_robot_commands": 0.09189584038474342, "deviation-center-line": 0.052936948290642376, "driven_lanedir_consec": 0.07773595494783447, "sim_compute_sim_state": 0.04416335712779652, "sim_compute_performance-ego": 0.06815603646365079, "sim_compute_robot_state-ego": 0.074531305919994, "sim_compute_robot_state-npc0": 0.0646223480051214, "sim_compute_robot_state-npc1": 0.07090155644850298, "sim_compute_robot_state-npc2": 0.07018121806058017, "sim_compute_robot_state-npc3": 0.07338511943817139}, "udem1-11-0": {"driven_any": 0.12383115729166085, "sim_physics": 0.21392386838009483, "survival_time": 0.9500000000000004, "driven_lanedir": 0.09275965022791643, "sim_render-ego": 0.06392585603814376, "in-drivable-lane": 0, "agent_compute-ego": 0.17721396998355263, "deviation-heading": 0.46851975312589333, "set_robot_commands": 0.10393362296255013, "deviation-center-line": 0.08461812622048823, "driven_lanedir_consec": 0.09275965022791643, "sim_compute_sim_state": 0.03827994748165733, "sim_compute_performance-ego": 0.06763534796865363, "sim_compute_robot_state-ego": 0.07169096093428762, "sim_compute_robot_state-npc0": 0.07516295031497353, "sim_compute_robot_state-npc1": 0.07055853542528655, "sim_compute_robot_state-npc2": 0.07023407283582185, "sim_compute_robot_state-npc3": 0.07126825734188683}, "udem1-12-0": {"driven_any": 0.25772357319187783, "sim_physics": 0.2196085013841328, "survival_time": 1.900000000000001, "driven_lanedir": 0.1243721458004623, "sim_render-ego": 0.06845487418927644, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16433323057074295, "deviation-heading": 0.755424244054515, "set_robot_commands": 0.0965254871468795, "deviation-center-line": 0.07766230339231019, "driven_lanedir_consec": 0.1243721458004623, "sim_compute_sim_state": 0.040158290612070185, "sim_compute_performance-ego": 0.06776269486075953, "sim_compute_robot_state-ego": 0.07311172861801951, "sim_compute_robot_state-npc0": 0.07003625443107203, "sim_compute_robot_state-npc1": 0.06800537987759239, "sim_compute_robot_state-npc2": 0.07091913097783138, "sim_compute_robot_state-npc3": 0.06828328810240093}, "udem1-13-0": {"driven_any": 0.12931479622045014, "sim_physics": 0.2452370036732067, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09104784103368856, "sim_render-ego": 0.06896632367914374, "in-drivable-lane": 0, "agent_compute-ego": 0.18925311348655008, "deviation-heading": 0.5459650736253725, "set_robot_commands": 0.0993285287510265, "deviation-center-line": 0.08650670585913293, "driven_lanedir_consec": 0.09104784103368856, "sim_compute_sim_state": 0.04268439249558882, "sim_compute_performance-ego": 0.07775186408649791, "sim_compute_robot_state-ego": 0.0906670635396784, "sim_compute_robot_state-npc0": 0.07448808713392778, "sim_compute_robot_state-npc1": 0.07146047462116588, "sim_compute_robot_state-npc2": 0.07359824397347191, "sim_compute_robot_state-npc3": 0.07234916903755882}, "udem1-14-0": {"driven_any": 0.164172273746567, "sim_physics": 0.22168445587158203, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12219871008623497, "sim_render-ego": 0.06727694548093356, "in-drivable-lane": 0, "agent_compute-ego": 0.19710135459899905, "deviation-heading": 0.6490146334586689, "set_robot_commands": 0.1045539929316594, "deviation-center-line": 0.08488527864084183, "driven_lanedir_consec": 0.12219871008623497, "sim_compute_sim_state": 0.04211476215949425, "sim_compute_performance-ego": 0.07561319607954758, "sim_compute_robot_state-ego": 0.08859671079195462, "sim_compute_robot_state-npc0": 0.07544032426980826, "sim_compute_robot_state-npc1": 0.0737143479860746, "sim_compute_robot_state-npc2": 0.07237456395075871, "sim_compute_robot_state-npc3": 0.07357854109544021}}set_robot_commands_max 0.1090350223310066 set_robot_commands_mean 0.1011098390009096 set_robot_commands_median 0.10128408128565008 set_robot_commands_min 0.09189584038474342 sim_compute_performance-ego_max 0.07918820959148985 sim_compute_performance-ego_mean 0.07217334309489735 sim_compute_performance-ego_median 0.07151345773176714 sim_compute_performance-ego_min 0.06620905616066673 sim_compute_robot_state-ego_max 0.0906670635396784 sim_compute_robot_state-ego_mean 0.07888256850331934 sim_compute_robot_state-ego_median 0.0767381489276886 sim_compute_robot_state-ego_min 0.06993479078466242 sim_compute_robot_state-npc0_max 0.07607303243694884 sim_compute_robot_state-npc0_mean 0.07199721373481978 sim_compute_robot_state-npc0_median 0.07281030217806499 sim_compute_robot_state-npc0_min 0.0646223480051214 sim_compute_robot_state-npc1_max 0.07703444361686707 sim_compute_robot_state-npc1_mean 0.07203926587582163 sim_compute_robot_state-npc1_median 0.07146047462116588 sim_compute_robot_state-npc1_min 0.06524783914739435 sim_compute_robot_state-npc2_max 0.07579811096191406 sim_compute_robot_state-npc2_mean 0.07154678455012577 sim_compute_robot_state-npc2_median 0.07153910940343683 sim_compute_robot_state-npc2_min 0.0671519474549727 sim_compute_robot_state-npc3_max 0.07523188591003419 sim_compute_robot_state-npc3_mean 0.07207271653643262 sim_compute_robot_state-npc3_median 0.07230621337890625 sim_compute_robot_state-npc3_min 0.06828328810240093 sim_compute_sim_state_max 0.04536506864759657 sim_compute_sim_state_mean 0.04189064284710554 sim_compute_sim_state_median 0.0418826522249164 sim_compute_sim_state_min 0.03827994748165733 sim_physics_max 0.27484339714050293 sim_physics_mean 0.2318259995668285 sim_physics_median 0.22495145267910427 sim_physics_min 0.19642836047757056 sim_render-ego_max 0.0735453547853412 sim_render-ego_mean 0.06604916679039416 sim_render-ego_median 0.06433437087319115 sim_render-ego_min 0.05843438885428689 simulation-passed 1 survival_time_max 1.900000000000001 survival_time_mean 1.3300000000000007 survival_time_min 0.9500000000000004
No reset possible 217532826Liam Paull challenge-aido_LF-template-random aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-38-104-51972019-05-07 21:01:05+00:00 2019-05-07 21:32:48+00:00 0:31:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.17501818566095262 agent_compute-ego_mean 0.1600338669339107 agent_compute-ego_median 0.16017496585845947 agent_compute-ego_min 0.14506195272718156 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22161306912385964, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.062422692021237146, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15726423263549805, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0983510651165926, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.037998410719859446, "sim_compute_performance-ego": 0.07108705858641033, "sim_compute_robot_state-ego": 0.0770999057383477, "sim_compute_robot_state-npc0": 0.07148160511934304, "sim_compute_robot_state-npc1": 0.07289549368846265, "sim_compute_robot_state-npc2": 0.06943741931190973, "sim_compute_robot_state-npc3": 0.06993068622637398}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2047352705683027, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06053170136043003, "in-drivable-lane": 0, "agent_compute-ego": 0.14506195272718156, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09319594076701572, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04248736585889544, "sim_compute_performance-ego": 0.06431654521397182, "sim_compute_robot_state-ego": 0.07018859897341047, "sim_compute_robot_state-npc0": 0.0647767526762826, "sim_compute_robot_state-npc1": 0.07349480901445661, "sim_compute_robot_state-npc2": 0.0733021582875933, "sim_compute_robot_state-npc3": 0.0716557502746582}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20543923192811245, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06478184172250692, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16197605966364295, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10149791634198532, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04043338136765563, "sim_compute_performance-ego": 0.06978078258847728, "sim_compute_robot_state-ego": 0.07899421627081714, "sim_compute_robot_state-npc0": 0.0747915957737895, "sim_compute_robot_state-npc1": 0.07133892207469755, "sim_compute_robot_state-npc2": 0.07002436998978402, "sim_compute_robot_state-npc3": 0.06868869587055688}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2301019529501597, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06581646203994751, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16112960875034332, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10455868144830067, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.041025872031847634, "sim_compute_performance-ego": 0.07285167276859283, "sim_compute_robot_state-ego": 0.08030207455158234, "sim_compute_robot_state-npc0": 0.07456693549950917, "sim_compute_robot_state-npc1": 0.07451522847016652, "sim_compute_robot_state-npc2": 0.07302242517471313, "sim_compute_robot_state-npc3": 0.07297452290852864}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.291599330447969, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0679200149717785, "in-drivable-lane": 0, "agent_compute-ego": 0.17501818566095262, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10749600047156924, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.041815780457996186, "sim_compute_performance-ego": 0.07578790755498976, "sim_compute_robot_state-ego": 0.09589104425339472, "sim_compute_robot_state-npc0": 0.07292736144292922, "sim_compute_robot_state-npc1": 0.07007223083859399, "sim_compute_robot_state-npc2": 0.07202026957557314, "sim_compute_robot_state-npc3": 0.0730390435173398}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.20885754345419877, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06392065636412113, "in-drivable-lane": 2, "agent_compute-ego": 0.15979669622318474, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09654787628950472, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04123567821022993, "sim_compute_performance-ego": 0.07318163060856436, "sim_compute_robot_state-ego": 0.07668660500806249, "sim_compute_robot_state-npc0": 0.07329044085062907, "sim_compute_robot_state-npc1": 0.07097557347691702, "sim_compute_robot_state-npc2": 0.07104100438649069, "sim_compute_robot_state-npc3": 0.07229844253220244}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.21543360219418425, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06282283727405141, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15117792249883263, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09781475668971978, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04164195986627375, "sim_compute_performance-ego": 0.07178942439625564, "sim_compute_robot_state-ego": 0.07568328357437282, "sim_compute_robot_state-npc0": 0.07147634839548649, "sim_compute_robot_state-npc1": 0.07066980843405121, "sim_compute_robot_state-npc2": 0.06958061514548886, "sim_compute_robot_state-npc3": 0.06837243941223738}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.22880255222320556, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06418053150177001, "in-drivable-lane": 0, "agent_compute-ego": 0.1585202121734619, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09620941162109375, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.0409436845779419, "sim_compute_performance-ego": 0.07053534507751465, "sim_compute_robot_state-ego": 0.07675061225891114, "sim_compute_robot_state-npc0": 0.0706361198425293, "sim_compute_robot_state-npc1": 0.07105868339538574, "sim_compute_robot_state-npc2": 0.0696978235244751, "sim_compute_robot_state-npc3": 0.07128984451293946}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2165960440268883, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06750717529883751, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16781916068150446, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.1054571454341595, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04106937463466938, "sim_compute_performance-ego": 0.07250216832527748, "sim_compute_robot_state-ego": 0.08261991922671978, "sim_compute_robot_state-npc0": 0.07552700776320237, "sim_compute_robot_state-npc1": 0.07448766781733586, "sim_compute_robot_state-npc2": 0.0718747744193444, "sim_compute_robot_state-npc3": 0.07293215164771447}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.24858654462374177, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06627058982849121, "in-drivable-lane": 0, "agent_compute-ego": 0.160895980321444, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09853540934049168, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03956447197840764, "sim_compute_performance-ego": 0.07245558958787185, "sim_compute_robot_state-ego": 0.08074471583733192, "sim_compute_robot_state-npc0": 0.0697109974347628, "sim_compute_robot_state-npc1": 0.07258104361020602, "sim_compute_robot_state-npc2": 0.07249292043539193, "sim_compute_robot_state-npc3": 0.07177188763251671}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.22801055691458963, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06682471795515581, "in-drivable-lane": 0, "agent_compute-ego": 0.15635984594171698, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10001489249142734, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.038162459026683464, "sim_compute_performance-ego": 0.07033949548547919, "sim_compute_robot_state-ego": 0.08039233901283958, "sim_compute_robot_state-npc0": 0.06475293636322021, "sim_compute_robot_state-npc1": 0.06885707378387451, "sim_compute_robot_state-npc2": 0.06721939823844215, "sim_compute_robot_state-npc3": 0.0712393197146329}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.19448638439178467, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06167098045349121, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16017496585845947, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09930256843566894, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.039698033332824706, "sim_compute_performance-ego": 0.07006284236907959, "sim_compute_robot_state-ego": 0.07266220092773437, "sim_compute_robot_state-npc0": 0.06818984985351563, "sim_compute_robot_state-npc1": 0.06864438533782959, "sim_compute_robot_state-npc2": 0.06997783184051513, "sim_compute_robot_state-npc3": 0.06938049793243409}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2232309047211992, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06591393085236245, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.16126660083202607, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09778417171315944, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04121267288289172, "sim_compute_performance-ego": 0.07127497551289011, "sim_compute_robot_state-ego": 0.08161459577844497, "sim_compute_robot_state-npc0": 0.07155116314583636, "sim_compute_robot_state-npc1": 0.06938446836268648, "sim_compute_robot_state-npc2": 0.07025474690376445, "sim_compute_robot_state-npc3": 0.07204299023810853}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.2404990058678847, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06828194398146409, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.17285705071229202, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.1077850185907804, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04553519762479342, "sim_compute_performance-ego": 0.07709979093991794, "sim_compute_robot_state-ego": 0.08899893668981698, "sim_compute_robot_state-npc0": 0.07476126689177293, "sim_compute_robot_state-npc1": 0.07618496051201454, "sim_compute_robot_state-npc2": 0.07717516789069542, "sim_compute_robot_state-npc3": 0.0803218621474046}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.20117120061601912, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06341940334865025, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1511895293281192, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09630980491638184, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04122100330534435, "sim_compute_performance-ego": 0.07042782193138486, "sim_compute_robot_state-ego": 0.0758239019484747, "sim_compute_robot_state-npc0": 0.07057993071419852, "sim_compute_robot_state-npc1": 0.07157427696954637, "sim_compute_robot_state-npc2": 0.07159855252220518, "sim_compute_robot_state-npc3": 0.07115299361092704}}set_robot_commands_max 0.1077850185907804 set_robot_commands_mean 0.10005737731119006 set_robot_commands_median 0.09853540934049168 set_robot_commands_min 0.09319594076701572 sim_compute_performance-ego_max 0.07709979093991794 sim_compute_performance-ego_mean 0.07156620339644518 sim_compute_performance-ego_median 0.07127497551289011 sim_compute_performance-ego_min 0.06431654521397182 sim_compute_robot_state-ego_max 0.09589104425339472 sim_compute_robot_state-ego_mean 0.0796301966700174 sim_compute_robot_state-ego_median 0.07899421627081714 sim_compute_robot_state-ego_min 0.07018859897341047 sim_compute_robot_state-npc0_max 0.07552700776320237 sim_compute_robot_state-npc0_mean 0.07126802078446715 sim_compute_robot_state-npc0_median 0.07148160511934304 sim_compute_robot_state-npc0_min 0.06475293636322021 sim_compute_robot_state-npc1_max 0.07618496051201454 sim_compute_robot_state-npc1_mean 0.07178230838574831 sim_compute_robot_state-npc1_median 0.07133892207469755 sim_compute_robot_state-npc1_min 0.06864438533782959 sim_compute_robot_state-npc2_max 0.07717516789069542 sim_compute_robot_state-npc2_mean 0.07124796517642577 sim_compute_robot_state-npc2_median 0.07104100438649069 sim_compute_robot_state-npc2_min 0.06721939823844215 sim_compute_robot_state-npc3_max 0.0803218621474046 sim_compute_robot_state-npc3_mean 0.071806075211905 sim_compute_robot_state-npc3_median 0.0716557502746582 sim_compute_robot_state-npc3_min 0.06837243941223738 sim_compute_sim_state_max 0.04553519762479342 sim_compute_sim_state_mean 0.04093635639175431 sim_compute_sim_state_median 0.04106937463466938 sim_compute_sim_state_min 0.037998410719859446 sim_physics_max 0.291599330447969 sim_physics_mean 0.22394421293680664 sim_physics_median 0.22161306912385964 sim_physics_min 0.19448638439178467 sim_render-ego_max 0.06828194398146409 sim_render-ego_mean 0.06481903193161967 sim_render-ego_median 0.06478184172250692 sim_render-ego_min 0.06053170136043003 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible 217352884Andrea Daniele minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-38-104-51972019-05-07 20:29:38+00:00 2019-05-07 21:00:57+00:00 0:31:19 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5197-job21735/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 217232568Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-38-104-51972019-05-07 20:00:56+00:00 2019-05-07 20:29:24+00:00 0:28:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.08301359064438764 agent_compute-ego_mean 0.07474391196482096 agent_compute-ego_median 0.07422445131384808 agent_compute-ego_min 0.06938756363732475 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.20697736452861004, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.060265110199709974, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07186149689088385, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.0929074861917151, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03777706766703043, "sim_compute_performance-ego": 0.06942545075014413, "sim_compute_robot_state-ego": 0.07413515125412538, "sim_compute_robot_state-npc0": 0.06672834488282721, "sim_compute_robot_state-npc1": 0.0671396054417254, "sim_compute_robot_state-npc2": 0.06691674152052546, "sim_compute_robot_state-npc3": 0.06577812619956143}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.2109903406213831, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06854234801398383, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0748542414771186, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09779969851175944, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.039050155215793185, "sim_compute_performance-ego": 0.06911849092554163, "sim_compute_robot_state-ego": 0.07946594556172688, "sim_compute_robot_state-npc0": 0.06835831536187066, "sim_compute_robot_state-npc1": 0.07278205730296948, "sim_compute_robot_state-npc2": 0.07169360584682888, "sim_compute_robot_state-npc3": 0.07158146964179145}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.22308663832835665, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06438166361588699, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07363500961890587, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.09905326060759716, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04059860645196377, "sim_compute_performance-ego": 0.06989057553120148, "sim_compute_robot_state-ego": 0.07472707369388679, "sim_compute_robot_state-npc0": 0.07097055973150791, "sim_compute_robot_state-npc1": 0.0746323451017722, "sim_compute_robot_state-npc2": 0.07132166776901637, "sim_compute_robot_state-npc3": 0.07046275261120918}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.22956674977352745, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06600396256697805, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07395188013712566, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10430910712794254, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.03991190174169708, "sim_compute_performance-ego": 0.07577378708019591, "sim_compute_robot_state-ego": 0.08134423640736363, "sim_compute_robot_state-npc0": 0.07103349451433148, "sim_compute_robot_state-npc1": 0.07401951572351288, "sim_compute_robot_state-npc2": 0.07212953400193599, "sim_compute_robot_state-npc3": 0.07308549211736311}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.22056924778482187, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06135531093763268, "in-drivable-lane": 0, "agent_compute-ego": 0.07422445131384808, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09748440203459366, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04050734768743101, "sim_compute_performance-ego": 0.0678082860034445, "sim_compute_robot_state-ego": 0.07341904225556747, "sim_compute_robot_state-npc0": 0.06795125422270401, "sim_compute_robot_state-npc1": 0.07085005096767259, "sim_compute_robot_state-npc2": 0.07335410947385042, "sim_compute_robot_state-npc3": 0.06996171370796535}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.2144093817355586, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06165603562897327, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07229162197487027, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.09586836543737672, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04106450080871582, "sim_compute_performance-ego": 0.06911565743240655, "sim_compute_robot_state-ego": 0.07418874899546306, "sim_compute_robot_state-npc0": 0.06860858318852443, "sim_compute_robot_state-npc1": 0.07021871267580519, "sim_compute_robot_state-npc2": 0.06964677455378514, "sim_compute_robot_state-npc3": 0.07001778191211176}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20498911993844168, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06535686595099313, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07569535289491926, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.10606728281293595, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04063434260232108, "sim_compute_performance-ego": 0.06987290212086268, "sim_compute_robot_state-ego": 0.08031210218157087, "sim_compute_robot_state-npc0": 0.07300278799874442, "sim_compute_robot_state-npc1": 0.07462372439248222, "sim_compute_robot_state-npc2": 0.0735758696283613, "sim_compute_robot_state-npc3": 0.07220605271203177}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.24324757758885213, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06732446200227084, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07696851312297665, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10428499195673696, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.04266371465709112, "sim_compute_performance-ego": 0.0733910129494863, "sim_compute_robot_state-ego": 0.08296824807990087, "sim_compute_robot_state-npc0": 0.07578058438758327, "sim_compute_robot_state-npc1": 0.07270292386616746, "sim_compute_robot_state-npc2": 0.07756049012484616, "sim_compute_robot_state-npc3": 0.07303625263579905}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.22070514878561331, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06564547572025033, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.0755864659021067, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.10288313377735228, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04144824660101602, "sim_compute_performance-ego": 0.07319453982419746, "sim_compute_robot_state-ego": 0.08392987972082094, "sim_compute_robot_state-npc0": 0.07520719461662825, "sim_compute_robot_state-npc1": 0.07109276361243669, "sim_compute_robot_state-npc2": 0.0711158791253733, "sim_compute_robot_state-npc3": 0.07285597712494606}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.2499141234617967, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06932354890383206, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07982466771052434, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09687905128185566, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.04172380153949444, "sim_compute_performance-ego": 0.07143284724308895, "sim_compute_robot_state-ego": 0.08058066551501934, "sim_compute_robot_state-npc0": 0.0692457235776461, "sim_compute_robot_state-npc1": 0.07277336487403283, "sim_compute_robot_state-npc2": 0.07321244936722976, "sim_compute_robot_state-npc3": 0.07144685891958383}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.20103708585103353, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06463021914164226, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0717707888285319, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.0970319938659668, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.039990021387736, "sim_compute_performance-ego": 0.06843146959940592, "sim_compute_robot_state-ego": 0.07519165356953939, "sim_compute_robot_state-npc0": 0.0697687021891276, "sim_compute_robot_state-npc1": 0.06854521751403808, "sim_compute_robot_state-npc2": 0.06894785881042481, "sim_compute_robot_state-npc3": 0.07190047264099121}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.21228524616786412, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06763853345598493, "in-drivable-lane": 0, "agent_compute-ego": 0.07381440344310942, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.10161133039565312, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.04139301890418643, "sim_compute_performance-ego": 0.06813688505263556, "sim_compute_robot_state-ego": 0.07720983596075148, "sim_compute_robot_state-npc0": 0.07097951571146648, "sim_compute_robot_state-npc1": 0.0656704789116269, "sim_compute_robot_state-npc2": 0.07202635492597308, "sim_compute_robot_state-npc3": 0.070486999693371}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.25143027860064837, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06633209073266318, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07427863187568132, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10119387160900029, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04128422293552132, "sim_compute_performance-ego": 0.0760146462640097, "sim_compute_robot_state-ego": 0.08476896064226018, "sim_compute_robot_state-npc0": 0.07089949208636616, "sim_compute_robot_state-npc1": 0.0707273760507273, "sim_compute_robot_state-npc2": 0.07361201907313147, "sim_compute_robot_state-npc3": 0.07350702063981877}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.19861469949994767, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06118387835366385, "in-drivable-lane": 0, "agent_compute-ego": 0.06938756363732475, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.0906705515725272, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.03929976054600307, "sim_compute_performance-ego": 0.06670690434319633, "sim_compute_robot_state-ego": 0.07764880997794014, "sim_compute_robot_state-npc0": 0.06568103177206856, "sim_compute_robot_state-npc1": 0.06568469320024763, "sim_compute_robot_state-npc2": 0.07192415850503105, "sim_compute_robot_state-npc3": 0.0696250285421099}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.24026154536826935, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06678156759224686, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.08301359064438764, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.10220285022959988, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04047597155851476, "sim_compute_performance-ego": 0.07382985189849255, "sim_compute_robot_state-ego": 0.076721004411286, "sim_compute_robot_state-npc0": 0.06955616614397835, "sim_compute_robot_state-npc1": 0.07440966250849705, "sim_compute_robot_state-npc2": 0.0739456625545726, "sim_compute_robot_state-npc3": 0.07198386098824296}}set_robot_commands_max 0.10606728281293595 set_robot_commands_mean 0.09934982516084086 set_robot_commands_median 0.09905326060759716 set_robot_commands_min 0.0906705515725272 sim_compute_performance-ego_max 0.0760146462640097 sim_compute_performance-ego_mean 0.07080955380122064 sim_compute_performance-ego_median 0.06987290212086268 sim_compute_performance-ego_min 0.06670690434319633 sim_compute_robot_state-ego_max 0.08476896064226018 sim_compute_robot_state-ego_mean 0.07844075721514816 sim_compute_robot_state-ego_median 0.07764880997794014 sim_compute_robot_state-ego_min 0.07341904225556747 sim_compute_robot_state-npc0_max 0.07578058438758327 sim_compute_robot_state-npc0_mean 0.07025145002569165 sim_compute_robot_state-npc0_median 0.0697687021891276 sim_compute_robot_state-npc0_min 0.06568103177206856 sim_compute_robot_state-npc1_max 0.0746323451017722 sim_compute_robot_state-npc1_mean 0.07105816614291426 sim_compute_robot_state-npc1_median 0.07109276361243669 sim_compute_robot_state-npc1_min 0.0656704789116269 sim_compute_robot_state-npc2_max 0.07756049012484616 sim_compute_robot_state-npc2_mean 0.07206554501872572 sim_compute_robot_state-npc2_median 0.07202635492597308 sim_compute_robot_state-npc2_min 0.06691674152052546 sim_compute_robot_state-npc3_max 0.07350702063981877 sim_compute_robot_state-npc3_mean 0.07119572400579313 sim_compute_robot_state-npc3_median 0.07158146964179145 sim_compute_robot_state-npc3_min 0.06577812619956143 sim_compute_sim_state_max 0.04266371465709112 sim_compute_sim_state_mean 0.04052151202030104 sim_compute_sim_state_median 0.04059860645196377 sim_compute_sim_state_min 0.03777706766703043 sim_physics_max 0.25143027860064837 sim_physics_mean 0.221872303202315 sim_physics_median 0.22056924778482187 sim_physics_min 0.19861469949994767 sim_render-ego_max 0.06932354890383206 sim_render-ego_mean 0.06509473818778083 sim_render-ego_median 0.06564547572025033 sim_render-ego_min 0.060265110199709974 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 217082636Andrea Censi challenge-aido_LF-template-random aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-38-104-51972019-05-07 19:32:46+00:00 2019-05-07 20:00:40+00:00 0:27:54 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2636/step1-simulation-ip-172-31-38-104-5197-job21708/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Anastasiya Nikolskaya 🇷🇺
jiang peng
Artem Ioselevskii
Sean Lu
Liam Paull 🇨🇦
Victor Guerra 🇫🇷
Andrea Daniele 🇮🇹
Alexander Karavaev
Andrea Censi 🇨ðŸ‡