Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 245534296Liam Paull challenge-aido_LF-template-random aido3-LFV-sim-testingstep1-simulation timeout no idsc-rudolf-82692019-10-31 13:51:31+00:00 2019-10-31 14:56:35+00:00 1:05:04 I can see how the jo [...] I can see how the job 24553 is timeout because passed 3904 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 245384289Frank (Chude) Qian PredictorLast aido2-PREDstep1-simulation success yes idsc-rudolf-82692019-10-31 13:50:16+00:00 2019-10-31 13:51:17+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10732669658687476 error_L2 0.01824830768147512
No reset possible 245154282Liam Paull challenge-aido_LF-template-random aido3-LF-sim-validationstep1-simulation success no idsc-rudolf-82692019-10-31 12:29:40+00:00 2019-10-31 12:33:36+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.13005513204193506 in-drivable-lane_median 0.29999999999999893
other stats agent_compute-ego_max 0.02455825443509259 agent_compute-ego_mean 0.02424048445249155 agent_compute-ego_median 0.0242470645904541 agent_compute-ego_min 0.023758724624035405 deviation-center-line_max 0.2072381278624381 deviation-center-line_mean 0.13189395308989765 deviation-center-line_min 0.0788839760023766 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3206717506075888 deviation-heading_median 0.23606825392187256 deviation-heading_min 0.19401296908406307 driven_any_max 1.6182144577009443 driven_any_mean 0.861378585933269 driven_any_median 0.9933867744747804 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 0.8010406009604816 driven_lanedir_consec_mean 0.5597645764431625 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 0.8010406009604816 driven_lanedir_mean 0.5597645764431625 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.619999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.0615421975100482, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.012022870558279532, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.02449389740272805, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007705710552356861, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004749902972468623, "sim_compute_performance-ego": 0.007332285245259603, "sim_compute_robot_state-ego": 0.008534360814977575}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06057212866988836, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.011647271175010533, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.023758724624035405, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.007696852964513442, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.004807752721449908, "sim_compute_performance-ego": 0.006724899890376073, "sim_compute_robot_state-ego": 0.008372414345834769}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06600433237412397, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.011305879144107592, "in-drivable-lane": 0, "agent_compute-ego": 0.02414448121014763, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.007304444032556871, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.004692231907564051, "sim_compute_performance-ego": 0.006427245981553022, "sim_compute_robot_state-ego": 0.00821859696332146}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06610438346862793, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.011637535095214844, "in-drivable-lane": 0, "agent_compute-ego": 0.0242470645904541, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007581415176391601, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.005121555328369141, "sim_compute_performance-ego": 0.0068429183959960935, "sim_compute_robot_state-ego": 0.008206939697265625}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.06069277208062667, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.011963364444201506, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02455825443509259, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.007950529267516318, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.005042565019824837, "sim_compute_performance-ego": 0.006855038147938403, "sim_compute_robot_state-ego": 0.008492865139925027}}set_robot_commands_max 0.007950529267516318 set_robot_commands_mean 0.007647790398667018 set_robot_commands_median 0.007696852964513442 set_robot_commands_min 0.007304444032556871 sim_compute_performance-ego_max 0.007332285245259603 sim_compute_performance-ego_mean 0.006836477532224638 sim_compute_performance-ego_median 0.0068429183959960935 sim_compute_performance-ego_min 0.006427245981553022 sim_compute_robot_state-ego_max 0.008534360814977575 sim_compute_robot_state-ego_mean 0.00836503539226489 sim_compute_robot_state-ego_median 0.008372414345834769 sim_compute_robot_state-ego_min 0.008206939697265625 sim_compute_sim_state_max 0.005121555328369141 sim_compute_sim_state_mean 0.004882801589935312 sim_compute_sim_state_median 0.004807752721449908 sim_compute_sim_state_min 0.004692231907564051 sim_physics_max 0.06610438346862793 sim_physics_mean 0.06298316282066302 sim_physics_median 0.0615421975100482 sim_physics_min 0.06057212866988836 sim_render-ego_max 0.012022870558279532 sim_render-ego_mean 0.011715384083362802 sim_render-ego_median 0.011647271175010533 sim_render-ego_min 0.011305879144107592 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2599999999999985 survival_time_min 0.8500000000000002
No reset possible 245034274Riza Velioglu Uni Bielefeld aido3-LFVI-sim-testingstep1-simulation error no idsc-rudolf-82692019-10-29 18:07:59+00:00 2019-10-29 18:09:34+00:00 0:01:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 244954265Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LFV-sim-validationstep1-simulation success no idsc-rudolf-82692019-10-29 17:54:23+00:00 2019-10-29 18:04:57+00:00 0:10:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6357593729806679 survival_time_median 10.90000000000002 deviation-center-line_median 0.6240253376917709 in-drivable-lane_median 0.950000000000002
other stats agent_compute-ego_max 0.026691152375909775 agent_compute-ego_mean 0.025057665430153885 agent_compute-ego_median 0.02531108724961587 agent_compute-ego_min 0.02382856948035104 deviation-center-line_max 1.0942896860753588 deviation-center-line_mean 0.6048137893294141 deviation-center-line_min 0.19068798702445408 deviation-heading_max 6.351236821376861 deviation-heading_mean 3.7566302975983112 deviation-heading_median 4.947636322530241 deviation-heading_min 1.0959163740629112 driven_any_max 2.3487188910961825 driven_any_mean 1.4778469509906509 driven_any_median 1.6978275255524713 driven_any_min 0.5333547124155278 driven_lanedir_consec_max 1.3192546639872118 driven_lanedir_consec_mean 0.8049273172656118 driven_lanedir_consec_min 0.44477587407804187 driven_lanedir_max 1.8802015511831636 driven_lanedir_mean 1.0639710425929327 driven_lanedir_median 1.020218596072367 driven_lanedir_min 0.44477587407804187 in-drivable-lane_max 3.0500000000000034 in-drivable-lane_mean 1.260000000000005 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5333547124155278, "sim_physics": 0.10157133115304484, "survival_time": 3.699999999999995, "driven_lanedir": 0.44477587407804187, "sim_render-ego": 0.011181467288249248, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.02392779169855891, "deviation-heading": 1.0959163740629112, "set_robot_commands": 0.007369173539651407, "deviation-center-line": 0.19068798702445408, "driven_lanedir_consec": 0.44477587407804187, "sim_compute_sim_state": 0.00446428801562335, "sim_compute_performance-ego": 0.00633141801163957, "sim_compute_robot_state-ego": 0.007872436497662519, "sim_compute_robot_state-npc0": 0.007724182025806324, "sim_compute_robot_state-npc1": 0.007420633290265058, "sim_compute_robot_state-npc2": 0.0074895362596254095, "sim_compute_robot_state-npc3": 0.007294181230905894}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3487188910961825, "sim_physics": 0.1027156678835551, "survival_time": 14.950000000000076, "driven_lanedir": 1.8802015511831636, "sim_render-ego": 0.01148559808731079, "in-drivable-lane": 0.950000000000002, "agent_compute-ego": 0.025529726346333825, "deviation-heading": 6.351236821376861, "set_robot_commands": 0.007831581433614095, "deviation-center-line": 1.0942896860753588, "driven_lanedir_consec": 1.3192546639872118, "sim_compute_sim_state": 0.004475232760111491, "sim_compute_performance-ego": 0.006576658884684245, "sim_compute_robot_state-ego": 0.008102055390675862, "sim_compute_robot_state-npc0": 0.007734018961588542, "sim_compute_robot_state-npc1": 0.007520735263824463, "sim_compute_robot_state-npc2": 0.007491257190704346, "sim_compute_robot_state-npc3": 0.00726903518040975}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0713770979548742, "sim_physics": 0.09744575704847064, "survival_time": 6.999999999999983, "driven_lanedir": 1.020218596072367, "sim_render-ego": 0.011118893963950022, "in-drivable-lane": 0, "agent_compute-ego": 0.02382856948035104, "deviation-heading": 1.375191457267969, "set_robot_commands": 0.007475272246769496, "deviation-center-line": 0.4663312339024331, "driven_lanedir_consec": 1.020218596072367, "sim_compute_sim_state": 0.004366799763270787, "sim_compute_performance-ego": 0.00632976804460798, "sim_compute_robot_state-ego": 0.00807694707598005, "sim_compute_robot_state-npc0": 0.007807958126068115, "sim_compute_robot_state-npc1": 0.007537199769701276, "sim_compute_robot_state-npc2": 0.007313190187726702, "sim_compute_robot_state-npc3": 0.007147361551012312}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6978275255524713, "sim_physics": 0.10116444705823144, "survival_time": 10.90000000000002, "driven_lanedir": 0.8623689831927577, "sim_render-ego": 0.01151959502368892, "in-drivable-lane": 3.0500000000000034, "agent_compute-ego": 0.02531108724961587, "deviation-heading": 4.947636322530241, "set_robot_commands": 0.008114580714374507, "deviation-center-line": 0.6487347019530534, "driven_lanedir_consec": 0.6357593729806679, "sim_compute_sim_state": 0.004522859503369813, "sim_compute_performance-ego": 0.006639109838993178, "sim_compute_robot_state-ego": 0.008391965419874279, "sim_compute_robot_state-npc0": 0.008135430309750618, "sim_compute_robot_state-npc1": 0.007777297168696692, "sim_compute_robot_state-npc2": 0.0076349579959834385, "sim_compute_robot_state-npc3": 0.007502813951684794}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.737956527934197, "sim_physics": 0.10208312812942026, "survival_time": 11.150000000000023, "driven_lanedir": 1.1122902084383328, "sim_render-ego": 0.012224011357055116, "in-drivable-lane": 2.0500000000000185, "agent_compute-ego": 0.026691152375909775, "deviation-heading": 5.013170512753575, "set_robot_commands": 0.008489716747951079, "deviation-center-line": 0.6240253376917709, "driven_lanedir_consec": 0.6046280792097704, "sim_compute_sim_state": 0.0049143425552299735, "sim_compute_performance-ego": 0.00691726282573067, "sim_compute_robot_state-ego": 0.00853575505483311, "sim_compute_robot_state-npc0": 0.008365465386566025, "sim_compute_robot_state-npc1": 0.008151380470515366, "sim_compute_robot_state-npc2": 0.00812943954638836, "sim_compute_robot_state-npc3": 0.007986962527972166}}set_robot_commands_max 0.008489716747951079 set_robot_commands_mean 0.007856064936472116 set_robot_commands_median 0.007831581433614095 set_robot_commands_min 0.007369173539651407 sim_compute_performance-ego_max 0.00691726282573067 sim_compute_performance-ego_mean 0.006558843521131129 sim_compute_performance-ego_median 0.006576658884684245 sim_compute_performance-ego_min 0.00632976804460798 sim_compute_robot_state-ego_max 0.00853575505483311 sim_compute_robot_state-ego_mean 0.008195831887805165 sim_compute_robot_state-ego_median 0.008102055390675862 sim_compute_robot_state-ego_min 0.007872436497662519 sim_compute_robot_state-npc0_max 0.008365465386566025 sim_compute_robot_state-npc0_mean 0.007953410961955924 sim_compute_robot_state-npc0_median 0.007807958126068115 sim_compute_robot_state-npc0_min 0.007724182025806324 sim_compute_robot_state-npc1_max 0.008151380470515366 sim_compute_robot_state-npc1_mean 0.00768144919260057 sim_compute_robot_state-npc1_median 0.007537199769701276 sim_compute_robot_state-npc1_min 0.007420633290265058 sim_compute_robot_state-npc2_max 0.00812943954638836 sim_compute_robot_state-npc2_mean 0.007611676236085651 sim_compute_robot_state-npc2_median 0.007491257190704346 sim_compute_robot_state-npc2_min 0.007313190187726702 sim_compute_robot_state-npc3_max 0.007986962527972166 sim_compute_robot_state-npc3_mean 0.007440070888396983 sim_compute_robot_state-npc3_median 0.007294181230905894 sim_compute_robot_state-npc3_min 0.007147361551012312 sim_compute_sim_state_max 0.0049143425552299735 sim_compute_sim_state_mean 0.004548704519521082 sim_compute_sim_state_median 0.004475232760111491 sim_compute_sim_state_min 0.004366799763270787 sim_physics_max 0.1027156678835551 sim_physics_mean 0.10099606625454444 sim_physics_median 0.10157133115304484 sim_physics_min 0.09744575704847064 sim_render-ego_max 0.012224011357055116 sim_render-ego_mean 0.01150591314405082 sim_render-ego_median 0.01148559808731079 sim_render-ego_min 0.011118893963950022 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.54000000000002 survival_time_min 3.699999999999995
No reset possible 244344235Andrea Censi challenge-aido_LF-template-pytorch aido3-LFVI-sim-testingstep1-simulation error no idsc-rudolf-82692019-10-24 17:13:57+00:00 2019-10-24 17:15:44+00:00 0:01:47 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 244264225Manfred Diaz Baseline-IL-logs-tensorflow aido3-LFV-sim-testingstep1-simulation error no idsc-rudolf-82692019-10-24 06:37:07+00:00 2019-10-24 06:37:59+00:00 0:00:52 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 244054210Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFV-sim-validationstep1-simulation error no idsc-rudolf-82692019-10-24 04:56:02+00:00 2019-10-24 04:59:23+00:00 0:03:21 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 243924201Manfred Diaz challenge-aido_LF-template-tensorflow aido3-LFV-sim-testingstep1-simulation error no idsc-rudolf-82692019-10-24 03:38:21+00:00 2019-10-24 03:40:26+00:00 0:02:05 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 243744187Liam Paull challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-validationstep1-simulation error no idsc-rudolf-82692019-10-23 19:50:23+00:00 2019-10-23 19:53:22+00:00 0:02:59 The result file is n [...] The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4187/step1-simulation-idsc-rudolf-8269-job24374:
File '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4187/step1-simulation-idsc-rudolf-8269-job24374/challenge-results/challenge_results.yaml' does not exist.
This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 243614178Liam Paull challenge-aido_LF-baseline-duckietown aido3-LF-sim-testingstep1-simulation error no idsc-rudolf-82692019-10-23 16:53:04+00:00 2019-10-23 16:57:11+00:00 0:04:07 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
