Job ID | submission | user | user label | challenge | step | status | up to date | evaluator | date started | date completed | duration | message | | |
23071 | 3554 | Amaury Camus 🇨🇠| Running the real lane following -- without challenge container | aido2-LFV-sim-validation | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:07:08 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
23040 | 3546 | Nicky Eichmann | Baseline solution using reinforcement learning | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:06:36 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.49875383285179353 | survival_time_median | 2.3999999999999995 | deviation-center-line_median | 0.11538350034890618 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.10158494114875792 | agent_compute-ego_mean | 0.10014772878688696 | agent_compute-ego_median | 0.10046342683432365 | agent_compute-ego_min | 0.0988225294993474 | deviation-center-line_max | 0.9756249920058196 | deviation-center-line_mean | 0.29967242060233484 | deviation-center-line_min | 0.07504719484739283 | deviation-heading_max | 4.665832034897311 | deviation-heading_mean | 1.82199740790182 | deviation-heading_median | 0.3617484806373441 | deviation-heading_min | 0.19211543327251043 | driven_any_max | 3.1247397514551785 | driven_any_mean | 1.0774621842084862 | driven_any_median | 0.639833675434663 | driven_any_min | 0.28362940600638153 | driven_lanedir_consec_max | 1.8684986765819485 | driven_lanedir_consec_mean | 0.6874605688321991 | driven_lanedir_consec_min | 0.16558340184722808 | driven_lanedir_max | 2.9184326900351483 | driven_lanedir_mean | 0.9801986640511842 | driven_lanedir_median | 0.5793398644889534 | driven_lanedir_min | 0.275488859799796 | in-drivable-lane_max | 2.799999999999991 | in-drivable-lane_mean | 0.8399999999999975 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.1247397514551785, "sim_physics": 0.05234848307545075, "survival_time": 14.050000000000065, "driven_lanedir": 2.9184326900351483, "sim_render-ego": 0.03637655180119959, "in-drivable-lane": 1.3999999999999968, "agent_compute-ego": 0.10046342683432365, "deviation-heading": 4.665832034897311, "set_robot_commands": 0.056010401545894525, "deviation-center-line": 0.9756249920058196, "driven_lanedir_consec": 1.8684986765819485, "sim_compute_sim_state": 0.02358895688718748, "sim_compute_performance-ego": 0.03991165619303747, "sim_compute_robot_state-ego": 0.04185006542137933}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8219258156979741, "sim_physics": 0.05683283689545422, "survival_time": 8.199999999999982, "driven_lanedir": 0.5793398644889534, "sim_render-ego": 0.03664392669026444, "in-drivable-lane": 2.799999999999991, "agent_compute-ego": 0.10099290929189544, "deviation-heading": 3.590454427606327, "set_robot_commands": 0.05525449863294276, "deviation-center-line": 0.2486177845253303, "driven_lanedir_consec": 0.16558340184722808, "sim_compute_sim_state": 0.023659552015909333, "sim_compute_performance-ego": 0.04068542689811892, "sim_compute_robot_state-ego": 0.04154545650249574}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.06376372277736664, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.036345019936561584, "in-drivable-lane": 0, "agent_compute-ego": 0.09887483716011047, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.0550406277179718, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.024562343955039975, "sim_compute_performance-ego": 0.039175719022750854, "sim_compute_robot_state-ego": 0.04168136417865753}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5171822724482341, "sim_physics": 0.05949924542353703, "survival_time": 1.3000000000000005, "driven_lanedir": 0.49875383285179353, "sim_render-ego": 0.03677565317887526, "in-drivable-lane": 0, "agent_compute-ego": 0.0988225294993474, "deviation-heading": 0.3617484806373441, "set_robot_commands": 0.05351920311267559, "deviation-center-line": 0.0836886312842255, "driven_lanedir_consec": 0.49875383285179353, "sim_compute_sim_state": 0.02359907443706806, "sim_compute_performance-ego": 0.03889782612140362, "sim_compute_robot_state-ego": 0.04177642785585844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.639833675434663, "sim_physics": 0.057750120759010315, "survival_time": 2.3999999999999995, "driven_lanedir": 0.6289780730802295, "sim_render-ego": 0.037068416674931846, "in-drivable-lane": 0, "agent_compute-ego": 0.10158494114875792, "deviation-heading": 0.29983666309560747, "set_robot_commands": 0.055899426341056824, "deviation-center-line": 0.11538350034890618, "driven_lanedir_consec": 0.6289780730802295, "sim_compute_sim_state": 0.023720110456148785, "sim_compute_performance-ego": 0.03973013659318288, "sim_compute_robot_state-ego": 0.041999767223993935}} | set_robot_commands_max | 0.056010401545894525 | set_robot_commands_mean | 0.055144831470108305 | set_robot_commands_median | 0.05525449863294276 | set_robot_commands_min | 0.05351920311267559 | sim_compute_performance-ego_max | 0.04068542689811892 | sim_compute_performance-ego_mean | 0.03968015296569875 | sim_compute_performance-ego_median | 0.03973013659318288 | sim_compute_performance-ego_min | 0.03889782612140362 | sim_compute_robot_state-ego_max | 0.041999767223993935 | sim_compute_robot_state-ego_mean | 0.041770616236476994 | sim_compute_robot_state-ego_median | 0.04177642785585844 | sim_compute_robot_state-ego_min | 0.04154545650249574 | sim_compute_sim_state_max | 0.024562343955039975 | sim_compute_sim_state_mean | 0.023826007550270728 | sim_compute_sim_state_median | 0.023659552015909333 | sim_compute_sim_state_min | 0.02358895688718748 | sim_physics_max | 0.06376372277736664 | sim_physics_mean | 0.05803888178616379 | sim_physics_median | 0.057750120759010315 | sim_physics_min | 0.05234848307545075 | sim_render-ego_max | 0.037068416674931846 | sim_render-ego_mean | 0.03664191365636655 | sim_render-ego_median | 0.03664392669026444 | sim_render-ego_min | 0.036345019936561584 | simulation-passed | 1 | survival_time_max | 14.050000000000065 | survival_time_mean | 5.350000000000009 | survival_time_min | 0.8000000000000002 |
| No reset possible |
23023 | 2374 | Liam Paull 🇨🇦 | minimal_agent (Python 3) | aido2-LFVI-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:25:58 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.7320108061087556 | survival_time_median | 11.300000000000026 | deviation-center-line_median | 0.41059891008830585 | in-drivable-lane_median | 1.699999999999994 |
other statsagent_compute-ego_max | 0.15838677765893155 | agent_compute-ego_mean | 0.15240832528744602 | agent_compute-ego_median | 0.15553910542378382 | agent_compute-ego_min | 0.1383727744773582 | deviation-center-line_max | 0.9349599376168654 | deviation-center-line_mean | 0.5199952742557017 | deviation-center-line_min | 0.20044345193716143 | deviation-heading_max | 2.690528154812385 | deviation-heading_mean | 1.27316543526639 | deviation-heading_median | 0.9719131370069356 | deviation-heading_min | 0.7672903262185754 | driven_any_max | 2.1860208965398997 | driven_any_mean | 1.3991133906830493 | driven_any_median | 1.641282781235245 | driven_any_min | 0.3581279985986457 | driven_lanedir_consec_max | 1.8538963171887557 | driven_lanedir_consec_mean | 1.0402347342992102 | driven_lanedir_consec_min | 0.3433638903020815 | driven_lanedir_max | 1.8539439248016505 | driven_lanedir_mean | 1.0402940375630965 | driven_lanedir_median | 0.7320108061087556 | driven_lanedir_min | 0.3433638903020815 | in-drivable-lane_max | 6.850000000000049 | in-drivable-lane_mean | 2.150000000000015 | in-drivable-lane_min | 0 | per-episodes | details{"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.192402418735808, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.06259112758974059, "in-drivable-lane": 0, "agent_compute-ego": 0.15553910542378382, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.09648810762219724, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.03905410893195498, "sim_compute_performance-ego": 0.06880636763783683, "sim_compute_robot_state-ego": 0.07522653689426659, "sim_compute_robot_state-npc0": 0.06943573571939383, "sim_compute_robot_state-npc1": 0.07023619234034445, "sim_compute_robot_state-npc2": 0.06917745771661268, "sim_compute_robot_state-npc3": 0.06909772358109466}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.1815089997318056, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06105141838391622, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.15233131249745688, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09614650077290005, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03969669176472558, "sim_compute_performance-ego": 0.06715430981583065, "sim_compute_robot_state-ego": 0.07233148482110766, "sim_compute_robot_state-npc0": 0.07039872805277507, "sim_compute_robot_state-npc1": 0.06923952864276038, "sim_compute_robot_state-npc2": 0.06812727451324463, "sim_compute_robot_state-npc3": 0.06807321475611793}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1907760950385547, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06432673286219112, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.15838677765893155, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09746057088257835, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.039878416256826435, "sim_compute_performance-ego": 0.07229464464500303, "sim_compute_robot_state-ego": 0.0761852147149258, "sim_compute_robot_state-npc0": 0.0704216869151006, "sim_compute_robot_state-npc1": 0.06942128841994238, "sim_compute_robot_state-npc2": 0.06928621550075344, "sim_compute_robot_state-npc3": 0.0695575759059093}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.19758028666178384, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06308098475138346, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1574116563796997, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.09648918787638348, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03948525031407674, "sim_compute_performance-ego": 0.07168923060099285, "sim_compute_robot_state-ego": 0.07449190378189087, "sim_compute_robot_state-npc0": 0.06998908996582032, "sim_compute_robot_state-npc1": 0.06927420298258463, "sim_compute_robot_state-npc2": 0.06965453465779622, "sim_compute_robot_state-npc3": 0.07032481749852498}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.16568267345428467, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.060964368007801195, "in-drivable-lane": 0, "agent_compute-ego": 0.1383727744773582, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.08656682791533293, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.03826971848805746, "sim_compute_performance-ego": 0.06471566359202068, "sim_compute_robot_state-ego": 0.06622366551999692, "sim_compute_robot_state-npc0": 0.06617520915137397, "sim_compute_robot_state-npc1": 0.06447999124173764, "sim_compute_robot_state-npc2": 0.06270736235159415, "sim_compute_robot_state-npc3": 0.06461166893994366}} | set_robot_commands_max | 0.09746057088257835 | set_robot_commands_mean | 0.0946302390138784 | set_robot_commands_median | 0.09648810762219724 | set_robot_commands_min | 0.08656682791533293 | sim_compute_performance-ego_max | 0.07229464464500303 | sim_compute_performance-ego_mean | 0.06893204325833681 | sim_compute_performance-ego_median | 0.06880636763783683 | sim_compute_performance-ego_min | 0.06471566359202068 | sim_compute_robot_state-ego_max | 0.0761852147149258 | sim_compute_robot_state-ego_mean | 0.07289176114643756 | sim_compute_robot_state-ego_median | 0.07449190378189087 | sim_compute_robot_state-ego_min | 0.06622366551999692 | sim_compute_robot_state-npc0_max | 0.0704216869151006 | sim_compute_robot_state-npc0_mean | 0.06928408996089276 | sim_compute_robot_state-npc0_median | 0.06998908996582032 | sim_compute_robot_state-npc0_min | 0.06617520915137397 | sim_compute_robot_state-npc1_max | 0.07023619234034445 | sim_compute_robot_state-npc1_mean | 0.0685302407254739 | sim_compute_robot_state-npc1_median | 0.06927420298258463 | sim_compute_robot_state-npc1_min | 0.06447999124173764 | sim_compute_robot_state-npc2_max | 0.06965453465779622 | sim_compute_robot_state-npc2_mean | 0.06779056894800022 | sim_compute_robot_state-npc2_median | 0.06917745771661268 | sim_compute_robot_state-npc2_min | 0.06270736235159415 | sim_compute_robot_state-npc3_max | 0.07032481749852498 | sim_compute_robot_state-npc3_mean | 0.06833300013631811 | sim_compute_robot_state-npc3_median | 0.06909772358109466 | sim_compute_robot_state-npc3_min | 0.06461166893994366 | sim_compute_sim_state_max | 0.039878416256826435 | sim_compute_sim_state_mean | 0.03927683715112824 | sim_compute_sim_state_median | 0.03948525031407674 | sim_compute_sim_state_min | 0.03826971848805746 | sim_physics_max | 0.19758028666178384 | sim_physics_mean | 0.18559009472444735 | sim_physics_median | 0.1907760950385547 | sim_physics_min | 0.16568267345428467 | sim_render-ego_max | 0.06432673286219112 | sim_render-ego_mean | 0.06240292631900651 | sim_render-ego_median | 0.06259112758974059 | sim_render-ego_min | 0.060964368007801195 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 9.670000000000025 | survival_time_min | 2.6999999999999984 |
| No reset possible |
23010 | 2391 | Liam Paull 🇨🇦 | random_agent | aido2-LF-sim-testing | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:16:00 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.5723310224856362 | survival_time_median | 2.549999999999999 | deviation-center-line_median | 0.10099507669212504 | in-drivable-lane_median | 0.4499999999999984 |
other statsagent_compute-ego_max | 0.15043240434983196 | agent_compute-ego_mean | 0.12985192450623015 | agent_compute-ego_median | 0.13465824547935934 | agent_compute-ego_min | 0.07940946306501116 | deviation-center-line_max | 0.2838635700333795 | deviation-center-line_mean | 0.12786165368054708 | deviation-center-line_min | 0.07112529346797256 | deviation-heading_max | 0.5289022616823588 | deviation-heading_mean | 0.3391682685652287 | deviation-heading_median | 0.32928385103533875 | deviation-heading_min | 0.19401296908406307 | driven_any_max | 2.1706243860917107 | driven_any_mean | 0.9759490378276146 | driven_any_median | 1.0117660515775693 | driven_any_min | 0.23626560261560617 | driven_lanedir_consec_max | 1.919400421063832 | driven_lanedir_consec_mean | 0.6896171461819246 | driven_lanedir_consec_min | 0.2264965947033466 | driven_lanedir_max | 1.919400421063832 | driven_lanedir_mean | 0.6896171461819246 | driven_lanedir_median | 0.5723310224856362 | driven_lanedir_min | 0.2264965947033466 | in-drivable-lane_max | 1.7999999999999936 | in-drivable-lane_mean | 0.5899999999999982 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10271796915266249, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06461237095020435, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1415336220352738, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10180842876434326, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.038990510834587946, "sim_compute_performance-ego": 0.07051033443874782, "sim_compute_robot_state-ego": 0.07946744671574345}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11542625520743575, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06360963279125738, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14232835115170947, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09606278643888586, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04187757361168955, "sim_compute_performance-ego": 0.07341717271243825, "sim_compute_robot_state-ego": 0.07895931075601016}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14248278561760397, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07729263866648954, "in-drivable-lane": 0, "agent_compute-ego": 0.15043240434983196, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.102887840831981, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.040891142452464384, "sim_compute_performance-ego": 0.07502024313982796, "sim_compute_robot_state-ego": 0.08954777437097886}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.10650437355041505, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.058139190673828126, "in-drivable-lane": 0, "agent_compute-ego": 0.13718822479248047, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.091250581741333, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03913865089416504, "sim_compute_performance-ego": 0.06881882667541504, "sim_compute_robot_state-ego": 0.07562188148498535}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09490370750427246, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05394844767413562, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12074960032595863, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08658875392962105, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03456840937650656, "sim_compute_performance-ego": 0.05950133106376551, "sim_compute_robot_state-ego": 0.0646001749400851}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.05529586636290258, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03650059505384796, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.07940946306501116, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.056020746425706515, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02364839826311384, "sim_compute_performance-ego": 0.03983721927720673, "sim_compute_robot_state-ego": 0.041865733205055704}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10787080441202436, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.057453542947769165, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.12829346741948808, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10030631508146014, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03568174157823835, "sim_compute_performance-ego": 0.06512308546475001, "sim_compute_robot_state-ego": 0.07180565595626831}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.10887900988260904, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06023006212143671, "in-drivable-lane": 0, "agent_compute-ego": 0.14004109019324892, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.09545736085800896, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.039016155969528926, "sim_compute_performance-ego": 0.07037247930254255, "sim_compute_robot_state-ego": 0.07025558607918876}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11262516652123404, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.059808957374702064, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12991097013829117, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09376696812904488, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03675232499332751, "sim_compute_performance-ego": 0.06460369643518481, "sim_compute_robot_state-ego": 0.0700188733763614}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10640250986272638, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06078646399758079, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1358331030065363, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09668470295992763, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03869804469021884, "sim_compute_performance-ego": 0.06639436375011097, "sim_compute_robot_state-ego": 0.0692798917943781}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.12015254156930108, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06321048426937748, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13779069541336655, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.09553470240010845, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03907961040348202, "sim_compute_performance-ego": 0.07079179565627854, "sim_compute_robot_state-ego": 0.0778136717808711}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.11430199657167708, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.060864312308175225, "in-drivable-lane": 0, "agent_compute-ego": 0.1169487578528268, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08845388037817818, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03962974888937814, "sim_compute_performance-ego": 0.06485380445207868, "sim_compute_robot_state-ego": 0.07025694847106934}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.08355661934497309, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05053887647740981, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1190773178549374, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08029082242180319, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.032592165703867, "sim_compute_performance-ego": 0.05933832654766008, "sim_compute_robot_state-ego": 0.06193271805258358}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.11060775650872123, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06071642593101219, "in-drivable-lane": 0, "agent_compute-ego": 0.1335835545151322, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.1019881389759205, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03732847284387659, "sim_compute_performance-ego": 0.06696841451856825, "sim_compute_robot_state-ego": 0.07238634427388509}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.10059802204954858, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06142300484227199, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13465824547935934, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09637154784857058, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03843273134792552, "sim_compute_performance-ego": 0.06547479302275415, "sim_compute_robot_state-ego": 0.07235316201752308}} | set_robot_commands_max | 0.102887840831981 | set_robot_commands_mean | 0.0922315718123262 | set_robot_commands_median | 0.09553470240010845 | set_robot_commands_min | 0.056020746425706515 | sim_compute_performance-ego_max | 0.07502024313982796 | sim_compute_performance-ego_mean | 0.06540172576382196 | sim_compute_performance-ego_median | 0.06639436375011097 | sim_compute_performance-ego_min | 0.03983721927720673 | sim_compute_robot_state-ego_max | 0.08954777437097886 | sim_compute_robot_state-ego_mean | 0.0710776782183325 | sim_compute_robot_state-ego_median | 0.07180565595626831 | sim_compute_robot_state-ego_min | 0.041865733205055704 | sim_compute_sim_state_max | 0.04187757361168955 | sim_compute_sim_state_mean | 0.03708837879015802 | sim_compute_sim_state_median | 0.03869804469021884 | sim_compute_sim_state_min | 0.02364839826311384 | sim_physics_max | 0.14248278561760397 | sim_physics_mean | 0.10548835894120716 | sim_physics_median | 0.10787080441202436 | sim_physics_min | 0.05529586636290258 | sim_render-ego_max | 0.07729263866648954 | sim_render-ego_mean | 0.05927566707196656 | sim_render-ego_median | 0.06071642593101219 | sim_render-ego_min | 0.03650059505384796 | simulation-passed | 1 | survival_time_max | 5.09999999999999 | survival_time_mean | 2.503333333333331 | survival_time_min | 0.8500000000000002 |
| No reset possible |
22966 | 2450 | Nicky Eichmann | Baseline solution using reinforcement learning | aido2-LFVI-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:49:24 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22962 | 2456 | Liam Paull 🇨🇦 | challenge-aido_LF-template-ros | aido2-LF-sim-validation | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:00:35 | The container "solut [...]The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22939 | 2500 | Liam Paull 🇨🇦 | challenge-aido_LF-template-pytorch | aido2-LFVI-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:07:18 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.14877926181586787 | survival_time_median | 1.2500000000000004 | deviation-center-line_median | 0.0900894619197119 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.1749580192565918 | agent_compute-ego_mean | 0.16031585738934448 | agent_compute-ego_median | 0.16370085875193277 | agent_compute-ego_min | 0.13459425502353245 | deviation-center-line_max | 0.108023335376982 | deviation-center-line_mean | 0.09056816104885967 | deviation-center-line_min | 0.06154871316490593 | deviation-heading_max | 0.8869347422330832 | deviation-heading_mean | 0.639075598662236 | deviation-heading_median | 0.6684966038869362 | deviation-heading_min | 0.3964948841068413 | driven_any_max | 0.2200239808224516 | driven_any_mean | 0.20077984117167763 | driven_any_median | 0.20693962569331095 | driven_any_min | 0.17253781610851482 | driven_lanedir_consec_max | 0.1817553286975784 | driven_lanedir_consec_mean | 0.15159919437753194 | driven_lanedir_consec_min | 0.12645681450472046 | driven_lanedir_max | 0.1817553286975784 | driven_lanedir_mean | 0.15159919437753194 | driven_lanedir_median | 0.14877926181586787 | driven_lanedir_min | 0.12645681450472046 | in-drivable-lane_max | 0 | in-drivable-lane_mean | 0 | in-drivable-lane_min | 0 | per-episodes | details{"udem1-0-0": {"driven_any": 0.21510136070944655, "sim_physics": 0.14870824637236418, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13534774200216804, "sim_render-ego": 0.04877112529895924, "in-drivable-lane": 0, "agent_compute-ego": 0.13459425502353245, "deviation-heading": 0.8434604904606764, "set_robot_commands": 0.07451986383508753, "deviation-center-line": 0.0900894619197119, "driven_lanedir_consec": 0.13534774200216804, "sim_compute_sim_state": 0.03173545554832176, "sim_compute_performance-ego": 0.054321500990125865, "sim_compute_robot_state-ego": 0.06074454166271069, "sim_compute_robot_state-npc0": 0.053879102071126304, "sim_compute_robot_state-npc1": 0.050162023968166776, "sim_compute_robot_state-npc2": 0.05328389450355813, "sim_compute_robot_state-npc3": 0.05177747761761701}, "udem1-1-0": {"driven_any": 0.2200239808224516, "sim_physics": 0.19691813909090483, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14877926181586787, "sim_render-ego": 0.06028135006244366, "in-drivable-lane": 0, "agent_compute-ego": 0.1548101810308603, "deviation-heading": 0.8869347422330832, "set_robot_commands": 0.08566691325261043, "deviation-center-line": 0.08652162569254425, "driven_lanedir_consec": 0.14877926181586787, "sim_compute_sim_state": 0.0347671600488516, "sim_compute_performance-ego": 0.06231237374819242, "sim_compute_robot_state-ego": 0.06438216796288124, "sim_compute_robot_state-npc0": 0.06411298421713021, "sim_compute_robot_state-npc1": 0.06010701106144832, "sim_compute_robot_state-npc2": 0.06554970374474159, "sim_compute_robot_state-npc3": 0.06196604325221135}, "udem1-2-0": {"driven_any": 0.18929642252466433, "sim_physics": 0.24621506532033283, "survival_time": 1.2000000000000004, "driven_lanedir": 0.16565682486732491, "sim_render-ego": 0.06083130836486816, "in-drivable-lane": 0, "agent_compute-ego": 0.16370085875193277, "deviation-heading": 0.3964948841068413, "set_robot_commands": 0.09254793326059978, "deviation-center-line": 0.108023335376982, "driven_lanedir_consec": 0.16565682486732491, "sim_compute_sim_state": 0.03969311714172363, "sim_compute_performance-ego": 0.06383198499679565, "sim_compute_robot_state-ego": 0.07457578182220459, "sim_compute_robot_state-npc0": 0.06647580862045288, "sim_compute_robot_state-npc1": 0.06831642985343933, "sim_compute_robot_state-npc2": 0.06623372435569763, "sim_compute_robot_state-npc3": 0.07022799054781596}, "udem1-3-0": {"driven_any": 0.20693962569331095, "sim_physics": 0.21352012634277345, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1817553286975784, "sim_render-ego": 0.058483009338378904, "in-drivable-lane": 0, "agent_compute-ego": 0.1749580192565918, "deviation-heading": 0.39999127262364287, "set_robot_commands": 0.09294204711914064, "deviation-center-line": 0.10665766909015428, "driven_lanedir_consec": 0.1817553286975784, "sim_compute_sim_state": 0.03755489349365235, "sim_compute_performance-ego": 0.06408319473266602, "sim_compute_robot_state-ego": 0.07246489524841308, "sim_compute_robot_state-npc0": 0.06954595565795899, "sim_compute_robot_state-npc1": 0.06580693244934083, "sim_compute_robot_state-npc2": 0.07111896514892578, "sim_compute_robot_state-npc3": 0.06667678833007812}, "udem1-4-0": {"driven_any": 0.17253781610851482, "sim_physics": 0.2229794108349344, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12645681450472046, "sim_render-ego": 0.06058492867842964, "in-drivable-lane": 0, "agent_compute-ego": 0.173515972883805, "deviation-heading": 0.6684966038869362, "set_robot_commands": 0.10436757751133131, "deviation-center-line": 0.06154871316490593, "driven_lanedir_consec": 0.12645681450472046, "sim_compute_sim_state": 0.04130721092224121, "sim_compute_performance-ego": 0.06753469550091287, "sim_compute_robot_state-ego": 0.0739319946454919, "sim_compute_robot_state-npc0": 0.0740984937419062, "sim_compute_robot_state-npc1": 0.07186613912167757, "sim_compute_robot_state-npc2": 0.07291329425314198, "sim_compute_robot_state-npc3": 0.06996057344519574}} | set_robot_commands_max | 0.10436757751133131 | set_robot_commands_mean | 0.09000886699575393 | set_robot_commands_median | 0.09254793326059978 | set_robot_commands_min | 0.07451986383508753 | sim_compute_performance-ego_max | 0.06753469550091287 | sim_compute_performance-ego_mean | 0.06241674999373856 | sim_compute_performance-ego_median | 0.06383198499679565 | sim_compute_performance-ego_min | 0.054321500990125865 | sim_compute_robot_state-ego_max | 0.07457578182220459 | sim_compute_robot_state-ego_mean | 0.0692198762683403 | sim_compute_robot_state-ego_median | 0.07246489524841308 | sim_compute_robot_state-ego_min | 0.06074454166271069 | sim_compute_robot_state-npc0_max | 0.0740984937419062 | sim_compute_robot_state-npc0_mean | 0.06562246886171491 | sim_compute_robot_state-npc0_median | 0.06647580862045288 | sim_compute_robot_state-npc0_min | 0.053879102071126304 | sim_compute_robot_state-npc1_max | 0.07186613912167757 | sim_compute_robot_state-npc1_mean | 0.06325170729081456 | sim_compute_robot_state-npc1_median | 0.06580693244934083 | sim_compute_robot_state-npc1_min | 0.050162023968166776 | sim_compute_robot_state-npc2_max | 0.07291329425314198 | sim_compute_robot_state-npc2_mean | 0.06581991640121301 | sim_compute_robot_state-npc2_median | 0.06623372435569763 | sim_compute_robot_state-npc2_min | 0.05328389450355813 | sim_compute_robot_state-npc3_max | 0.07022799054781596 | sim_compute_robot_state-npc3_mean | 0.06412177463858364 | sim_compute_robot_state-npc3_median | 0.06667678833007812 | sim_compute_robot_state-npc3_min | 0.05177747761761701 | sim_compute_sim_state_max | 0.04130721092224121 | sim_compute_sim_state_mean | 0.03701156743095811 | sim_compute_sim_state_median | 0.03755489349365235 | sim_compute_sim_state_min | 0.03173545554832176 | sim_physics_max | 0.24621506532033283 | sim_physics_mean | 0.20566819759226193 | sim_physics_median | 0.21352012634277345 | sim_physics_min | 0.14870824637236418 | sim_render-ego_max | 0.06083130836486816 | sim_render-ego_mean | 0.05779034434861592 | sim_render-ego_median | 0.06028135006244366 | sim_render-ego_min | 0.04877112529895924 | simulation-passed | 1 | survival_time_max | 1.3500000000000003 | survival_time_mean | 1.2500000000000004 | survival_time_min | 1.1500000000000004 |
| No reset possible |
22931 | 2507 | Rami Al-Naim 🇷🇺 | challenge-aido_LF-template-ros | aido2-LFVI-sim-validation | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:00:46 | The container "solut [...]The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22922 | 2513 | Rami Al-Naim 🇷🇺 | challenge-aido_LF-template-ros | aido2-LFVI-sim-validation | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:00:44 | The container "solut [...]The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22910 | 2538 | Liam Paull 🇨🇦 | challenge-aido_LF-baseline-duckietown | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:03:42 | The container "solut [...]The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22893 | 2568 | Alexander Karavaev | challenge-aido_LF-template-ros - Template solution using ROS | aido2-LFVI-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:18:02 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22886 | 2578 | Alexander Karavaev | challenge-aido_LF-template-ros - Template solution using ROS | aido2-LFV-sim-validation | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:02:29 | The container "solut [...]The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22871 | 2599 | Liam Paull 🇨🇦 | challenge-aido_LF-template-pytorch | aido2-LF-sim-testing | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:12:06 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.1139735627251528 | survival_time_median | 1.3500000000000003 | deviation-center-line_median | 0.08503964153926305 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.20329191066600655 | agent_compute-ego_mean | 0.17239502975860038 | agent_compute-ego_median | 0.17171478271484375 | agent_compute-ego_min | 0.13107856114705405 | deviation-center-line_max | 0.1212710617322007 | deviation-center-line_mean | 0.08670343154711144 | deviation-center-line_min | 0.06221135828939317 | deviation-heading_max | 0.9968959112231024 | deviation-heading_mean | 0.7572270058137147 | deviation-heading_median | 0.7592158790972738 | deviation-heading_min | 0.4558983017349816 | driven_any_max | 0.2337768127869152 | driven_any_mean | 0.1728229565267463 | driven_any_median | 0.17537372134431994 | driven_any_min | 0.10880362219541367 | driven_lanedir_consec_max | 0.1732475914950573 | driven_lanedir_consec_mean | 0.1179049109046419 | driven_lanedir_consec_min | 0.07501591491870618 | driven_lanedir_max | 0.1732475914950573 | driven_lanedir_mean | 0.1179049109046419 | driven_lanedir_median | 0.1139735627251528 | driven_lanedir_min | 0.07501591491870618 | in-drivable-lane_max | 0.15000000000000013 | in-drivable-lane_mean | 0.023333333333333355 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2337768127869152, "sim_physics": 0.14239862470915823, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1465881247200835, "sim_render-ego": 0.06840209527449174, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19836907675772003, "deviation-heading": 0.9373488182848472, "set_robot_commands": 0.10610135396321614, "deviation-center-line": 0.09589074414272385, "driven_lanedir_consec": 0.1465881247200835, "sim_compute_sim_state": 0.04284101544004498, "sim_compute_performance-ego": 0.07743815219763553, "sim_compute_robot_state-ego": 0.08821915857719653}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22638205838121855, "sim_physics": 0.10800717157476088, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1566142987092367, "sim_render-ego": 0.06316871502820183, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17555786581600413, "deviation-heading": 0.8973721215780901, "set_robot_commands": 0.0920324816423304, "deviation-center-line": 0.06971392826586914, "driven_lanedir_consec": 0.1566142987092367, "sim_compute_sim_state": 0.03905265471514534, "sim_compute_performance-ego": 0.07001454689923454, "sim_compute_robot_state-ego": 0.07620195080252255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12840875721871625, "sim_physics": 0.11805632000877744, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09710921619299072, "sim_render-ego": 0.06461857614063081, "in-drivable-lane": 0, "agent_compute-ego": 0.167175327028547, "deviation-heading": 0.5640728245542901, "set_robot_commands": 0.10255880582900274, "deviation-center-line": 0.10018248397771824, "driven_lanedir_consec": 0.09710921619299072, "sim_compute_sim_state": 0.040733133043561666, "sim_compute_performance-ego": 0.07131196203685942, "sim_compute_robot_state-ego": 0.08275156929379418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.189143589203882, "sim_physics": 0.08490536831043384, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1139735627251528, "sim_render-ego": 0.05043504856250904, "in-drivable-lane": 0, "agent_compute-ego": 0.13107856114705405, "deviation-heading": 0.9968959112231024, "set_robot_commands": 0.07187053892347547, "deviation-center-line": 0.0808985426145111, "driven_lanedir_consec": 0.1139735627251528, "sim_compute_sim_state": 0.03330234245017723, "sim_compute_performance-ego": 0.0529853414606165, "sim_compute_robot_state-ego": 0.05471231319286205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2323156261313799, "sim_physics": 0.0875069722533226, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1732475914950573, "sim_render-ego": 0.05455400794744491, "in-drivable-lane": 0, "agent_compute-ego": 0.13605009764432907, "deviation-heading": 0.7794392359100324, "set_robot_commands": 0.07473644614219666, "deviation-center-line": 0.07935154241235286, "driven_lanedir_consec": 0.1732475914950573, "sim_compute_sim_state": 0.03091626614332199, "sim_compute_performance-ego": 0.05467066168785095, "sim_compute_robot_state-ego": 0.0558088943362236}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18976264857822756, "sim_physics": 0.11527362040110996, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0854888207315696, "sim_render-ego": 0.06577726772853307, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17255860567092896, "deviation-heading": 0.9891748265490204, "set_robot_commands": 0.09510843242917742, "deviation-center-line": 0.0719992251059456, "driven_lanedir_consec": 0.0854888207315696, "sim_compute_sim_state": 0.036898016929626465, "sim_compute_performance-ego": 0.06799164840153285, "sim_compute_robot_state-ego": 0.07052432639258248}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1903027947264288, "sim_physics": 0.12179765208014126, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1590714389295238, "sim_render-ego": 0.061065673828125, "in-drivable-lane": 0, "agent_compute-ego": 0.16517167255796236, "deviation-heading": 0.5864153296285759, "set_robot_commands": 0.09872695495342386, "deviation-center-line": 0.10448472358234331, "driven_lanedir_consec": 0.1590714389295238, "sim_compute_sim_state": 0.037836313247680664, "sim_compute_performance-ego": 0.06850594487683527, "sim_compute_robot_state-ego": 0.07697728584552634}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10880362219541367, "sim_physics": 0.1090756030309768, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07501591491870618, "sim_render-ego": 0.06346067928132557, "in-drivable-lane": 0, "agent_compute-ego": 0.16571816943940662, "deviation-heading": 0.6089535819541299, "set_robot_commands": 0.09861761047726586, "deviation-center-line": 0.08971452553121945, "driven_lanedir_consec": 0.07501591491870618, "sim_compute_sim_state": 0.03953908738635835, "sim_compute_performance-ego": 0.07087024052937825, "sim_compute_robot_state-ego": 0.07706818126496814}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17537372134431994, "sim_physics": 0.12021333199960214, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1266638945995262, "sim_render-ego": 0.06849990067658601, "in-drivable-lane": 0, "agent_compute-ego": 0.20329191066600655, "deviation-heading": 0.7519237831167496, "set_robot_commands": 0.103369050555759, "deviation-center-line": 0.06381227681626964, "driven_lanedir_consec": 0.1266638945995262, "sim_compute_sim_state": 0.04268503189086914, "sim_compute_performance-ego": 0.07657210915176957, "sim_compute_robot_state-ego": 0.090584189803512}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1417280565582053, "sim_physics": 0.11172369122505188, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10461342097519966, "sim_render-ego": 0.0673153003056844, "in-drivable-lane": 0, "agent_compute-ego": 0.17114191253980002, "deviation-heading": 0.5905018267554549, "set_robot_commands": 0.09780444701512654, "deviation-center-line": 0.08503964153926305, "driven_lanedir_consec": 0.10461342097519966, "sim_compute_sim_state": 0.03775385022163391, "sim_compute_performance-ego": 0.07088841001192729, "sim_compute_robot_state-ego": 0.08099484443664551}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15412268110979, "sim_physics": 0.11664840910169812, "survival_time": 1.3500000000000003, "driven_lanedir": 0.12303777990245868, "sim_render-ego": 0.062442020133689595, "in-drivable-lane": 0, "agent_compute-ego": 0.17171478271484375, "deviation-heading": 0.5898288245736495, "set_robot_commands": 0.0974124272664388, "deviation-center-line": 0.1169722726476068, "driven_lanedir_consec": 0.12303777990245868, "sim_compute_sim_state": 0.040288545467235426, "sim_compute_performance-ego": 0.07141696082221137, "sim_compute_robot_state-ego": 0.07562867800394694}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14877952066571376, "sim_physics": 0.1243896484375, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10287228352430622, "sim_render-ego": 0.06711110115051269, "in-drivable-lane": 0, "agent_compute-ego": 0.19730897903442385, "deviation-heading": 0.7592158790972738, "set_robot_commands": 0.10833165168762209, "deviation-center-line": 0.08581799717637291, "driven_lanedir_consec": 0.10287228352430622, "sim_compute_sim_state": 0.04067755699157715, "sim_compute_performance-ego": 0.07395674705505371, "sim_compute_robot_state-ego": 0.08297057151794433}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18471897984863292, "sim_physics": 0.11839791933695476, "survival_time": 1.5000000000000009, "driven_lanedir": 0.10235357005741286, "sim_render-ego": 0.06591118971506754, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1936617771784465, "deviation-heading": 0.9287432649925178, "set_robot_commands": 0.10281867980957032, "deviation-center-line": 0.07319114937288172, "driven_lanedir_consec": 0.10235357005741286, "sim_compute_sim_state": 0.042366464932759605, "sim_compute_performance-ego": 0.07478609879811605, "sim_compute_robot_state-ego": 0.09409173329671223}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.143293969658817, "sim_physics": 0.10860212032611552, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08205678304190922, "sim_render-ego": 0.057788803027226374, "in-drivable-lane": 0, "agent_compute-ego": 0.16260437781994158, "deviation-heading": 0.9226205572530052, "set_robot_commands": 0.08592203030219445, "deviation-center-line": 0.06221135828939317, "driven_lanedir_consec": 0.08205678304190922, "sim_compute_sim_state": 0.03571997239039494, "sim_compute_performance-ego": 0.06425319268153264, "sim_compute_robot_state-ego": 0.06730236456944393}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.14543150949353348, "sim_physics": 0.1129281719525655, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11986696304649502, "sim_render-ego": 0.06387301286061604, "in-drivable-lane": 0, "agent_compute-ego": 0.17452233036359152, "deviation-heading": 0.4558983017349816, "set_robot_commands": 0.10104320446650188, "deviation-center-line": 0.1212710617322007, "driven_lanedir_consec": 0.11986696304649502, "sim_compute_sim_state": 0.03884513179461161, "sim_compute_performance-ego": 0.0723322331905365, "sim_compute_robot_state-ego": 0.07579616705576579}} | set_robot_commands_max | 0.10833165168762209 | set_robot_commands_mean | 0.09576360769755345 | set_robot_commands_median | 0.09861761047726586 | set_robot_commands_min | 0.07187053892347547 | sim_compute_performance-ego_max | 0.07743815219763553 | sim_compute_performance-ego_mean | 0.06919961665340603 | sim_compute_performance-ego_median | 0.07088841001192729 | sim_compute_performance-ego_min | 0.0529853414606165 | sim_compute_robot_state-ego_max | 0.09409173329671223 | sim_compute_robot_state-ego_mean | 0.07664214855930979 | sim_compute_robot_state-ego_median | 0.07697728584552634 | sim_compute_robot_state-ego_min | 0.05471231319286205 | sim_compute_sim_state_max | 0.04284101544004498 | sim_compute_sim_state_mean | 0.03863035886966657 | sim_compute_sim_state_median | 0.03905265471514534 | sim_compute_sim_state_min | 0.03091626614332199 | sim_physics_max | 0.14239862470915823 | sim_physics_mean | 0.1133283083165446 | sim_physics_median | 0.11527362040110996 | sim_physics_min | 0.08490536831043384 | sim_render-ego_max | 0.06849990067658601 | sim_render-ego_mean | 0.06296155944404297 | sim_render-ego_median | 0.06387301286061604 | sim_render-ego_min | 0.05043504856250904 | simulation-passed | 1 | survival_time_max | 1.7000000000000008 | survival_time_mean | 1.3600000000000003 | survival_time_min | 1.0500000000000005 |
| No reset possible |
22856 | 3545 | FANG MEIYI 🇸🇬 | test | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:18:17 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 2.9800263823744455 | survival_time_median | 14.950000000000076 | deviation-center-line_median | 0.6156266144350033 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.16030456145604452 | agent_compute-ego_mean | 0.15647040593182598 | agent_compute-ego_median | 0.15610625664393107 | agent_compute-ego_min | 0.15322699546813964 | deviation-center-line_max | 0.969065430285506 | deviation-center-line_mean | 0.5836779280470779 | deviation-center-line_min | 0.22094675191295363 | deviation-heading_max | 2.570786587859757 | deviation-heading_mean | 1.4435163677675784 | deviation-heading_median | 1.2055110933872464 | deviation-heading_min | 0.6565102366743353 | driven_any_max | 3.433941368609094 | driven_any_mean | 2.2747014320138965 | driven_any_median | 3.043935897441757 | driven_any_min | 0.5854401522738057 | driven_lanedir_consec_max | 3.4144100276378087 | driven_lanedir_consec_mean | 2.2394881393047563 | driven_lanedir_consec_min | 0.5575898075335641 | driven_lanedir_max | 3.4144100276378087 | driven_lanedir_mean | 2.2394881393047563 | driven_lanedir_median | 2.9800263823744455 | driven_lanedir_min | 0.5575898075335641 | in-drivable-lane_max | 0 | in-drivable-lane_mean | 0 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5854401522738057, "sim_physics": 0.10128630797068278, "survival_time": 2.9999999999999973, "driven_lanedir": 0.5575898075335641, "sim_render-ego": 0.06095796823501587, "in-drivable-lane": 0, "agent_compute-ego": 0.15322699546813964, "deviation-heading": 0.7735902947186319, "set_robot_commands": 0.09163127342859904, "deviation-center-line": 0.22094675191295363, "driven_lanedir_consec": 0.5575898075335641, "sim_compute_sim_state": 0.03735390106836955, "sim_compute_performance-ego": 0.06911587317784627, "sim_compute_robot_state-ego": 0.07260355154673258}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.433941368609094, "sim_physics": 0.10720294872919718, "survival_time": 14.950000000000076, "driven_lanedir": 3.4144100276378087, "sim_render-ego": 0.06266396522521972, "in-drivable-lane": 0, "agent_compute-ego": 0.16030456145604452, "deviation-heading": 1.2055110933872464, "set_robot_commands": 0.09518357435862224, "deviation-center-line": 0.6156266144350033, "driven_lanedir_consec": 3.4144100276378087, "sim_compute_sim_state": 0.03898022810618083, "sim_compute_performance-ego": 0.06989474376042684, "sim_compute_robot_state-ego": 0.0750655444463094}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.157639879675464, "sim_physics": 0.10265667994817096, "survival_time": 14.950000000000076, "driven_lanedir": 3.1086991408542106, "sim_render-ego": 0.06340758005777995, "in-drivable-lane": 0, "agent_compute-ego": 0.15909504810969036, "deviation-heading": 2.011183626197921, "set_robot_commands": 0.09579447269439698, "deviation-center-line": 0.8307217204228979, "driven_lanedir_consec": 3.1086991408542106, "sim_compute_sim_state": 0.03868840297063192, "sim_compute_performance-ego": 0.06984513362248738, "sim_compute_robot_state-ego": 0.07610936164855957}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.043935897441757, "sim_physics": 0.10228124698003133, "survival_time": 14.950000000000076, "driven_lanedir": 2.9800263823744455, "sim_render-ego": 0.06049269199371338, "in-drivable-lane": 0, "agent_compute-ego": 0.15610625664393107, "deviation-heading": 2.570786587859757, "set_robot_commands": 0.09289702574412027, "deviation-center-line": 0.969065430285506, "driven_lanedir_consec": 2.9800263823744455, "sim_compute_sim_state": 0.038512749671936033, "sim_compute_performance-ego": 0.06779128472010294, "sim_compute_robot_state-ego": 0.07140744686126708}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.152549862069362, "sim_physics": 0.09723392680839256, "survival_time": 5.399999999999989, "driven_lanedir": 1.1367153381237518, "sim_render-ego": 0.05650019866448862, "in-drivable-lane": 0, "agent_compute-ego": 0.15361916798132438, "deviation-heading": 0.6565102366743353, "set_robot_commands": 0.09112478185583044, "deviation-center-line": 0.28202912317902834, "driven_lanedir_consec": 1.1367153381237518, "sim_compute_sim_state": 0.03664336381135164, "sim_compute_performance-ego": 0.06295638172714799, "sim_compute_robot_state-ego": 0.07015454769134521}} | set_robot_commands_max | 0.09579447269439698 | set_robot_commands_mean | 0.0933262256163138 | set_robot_commands_median | 0.09289702574412027 | set_robot_commands_min | 0.09112478185583044 | sim_compute_performance-ego_max | 0.06989474376042684 | sim_compute_performance-ego_mean | 0.06792068340160229 | sim_compute_performance-ego_median | 0.06911587317784627 | sim_compute_performance-ego_min | 0.06295638172714799 | sim_compute_robot_state-ego_max | 0.07610936164855957 | sim_compute_robot_state-ego_mean | 0.07306809043884277 | sim_compute_robot_state-ego_median | 0.07260355154673258 | sim_compute_robot_state-ego_min | 0.07015454769134521 | sim_compute_sim_state_max | 0.03898022810618083 | sim_compute_sim_state_mean | 0.038035729125693994 | sim_compute_sim_state_median | 0.038512749671936033 | sim_compute_sim_state_min | 0.03664336381135164 | sim_physics_max | 0.10720294872919718 | sim_physics_mean | 0.10213222208729496 | sim_physics_median | 0.10228124698003133 | sim_physics_min | 0.09723392680839256 | sim_render-ego_max | 0.06340758005777995 | sim_render-ego_mean | 0.060804480835243514 | sim_render-ego_median | 0.06095796823501587 | sim_render-ego_min | 0.05650019866448862 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 10.650000000000045 | survival_time_min | 2.9999999999999973 |
| No reset possible |
22853 | 2641 | Egor Zamotaev | challenge-aido_LF-template-ros - Template solution using ROS | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:05:37 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.36592094708219225 | survival_time_median | 2.3999999999999995 | deviation-center-line_median | 0.1166759393545397 | in-drivable-lane_median | 0.29999999999999893 |
other statsagent_compute-ego_max | 0.07120662339976136 | agent_compute-ego_mean | 0.06931532133896226 | agent_compute-ego_median | 0.06992621024449666 | agent_compute-ego_min | 0.0673259821805087 | deviation-center-line_max | 0.16987818035809085 | deviation-center-line_mean | 0.13199870851217008 | deviation-center-line_min | 0.1011892720306074 | deviation-heading_max | 0.5809378480871981 | deviation-heading_mean | 0.4194004386292103 | deviation-heading_median | 0.34882560565471876 | deviation-heading_min | 0.2596285487829774 | driven_any_max | 0.922682252912863 | driven_any_mean | 0.6324710235085378 | driven_any_median | 0.609146202404747 | driven_any_min | 0.2364518949491652 | driven_lanedir_consec_max | 0.6632135184572027 | driven_lanedir_consec_mean | 0.4245071231796042 | driven_lanedir_consec_min | 0.2221238695940002 | driven_lanedir_max | 0.6632135184572027 | driven_lanedir_mean | 0.4245071231796042 | driven_lanedir_median | 0.36592094708219225 | driven_lanedir_min | 0.2221238695940002 | in-drivable-lane_max | 1.8999999999999944 | in-drivable-lane_mean | 0.6299999999999986 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.10863721874398244, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06316193392578985, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07120662339976136, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09944693135543609, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0407947688035562, "sim_compute_performance-ego": 0.07291886840068118, "sim_compute_robot_state-ego": 0.08031392769074776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11067357063293456, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.0623161514600118, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06992621024449666, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09893099466959636, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.04019923607508342, "sim_compute_performance-ego": 0.07338448365529378, "sim_compute_robot_state-ego": 0.07503651380538941}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.10968499833887274, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.0563779202374545, "in-drivable-lane": 0, "agent_compute-ego": 0.0673259821805087, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.08962889151139693, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.037444147196683014, "sim_compute_performance-ego": 0.06367079778151079, "sim_compute_robot_state-ego": 0.07190761782906273}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.10190932949384052, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05680840710798899, "in-drivable-lane": 0, "agent_compute-ego": 0.06808994710445404, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09342881043752034, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03696604569753011, "sim_compute_performance-ego": 0.06648929913838704, "sim_compute_robot_state-ego": 0.07343475023905437}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.1091348295626433, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.05967693743498429, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.0700278437655905, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09014580042465874, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.038228242293648095, "sim_compute_performance-ego": 0.06823995838994565, "sim_compute_robot_state-ego": 0.07523764734682829}} | set_robot_commands_max | 0.09944693135543609 | set_robot_commands_mean | 0.0943162856797217 | set_robot_commands_median | 0.09342881043752034 | set_robot_commands_min | 0.08962889151139693 | sim_compute_performance-ego_max | 0.07338448365529378 | sim_compute_performance-ego_mean | 0.06894068147316368 | sim_compute_performance-ego_median | 0.06823995838994565 | sim_compute_performance-ego_min | 0.06367079778151079 | sim_compute_robot_state-ego_max | 0.08031392769074776 | sim_compute_robot_state-ego_mean | 0.07518609138221652 | sim_compute_robot_state-ego_median | 0.07503651380538941 | sim_compute_robot_state-ego_min | 0.07190761782906273 | sim_compute_sim_state_max | 0.0407947688035562 | sim_compute_sim_state_mean | 0.03872648801330017 | sim_compute_sim_state_median | 0.038228242293648095 | sim_compute_sim_state_min | 0.03696604569753011 | sim_physics_max | 0.11067357063293456 | sim_physics_mean | 0.1080079893544547 | sim_physics_median | 0.1091348295626433 | sim_physics_min | 0.10190932949384052 | sim_render-ego_max | 0.06316193392578985 | sim_render-ego_mean | 0.05966827003324589 | sim_render-ego_median | 0.05967693743498429 | sim_render-ego_min | 0.0563779202374545 | simulation-passed | 1 | survival_time_max | 3.5499999999999954 | survival_time_mean | 2.469999999999999 | survival_time_min | 1.1000000000000003 |
| No reset possible |
22831 | 2676 | Rami Al-Naim 🇷🇺 | challenge-aido_LF-baseline-duckietown | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:23:44 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22822 | 3544 | jiang peng | Fourth test - TH | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:26:53 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0 | survival_time_median | 14.950000000000076 | deviation-center-line_median | 0.4645543752739657 | in-drivable-lane_median | 7.050000000000024 |
other statsagent_compute-ego_max | 0.20824609359105428 | agent_compute-ego_mean | 0.1843595201174418 | agent_compute-ego_median | 0.17970205545425416 | agent_compute-ego_min | 0.17541431427001952 | deviation-center-line_max | 0.6086571803616331 | deviation-center-line_mean | 0.3963853336930728 | deviation-center-line_min | 0.13323342759563145 | deviation-heading_max | 5.809547093182326 | deviation-heading_mean | 5.700555248701884 | deviation-heading_median | 5.671643317488005 | deviation-heading_min | 5.591444731989129 | driven_any_max | 3.009997301818634e-10 | driven_any_mean | 6.02499131467472e-11 | driven_any_median | 6.371060352813345e-14 | driven_any_min | 5.1361988539061546e-14 | driven_lanedir_consec_max | 3.4762543954514062e-09 | driven_lanedir_consec_mean | 6.952508790902812e-10 | driven_lanedir_consec_min | 0 | driven_lanedir_max | 3.4762543954514062e-09 | driven_lanedir_mean | 6.952508790902812e-10 | driven_lanedir_median | 0 | driven_lanedir_min | 0 | in-drivable-lane_max | 7.050000000000034 | in-drivable-lane_mean | 7.050000000000024 | in-drivable-lane_min | 7.050000000000015 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 6.371060352813345e-14, "sim_physics": 0.1043007230758667, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06350469032923381, "in-drivable-lane": 7.050000000000024, "agent_compute-ego": 0.17970205545425416, "deviation-heading": 5.671643317488005, "set_robot_commands": 0.09824852705001832, "deviation-center-line": 0.6086571803616331, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.039453167915344235, "sim_compute_performance-ego": 0.07092229922612509, "sim_compute_robot_state-ego": 0.07801059643427531}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 8.103864363402158e-14, "sim_physics": 0.10994404792785643, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06310207446416219, "in-drivable-lane": 7.050000000000034, "agent_compute-ego": 0.17989869991938273, "deviation-heading": 5.629602026479737, "set_robot_commands": 0.09673828919728596, "deviation-center-line": 0.13323342759563145, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03929477294286092, "sim_compute_performance-ego": 0.07086102565129598, "sim_compute_robot_state-ego": 0.07775094827016195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 5.1361988539061546e-14, "sim_physics": 0.1058773636817932, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.06190087636311849, "in-drivable-lane": 7.050000000000018, "agent_compute-ego": 0.17853643735249838, "deviation-heading": 5.800539074370222, "set_robot_commands": 0.09806665817896525, "deviation-center-line": 0.4645543752739657, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.03953501621882121, "sim_compute_performance-ego": 0.0704296096165975, "sim_compute_robot_state-ego": 0.07671314636866251}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.009997301818634e-10, "sim_physics": 0.10355684836705524, "survival_time": 14.950000000000076, "driven_lanedir": 3.4762543954514062e-09, "sim_render-ego": 0.058257468541463214, "in-drivable-lane": 7.050000000000015, "agent_compute-ego": 0.17541431427001952, "deviation-heading": 5.809547093182326, "set_robot_commands": 0.09347278674443564, "deviation-center-line": 0.49449453486785866, "driven_lanedir_consec": 3.4762543954514062e-09, "sim_compute_sim_state": 0.0371428910891215, "sim_compute_performance-ego": 0.06747064431508382, "sim_compute_robot_state-ego": 0.07135785341262818}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.372431617137288e-14, "sim_physics": 0.12956693092981977, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.07029642105102539, "in-drivable-lane": 7.05000000000003, "agent_compute-ego": 0.20824609359105428, "deviation-heading": 5.591444731989129, "set_robot_commands": 0.10874003410339356, "deviation-center-line": 0.28098715036627514, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.04326374848683675, "sim_compute_performance-ego": 0.07935749451319377, "sim_compute_robot_state-ego": 0.0915598718325297}} | set_robot_commands_max | 0.10874003410339356 | set_robot_commands_mean | 0.09905325905481976 | set_robot_commands_median | 0.09806665817896525 | set_robot_commands_min | 0.09347278674443564 | sim_compute_performance-ego_max | 0.07935749451319377 | sim_compute_performance-ego_mean | 0.07180821466445923 | sim_compute_performance-ego_median | 0.07086102565129598 | sim_compute_performance-ego_min | 0.06747064431508382 | sim_compute_robot_state-ego_max | 0.0915598718325297 | sim_compute_robot_state-ego_mean | 0.07907848326365152 | sim_compute_robot_state-ego_median | 0.07775094827016195 | sim_compute_robot_state-ego_min | 0.07135785341262818 | sim_compute_sim_state_max | 0.04326374848683675 | sim_compute_sim_state_mean | 0.03973791933059693 | sim_compute_sim_state_median | 0.039453167915344235 | sim_compute_sim_state_min | 0.0371428910891215 | sim_physics_max | 0.12956693092981977 | sim_physics_mean | 0.11064918279647826 | sim_physics_median | 0.1058773636817932 | sim_physics_min | 0.10355684836705524 | sim_render-ego_max | 0.07029642105102539 | sim_render-ego_mean | 0.06341230614980062 | sim_render-ego_median | 0.06310207446416219 | sim_render-ego_min | 0.058257468541463214 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 14.950000000000076 | survival_time_min | 14.950000000000076 |
| No reset possible |
22787 | 2759 | Bhairav Mehta | challenge-aido_LF-template-ros - Template solution using ROS | aido2-LFV-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:08:42 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.36592094708219225 | survival_time_median | 2.5999999999999988 | deviation-center-line_median | 0.16987818035809085 | in-drivable-lane_median | 0.05000000000000005 |
other statsagent_compute-ego_max | 0.07630937546491623 | agent_compute-ego_mean | 0.07069102264993996 | agent_compute-ego_median | 0.0703975046184701 | agent_compute-ego_min | 0.06743087087358747 | deviation-center-line_max | 0.2294363663374862 | deviation-center-line_mean | 0.14972083567701736 | deviation-center-line_min | 0.06426934298501713 | deviation-heading_max | 0.6986268167330368 | deviation-heading_mean | 0.4280304166285303 | deviation-heading_median | 0.41847631252347706 | deviation-heading_min | 0.2596285487829774 | driven_any_max | 1.2972979671834337 | driven_any_mean | 0.7173901327940211 | driven_any_median | 0.7336463183586153 | driven_any_min | 0.26903550091980144 | driven_lanedir_consec_max | 0.97716132702229 | driven_lanedir_consec_mean | 0.5227475277218055 | driven_lanedir_consec_min | 0.2407721645627201 | driven_lanedir_max | 0.97716132702229 | driven_lanedir_mean | 0.5227475277218055 | driven_lanedir_median | 0.36592094708219225 | driven_lanedir_min | 0.2407721645627201 | in-drivable-lane_max | 1.8999999999999944 | in-drivable-lane_mean | 0.5799999999999983 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1640655557874223, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06352941754838111, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0703975046184701, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09276333661146569, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03939069828517001, "sim_compute_performance-ego": 0.07002679059203241, "sim_compute_robot_state-ego": 0.07710811789606659, "sim_compute_robot_state-npc0": 0.07016971413518341, "sim_compute_robot_state-npc1": 0.06652215165151677, "sim_compute_robot_state-npc2": 0.06718319570514518, "sim_compute_robot_state-npc3": 0.07120425264600297}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.18302694708108905, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06505502760410309, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07630937546491623, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09618920832872392, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.03960037976503372, "sim_compute_performance-ego": 0.06948680430650711, "sim_compute_robot_state-ego": 0.07515127956867218, "sim_compute_robot_state-npc0": 0.06940776109695435, "sim_compute_robot_state-npc1": 0.07014405727386475, "sim_compute_robot_state-npc2": 0.06414247304201126, "sim_compute_robot_state-npc3": 0.06805433332920074}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.18135257409169123, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06196604325221135, "in-drivable-lane": 0, "agent_compute-ego": 0.06757386372639583, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09335168966880213, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.03801993223337027, "sim_compute_performance-ego": 0.06869870882767898, "sim_compute_robot_state-ego": 0.07539491928540744, "sim_compute_robot_state-npc0": 0.06607576975455651, "sim_compute_robot_state-npc1": 0.06893295508164626, "sim_compute_robot_state-npc2": 0.06911734892771794, "sim_compute_robot_state-npc3": 0.06973766363584079}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.17655498750748172, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.0618265187868508, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07174349856633012, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09674428355309272, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03955469849289105, "sim_compute_performance-ego": 0.07016149643928773, "sim_compute_robot_state-ego": 0.07466686412852297, "sim_compute_robot_state-npc0": 0.07084878542089976, "sim_compute_robot_state-npc1": 0.07064903936078472, "sim_compute_robot_state-npc2": 0.06991420766358734, "sim_compute_robot_state-npc3": 0.07139474345791724}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.17194752466110955, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.058933110464186894, "in-drivable-lane": 0, "agent_compute-ego": 0.06743087087358747, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09368809064229328, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04023664338248117, "sim_compute_performance-ego": 0.06782582827976771, "sim_compute_robot_state-ego": 0.0711648804800851, "sim_compute_robot_state-npc0": 0.07082833562578474, "sim_compute_robot_state-npc1": 0.07060028257824126, "sim_compute_robot_state-npc2": 0.0701327437446231, "sim_compute_robot_state-npc3": 0.07384186699276879}} | set_robot_commands_max | 0.09674428355309272 | set_robot_commands_mean | 0.09454732176087552 | set_robot_commands_median | 0.09368809064229328 | set_robot_commands_min | 0.09276333661146569 | sim_compute_performance-ego_max | 0.07016149643928773 | sim_compute_performance-ego_mean | 0.0692399256890548 | sim_compute_performance-ego_median | 0.06948680430650711 | sim_compute_performance-ego_min | 0.06782582827976771 | sim_compute_robot_state-ego_max | 0.07710811789606659 | sim_compute_robot_state-ego_mean | 0.07469721227175086 | sim_compute_robot_state-ego_median | 0.07515127956867218 | sim_compute_robot_state-ego_min | 0.0711648804800851 | sim_compute_robot_state-npc0_max | 0.07084878542089976 | sim_compute_robot_state-npc0_mean | 0.06946607320667575 | sim_compute_robot_state-npc0_median | 0.07016971413518341 | sim_compute_robot_state-npc0_min | 0.06607576975455651 | sim_compute_robot_state-npc1_max | 0.07064903936078472 | sim_compute_robot_state-npc1_mean | 0.06936969718921074 | sim_compute_robot_state-npc1_median | 0.07014405727386475 | sim_compute_robot_state-npc1_min | 0.06652215165151677 | sim_compute_robot_state-npc2_max | 0.0701327437446231 | sim_compute_robot_state-npc2_mean | 0.06809799381661696 | sim_compute_robot_state-npc2_median | 0.06911734892771794 | sim_compute_robot_state-npc2_min | 0.06414247304201126 | sim_compute_robot_state-npc3_max | 0.07384186699276879 | sim_compute_robot_state-npc3_mean | 0.0708465720123461 | sim_compute_robot_state-npc3_median | 0.07120425264600297 | sim_compute_robot_state-npc3_min | 0.06805433332920074 | sim_compute_sim_state_max | 0.04023664338248117 | sim_compute_sim_state_mean | 0.03936047043178924 | sim_compute_sim_state_median | 0.03955469849289105 | sim_compute_sim_state_min | 0.03801993223337027 | sim_physics_max | 0.18302694708108905 | sim_physics_mean | 0.1753895178257588 | sim_physics_median | 0.17655498750748172 | sim_physics_min | 0.1640655557874223 | sim_render-ego_max | 0.06505502760410309 | sim_render-ego_mean | 0.06226202353114665 | sim_render-ego_median | 0.06196604325221135 | sim_render-ego_min | 0.058933110464186894 | simulation-passed | 1 | survival_time_max | 4.6499999999999915 | survival_time_mean | 2.6899999999999973 | survival_time_min | 1.0500000000000005 |
| No reset possible |
22766 | 2804 | Andrea Censi 🇨🇠| challenge-aido_LF-template-random - random_agent | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:15:24 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22732 | 2866 | Konstantin Chaika | challenge-aido_LF-baseline-duckietown | aido2-LF-sim-testing | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:31:18 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.24671783642101008 | survival_time_median | 4.449999999999992 | deviation-center-line_median | 0.21740686391939587 | in-drivable-lane_median | 0.14999999999999947 |
other statsagent_compute-ego_max | 0.11395562949933503 | agent_compute-ego_mean | 0.10646578257951216 | agent_compute-ego_median | 0.10604851979475756 | agent_compute-ego_min | 0.0992668634173514 | deviation-center-line_max | 0.5410051280540246 | deviation-center-line_mean | 0.2322045937351865 | deviation-center-line_min | 0.09709119920093633 | deviation-heading_max | 2.335064223187794 | deviation-heading_mean | 1.639071667033012 | deviation-heading_median | 1.6217424294464378 | deviation-heading_min | 1.0045413067653672 | driven_any_max | 1.1745507824729131 | driven_any_mean | 0.4178376009913278 | driven_any_median | 0.33075696258931925 | driven_any_min | 0.15799583171243467 | driven_lanedir_consec_max | 0.5812652382396115 | driven_lanedir_consec_mean | 0.31451619839906175 | driven_lanedir_consec_min | 0.13536267353535347 | driven_lanedir_max | 0.5812652382396115 | driven_lanedir_mean | 0.31451619839906175 | driven_lanedir_median | 0.24671783642101008 | driven_lanedir_min | 0.13536267353535347 | in-drivable-lane_max | 7.700000000000095 | in-drivable-lane_mean | 0.7366666666666721 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4274058805625903, "sim_physics": 0.12199818042286656, "survival_time": 5.699999999999988, "driven_lanedir": 0.3797453961530901, "sim_render-ego": 0.07008045598080284, "in-drivable-lane": 0, "agent_compute-ego": 0.11395562949933503, "deviation-heading": 1.9922709411396304, "set_robot_commands": 0.11529943817540218, "deviation-center-line": 0.3176699139496802, "driven_lanedir_consec": 0.3797453961530901, "sim_compute_sim_state": 0.04263411906727573, "sim_compute_performance-ego": 0.07980118090646308, "sim_compute_robot_state-ego": 0.09271154069063955}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20620509555673744, "sim_physics": 0.11560838797996784, "survival_time": 2.8999999999999977, "driven_lanedir": 0.14709274835295216, "sim_render-ego": 0.06654161009295233, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.1087527768365268, "deviation-heading": 1.4814381778227086, "set_robot_commands": 0.10536793593702644, "deviation-center-line": 0.11406534579599092, "driven_lanedir_consec": 0.14709274835295216, "sim_compute_sim_state": 0.044122679480190934, "sim_compute_performance-ego": 0.07764923983606799, "sim_compute_robot_state-ego": 0.08308242929392848}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15799583171243467, "sim_physics": 0.1182698737020078, "survival_time": 2.3, "driven_lanedir": 0.13536267353535347, "sim_render-ego": 0.0631628243819527, "in-drivable-lane": 0, "agent_compute-ego": 0.10280407511669656, "deviation-heading": 1.0045413067653672, "set_robot_commands": 0.1072214012560637, "deviation-center-line": 0.22007221066592267, "driven_lanedir_consec": 0.13536267353535347, "sim_compute_sim_state": 0.042782498442608376, "sim_compute_performance-ego": 0.07197926873746126, "sim_compute_robot_state-ego": 0.07625272481337837}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5437260479173953, "sim_physics": 0.1233572221138108, "survival_time": 7.099999999999983, "driven_lanedir": 0.4805089801131692, "sim_render-ego": 0.06696581840515137, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1040911338698696, "deviation-heading": 1.9653899722963435, "set_robot_commands": 0.10368442031699168, "deviation-center-line": 0.21740686391939587, "driven_lanedir_consec": 0.4805089801131692, "sim_compute_sim_state": 0.041490793228149414, "sim_compute_performance-ego": 0.07430774729016801, "sim_compute_robot_state-ego": 0.08054928712441888}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5638086188799438, "sim_physics": 0.12490794123435509, "survival_time": 7.349999999999982, "driven_lanedir": 0.46303670019861887, "sim_render-ego": 0.06707178654313899, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.10601490208891784, "deviation-heading": 1.7096441617409257, "set_robot_commands": 0.10808877555691468, "deviation-center-line": 0.16805948426737172, "driven_lanedir_consec": 0.46303670019861887, "sim_compute_sim_state": 0.041697182622896574, "sim_compute_performance-ego": 0.07485677109283655, "sim_compute_robot_state-ego": 0.08011532965160552}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3669189283422206, "sim_physics": 0.12820505366033438, "survival_time": 4.899999999999991, "driven_lanedir": 0.2509974226134841, "sim_render-ego": 0.06936177185603551, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.11031027959317576, "deviation-heading": 1.761710510902259, "set_robot_commands": 0.11102322412996876, "deviation-center-line": 0.2078683190205053, "driven_lanedir_consec": 0.2509974226134841, "sim_compute_sim_state": 0.04129396166120257, "sim_compute_performance-ego": 0.077971414643891, "sim_compute_robot_state-ego": 0.08980623070074588}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.1745507824729131, "sim_physics": 0.11004300355911256, "survival_time": 14.950000000000076, "driven_lanedir": 0.48465777620308703, "sim_render-ego": 0.06173054218292237, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.10414315064748128, "deviation-heading": 2.335064223187794, "set_robot_commands": 0.10062631050745646, "deviation-center-line": 0.2811154974207896, "driven_lanedir_consec": 0.48465777620308703, "sim_compute_sim_state": 0.038680925369262695, "sim_compute_performance-ego": 0.07064624865849813, "sim_compute_robot_state-ego": 0.07848153114318848}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1821042406785927, "sim_physics": 0.11682304052206186, "survival_time": 2.5999999999999988, "driven_lanedir": 0.15793000174726934, "sim_render-ego": 0.06357078827344455, "in-drivable-lane": 0, "agent_compute-ego": 0.10604851979475756, "deviation-heading": 1.0712968188829397, "set_robot_commands": 0.10852131018271811, "deviation-center-line": 0.24221339574719655, "driven_lanedir_consec": 0.15793000174726934, "sim_compute_sim_state": 0.04105632580243624, "sim_compute_performance-ego": 0.07483163246741661, "sim_compute_robot_state-ego": 0.08789157408934373}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.33075696258931925, "sim_physics": 0.1117258607671502, "survival_time": 4.449999999999992, "driven_lanedir": 0.23258452715322697, "sim_render-ego": 0.06621848867180642, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10287774278876488, "deviation-heading": 1.60808845658844, "set_robot_commands": 0.10827553406190336, "deviation-center-line": 0.09709119920093633, "driven_lanedir_consec": 0.23258452715322697, "sim_compute_sim_state": 0.04181873932313383, "sim_compute_performance-ego": 0.07619554808970248, "sim_compute_robot_state-ego": 0.08180150021328016}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2825515076677565, "sim_physics": 0.1344953543179995, "survival_time": 3.8499999999999943, "driven_lanedir": 0.2397283166675086, "sim_render-ego": 0.06687375787016633, "in-drivable-lane": 0, "agent_compute-ego": 0.10908771799756337, "deviation-heading": 1.481796881343552, "set_robot_commands": 0.10788253065827604, "deviation-center-line": 0.1910915202831569, "driven_lanedir_consec": 0.2397283166675086, "sim_compute_sim_state": 0.04223867205830364, "sim_compute_performance-ego": 0.07545216981466714, "sim_compute_robot_state-ego": 0.08576008561369661}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5156037129034067, "sim_physics": 0.12454442271479854, "survival_time": 6.749999999999984, "driven_lanedir": 0.48090252571958, "sim_render-ego": 0.06723249046890824, "in-drivable-lane": 0, "agent_compute-ego": 0.10784333723562736, "deviation-heading": 1.6443263024592747, "set_robot_commands": 0.10838997275741012, "deviation-center-line": 0.5410051280540246, "driven_lanedir_consec": 0.48090252571958, "sim_compute_sim_state": 0.04178886766786929, "sim_compute_performance-ego": 0.07406593252111364, "sim_compute_robot_state-ego": 0.08382867177327474}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.6120478889954961, "sim_physics": 0.12055632603243462, "survival_time": 7.94999999999998, "driven_lanedir": 0.5812652382396115, "sim_render-ego": 0.06599080337668364, "in-drivable-lane": 0, "agent_compute-ego": 0.10892086208991283, "deviation-heading": 1.7525412375760343, "set_robot_commands": 0.10755092093029862, "deviation-center-line": 0.3660595386254619, "driven_lanedir_consec": 0.5812652382396115, "sim_compute_sim_state": 0.04142953614768742, "sim_compute_performance-ego": 0.07471144124396942, "sim_compute_robot_state-ego": 0.08716841163875172}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.32272253633077014, "sim_physics": 0.10959420807060154, "survival_time": 4.3499999999999925, "driven_lanedir": 0.21564222896748397, "sim_render-ego": 0.06487908034489073, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0992668634173514, "deviation-heading": 1.6217424294464378, "set_robot_commands": 0.1043833754528528, "deviation-center-line": 0.17154367212186306, "driven_lanedir_consec": 0.21564222896748397, "sim_compute_sim_state": 0.04080619209114163, "sim_compute_performance-ego": 0.07208354719753923, "sim_compute_robot_state-ego": 0.07926469287653079}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3146898079848945, "sim_physics": 0.11322177999159869, "survival_time": 4.249999999999993, "driven_lanedir": 0.24671783642101008, "sim_render-ego": 0.06668231627520393, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1094050267163445, "deviation-heading": 1.5795620194924105, "set_robot_commands": 0.11365328676560346, "deviation-center-line": 0.09881646657807308, "driven_lanedir_consec": 0.24671783642101008, "sim_compute_sim_state": 0.042490645015940944, "sim_compute_performance-ego": 0.07727251052856446, "sim_compute_robot_state-ego": 0.0902558495016659}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.26647617227544407, "sim_physics": 0.11912110407058508, "survival_time": 3.649999999999995, "driven_lanedir": 0.22157060390048056, "sim_render-ego": 0.06488250706293812, "in-drivable-lane": 0, "agent_compute-ego": 0.10346472100035783, "deviation-heading": 1.576661565851058, "set_robot_commands": 0.10358775478519804, "deviation-center-line": 0.2489903503774295, "driven_lanedir_consec": 0.22157060390048056, "sim_compute_sim_state": 0.04065038080084814, "sim_compute_performance-ego": 0.07320197314432222, "sim_compute_robot_state-ego": 0.0772975993483034}} | set_robot_commands_max | 0.11529943817540218 | set_robot_commands_mean | 0.10757041276493896 | set_robot_commands_median | 0.10788253065827604 | set_robot_commands_min | 0.10062631050745646 | sim_compute_performance-ego_max | 0.07980118090646308 | sim_compute_performance-ego_mean | 0.07500177507817878 | sim_compute_performance-ego_median | 0.07483163246741661 | sim_compute_performance-ego_min | 0.07064624865849813 | sim_compute_robot_state-ego_max | 0.09271154069063955 | sim_compute_robot_state-ego_mean | 0.08361783056485014 | sim_compute_robot_state-ego_median | 0.08308242929392848 | sim_compute_robot_state-ego_min | 0.07625272481337837 | sim_compute_sim_state_max | 0.044122679480190934 | sim_compute_sim_state_mean | 0.041665434585263166 | sim_compute_sim_state_median | 0.041697182622896574 | sim_compute_sim_state_min | 0.038680925369262695 | sim_physics_max | 0.1344953543179995 | sim_physics_mean | 0.11949811727731234 | sim_physics_median | 0.11912110407058508 | sim_physics_min | 0.10959420807060154 | sim_render-ego_max | 0.07008045598080284 | sim_render-ego_mean | 0.06608300278579987 | sim_render-ego_median | 0.06654161009295233 | sim_render-ego_min | 0.06173054218292237 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 5.536666666666663 | survival_time_min | 2.3 |
| No reset possible |
22728 | 2872 | Peter Almasi ðŸ‡ðŸ‡º | challenge-aido_LF-template-pytorch | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:05:53 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.11373989389152372 | survival_time_median | 1.4000000000000006 | deviation-center-line_median | 0.05642535550146458 | in-drivable-lane_median | 0.15000000000000013 |
other statsagent_compute-ego_max | 0.18989652395248413 | agent_compute-ego_mean | 0.18231884495448816 | agent_compute-ego_median | 0.1834187337330409 | agent_compute-ego_min | 0.17513106018304825 | deviation-center-line_max | 0.09660190096051843 | deviation-center-line_mean | 0.06476938671659394 | deviation-center-line_min | 0.053949266909212375 | deviation-heading_max | 0.8333736878034987 | deviation-heading_mean | 0.7068380101576215 | deviation-heading_median | 0.7430573938529722 | deviation-heading_min | 0.5000027163623454 | driven_any_max | 0.2060441987207372 | driven_any_mean | 0.18655805818890797 | driven_any_median | 0.20085017722858323 | driven_any_min | 0.14321040330459464 | driven_lanedir_consec_max | 0.1401280449767034 | driven_lanedir_consec_mean | 0.10132093761781948 | driven_lanedir_consec_min | 0.05973622786814525 | driven_lanedir_max | 0.1401280449767034 | driven_lanedir_mean | 0.10132093761781948 | driven_lanedir_median | 0.11373989389152372 | driven_lanedir_min | 0.05973622786814525 | in-drivable-lane_max | 0.5000000000000004 | in-drivable-lane_mean | 0.18000000000000016 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2034716278508037, "sim_physics": 0.11490164697170258, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05973622786814525, "sim_render-ego": 0.0636666938662529, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17513106018304825, "deviation-heading": 0.7065103341836019, "set_robot_commands": 0.0957014337182045, "deviation-center-line": 0.061497555886120985, "driven_lanedir_consec": 0.05973622786814525, "sim_compute_sim_state": 0.03905817121267319, "sim_compute_performance-ego": 0.06730847805738449, "sim_compute_robot_state-ego": 0.07540690898895264}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2060441987207372, "sim_physics": 0.12900987693241664, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1401280449767034, "sim_render-ego": 0.06815824338368007, "in-drivable-lane": 0, "agent_compute-ego": 0.1834187337330409, "deviation-heading": 0.7512459185856887, "set_robot_commands": 0.1105838247707912, "deviation-center-line": 0.05642535550146458, "driven_lanedir_consec": 0.1401280449767034, "sim_compute_sim_state": 0.04145770413534982, "sim_compute_performance-ego": 0.0755501559802464, "sim_compute_robot_state-ego": 0.0845346110207694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14321040330459464, "sim_physics": 0.12265359163284302, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11373989389152372, "sim_render-ego": 0.06649655103683472, "in-drivable-lane": 0, "agent_compute-ego": 0.18989652395248413, "deviation-heading": 0.5000027163623454, "set_robot_commands": 0.10157673358917237, "deviation-center-line": 0.09660190096051843, "driven_lanedir_consec": 0.11373989389152372, "sim_compute_sim_state": 0.040878045558929446, "sim_compute_performance-ego": 0.07609845399856567, "sim_compute_robot_state-ego": 0.08808301687240601}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17921388383982112, "sim_physics": 0.12764614599722404, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07767268798589022, "sim_render-ego": 0.06309307946099176, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1837300901059751, "deviation-heading": 0.8333736878034987, "set_robot_commands": 0.0977090906213831, "deviation-center-line": 0.05537285432565331, "driven_lanedir_consec": 0.07767268798589022, "sim_compute_sim_state": 0.04064781577498824, "sim_compute_performance-ego": 0.06966010729471843, "sim_compute_robot_state-ego": 0.07543819038956254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20085017722858323, "sim_physics": 0.1312548240025838, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11532783336683484, "sim_render-ego": 0.06609007517496744, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17941781679789226, "deviation-heading": 0.7430573938529722, "set_robot_commands": 0.10259501139322916, "deviation-center-line": 0.053949266909212375, "driven_lanedir_consec": 0.11532783336683484, "sim_compute_sim_state": 0.03946795463562012, "sim_compute_performance-ego": 0.06988736788431803, "sim_compute_robot_state-ego": 0.07283605734507242}} | set_robot_commands_max | 0.1105838247707912 | set_robot_commands_mean | 0.10163321881855608 | set_robot_commands_median | 0.10157673358917237 | set_robot_commands_min | 0.0957014337182045 | sim_compute_performance-ego_max | 0.07609845399856567 | sim_compute_performance-ego_mean | 0.07170091264304661 | sim_compute_performance-ego_median | 0.06988736788431803 | sim_compute_performance-ego_min | 0.06730847805738449 | sim_compute_robot_state-ego_max | 0.08808301687240601 | sim_compute_robot_state-ego_mean | 0.0792597569233526 | sim_compute_robot_state-ego_median | 0.07543819038956254 | sim_compute_robot_state-ego_min | 0.07283605734507242 | sim_compute_sim_state_max | 0.04145770413534982 | sim_compute_sim_state_mean | 0.040301938263512166 | sim_compute_sim_state_median | 0.04064781577498824 | sim_compute_sim_state_min | 0.03905817121267319 | sim_physics_max | 0.1312548240025838 | sim_physics_mean | 0.12509321710735402 | sim_physics_median | 0.12764614599722404 | sim_physics_min | 0.11490164697170258 | sim_render-ego_max | 0.06815824338368007 | sim_render-ego_mean | 0.06550092858454538 | sim_render-ego_median | 0.06609007517496744 | sim_render-ego_min | 0.06309307946099176 | simulation-passed | 1 | survival_time_max | 1.6000000000000008 | survival_time_mean | 1.3700000000000006 | survival_time_min | 1.0000000000000002 |
| No reset possible |
22720 | 2909 | Ashwin Ram 🇸🇬 | challenge-aido_LF-template-random | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:05:35 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.431749818466148 | survival_time_median | 1.2500000000000004 | deviation-center-line_median | 0.07644603511631752 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.2696086287498474 | agent_compute-ego_mean | 0.2482610228476317 | agent_compute-ego_median | 0.2522963333129883 | agent_compute-ego_min | 0.2236361026763916 | deviation-center-line_max | 0.20620379818411205 | deviation-center-line_mean | 0.10234900420910947 | deviation-center-line_min | 0.05525180113567536 | deviation-heading_max | 0.34079905236323005 | deviation-heading_mean | 0.24338956807840056 | deviation-heading_median | 0.1895456122043391 | deviation-heading_min | 0.16290079358306278 | driven_any_max | 1.59512301064124 | driven_any_mean | 0.71746348416769 | driven_any_median | 0.4873038210830887 | driven_any_min | 0.2824464865551075 | driven_lanedir_consec_max | 1.1973173655402514 | driven_lanedir_consec_mean | 0.5481581061625151 | driven_lanedir_consec_min | 0.2747028358731525 | driven_lanedir_max | 1.1973173655402514 | driven_lanedir_mean | 0.5481581061625151 | driven_lanedir_median | 0.431749818466148 | driven_lanedir_min | 0.2747028358731525 | in-drivable-lane_max | 0.7000000000000006 | in-drivable-lane_mean | 0.2699999999999997 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7526511681720554, "sim_physics": 0.09435811723981584, "survival_time": 1.7500000000000009, "driven_lanedir": 0.37025785151428314, "sim_render-ego": 0.05497157914297921, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.2236361026763916, "deviation-heading": 0.16290079358306278, "set_robot_commands": 0.08391520636422294, "deviation-center-line": 0.09922109875527278, "driven_lanedir_consec": 0.37025785151428314, "sim_compute_sim_state": 0.03653725896562849, "sim_compute_performance-ego": 0.06249188014439174, "sim_compute_robot_state-ego": 0.06178593635559082}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4697929343869585, "sim_physics": 0.12612196922302246, "survival_time": 1.2500000000000004, "driven_lanedir": 0.431749818466148, "sim_render-ego": 0.06270847320556641, "in-drivable-lane": 0, "agent_compute-ego": 0.2522963333129883, "deviation-heading": 0.3370968471517856, "set_robot_commands": 0.10048786163330078, "deviation-center-line": 0.05525180113567536, "driven_lanedir_consec": 0.431749818466148, "sim_compute_sim_state": 0.0391904354095459, "sim_compute_performance-ego": 0.07249873161315917, "sim_compute_robot_state-ego": 0.07956485748291016}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2824464865551075, "sim_physics": 0.10924822092056274, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2747028358731525, "sim_render-ego": 0.06451945006847382, "in-drivable-lane": 0, "agent_compute-ego": 0.25259682536125183, "deviation-heading": 0.1895456122043391, "set_robot_commands": 0.09812752902507782, "deviation-center-line": 0.07462228785416973, "driven_lanedir_consec": 0.2747028358731525, "sim_compute_sim_state": 0.039878398180007935, "sim_compute_performance-ego": 0.06992021203041077, "sim_compute_robot_state-ego": 0.07121086120605469}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4873038210830887, "sim_physics": 0.1117057178331458, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4667626594187406, "sim_render-ego": 0.06075112716011379, "in-drivable-lane": 0, "agent_compute-ego": 0.24316722413767936, "deviation-heading": 0.34079905236323005, "set_robot_commands": 0.09693349962649138, "deviation-center-line": 0.07644603511631752, "driven_lanedir_consec": 0.4667626594187406, "sim_compute_sim_state": 0.04048846078955609, "sim_compute_performance-ego": 0.06663319338922916, "sim_compute_robot_state-ego": 0.07200730365255605}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59512301064124, "sim_physics": 0.1101721247037252, "survival_time": 2.9999999999999973, "driven_lanedir": 1.1973173655402514, "sim_render-ego": 0.06894137064615885, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.2696086287498474, "deviation-heading": 0.18660553508958524, "set_robot_commands": 0.10297410090764364, "deviation-center-line": 0.20620379818411205, "driven_lanedir_consec": 1.1973173655402514, "sim_compute_sim_state": 0.039613330364227296, "sim_compute_performance-ego": 0.07229504585266114, "sim_compute_robot_state-ego": 0.08110334475835164}} | set_robot_commands_max | 0.10297410090764364 | set_robot_commands_mean | 0.09648763951134733 | set_robot_commands_median | 0.09812752902507782 | set_robot_commands_min | 0.08391520636422294 | sim_compute_performance-ego_max | 0.07249873161315917 | sim_compute_performance-ego_mean | 0.0687678126059704 | sim_compute_performance-ego_median | 0.06992021203041077 | sim_compute_performance-ego_min | 0.06249188014439174 | sim_compute_robot_state-ego_max | 0.08110334475835164 | sim_compute_robot_state-ego_mean | 0.07313446069109267 | sim_compute_robot_state-ego_median | 0.07200730365255605 | sim_compute_robot_state-ego_min | 0.06178593635559082 | sim_compute_sim_state_max | 0.04048846078955609 | sim_compute_sim_state_mean | 0.039141576741793145 | sim_compute_sim_state_median | 0.039613330364227296 | sim_compute_sim_state_min | 0.03653725896562849 | sim_physics_max | 0.12612196922302246 | sim_physics_mean | 0.11032122998405444 | sim_physics_median | 0.1101721247037252 | sim_physics_min | 0.09435811723981584 | sim_render-ego_max | 0.06894137064615885 | sim_render-ego_mean | 0.06237840004465842 | sim_render-ego_median | 0.06270847320556641 | sim_render-ego_min | 0.05497157914297921 | simulation-passed | 1 | survival_time_max | 2.9999999999999973 | survival_time_mean | 1.59 | survival_time_min | 0.8000000000000002 |
| No reset possible |
22694 | 2956 | Julian Zilly | Baseline-IL-logs-tensorflow | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:23:54 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22637 | 3059 | Andrea Censi 🇨🇠| rotation | aido2-LFV-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:35:55 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.0003144622101045602 | survival_time_median | 14.950000000000076 | deviation-center-line_median | 0.489104853041521 | in-drivable-lane_median | 7.600000000000043 |
other statsagent_compute-ego_max | 0.15649249871571858 | agent_compute-ego_mean | 0.15554450209935505 | agent_compute-ego_median | 0.15576807181040445 | agent_compute-ego_min | 0.1535904916127523 | deviation-center-line_max | 0.6113242374220981 | deviation-center-line_mean | 0.422546032853888 | deviation-center-line_min | 0.020737127615471695 | deviation-heading_max | 5.830135897709593 | deviation-heading_mean | 5.684570550707688 | deviation-heading_median | 5.657649106857695 | deviation-heading_min | 5.536662996854866 | driven_any_max | 0.026478672834056367 | driven_any_mean | 0.024864239592254977 | driven_any_median | 0.025930195541215405 | driven_any_min | 0.022165452661382225 | driven_lanedir_consec_max | 0.0021599934447711355 | driven_lanedir_consec_mean | -0.00048592825605582314 | driven_lanedir_consec_min | -0.003645956811333395 | driven_lanedir_max | 0.0021599934447711355 | driven_lanedir_mean | -0.00048592825605582314 | driven_lanedir_median | 0.0003144622101045602 | driven_lanedir_min | -0.003645956811333395 | in-drivable-lane_max | 7.650000000000043 | in-drivable-lane_mean | 7.600000000000042 | in-drivable-lane_min | 7.550000000000044 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.17355937163035076, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.06264120896657308, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15558146635691325, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.09673843145370484, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.0401012905438741, "sim_compute_performance-ego": 0.06965616544087729, "sim_compute_robot_state-ego": 0.07499462127685547, "sim_compute_robot_state-npc0": 0.07029093583424886, "sim_compute_robot_state-npc1": 0.06950815836588542, "sim_compute_robot_state-npc2": 0.06941475947697957, "sim_compute_robot_state-npc3": 0.07000781615575155}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541215405, "sim_physics": 0.161367031733195, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.06374190489451091, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15649249871571858, "deviation-heading": 5.795316370396737, "set_robot_commands": 0.09715783516565958, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.03934090852737427, "sim_compute_performance-ego": 0.06946030139923096, "sim_compute_robot_state-ego": 0.07385567903518676, "sim_compute_robot_state-npc0": 0.07167641003926595, "sim_compute_robot_state-npc1": 0.07036343971888225, "sim_compute_robot_state-npc2": 0.07062891801198323, "sim_compute_robot_state-npc3": 0.07104990005493164}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672440337, "sim_physics": 0.17377921422322593, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.06329180637995402, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.15628998200098673, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.09750309944152832, "deviation-center-line": 0.489104853041521, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.03970322688420613, "sim_compute_performance-ego": 0.07013305028279622, "sim_compute_robot_state-ego": 0.0742445985476176, "sim_compute_robot_state-npc0": 0.0709423812230428, "sim_compute_robot_state-npc1": 0.07183480660120646, "sim_compute_robot_state-npc2": 0.07062990506490072, "sim_compute_robot_state-npc3": 0.07219893614451091}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382225, "sim_physics": 0.16454767306645712, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988773, "sim_render-ego": 0.06300127188364665, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15576807181040445, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.09616023302078248, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988773, "sim_compute_sim_state": 0.039713444709777834, "sim_compute_performance-ego": 0.06909979820251465, "sim_compute_robot_state-ego": 0.07542394161224365, "sim_compute_robot_state-npc0": 0.06982931613922119, "sim_compute_robot_state-npc1": 0.07056098620096843, "sim_compute_robot_state-npc2": 0.07034600019454956, "sim_compute_robot_state-npc3": 0.07011023362477621}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218054, "sim_physics": 0.17306909163792927, "survival_time": 14.950000000000076, "driven_lanedir": 0.0003144622101045602, "sim_render-ego": 0.0626609738667806, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.1535904916127523, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.09530571460723876, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.0003144622101045602, "sim_compute_sim_state": 0.03938336213429769, "sim_compute_performance-ego": 0.06955384731292724, "sim_compute_robot_state-ego": 0.07430900494257608, "sim_compute_robot_state-npc0": 0.06974963188171386, "sim_compute_robot_state-npc1": 0.06933346192042032, "sim_compute_robot_state-npc2": 0.06889518817265829, "sim_compute_robot_state-npc3": 0.06883553902308147}} | set_robot_commands_max | 0.09750309944152832 | set_robot_commands_mean | 0.0965730627377828 | set_robot_commands_median | 0.09673843145370484 | set_robot_commands_min | 0.09530571460723876 | sim_compute_performance-ego_max | 0.07013305028279622 | sim_compute_performance-ego_mean | 0.06958063252766927 | sim_compute_performance-ego_median | 0.06955384731292724 | sim_compute_performance-ego_min | 0.06909979820251465 | sim_compute_robot_state-ego_max | 0.07542394161224365 | sim_compute_robot_state-ego_mean | 0.07456556908289591 | sim_compute_robot_state-ego_median | 0.07430900494257608 | sim_compute_robot_state-ego_min | 0.07385567903518676 | sim_compute_robot_state-npc0_max | 0.07167641003926595 | sim_compute_robot_state-npc0_mean | 0.07049773502349853 | sim_compute_robot_state-npc0_median | 0.07029093583424886 | sim_compute_robot_state-npc0_min | 0.06974963188171386 | sim_compute_robot_state-npc1_max | 0.07183480660120646 | sim_compute_robot_state-npc1_mean | 0.07032017056147258 | sim_compute_robot_state-npc1_median | 0.07036343971888225 | sim_compute_robot_state-npc1_min | 0.06933346192042032 | sim_compute_robot_state-npc2_max | 0.07062990506490072 | sim_compute_robot_state-npc2_mean | 0.06998295418421427 | sim_compute_robot_state-npc2_median | 0.07034600019454956 | sim_compute_robot_state-npc2_min | 0.06889518817265829 | sim_compute_robot_state-npc3_max | 0.07219893614451091 | sim_compute_robot_state-npc3_mean | 0.07044048500061036 | sim_compute_robot_state-npc3_median | 0.07011023362477621 | sim_compute_robot_state-npc3_min | 0.06883553902308147 | sim_compute_sim_state_max | 0.0401012905438741 | sim_compute_sim_state_mean | 0.03964844655990601 | sim_compute_sim_state_median | 0.03970322688420613 | sim_compute_sim_state_min | 0.03934090852737427 | sim_physics_max | 0.17377921422322593 | sim_physics_mean | 0.16926447645823162 | sim_physics_median | 0.17306909163792927 | sim_physics_min | 0.161367031733195 | sim_render-ego_max | 0.06374190489451091 | sim_render-ego_mean | 0.06306743319829304 | sim_render-ego_median | 0.06300127188364665 | sim_render-ego_min | 0.06264120896657308 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 14.950000000000076 | survival_time_min | 14.950000000000076 |
| No reset possible |
22631 | 3070 | Julian Zilly | Baseline-IL-logs-tensorflow | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:00:34 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22621 | 3097 | Rami Al-Naim 🇷🇺 | challenge-aido_LF-baseline-duckietown | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:17:13 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.7497731126488496 | survival_time_median | 5.749999999999988 | deviation-center-line_median | 0.4542571062650615 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.15514161712244937 | agent_compute-ego_mean | 0.14262498082177025 | agent_compute-ego_median | 0.1429216032442839 | agent_compute-ego_min | 0.13389546879918585 | deviation-center-line_max | 0.9892072024890246 | deviation-center-line_mean | 0.5587433555893095 | deviation-center-line_min | 0.19015401406126392 | deviation-heading_max | 8.24969965563321 | deviation-heading_mean | 3.982172385027039 | deviation-heading_median | 2.4534306224677804 | deviation-heading_min | 1.3980260384907996 | driven_any_max | 2.3488749569524434 | driven_any_mean | 1.3461098239515406 | driven_any_median | 0.8626779353011732 | driven_any_min | 0.6695517997045708 | driven_lanedir_consec_max | 2.0898749724894543 | driven_lanedir_consec_mean | 1.0259707323992484 | driven_lanedir_consec_min | 0.6111339774968703 | driven_lanedir_max | 2.0898749724894543 | driven_lanedir_mean | 1.1018819171573238 | driven_lanedir_median | 0.7497731126488496 | driven_lanedir_min | 0.6111339774968703 | in-drivable-lane_max | 1.0499999999999998 | in-drivable-lane_mean | 0.20999999999999996 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8626779353011732, "sim_physics": 0.11703101448390794, "survival_time": 5.749999999999988, "driven_lanedir": 0.7497731126488496, "sim_render-ego": 0.06699370301288107, "in-drivable-lane": 0, "agent_compute-ego": 0.1429216032442839, "deviation-heading": 2.4534306224677804, "set_robot_commands": 0.10763513938240384, "deviation-center-line": 0.4542571062650615, "driven_lanedir_consec": 0.7497731126488496, "sim_compute_sim_state": 0.04260664815488069, "sim_compute_performance-ego": 0.07272527321525242, "sim_compute_robot_state-ego": 0.0792851385862931}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1397024165819056, "sim_physics": 0.1229526970412705, "survival_time": 13.65000000000006, "driven_lanedir": 1.4344240906315724, "sim_render-ego": 0.06734260010631966, "in-drivable-lane": 1.0499999999999998, "agent_compute-ego": 0.13389546879918585, "deviation-heading": 8.24969965563321, "set_robot_commands": 0.10729997323982882, "deviation-center-line": 0.903180865287891, "driven_lanedir_consec": 1.0548681668411937, "sim_compute_sim_state": 0.041523053969219056, "sim_compute_performance-ego": 0.07615852967286721, "sim_compute_robot_state-ego": 0.08569449470156715}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3488749569524434, "sim_physics": 0.1204693094889323, "survival_time": 14.950000000000076, "driven_lanedir": 2.0898749724894543, "sim_render-ego": 0.06816211938858033, "in-drivable-lane": 0, "agent_compute-ego": 0.1366382392247518, "deviation-heading": 5.97879496187745, "set_robot_commands": 0.10696719964345296, "deviation-center-line": 0.9892072024890246, "driven_lanedir_consec": 2.0898749724894543, "sim_compute_sim_state": 0.04199089129765828, "sim_compute_performance-ego": 0.07751037915547689, "sim_compute_robot_state-ego": 0.08851662556330363}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7097420112176095, "sim_physics": 0.12342029119792736, "survival_time": 4.749999999999991, "driven_lanedir": 0.6242034325198733, "sim_render-ego": 0.06919737113149542, "in-drivable-lane": 0, "agent_compute-ego": 0.15514161712244937, "deviation-heading": 1.8309106466659515, "set_robot_commands": 0.10852051283183851, "deviation-center-line": 0.19015401406126392, "driven_lanedir_consec": 0.6242034325198733, "sim_compute_sim_state": 0.0422250371230276, "sim_compute_performance-ego": 0.07669016687493575, "sim_compute_robot_state-ego": 0.08805577880457828}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6695517997045708, "sim_physics": 0.12279862032996285, "survival_time": 4.499999999999992, "driven_lanedir": 0.6111339774968703, "sim_render-ego": 0.07010780705346001, "in-drivable-lane": 0, "agent_compute-ego": 0.14452797571818035, "deviation-heading": 1.3980260384907996, "set_robot_commands": 0.10340554979112414, "deviation-center-line": 0.25691758984330704, "driven_lanedir_consec": 0.6111339774968703, "sim_compute_sim_state": 0.04159916241963704, "sim_compute_performance-ego": 0.07341577212015787, "sim_compute_robot_state-ego": 0.08345864613850912}} | set_robot_commands_max | 0.10852051283183851 | set_robot_commands_mean | 0.10676567497772964 | set_robot_commands_median | 0.10729997323982882 | set_robot_commands_min | 0.10340554979112414 | sim_compute_performance-ego_max | 0.07751037915547689 | sim_compute_performance-ego_mean | 0.07530002420773803 | sim_compute_performance-ego_median | 0.07615852967286721 | sim_compute_performance-ego_min | 0.07272527321525242 | sim_compute_robot_state-ego_max | 0.08851662556330363 | sim_compute_robot_state-ego_mean | 0.08500213675885025 | sim_compute_robot_state-ego_median | 0.08569449470156715 | sim_compute_robot_state-ego_min | 0.0792851385862931 | sim_compute_sim_state_max | 0.04260664815488069 | sim_compute_sim_state_mean | 0.04198895859288453 | sim_compute_sim_state_median | 0.04199089129765828 | sim_compute_sim_state_min | 0.041523053969219056 | sim_physics_max | 0.12342029119792736 | sim_physics_mean | 0.1213343865084002 | sim_physics_median | 0.12279862032996285 | sim_physics_min | 0.11703101448390794 | sim_render-ego_max | 0.07010780705346001 | sim_render-ego_mean | 0.0683607201385473 | sim_render-ego_median | 0.06816211938858033 | sim_render-ego_min | 0.06699370301288107 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 8.720000000000022 | survival_time_min | 4.499999999999992 |
| No reset possible |
22598 | 3121 | Rami Al-Naim 🇷🇺 | v_d_1_K_t_-0.75_no_cache | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:22:48 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 1.8325483626052672 | survival_time_median | 12.000000000000036 | deviation-center-line_median | 0.8815997444867918 | in-drivable-lane_median | 0 |
other statsagent_compute-ego_max | 0.1586750594774882 | agent_compute-ego_mean | 0.1486992659356938 | agent_compute-ego_median | 0.14800444122188347 | agent_compute-ego_min | 0.14264484842618305 | deviation-center-line_max | 1.3376448223619095 | deviation-center-line_mean | 0.9197921598607474 | deviation-center-line_min | 0.485732701580119 | deviation-heading_max | 3.2266948184565996 | deviation-heading_mean | 1.7949124448445095 | deviation-heading_median | 1.6330992408295897 | deviation-heading_min | 1.031330679044669 | driven_any_max | 2.3491423054072724 | driven_any_mean | 1.6532890184154077 | driven_any_median | 1.8750254044901604 | driven_any_min | 0.9110279691839326 | driven_lanedir_consec_max | 2.3101768871616195 | driven_lanedir_consec_mean | 1.57000446008384 | driven_lanedir_consec_min | 0.8697256198070926 | driven_lanedir_max | 2.3101768871616195 | driven_lanedir_mean | 1.57000446008384 | driven_lanedir_median | 1.8325483626052672 | driven_lanedir_min | 0.8697256198070926 | in-drivable-lane_max | 0.9500000000000136 | in-drivable-lane_mean | 0.1900000000000027 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9110279691839326, "sim_physics": 0.12912969549825368, "survival_time": 6.0499999999999865, "driven_lanedir": 0.8697256198070926, "sim_render-ego": 0.07028281984250408, "in-drivable-lane": 0, "agent_compute-ego": 0.14800444122188347, "deviation-heading": 1.2536783841019148, "set_robot_commands": 0.11060231185156452, "deviation-center-line": 0.485732701580119, "driven_lanedir_consec": 0.8697256198070926, "sim_compute_sim_state": 0.04315736668169006, "sim_compute_performance-ego": 0.07646922631697221, "sim_compute_robot_state-ego": 0.08745011416348544}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8750254044901604, "sim_physics": 0.12146683633327485, "survival_time": 12.000000000000036, "driven_lanedir": 1.850016525144048, "sim_render-ego": 0.06795400679111481, "in-drivable-lane": 0, "agent_compute-ego": 0.14264484842618305, "deviation-heading": 1.6330992408295897, "set_robot_commands": 0.11374503274758656, "deviation-center-line": 0.8815997444867918, "driven_lanedir_consec": 1.850016525144048, "sim_compute_sim_state": 0.04247107207775116, "sim_compute_performance-ego": 0.07732979754606882, "sim_compute_robot_state-ego": 0.09200626214345296}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.1241288676777734, "sim_physics": 0.1307632140127935, "survival_time": 13.550000000000058, "driven_lanedir": 1.8325483626052672, "sim_render-ego": 0.07068356552687079, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.15042701154617366, "deviation-heading": 3.2266948184565996, "set_robot_commands": 0.11430892293303654, "deviation-center-line": 1.291220222997068, "driven_lanedir_consec": 1.8325483626052672, "sim_compute_sim_state": 0.04277678873266241, "sim_compute_performance-ego": 0.07916511732713763, "sim_compute_robot_state-ego": 0.09055066284658284}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0071205453178993, "sim_physics": 0.14559363957607385, "survival_time": 6.5999999999999845, "driven_lanedir": 0.9875549057011724, "sim_render-ego": 0.06936719742688266, "in-drivable-lane": 0, "agent_compute-ego": 0.1437449690067407, "deviation-heading": 1.031330679044669, "set_robot_commands": 0.11325378851457076, "deviation-center-line": 0.6027633078778487, "driven_lanedir_consec": 0.9875549057011724, "sim_compute_sim_state": 0.04278185512080337, "sim_compute_performance-ego": 0.0782172643777096, "sim_compute_robot_state-ego": 0.0898264700716192}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491423054072724, "sim_physics": 0.1246459182103475, "survival_time": 14.950000000000076, "driven_lanedir": 2.3101768871616195, "sim_render-ego": 0.07142459789911906, "in-drivable-lane": 0, "agent_compute-ego": 0.1586750594774882, "deviation-heading": 1.829759101789776, "set_robot_commands": 0.11417208353678386, "deviation-center-line": 1.3376448223619095, "driven_lanedir_consec": 2.3101768871616195, "sim_compute_sim_state": 0.04412167549133301, "sim_compute_performance-ego": 0.07904360135396321, "sim_compute_robot_state-ego": 0.08976370652516683}} | set_robot_commands_max | 0.11430892293303654 | set_robot_commands_mean | 0.11321642791670844 | set_robot_commands_median | 0.11374503274758656 | set_robot_commands_min | 0.11060231185156452 | sim_compute_performance-ego_max | 0.07916511732713763 | sim_compute_performance-ego_mean | 0.07804500138437029 | sim_compute_performance-ego_median | 0.0782172643777096 | sim_compute_performance-ego_min | 0.07646922631697221 | sim_compute_robot_state-ego_max | 0.09200626214345296 | sim_compute_robot_state-ego_mean | 0.08991944315006144 | sim_compute_robot_state-ego_median | 0.0898264700716192 | sim_compute_robot_state-ego_min | 0.08745011416348544 | sim_compute_sim_state_max | 0.04412167549133301 | sim_compute_sim_state_mean | 0.04306175162084801 | sim_compute_sim_state_median | 0.04278185512080337 | sim_compute_sim_state_min | 0.04247107207775116 | sim_physics_max | 0.14559363957607385 | sim_physics_mean | 0.13031986072614868 | sim_physics_median | 0.12912969549825368 | sim_physics_min | 0.12146683633327485 | sim_render-ego_max | 0.07142459789911906 | sim_render-ego_mean | 0.06994243749729827 | sim_render-ego_median | 0.07028281984250408 | sim_render-ego_min | 0.06795400679111481 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 10.63000000000003 | survival_time_min | 6.0499999999999865 |
| No reset possible |
22585 | 3137 | Amaury Camus 🇨🇠| challenge-aido_LF-template-random | aido2-LF-sim-testing | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:16:29 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 0.5723310224856362 | survival_time_median | 2.549999999999999 | deviation-center-line_median | 0.10099507669212504 | in-drivable-lane_median | 0.4499999999999984 |
other statsagent_compute-ego_max | 0.22936274023617015 | agent_compute-ego_mean | 0.1626203470475249 | agent_compute-ego_median | 0.15710596914415237 | agent_compute-ego_min | 0.14761577678632132 | deviation-center-line_max | 0.2838635700333795 | deviation-center-line_mean | 0.12786165368054708 | deviation-center-line_min | 0.07112529346797256 | deviation-heading_max | 0.5289022616823588 | deviation-heading_mean | 0.3391682685652287 | deviation-heading_median | 0.32928385103533875 | deviation-heading_min | 0.19401296908406307 | driven_any_max | 2.1706243860917107 | driven_any_mean | 0.9759490378276146 | driven_any_median | 1.0117660515775693 | driven_any_min | 0.23626560261560617 | driven_lanedir_consec_max | 1.919400421063832 | driven_lanedir_consec_mean | 0.6896171461819246 | driven_lanedir_consec_min | 0.2264965947033466 | driven_lanedir_max | 1.919400421063832 | driven_lanedir_mean | 0.6896171461819246 | driven_lanedir_median | 0.5723310224856362 | driven_lanedir_min | 0.2264965947033466 | in-drivable-lane_max | 1.7999999999999936 | in-drivable-lane_mean | 0.5899999999999982 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10208764782658328, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05720108526724356, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1476307400950679, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09011077880859376, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03386560634330467, "sim_compute_performance-ego": 0.0694802204767863, "sim_compute_robot_state-ego": 0.07338487218927454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1291935069888246, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06490883172727098, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1769581074808158, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10986699310003542, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.040756599575865506, "sim_compute_performance-ego": 0.0727384324167289, "sim_compute_robot_state-ego": 0.07594676578746122}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15447521209716797, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07192733708549948, "in-drivable-lane": 0, "agent_compute-ego": 0.22936274023617015, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.1092510784373564, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04614939409143785, "sim_compute_performance-ego": 0.08637801338644589, "sim_compute_robot_state-ego": 0.10099230093114515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1353926181793213, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06430031776428223, "in-drivable-lane": 0, "agent_compute-ego": 0.159417781829834, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10701807022094728, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03990574836730957, "sim_compute_performance-ego": 0.06983386993408203, "sim_compute_robot_state-ego": 0.07913887023925781}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10159054285363306, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06291121470777294, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14761577678632132, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0952642084677008, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03713382346720635, "sim_compute_performance-ego": 0.06861334209200702, "sim_compute_robot_state-ego": 0.0738090593603593}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.10743041427768006, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.062367444135704816, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1618857383728027, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09733560133953484, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03765030783049914, "sim_compute_performance-ego": 0.06855289790095115, "sim_compute_robot_state-ego": 0.07217177566216916}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10642599208014351, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06049424409866333, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15293522817747934, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09173760669572012, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03772030557904925, "sim_compute_performance-ego": 0.070387921163014, "sim_compute_robot_state-ego": 0.07209504502160209}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14104974837530226, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.0664327031090146, "in-drivable-lane": 0, "agent_compute-ego": 0.16374093010312035, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10521078109741212, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04057982989719936, "sim_compute_performance-ego": 0.07223346119835264, "sim_compute_robot_state-ego": 0.0893559455871582}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11479867514917406, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06570982933044434, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1606075602062678, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1022292799868826, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04034105801986436, "sim_compute_performance-ego": 0.07233595848083496, "sim_compute_robot_state-ego": 0.07908294564586575}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11126413345336914, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06199709285389293, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.152091477134011, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09726211807944558, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.038438363508744675, "sim_compute_performance-ego": 0.06674563667990945, "sim_compute_robot_state-ego": 0.07548392902721059}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.10751411512300564, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.0643897768738982, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15710596914415237, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.098209861037019, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.039511702277443626, "sim_compute_performance-ego": 0.07130686958114822, "sim_compute_robot_state-ego": 0.0770607211373069}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.1170902933393206, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.059973835945129395, "in-drivable-lane": 0, "agent_compute-ego": 0.15432122775486537, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10114936317716326, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04256369386400495, "sim_compute_performance-ego": 0.07050713471003942, "sim_compute_robot_state-ego": 0.07115450075694493}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12411722014932072, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06428094003714767, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.164704163869222, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10251731031081256, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03993322802524941, "sim_compute_performance-ego": 0.07518633206685384, "sim_compute_robot_state-ego": 0.0892017448649687}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.1154441303677029, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06383117039998372, "in-drivable-lane": 0, "agent_compute-ego": 0.15682753810176142, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.09788267700760452, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04166921862849483, "sim_compute_performance-ego": 0.07222552652712222, "sim_compute_robot_state-ego": 0.07755543567516186}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.10597075434292064, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06273005756677366, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1541002264209822, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10023077796487248, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04093407649619907, "sim_compute_performance-ego": 0.06819619618210138, "sim_compute_robot_state-ego": 0.07404749066221948}} | set_robot_commands_max | 0.10986699310003542 | set_robot_commands_mean | 0.10035176704874003 | set_robot_commands_median | 0.10023077796487248 | set_robot_commands_min | 0.09011077880859376 | sim_compute_performance-ego_max | 0.08637801338644589 | sim_compute_performance-ego_mean | 0.07164812085309183 | sim_compute_performance-ego_median | 0.07050713471003942 | sim_compute_performance-ego_min | 0.06674563667990945 | sim_compute_robot_state-ego_max | 0.10099230093114515 | sim_compute_robot_state-ego_mean | 0.0786987601698737 | sim_compute_robot_state-ego_median | 0.07594676578746122 | sim_compute_robot_state-ego_min | 0.07115450075694493 | sim_compute_sim_state_max | 0.04614939409143785 | sim_compute_sim_state_mean | 0.03981019706479151 | sim_compute_sim_state_median | 0.03993322802524941 | sim_compute_sim_state_min | 0.03386560634330467 | sim_physics_max | 0.15447521209716797 | sim_physics_mean | 0.11825633364023132 | sim_physics_median | 0.11479867514917406 | sim_physics_min | 0.10159054285363306 | sim_render-ego_max | 0.07192733708549948 | sim_render-ego_mean | 0.0635637253935148 | sim_render-ego_median | 0.06383117039998372 | sim_render-ego_min | 0.05720108526724356 | simulation-passed | 1 | survival_time_max | 5.09999999999999 | survival_time_mean | 2.503333333333331 | survival_time_min | 0.8500000000000002 |
| No reset possible |
22577 | 3148 | Anastasiya Nikolskaya 🇷🇺 | challenge-aido_LF-baseline-duckietown | aido2-LF-sim-testing | step1-simulation | error | yes | ip-172-31-40-253-16443 | | | 0:04:13 | The container "evalu [...]The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
22547 | 3189 | jiang peng | First test - TH | aido2-LF-sim-validation | step1-simulation | success | yes | ip-172-31-40-253-16443 | | | 0:25:23 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | driven_lanedir_consec_median | 2.8775589817140395 | survival_time_median | 14.950000000000076 | deviation-center-line_median | 0.5863771768965761 | in-drivable-lane_median | 0.8000000000000114 |
other statsagent_compute-ego_max | 0.20921541372934976 | agent_compute-ego_mean | 0.2060880170335957 | agent_compute-ego_median | 0.2054319143295288 | agent_compute-ego_min | 0.20259031478096456 | deviation-center-line_max | 1.3692098472775998 | deviation-center-line_mean | 0.7259797874170324 | deviation-center-line_min | 0.12124436418648434 | deviation-heading_max | 3.631538197176222 | deviation-heading_mean | 2.4909268302144794 | deviation-heading_median | 2.671628019177351 | deviation-heading_min | 1.221536266605055 | driven_any_max | 4.2835003056850365 | driven_any_mean | 2.6325657097681896 | driven_any_median | 3.5050755988986895 | driven_any_min | 0.5885557658404479 | driven_lanedir_consec_max | 3.584447350340236 | driven_lanedir_consec_mean | 2.2000381588452314 | driven_lanedir_consec_min | 0.49953463927426567 | driven_lanedir_max | 3.584447350340236 | driven_lanedir_mean | 2.2000381588452314 | driven_lanedir_median | 2.8775589817140395 | driven_lanedir_min | 0.49953463927426567 | in-drivable-lane_max | 2.950000000000042 | in-drivable-lane_mean | 1.1900000000000168 | in-drivable-lane_min | 0 | per-episodes | details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5885557658404479, "sim_physics": 0.13353168964385986, "survival_time": 3.399999999999996, "driven_lanedir": 0.49953463927426567, "sim_render-ego": 0.07038539998671588, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.20259031478096456, "deviation-heading": 1.221536266605055, "set_robot_commands": 0.11201059117036707, "deviation-center-line": 0.12124436418648434, "driven_lanedir_consec": 0.49953463927426567, "sim_compute_sim_state": 0.04269356236738317, "sim_compute_performance-ego": 0.07918054566663854, "sim_compute_robot_state-ego": 0.08486283176085528}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.158809217368596, "sim_physics": 0.1235827374458313, "survival_time": 4.99999999999999, "driven_lanedir": 1.0528139847428388, "sim_render-ego": 0.07500938653945922, "in-drivable-lane": 0, "agent_compute-ego": 0.2054319143295288, "deviation-heading": 1.641517864202103, "set_robot_commands": 0.11172403573989868, "deviation-center-line": 0.4488994386060656, "driven_lanedir_consec": 1.0528139847428388, "sim_compute_sim_state": 0.04478576898574829, "sim_compute_performance-ego": 0.08082453966140747, "sim_compute_robot_state-ego": 0.0870920729637146}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.2835003056850365, "sim_physics": 0.13393683513005575, "survival_time": 14.950000000000076, "driven_lanedir": 3.584447350340236, "sim_render-ego": 0.07020028670628865, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.20921541372934976, "deviation-heading": 2.671628019177351, "set_robot_commands": 0.11001466830571492, "deviation-center-line": 0.5863771768965761, "driven_lanedir_consec": 3.584447350340236, "sim_compute_sim_state": 0.04334409236907959, "sim_compute_performance-ego": 0.07932802438735961, "sim_compute_robot_state-ego": 0.08933422406514485}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.5050755988986895, "sim_physics": 0.12709225257237752, "survival_time": 14.950000000000076, "driven_lanedir": 2.985835838154778, "sim_render-ego": 0.07259023507436116, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.2054254921277364, "deviation-heading": 3.631538197176222, "set_robot_commands": 0.10881559054056804, "deviation-center-line": 1.1041681101184362, "driven_lanedir_consec": 2.985835838154778, "sim_compute_sim_state": 0.04319346348444621, "sim_compute_performance-ego": 0.07810639142990113, "sim_compute_robot_state-ego": 0.08563554525375366}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.6268876610481806, "sim_physics": 0.13197017908096317, "survival_time": 14.950000000000076, "driven_lanedir": 2.8775589817140395, "sim_render-ego": 0.07054581721623739, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.20777695020039877, "deviation-heading": 3.288413803911667, "set_robot_commands": 0.1085192314783732, "deviation-center-line": 1.3692098472775998, "driven_lanedir_consec": 2.8775589817140395, "sim_compute_sim_state": 0.043106416861216225, "sim_compute_performance-ego": 0.07866562287012736, "sim_compute_robot_state-ego": 0.08853881120681763}} | set_robot_commands_max | 0.11201059117036707 | set_robot_commands_mean | 0.1102168234469844 | set_robot_commands_median | 0.11001466830571492 | set_robot_commands_min | 0.1085192314783732 | sim_compute_performance-ego_max | 0.08082453966140747 | sim_compute_performance-ego_mean | 0.07922102480308682 | sim_compute_performance-ego_median | 0.07918054566663854 | sim_compute_performance-ego_min | 0.07810639142990113 | sim_compute_robot_state-ego_max | 0.08933422406514485 | sim_compute_robot_state-ego_mean | 0.0870926970500572 | sim_compute_robot_state-ego_median | 0.0870920729637146 | sim_compute_robot_state-ego_min | 0.08486283176085528 | sim_compute_sim_state_max | 0.04478576898574829 | sim_compute_sim_state_mean | 0.0434246608135747 | sim_compute_sim_state_median | 0.04319346348444621 | sim_compute_sim_state_min | 0.04269356236738317 | sim_physics_max | 0.13393683513005575 | sim_physics_mean | 0.1300227387746175 | sim_physics_median | 0.13197017908096317 | sim_physics_min | 0.1235827374458313 | sim_render-ego_max | 0.07500938653945922 | sim_render-ego_mean | 0.07174622510461245 | sim_render-ego_median | 0.07054581721623739 | sim_render-ego_min | 0.07020028670628865 | simulation-passed | 1 | survival_time_max | 14.950000000000076 | survival_time_mean | 10.650000000000045 | survival_time_min | 3.399999999999996 |
| No reset possible |