Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 17107
2278
Peter Almasi 🇭🇺PyTorch template aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-08 10:20:51+00:00 2019-04-08 10:51:30+00:00 0:30:39 Timeout:
Waited 180 [...] Timeout:
Waited 1801.1275572776794 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17101
2253
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation success no idsc-rudolf-16007
2019-04-08 10:10:58+00:00 2019-04-08 10:20:25+00:00 0:09:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2469145366098973 survival_time_median 4.549999999999992 deviation-center-line_median 0.04673405217823424 in-drivable-lane_median 0.849999999999997
other stats agent_compute-ego_max 0.2132335416563265 agent_compute-ego_mean 0.2052087308906833 agent_compute-ego_median 0.20259782305934973 agent_compute-ego_min 0.19911154809888904 deviation-center-line_max 0.061461333051357134 deviation-center-line_mean 0.05095763232758586 deviation-center-line_min 0.0425278962863902 deviation-heading_max 0.3651736217500463 deviation-heading_mean 0.3373210581753059 deviation-heading_median 0.34422121994097304 deviation-heading_min 0.2988709034717947 driven_any_max 1.5853704928859882 driven_any_mean 1.347903949295549 driven_any_median 1.5846743133395478 driven_any_min 0.9920591446704368 driven_lanedir_consec_max 1.3525954544703422 driven_lanedir_consec_mean 1.0530351498466604 driven_lanedir_consec_min 0.6573740979691927 driven_lanedir_max 1.3525954544703422 driven_lanedir_mean 1.0530351498466604 driven_lanedir_median 1.2469145366098973 driven_lanedir_min 0.6573740979691927 in-drivable-lane_max 0.849999999999997 in-drivable-lane_mean 0.7499999999999973 in-drivable-lane_min 0.5999999999999979 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9920591446704368, "sim_physics": 0.0036508786050896895, "survival_time": 2.849999999999998, "driven_lanedir": 0.6573740979691927, "sim_render-ego": 0.0725752638097395, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.20259782305934973, "deviation-heading": 0.34422121994097304, "set_robot_commands": 0.07847821503354792, "deviation-center-line": 0.0425278962863902, "driven_lanedir_consec": 0.6573740979691927, "sim_compute_sim_state": 0.04537733395894369, "sim_compute_performance-ego": 0.07029084573712266, "sim_compute_robot_state-ego": 0.27941422713430303}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9926034286287166, "sim_physics": 0.0035914705510725056, "survival_time": 2.849999999999998, "driven_lanedir": 0.7613605954270737, "sim_render-ego": 0.07141241692660148, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.20257623153820373, "deviation-heading": 0.2988709034717947, "set_robot_commands": 0.07846112418593022, "deviation-center-line": 0.05733607779192401, "driven_lanedir_consec": 0.7613605954270737, "sim_compute_sim_state": 0.043549299240112305, "sim_compute_performance-ego": 0.07122516632080078, "sim_compute_robot_state-ego": 0.07645614941914876}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5853704928859882, "sim_physics": 0.0032854630396916317, "survival_time": 4.549999999999992, "driven_lanedir": 1.3525954544703422, "sim_render-ego": 0.06671037778749571, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.19911154809888904, "deviation-heading": 0.31316633966492985, "set_robot_commands": 0.07684637164021586, "deviation-center-line": 0.061461333051357134, "driven_lanedir_consec": 1.3525954544703422, "sim_compute_sim_state": 0.0426695425431807, "sim_compute_performance-ego": 0.06540247372218541, "sim_compute_robot_state-ego": 0.07376696251250886}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.584812366953054, "sim_physics": 0.0036935203678005344, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469310647567955, "sim_render-ego": 0.07498553297021887, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.20852451010064765, "deviation-heading": 0.3651736217500463, "set_robot_commands": 0.07966768872606886, "deviation-center-line": 0.04673405217823424, "driven_lanedir_consec": 1.2469310647567955, "sim_compute_sim_state": 0.04521353166181963, "sim_compute_performance-ego": 0.07166775504311362, "sim_compute_robot_state-ego": 0.0771966032929473}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5846743133395478, "sim_physics": 0.0034899109012478, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469145366098973, "sim_render-ego": 0.07097640142335997, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.2132335416563265, "deviation-heading": 0.3651732060487856, "set_robot_commands": 0.07922630781655783, "deviation-center-line": 0.046728802330023675, "driven_lanedir_consec": 1.2469145366098973, "sim_compute_sim_state": 0.04607934218186598, "sim_compute_performance-ego": 0.06650569674732922, "sim_compute_robot_state-ego": 0.07645783319578066}}set_robot_commands_max 0.07966768872606886 set_robot_commands_mean 0.07853594148046414 set_robot_commands_median 0.07847821503354792 set_robot_commands_min 0.07684637164021586 sim_compute_performance-ego_max 0.07166775504311362 sim_compute_performance-ego_mean 0.06901838751411034 sim_compute_performance-ego_median 0.07029084573712266 sim_compute_performance-ego_min 0.06540247372218541 sim_compute_robot_state-ego_max 0.27941422713430303 sim_compute_robot_state-ego_mean 0.11665835511093772 sim_compute_robot_state-ego_median 0.07645783319578066 sim_compute_robot_state-ego_min 0.07376696251250886 sim_compute_sim_state_max 0.04607934218186598 sim_compute_sim_state_mean 0.04457780991718446 sim_compute_sim_state_median 0.04521353166181963 sim_compute_sim_state_min 0.0426695425431807 sim_physics_max 0.0036935203678005344 sim_physics_mean 0.0035422486929804326 sim_physics_median 0.0035914705510725056 sim_physics_min 0.0032854630396916317 sim_render-ego_max 0.07498553297021887 sim_render-ego_mean 0.07133199858348312 sim_render-ego_median 0.07141241692660148 sim_render-ego_min 0.06671037778749571 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 3.869999999999995 survival_time_min 2.849999999999998
No reset possible 17100
2260
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-08 10:10:05+00:00 2019-04-08 10:10:44+00:00 0:00:39 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17098
2262
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-08 10:09:12+00:00 2019-04-08 10:09:52+00:00 0:00:40 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17097
2263
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-08 10:08:27+00:00 2019-04-08 10:09:05+00:00 0:00:38 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17096
2264
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation failed no idsc-rudolf-16007
2019-04-08 10:06:52+00:00 2019-04-08 10:08:14+00:00 0:01:22 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 277, in run_episode
r: MsgReceived = agent.read_one(expect_topic='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 165, in read_one
raise RemoteNodeAborted(m) # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.
agent error |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
|| schema = type_to_schema_(T, globals_, processing)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
|| raise ValueError(msg)
|| ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
|| res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 107, in serialize_dataclass
|| the_schema = type_to_schema(T, globals_)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 641, in type_to_schema
|| raise type(e)(msg) from e
|| ValueError: Cannot get schema for <class 'numpy.float32'>:
|| │ processing: (empty dict)
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
|| schema = type_to_schema_(T, globals_, processing)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
|| raise ValueError(msg)
|| ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
||
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
|| res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
|| raise Exception(msg) from e
|| Exception: Cannot serialize attribute motor_left = 0.45472970604896545
|| Type <class 'aido_schemas.schemas.PWMCommands'> has annotated it as <class 'float'>
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
|| handle_message_node(parsed, protocol, pc, node, context_data)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 50, in on_received_get_commands
|| context.write('commands', commands)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 136, in write
|| m[FIELD_DATA] = object_to_ipce(data, {}, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
|| res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
|| return serialize_dataclass(ob, globals_, with_schema=with_schema)
|| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
|| raise Exception(msg) from e
|| Exception: Cannot serialize attribute wheels = PWMCommands(motor_left=0.4547297, motor_right=-0.11871486)
|| Type <class 'aido_schemas.schemas.Duckiebot1Commands'> has annotated it as <class 'aido_schemas.schemas.PWMCommands'>
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 404, in <module>
wrap(cie)
File "experiment_manager.py", line 393, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 127, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 280, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17095
2265
Andrea Censi 🇨🇭PredictorMean aido2-PRED
step1-simulation success no idsc-rudolf-16007
2019-04-08 10:06:11+00:00 2019-04-08 10:06:39+00:00 0:00:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.27602779598084853 error_L2 0.0899524446012454
No reset possible 17094
2266
Andrea Censi 🇨🇭PredictorRandom aido2-PRED
step1-simulation success no idsc-rudolf-16007
2019-04-08 10:05:31+00:00 2019-04-08 10:05:58+00:00 0:00:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.3030667994366853 error_L2 0.14264499702969025
No reset possible 17093
2267
Andrea Censi 🇨🇭PredictorLast aido2-PRED
step1-simulation success no idsc-rudolf-16007
2019-04-08 10:04:53+00:00 2019-04-08 10:05:19+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1209853947455215 error_L2 0.023239851935755784
No reset possible 17072
2313
FANG MEIYI 🇸🇬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-08 09:34:02+00:00 2019-04-08 10:04:40+00:00 0:30:38 Timeout:
Waited 180 [...] Timeout:
Waited 1800.714684009552 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17070
2289
Andrea Censi 🇨🇭PredictorRandom aido2-PRED
step1-simulation success no idsc-rudolf-16007
2019-04-08 09:33:28+00:00 2019-04-08 09:33:54+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.29724595091203704 error_L2 0.13916078739280557
No reset possible 17069
2290
Andrea Censi 🇨🇭PredictorLast aido2-PRED
step1-simulation success no idsc-rudolf-16007
2019-04-08 09:32:47+00:00 2019-04-08 09:33:14+00:00 0:00:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12408790536871075 error_L2 0.023584390804624905
No reset possible 17067
2291
Andrea Censi 🇨🇭Minimal agent aido2_LF_r2-v4
step1-simulation success no idsc-rudolf-16007
2019-04-08 09:25:08+00:00 2019-04-08 09:32:40+00:00 0:07:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.16166100868811975 agent_compute-ego_mean 0.15851790030394866 agent_compute-ego_median 0.15942267383017192 agent_compute-ego_min 0.1552846256424399 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003145919126622817, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0682910119785982, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1552846256424399, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0806810224757475, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043758725418764, "sim_compute_performance-ego": 0.06619962173349717, "sim_compute_robot_state-ego": 0.2649695697952719}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003358337614271376, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06914934657868885, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15666186241876512, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07896861954340859, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04353718152121892, "sim_compute_performance-ego": 0.06988148840646895, "sim_compute_robot_state-ego": 0.08014552933829171}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0035532767956073467, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06946375553424541, "in-drivable-lane": 0, "agent_compute-ego": 0.16166100868811975, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07996058464050293, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04389031850374662, "sim_compute_performance-ego": 0.07005101350637583, "sim_compute_robot_state-ego": 0.0796161358173077}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003532956286174495, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06777732546736555, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15942267383017192, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08032450443360864, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04439485945352694, "sim_compute_performance-ego": 0.06889035643600835, "sim_compute_robot_state-ego": 0.0798158529328137}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003063805103302002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06394846200942993, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15955933094024655, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07827025890350342, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04202385425567627, "sim_compute_performance-ego": 0.06550375699996948, "sim_compute_robot_state-ego": 0.0761937952041626}}set_robot_commands_max 0.0806810224757475 set_robot_commands_mean 0.07964099799935422 set_robot_commands_median 0.07996058464050293 set_robot_commands_min 0.07827025890350342 sim_compute_performance-ego_max 0.07005101350637583 sim_compute_performance-ego_mean 0.06810524741646395 sim_compute_performance-ego_median 0.06889035643600835 sim_compute_performance-ego_min 0.06550375699996948 sim_compute_robot_state-ego_max 0.2649695697952719 sim_compute_robot_state-ego_mean 0.11614817661756952 sim_compute_robot_state-ego_median 0.0798158529328137 sim_compute_robot_state-ego_min 0.0761937952041626 sim_compute_sim_state_max 0.04439485945352694 sim_compute_sim_state_mean 0.043520987830586555 sim_compute_sim_state_median 0.043758725418764 sim_compute_sim_state_min 0.04202385425567627 sim_physics_max 0.0035532767956073467 sim_physics_mean 0.0033308589851956073 sim_physics_median 0.003358337614271376 sim_physics_min 0.003063805103302002 sim_render-ego_max 0.06946375553424541 sim_render-ego_mean 0.06772598031366558 sim_render-ego_median 0.0682910119785982 sim_render-ego_min 0.06394846200942993 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17052
2306
Andrea Censi 🇨🇭Minimal agent aido2_LFVI_r1-v4
step1-simulation success no idsc-rudolf-16007
2019-04-08 09:10:11+00:00 2019-04-08 09:25:01+00:00 0:14:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.72155331423772 survival_time_median 4.249999999999993 deviation-center-line_median 0.15741823007542524 in-drivable-lane_median 1.7499999999999938
other stats agent_compute-ego_max 0.1630873960607192 agent_compute-ego_mean 0.15862500131196555 agent_compute-ego_median 0.1572857435713423 agent_compute-ego_min 0.1542690269874804 deviation-center-line_max 0.32861340027620084 deviation-center-line_mean 0.16720563088123774 deviation-center-line_min 0.08372346350452832 deviation-heading_max 1.6095487863912878 deviation-heading_mean 0.7416120746207572 deviation-heading_median 0.6111580236941071 deviation-heading_min 0.3663194255812494 driven_any_max 2.174849274549989 driven_any_mean 1.370290316170529 driven_any_median 1.2632550932005688 driven_any_min 0.9890108043245008 driven_lanedir_consec_max 1.0300199271670714 driven_lanedir_consec_mean 0.7679244191832472 driven_lanedir_consec_min 0.523101221541693 driven_lanedir_max 1.0586376106182156 driven_lanedir_mean 0.773647955873476 driven_lanedir_median 0.72155331423772 driven_lanedir_min 0.523101221541693 in-drivable-lane_max 3.149999999999989 in-drivable-lane_mean 1.7699999999999938 in-drivable-lane_min 0.1999999999999993 per-episodes details {"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0035577247882711475, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.07328236678550984, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.16217996991913894, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07909253383504933, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.041787422114405136, "sim_compute_performance-ego": 0.07142374762173356, "sim_compute_robot_state-ego": 0.16990175247192382, "sim_compute_robot_state-npc0": 0.07730874028699151, "sim_compute_robot_state-npc1": 0.07344106805735622, "sim_compute_robot_state-npc2": 0.0724806966452763, "sim_compute_robot_state-npc3": 0.0735570397870294}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003269831339518229, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.07207044326897824, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1542690269874804, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07647637164953983, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.03983796726573597, "sim_compute_performance-ego": 0.06709039211273193, "sim_compute_robot_state-ego": 0.08720953536756111, "sim_compute_robot_state-npc0": 0.07266387072476474, "sim_compute_robot_state-npc1": 0.07019538951642586, "sim_compute_robot_state-npc2": 0.07040124228506377, "sim_compute_robot_state-npc3": 0.07289500669999556}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.00332558662333387, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.06886448758713742, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.1572857435713423, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07766995785084177, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.038648511501068766, "sim_compute_performance-ego": 0.06720970539336509, "sim_compute_robot_state-ego": 0.0905964932543166, "sim_compute_robot_state-npc0": 0.07345486194529433, "sim_compute_robot_state-npc1": 0.06986520138192684, "sim_compute_robot_state-npc2": 0.06952852137545322, "sim_compute_robot_state-npc3": 0.06978284298105443}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.00318760871887207, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.06647391880259794, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1563028700211469, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07775120454676011, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.0365295830894919, "sim_compute_performance-ego": 0.06494663743411794, "sim_compute_robot_state-ego": 0.08826229151557474, "sim_compute_robot_state-npc0": 0.0727840591879452, "sim_compute_robot_state-npc1": 0.06604441754958208, "sim_compute_robot_state-npc2": 0.06399083137512207, "sim_compute_robot_state-npc3": 0.06492908141192268}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0034693479537963867, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.0727573598132414, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1630873960607192, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.07838806334663839, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.038834880380069506, "sim_compute_performance-ego": 0.07106546444051406, "sim_compute_robot_state-ego": 0.09081080380608052, "sim_compute_robot_state-npc0": 0.08220996225581449, "sim_compute_robot_state-npc1": 0.07164165552924662, "sim_compute_robot_state-npc2": 0.0683538037187913, "sim_compute_robot_state-npc3": 0.06888292116277359}}set_robot_commands_max 0.07909253383504933 set_robot_commands_mean 0.07787562624576588 set_robot_commands_median 0.07775120454676011 set_robot_commands_min 0.07647637164953983 sim_compute_performance-ego_max 0.07142374762173356 sim_compute_performance-ego_mean 0.06834718940049252 sim_compute_performance-ego_median 0.06720970539336509 sim_compute_performance-ego_min 0.06494663743411794 sim_compute_robot_state-ego_max 0.16990175247192382 sim_compute_robot_state-ego_mean 0.10535617528309138 sim_compute_robot_state-ego_median 0.0905964932543166 sim_compute_robot_state-ego_min 0.08720953536756111 sim_compute_robot_state-npc0_max 0.08220996225581449 sim_compute_robot_state-npc0_mean 0.07568429888016205 sim_compute_robot_state-npc0_median 0.07345486194529433 sim_compute_robot_state-npc0_min 0.07266387072476474 sim_compute_robot_state-npc1_max 0.07344106805735622 sim_compute_robot_state-npc1_mean 0.07023754640690752 sim_compute_robot_state-npc1_median 0.07019538951642586 sim_compute_robot_state-npc1_min 0.06604441754958208 sim_compute_robot_state-npc2_max 0.0724806966452763 sim_compute_robot_state-npc2_mean 0.06895101907994133 sim_compute_robot_state-npc2_median 0.06952852137545322 sim_compute_robot_state-npc2_min 0.06399083137512207 sim_compute_robot_state-npc3_max 0.0735570397870294 sim_compute_robot_state-npc3_mean 0.07000937840855512 sim_compute_robot_state-npc3_median 0.06978284298105443 sim_compute_robot_state-npc3_min 0.06492908141192268 sim_compute_sim_state_max 0.041787422114405136 sim_compute_sim_state_mean 0.03912767287015425 sim_compute_sim_state_median 0.038834880380069506 sim_compute_sim_state_min 0.0365295830894919 sim_physics_max 0.0035577247882711475 sim_physics_mean 0.003362019884758341 sim_physics_median 0.00332558662333387 sim_physics_min 0.00318760871887207 sim_render-ego_max 0.07328236678550984 sim_render-ego_mean 0.07068971525149297 sim_render-ego_median 0.07207044326897824 sim_render-ego_min 0.06647391880259794 simulation-passed 1 survival_time_max 7.249999999999982 survival_time_mean 4.579999999999992 survival_time_min 3.2999999999999963
No reset possible 17047
2243
Andrea Censi 🇨🇭Solution template aido2_LF_r2-v4
step1-simulation aborted no idsc-rudolf-16007
2019-04-08 09:02:12+00:00 2019-04-08 09:09:58+00:00 0:07:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.15939441541346108 agent_compute-ego_mean 0.1576512799728074 agent_compute-ego_median 0.15762344140272874 agent_compute-ego_min 0.15579524993896485 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034807149101706114, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07193427927353803, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15820273581673117, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07889779175029081, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04409091612871956, "sim_compute_performance-ego": 0.07092205566518447, "sim_compute_robot_state-ego": 0.28422005036297965}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003431157460288396, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07052924519493467, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15724055729215108, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.08029406789749388, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.0433802188388885, "sim_compute_performance-ego": 0.0702181165180509, "sim_compute_robot_state-ego": 0.07986928924681648}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.00346837410560021, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07279884631817157, "in-drivable-lane": 0, "agent_compute-ego": 0.15762344140272874, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07884716620812049, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04385721866901104, "sim_compute_performance-ego": 0.07172705943767842, "sim_compute_robot_state-ego": 0.08449189846332257}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003717128823443157, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07171415701145079, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15939441541346108, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07899249472269197, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04441499419328643, "sim_compute_performance-ego": 0.07033548413253413, "sim_compute_robot_state-ego": 0.08069092762179492}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003524179458618164, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07199149370193482, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15579524993896485, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07940498113632202, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.044747653007507326, "sim_compute_performance-ego": 0.0688549542427063, "sim_compute_robot_state-ego": 0.07802570819854736}}set_robot_commands_max 0.08029406789749388 set_robot_commands_mean 0.07928730034298384 set_robot_commands_median 0.07899249472269197 set_robot_commands_min 0.07884716620812049 sim_compute_performance-ego_max 0.07172705943767842 sim_compute_performance-ego_mean 0.07041153399923084 sim_compute_performance-ego_median 0.07033548413253413 sim_compute_performance-ego_min 0.0688549542427063 sim_compute_robot_state-ego_max 0.28422005036297965 sim_compute_robot_state-ego_mean 0.12145957477869218 sim_compute_robot_state-ego_median 0.08069092762179492 sim_compute_robot_state-ego_min 0.07802570819854736 sim_compute_sim_state_max 0.044747653007507326 sim_compute_sim_state_mean 0.044098200167482574 sim_compute_sim_state_median 0.04409091612871956 sim_compute_sim_state_min 0.0433802188388885 sim_physics_max 0.003717128823443157 sim_physics_mean 0.003524310951624108 sim_physics_median 0.0034807149101706114 sim_physics_min 0.003431157460288396 sim_render-ego_max 0.07279884631817157 sim_render-ego_mean 0.07179360430000598 sim_render-ego_median 0.07193427927353803 sim_render-ego_min 0.07052924519493467 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17038
2250
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-06 23:26:28+00:00 2019-04-06 23:57:22+00:00 0:30:54 Timeout:
Waited 180 [...] Timeout:
Waited 1801.3442862033844 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17036
2251
Julian Zilly Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-06 23:23:46+00:00 2019-04-06 23:25:41+00:00 0:01:55 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17033
2260
Bhairav Mehta PyTorch template aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-06 23:22:16+00:00 2019-04-06 23:22:55+00:00 0:00:39 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17024
2269
Andrea Censi 🇨🇭Solution template aido2_LFV_r1-v4
step1-simulation success no idsc-rudolf-16007
2019-04-06 23:09:25+00:00 2019-04-06 23:22:10+00:00 0:12:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.16808391780388066 agent_compute-ego_mean 0.16507525489492025 agent_compute-ego_median 0.16710413455963136 agent_compute-ego_min 0.16071864915272546 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003634414252112894, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06863973421208999, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16152575787375956, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07969888869453878, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043168786694021785, "sim_compute_performance-ego": 0.07214254491469439, "sim_compute_robot_state-ego": 0.24934212600483613, "sim_compute_robot_state-npc0": 0.08127305086921244, "sim_compute_robot_state-npc1": 0.08007352141773, "sim_compute_robot_state-npc2": 0.0817819588324603, "sim_compute_robot_state-npc3": 0.08066365298102884}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003626562300182524, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.0743202595483689, "in-drivable-lane": 0, "agent_compute-ego": 0.16071864915272546, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07935162196083674, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.0450927908458407, "sim_compute_performance-ego": 0.07709248860677083, "sim_compute_robot_state-ego": 0.09753579185122536, "sim_compute_robot_state-npc0": 0.08588536580403645, "sim_compute_robot_state-npc1": 0.08442697070893787, "sim_compute_robot_state-npc2": 0.08681423323495048, "sim_compute_robot_state-npc3": 0.08658496160355825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0034722108107346755, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07169910210829515, "in-drivable-lane": 0, "agent_compute-ego": 0.16794381508460413, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08201665144700271, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.04269138482900766, "sim_compute_performance-ego": 0.0730201977949876, "sim_compute_robot_state-ego": 0.09418801894554724, "sim_compute_robot_state-npc0": 0.0885657787322998, "sim_compute_robot_state-npc1": 0.08549874012286847, "sim_compute_robot_state-npc2": 0.0829394817352295, "sim_compute_robot_state-npc3": 0.08216959513150729}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035447783586455553, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0701163600130779, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16808391780388066, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08225168251409763, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04078609478182909, "sim_compute_performance-ego": 0.07303758074597615, "sim_compute_robot_state-ego": 0.09723825280259296, "sim_compute_robot_state-npc0": 0.08794499606620974, "sim_compute_robot_state-npc1": 0.08232658374600293, "sim_compute_robot_state-npc2": 0.08177200177820718, "sim_compute_robot_state-npc3": 0.08051273880935297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035022997856140135, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.06999177694320678, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16710413455963136, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08199993848800659, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04167727947235107, "sim_compute_performance-ego": 0.0692064619064331, "sim_compute_robot_state-ego": 0.09559743642807007, "sim_compute_robot_state-npc0": 0.08917153596878052, "sim_compute_robot_state-npc1": 0.08325286865234376, "sim_compute_robot_state-npc2": 0.08248684167861939, "sim_compute_robot_state-npc3": 0.08117295503616333}}set_robot_commands_max 0.08225168251409763 set_robot_commands_mean 0.08106375662089649 set_robot_commands_median 0.08199993848800659 set_robot_commands_min 0.07935162196083674 sim_compute_performance-ego_max 0.07709248860677083 sim_compute_performance-ego_mean 0.07289985479377241 sim_compute_performance-ego_median 0.0730201977949876 sim_compute_performance-ego_min 0.0692064619064331 sim_compute_robot_state-ego_max 0.24934212600483613 sim_compute_robot_state-ego_mean 0.12678032520645435 sim_compute_robot_state-ego_median 0.09723825280259296 sim_compute_robot_state-ego_min 0.09418801894554724 sim_compute_robot_state-npc0_max 0.08917153596878052 sim_compute_robot_state-npc0_mean 0.08656814548810779 sim_compute_robot_state-npc0_median 0.08794499606620974 sim_compute_robot_state-npc0_min 0.08127305086921244 sim_compute_robot_state-npc1_max 0.08549874012286847 sim_compute_robot_state-npc1_mean 0.0831157369295766 sim_compute_robot_state-npc1_median 0.08325286865234376 sim_compute_robot_state-npc1_min 0.08007352141773 sim_compute_robot_state-npc2_max 0.08681423323495048 sim_compute_robot_state-npc2_mean 0.08315890345189339 sim_compute_robot_state-npc2_median 0.08248684167861939 sim_compute_robot_state-npc2_min 0.08177200177820718 sim_compute_robot_state-npc3_max 0.08658496160355825 sim_compute_robot_state-npc3_mean 0.08222078071232214 sim_compute_robot_state-npc3_median 0.08117295503616333 sim_compute_robot_state-npc3_min 0.08051273880935297 sim_compute_sim_state_max 0.0450927908458407 sim_compute_sim_state_mean 0.042683267324610065 sim_compute_sim_state_median 0.04269138482900766 sim_compute_sim_state_min 0.04078609478182909 sim_physics_max 0.003634414252112894 sim_physics_mean 0.003556053101457933 sim_physics_median 0.0035447783586455553 sim_physics_min 0.0034722108107346755 sim_render-ego_max 0.0743202595483689 sim_render-ego_mean 0.07095344656500775 sim_render-ego_median 0.0701163600130779 sim_render-ego_min 0.06863973421208999 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17019
2274
Andrea Censi 🇨🇭Solution template aido2_LF_r2-v4
step1-simulation success no idsc-rudolf-16007
2019-04-06 23:01:24+00:00 2019-04-06 23:09:00+00:00 0:07:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.16283778583302216 agent_compute-ego_mean 0.1603010760906541 agent_compute-ego_median 0.16016491632612925 agent_compute-ego_min 0.15684913873672485 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0032909021658055924, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06718476029003367, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16283778583302216, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08065788535510793, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04515722919912899, "sim_compute_performance-ego": 0.07078249314252068, "sim_compute_robot_state-ego": 0.27139050469678994}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003757257310170976, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07487068857465472, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16016491632612925, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07910485494704474, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04519602987501356, "sim_compute_performance-ego": 0.07856139304145934, "sim_compute_robot_state-ego": 0.0874073656778487}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0037046102377084585, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07560781698960524, "in-drivable-lane": 0, "agent_compute-ego": 0.1617363012754, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07954653960007887, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04512318464425894, "sim_compute_performance-ego": 0.0775378520672138, "sim_compute_robot_state-ego": 0.08555569281944862}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036102795019382385, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07507258508263565, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1599172382819943, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07924860861243271, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04497079732941418, "sim_compute_performance-ego": 0.07636581397638088, "sim_compute_robot_state-ego": 0.0853043736481085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0035601592063903807, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07068872690200806, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15684913873672485, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.0784910249710083, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04267159461975098, "sim_compute_performance-ego": 0.07273762226104737, "sim_compute_robot_state-ego": 0.0831803035736084}}set_robot_commands_max 0.08065788535510793 set_robot_commands_mean 0.07940978269713451 set_robot_commands_median 0.07924860861243271 set_robot_commands_min 0.0784910249710083 sim_compute_performance-ego_max 0.07856139304145934 sim_compute_performance-ego_mean 0.07519703489772442 sim_compute_performance-ego_median 0.07636581397638088 sim_compute_performance-ego_min 0.07078249314252068 sim_compute_robot_state-ego_max 0.27139050469678994 sim_compute_robot_state-ego_mean 0.12256764808316084 sim_compute_robot_state-ego_median 0.08555569281944862 sim_compute_robot_state-ego_min 0.0831803035736084 sim_compute_sim_state_max 0.04519602987501356 sim_compute_sim_state_mean 0.044623767133513334 sim_compute_sim_state_median 0.04512318464425894 sim_compute_sim_state_min 0.04267159461975098 sim_physics_max 0.003757257310170976 sim_physics_mean 0.0035846416844027293 sim_physics_median 0.0036102795019382385 sim_physics_min 0.0032909021658055924 sim_render-ego_max 0.07560781698960524 sim_render-ego_mean 0.07268491556778747 sim_render-ego_median 0.07487068857465472 sim_render-ego_min 0.06718476029003367 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 17017
2276
FANG MEIYI 🇸🇬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-06 22:59:30+00:00 2019-04-06 23:01:10+00:00 0:01:40 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17009
2284
Andrea Censi 🇨🇭Minimal agent aido2_LF_r2-v4
step1-simulation success no idsc-rudolf-16007
2019-04-06 22:51:54+00:00 2019-04-06 22:59:09+00:00 0:07:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.1627621615634245 agent_compute-ego_mean 0.1580051283417042 agent_compute-ego_median 0.15995227722894578 agent_compute-ego_min 0.14891865968704224 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003785256077261532, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07583954404382144, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1627621615634245, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07961623808916878, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04499404921251185, "sim_compute_performance-ego": 0.0788044298396391, "sim_compute_robot_state-ego": 0.25359169174643126}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003809062261430044, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07271443094526019, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15995227722894578, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.08009094283694312, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.045437585739862354, "sim_compute_performance-ego": 0.0753633559696258, "sim_compute_robot_state-ego": 0.08805493702964177}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0036105009225698616, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06888503661522498, "in-drivable-lane": 0, "agent_compute-ego": 0.1570212510915903, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07798894001887395, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04278404529278095, "sim_compute_performance-ego": 0.0738747083223783, "sim_compute_robot_state-ego": 0.08725806016188402}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036819271925019057, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07075144314184421, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16137129213751816, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07950267559144555, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0450220805842702, "sim_compute_performance-ego": 0.0736456498867128, "sim_compute_robot_state-ego": 0.08687350517365991}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003335118293762207, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06847959756851196, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14891865968704224, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07776521921157836, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.0459032154083252, "sim_compute_performance-ego": 0.0706647801399231, "sim_compute_robot_state-ego": 0.08570194244384766}}set_robot_commands_max 0.08009094283694312 set_robot_commands_mean 0.07899280314960197 set_robot_commands_median 0.07950267559144555 set_robot_commands_min 0.07776521921157836 sim_compute_performance-ego_max 0.0788044298396391 sim_compute_performance-ego_mean 0.07447058483165582 sim_compute_performance-ego_median 0.0738747083223783 sim_compute_performance-ego_min 0.0706647801399231 sim_compute_robot_state-ego_max 0.25359169174643126 sim_compute_robot_state-ego_mean 0.12029602731109292 sim_compute_robot_state-ego_median 0.08725806016188402 sim_compute_robot_state-ego_min 0.08570194244384766 sim_compute_sim_state_max 0.0459032154083252 sim_compute_sim_state_mean 0.044828195247550114 sim_compute_sim_state_median 0.0450220805842702 sim_compute_sim_state_min 0.04278404529278095 sim_physics_max 0.003809062261430044 sim_physics_mean 0.00364437294950511 sim_physics_median 0.0036819271925019057 sim_physics_min 0.003335118293762207 sim_render-ego_max 0.07583954404382144 sim_render-ego_mean 0.07133401046293256 sim_render-ego_median 0.07075144314184421 sim_render-ego_min 0.06847959756851196 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 16999
2292
Andrea Censi 🇨🇭Minimal agent aido2_LFV_r1-v4
step1-simulation success no idsc-rudolf-16007
2019-04-06 22:39:26+00:00 2019-04-06 22:51:41+00:00 0:12:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8516119779536884 survival_time_median 3.399999999999996 deviation-center-line_median 0.16534908678864438 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.15372944611769457 agent_compute-ego_mean 0.15239128612075786 agent_compute-ego_median 0.15289469718933105 agent_compute-ego_min 0.15048380809671738 deviation-center-line_max 0.2078435673968125 deviation-center-line_mean 0.15835662027727432 deviation-center-line_min 0.1128230942788872 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.352177996344455 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420794 driven_any_mean 1.1315473506196985 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430378 driven_lanedir_consec_max 0.9654696798546664 driven_lanedir_consec_mean 0.7930140409285634 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654696798546664 driven_lanedir_mean 0.7930140409285634 driven_lanedir_median 0.8516119779536884 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.079999999999996 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034940733629114486, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06711039122413187, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15048380809671738, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0794148655498729, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03685632873983944, "sim_compute_performance-ego": 0.07221226131214815, "sim_compute_robot_state-ego": 0.26216384593178244, "sim_compute_robot_state-npc0": 0.08126101073096781, "sim_compute_robot_state-npc1": 0.07563026862985947, "sim_compute_robot_state-npc2": 0.07470356015598073, "sim_compute_robot_state-npc3": 0.0744590583969565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0035014720190139044, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.06595869669838557, "in-drivable-lane": 0, "agent_compute-ego": 0.15363037018548875, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07827892379155235, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.0385101182120187, "sim_compute_performance-ego": 0.06853713308061872, "sim_compute_robot_state-ego": 0.09301940221635122, "sim_compute_robot_state-npc0": 0.07952776787773011, "sim_compute_robot_state-npc1": 0.07682101688687763, "sim_compute_robot_state-npc2": 0.07603029599265447, "sim_compute_robot_state-npc3": 0.07546444544716487}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003486134455754206, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07055807113647461, "in-drivable-lane": 0, "agent_compute-ego": 0.15372944611769457, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07999263176551231, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.039923840302687426, "sim_compute_performance-ego": 0.07680600973275992, "sim_compute_robot_state-ego": 0.09529679004962628, "sim_compute_robot_state-npc0": 0.08793601256150466, "sim_compute_robot_state-npc1": 0.08225555419921875, "sim_compute_robot_state-npc2": 0.08169957307668832, "sim_compute_robot_state-npc3": 0.07867088684668908}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035292346303055925, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06756207128850425, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15121810901455762, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07987898152048994, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04000618690397681, "sim_compute_performance-ego": 0.0705565243232541, "sim_compute_robot_state-ego": 0.09398673220378596, "sim_compute_robot_state-npc0": 0.08291148267141203, "sim_compute_robot_state-npc1": 0.07910543534813858, "sim_compute_robot_state-npc2": 0.07811049717228587, "sim_compute_robot_state-npc3": 0.07680997325152886}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035335826873779297, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07302826404571533, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15289469718933105, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08109652996063232, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04188397884368897, "sim_compute_performance-ego": 0.07412758588790894, "sim_compute_robot_state-ego": 0.09575738906860352, "sim_compute_robot_state-npc0": 0.08542879343032837, "sim_compute_robot_state-npc1": 0.08244101285934448, "sim_compute_robot_state-npc2": 0.08226365327835083, "sim_compute_robot_state-npc3": 0.08101269960403443}}set_robot_commands_max 0.08109652996063232 set_robot_commands_mean 0.07973238651761197 set_robot_commands_median 0.07987898152048994 set_robot_commands_min 0.07827892379155235 sim_compute_performance-ego_max 0.07680600973275992 sim_compute_performance-ego_mean 0.07244790286733796 sim_compute_performance-ego_median 0.07221226131214815 sim_compute_performance-ego_min 0.06853713308061872 sim_compute_robot_state-ego_max 0.26216384593178244 sim_compute_robot_state-ego_mean 0.12804483189402988 sim_compute_robot_state-ego_median 0.09529679004962628 sim_compute_robot_state-ego_min 0.09301940221635122 sim_compute_robot_state-npc0_max 0.08793601256150466 sim_compute_robot_state-npc0_mean 0.08341301345438859 sim_compute_robot_state-npc0_median 0.08291148267141203 sim_compute_robot_state-npc0_min 0.07952776787773011 sim_compute_robot_state-npc1_max 0.08244101285934448 sim_compute_robot_state-npc1_mean 0.07925065758468777 sim_compute_robot_state-npc1_median 0.07910543534813858 sim_compute_robot_state-npc1_min 0.07563026862985947 sim_compute_robot_state-npc2_max 0.08226365327835083 sim_compute_robot_state-npc2_mean 0.07856151593519205 sim_compute_robot_state-npc2_median 0.07811049717228587 sim_compute_robot_state-npc2_min 0.07470356015598073 sim_compute_robot_state-npc3_max 0.08101269960403443 sim_compute_robot_state-npc3_mean 0.07728341270927475 sim_compute_robot_state-npc3_median 0.07680997325152886 sim_compute_robot_state-npc3_min 0.0744590583969565 sim_compute_sim_state_max 0.04188397884368897 sim_compute_sim_state_mean 0.03943609060044227 sim_compute_sim_state_median 0.039923840302687426 sim_compute_sim_state_min 0.03685632873983944 sim_physics_max 0.0035335826873779297 sim_physics_mean 0.0035088994310726166 sim_physics_median 0.0035014720190139044 sim_physics_min 0.003486134455754206 sim_render-ego_max 0.07302826404571533 sim_render-ego_mean 0.06884349887864233 sim_render-ego_median 0.06756207128850425 sim_render-ego_min 0.06595869669838557 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 16998
2298
Andrea Censi 🇨🇭Python template aido2-AMOD-efficiency
step2-scoring error no idsc-rudolf-16007
2019-04-06 22:37:54+00:00 2019-04-06 22:39:19+00:00 0:01:25 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16997
2300
Andrea Censi 🇨🇭Python template aido2-AMOD-service_quality
step2-scoring error no idsc-rudolf-16007
2019-04-06 22:36:33+00:00 2019-04-06 22:36:54+00:00 0:00:21 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16987
2243
Andrea Censi 🇨🇭Solution template aido2_LF_r2-v4
step1-simulation aborted no idsc-rudolf-16007
2019-04-06 22:27:56+00:00 2019-04-06 22:35:58+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6859990822522983 survival_time_median 3.399999999999996 deviation-center-line_median 0.1202293815485396 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.16312493911156287 agent_compute-ego_mean 0.1573580124057111 agent_compute-ego_median 0.15791380167007446 agent_compute-ego_min 0.15188577989252602 deviation-center-line_max 0.20784364836514316 deviation-center-line_mean 0.14265024925288242 deviation-center-line_min 0.1070055904497026 deviation-heading_max 0.3886055345167397 deviation-heading_mean 0.3621006277452553 deviation-heading_median 0.37092376484647793 deviation-heading_min 0.30707254041461957 driven_any_max 1.4782765184420763 driven_any_mean 1.131547350619698 driven_any_median 1.0097725221691731 driven_any_min 0.9477327875430368 driven_lanedir_consec_max 0.9654651499017186 driven_lanedir_consec_mean 0.7418830599145954 driven_lanedir_consec_min 0.5879893173150568 driven_lanedir_max 0.9654651499017186 driven_lanedir_mean 0.7418830599145954 driven_lanedir_median 0.6859990822522983 driven_lanedir_min 0.5879893173150568 in-drivable-lane_max 2.0499999999999927 in-drivable-lane_mean 1.2399999999999956 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003091002211851232, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06536651008269366, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15205239197787115, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0781448623713325, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04193110676372752, "sim_compute_performance-ego": 0.06669651410158943, "sim_compute_robot_state-ego": 0.26521479031618905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0034351424565390934, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07333130685109941, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16181314937652105, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07978865078517369, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04501358289567251, "sim_compute_performance-ego": 0.07540485972449892, "sim_compute_robot_state-ego": 0.08872611938960968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0030934700599083535, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07084873639620268, "in-drivable-lane": 0, "agent_compute-ego": 0.16312493911156287, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07900727345393255, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.0448212036719689, "sim_compute_performance-ego": 0.07245489634000338, "sim_compute_robot_state-ego": 0.08865005053006686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0030507256345051093, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07385134115451719, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15188577989252602, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07712486313610542, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0442464060899688, "sim_compute_performance-ego": 0.07223040301625322, "sim_compute_robot_state-ego": 0.08615870882825154}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0029666519165039065, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06773993968963624, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15791380167007446, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07776963710784912, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.043624072074890136, "sim_compute_performance-ego": 0.06916907787322998, "sim_compute_robot_state-ego": 0.08584633588790894}}set_robot_commands_max 0.07978865078517369 set_robot_commands_mean 0.07836705737087865 set_robot_commands_median 0.0781448623713325 set_robot_commands_min 0.07712486313610542 sim_compute_performance-ego_max 0.07540485972449892 sim_compute_performance-ego_mean 0.071191150211115 sim_compute_performance-ego_median 0.07223040301625322 sim_compute_performance-ego_min 0.06669651410158943 sim_compute_robot_state-ego_max 0.26521479031618905 sim_compute_robot_state-ego_mean 0.1229192009904052 sim_compute_robot_state-ego_median 0.08865005053006686 sim_compute_robot_state-ego_min 0.08584633588790894 sim_compute_sim_state_max 0.04501358289567251 sim_compute_sim_state_mean 0.043927274299245575 sim_compute_sim_state_median 0.0442464060899688 sim_compute_sim_state_min 0.04193110676372752 sim_physics_max 0.0034351424565390934 sim_physics_mean 0.0031273984558615386 sim_physics_median 0.003091002211851232 sim_physics_min 0.0029666519165039065 sim_render-ego_max 0.07385134115451719 sim_render-ego_mean 0.07022756683482982 sim_render-ego_median 0.07084873639620268 sim_render-ego_min 0.06536651008269366 simulation-passed 1 survival_time_max 4.99999999999999 survival_time_mean 3.779999999999995 survival_time_min 3.149999999999997
No reset possible 16986
2280
FANG MEIYI 🇸🇬Baseline solution using imitation learning from logs aido2_LF_r2-v4
step1-simulation error no idsc-rudolf-16007
2019-04-05 08:40:32+00:00 2019-04-05 09:11:13+00:00 0:30:41 Timeout:
Waited 180 [...] Timeout:
Waited 1803.0568063259125 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16981
2266
Andrea Censi 🇨🇭PredictorRandom aido2-PRED
step1-simulation error no idsc-rudolf-16007
2019-04-05 08:03:57+00:00 2019-04-05 08:04:27+00:00 0:00:30 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 16977
2273
Andrea Censi 🇨🇭PredictorRandom aido2-PRED
step1-simulation error no idsc-rudolf-16007
2019-04-05 08:02:14+00:00 2019-04-05 08:02:49+00:00 0:00:35 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible