Duckietown Challenges Home Challenges Submissions

Evaluator 511

ID511
evaluatoridsc-rudolf-16007
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-16007
versionDC:4.0.6;DCR:4.0.5;DTS:4.0.8
first heard
last heard
statusinactive
# evaluating
# success12 16999
# timeout
# failed1 17096
# error14 16977
# aborted2 16987
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171072278Peter Almasi 🇭🇺PyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:30:39
Timeout: Waited 180 [...]
Timeout:

Waited 1801.1275572776794 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171012253Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2469145366098973
survival_time_median4.549999999999992
deviation-center-line_median0.04673405217823424
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.2132335416563265
agent_compute-ego_mean0.2052087308906833
agent_compute-ego_median0.20259782305934973
agent_compute-ego_min0.19911154809888904
deviation-center-line_max0.061461333051357134
deviation-center-line_mean0.05095763232758586
deviation-center-line_min0.0425278962863902
deviation-heading_max0.3651736217500463
deviation-heading_mean0.3373210581753059
deviation-heading_median0.34422121994097304
deviation-heading_min0.2988709034717947
driven_any_max1.5853704928859882
driven_any_mean1.347903949295549
driven_any_median1.5846743133395478
driven_any_min0.9920591446704368
driven_lanedir_consec_max1.3525954544703422
driven_lanedir_consec_mean1.0530351498466604
driven_lanedir_consec_min0.6573740979691927
driven_lanedir_max1.3525954544703422
driven_lanedir_mean1.0530351498466604
driven_lanedir_median1.2469145366098973
driven_lanedir_min0.6573740979691927
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9920591446704368, "sim_physics": 0.0036508786050896895, "survival_time": 2.849999999999998, "driven_lanedir": 0.6573740979691927, "sim_render-ego": 0.0725752638097395, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.20259782305934973, "deviation-heading": 0.34422121994097304, "set_robot_commands": 0.07847821503354792, "deviation-center-line": 0.0425278962863902, "driven_lanedir_consec": 0.6573740979691927, "sim_compute_sim_state": 0.04537733395894369, "sim_compute_performance-ego": 0.07029084573712266, "sim_compute_robot_state-ego": 0.27941422713430303}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9926034286287166, "sim_physics": 0.0035914705510725056, "survival_time": 2.849999999999998, "driven_lanedir": 0.7613605954270737, "sim_render-ego": 0.07141241692660148, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.20257623153820373, "deviation-heading": 0.2988709034717947, "set_robot_commands": 0.07846112418593022, "deviation-center-line": 0.05733607779192401, "driven_lanedir_consec": 0.7613605954270737, "sim_compute_sim_state": 0.043549299240112305, "sim_compute_performance-ego": 0.07122516632080078, "sim_compute_robot_state-ego": 0.07645614941914876}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5853704928859882, "sim_physics": 0.0032854630396916317, "survival_time": 4.549999999999992, "driven_lanedir": 1.3525954544703422, "sim_render-ego": 0.06671037778749571, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.19911154809888904, "deviation-heading": 0.31316633966492985, "set_robot_commands": 0.07684637164021586, "deviation-center-line": 0.061461333051357134, "driven_lanedir_consec": 1.3525954544703422, "sim_compute_sim_state": 0.0426695425431807, "sim_compute_performance-ego": 0.06540247372218541, "sim_compute_robot_state-ego": 0.07376696251250886}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.584812366953054, "sim_physics": 0.0036935203678005344, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469310647567955, "sim_render-ego": 0.07498553297021887, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.20852451010064765, "deviation-heading": 0.3651736217500463, "set_robot_commands": 0.07966768872606886, "deviation-center-line": 0.04673405217823424, "driven_lanedir_consec": 1.2469310647567955, "sim_compute_sim_state": 0.04521353166181963, "sim_compute_performance-ego": 0.07166775504311362, "sim_compute_robot_state-ego": 0.0771966032929473}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5846743133395478, "sim_physics": 0.0034899109012478, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469145366098973, "sim_render-ego": 0.07097640142335997, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.2132335416563265, "deviation-heading": 0.3651732060487856, "set_robot_commands": 0.07922630781655783, "deviation-center-line": 0.046728802330023675, "driven_lanedir_consec": 1.2469145366098973, "sim_compute_sim_state": 0.04607934218186598, "sim_compute_performance-ego": 0.06650569674732922, "sim_compute_robot_state-ego": 0.07645783319578066}}
set_robot_commands_max0.07966768872606886
set_robot_commands_mean0.07853594148046414
set_robot_commands_median0.07847821503354792
set_robot_commands_min0.07684637164021586
sim_compute_performance-ego_max0.07166775504311362
sim_compute_performance-ego_mean0.06901838751411034
sim_compute_performance-ego_median0.07029084573712266
sim_compute_performance-ego_min0.06540247372218541
sim_compute_robot_state-ego_max0.27941422713430303
sim_compute_robot_state-ego_mean0.11665835511093772
sim_compute_robot_state-ego_median0.07645783319578066
sim_compute_robot_state-ego_min0.07376696251250886
sim_compute_sim_state_max0.04607934218186598
sim_compute_sim_state_mean0.04457780991718446
sim_compute_sim_state_median0.04521353166181963
sim_compute_sim_state_min0.0426695425431807
sim_physics_max0.0036935203678005344
sim_physics_mean0.0035422486929804326
sim_physics_median0.0035914705510725056
sim_physics_min0.0032854630396916317
sim_render-ego_max0.07498553297021887
sim_render-ego_mean0.07133199858348312
sim_render-ego_median0.07141241692660148
sim_render-ego_min0.06671037778749571
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean3.869999999999995
survival_time_min2.849999999999998
No reset possible
171002260Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:00:39
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170982262Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:00:40
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170972263Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:00:38
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170962264Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationfailednoidsc-rudolf-160070:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 277, in run_episode
    r: MsgReceived = agent.read_one(expect_topic='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 165, in read_one
    raise RemoteNodeAborted(m)  # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.

agent error |Exception while handling a message on topic "get_commands".
            |
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
            ||     schema = type_to_schema_(T, globals_, processing)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
            ||     raise ValueError(msg)
            || ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
            ||
            || The above exception was the direct cause of the following exception:
            ||
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
            ||     res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
            ||     res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
            ||     return serialize_dataclass(ob, globals_, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 107, in serialize_dataclass
            ||     the_schema = type_to_schema(T, globals_)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 641, in type_to_schema
            ||     raise type(e)(msg) from e
            || ValueError: Cannot get schema for <class 'numpy.float32'>:
            || │ processing: (empty dict)
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 633, in type_to_schema
            ||     schema = type_to_schema_(T, globals_, processing)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 838, in type_to_schema_
            ||     raise ValueError(msg)
            || ValueError: Cannot interpret this type. (not a dataclass): <class 'numpy.float32'>
            ||
            ||
            || The above exception was the direct cause of the following exception:
            ||
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 132, in serialize_dataclass
            ||     res[k] = object_to_ipce(v, globals_, suggest_type=ann, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
            ||     res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
            ||     return serialize_dataclass(ob, globals_, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
            ||     raise Exception(msg) from e
            || Exception: Cannot serialize attribute motor_left  = 0.45472970604896545
            || Type <class 'aido_schemas.schemas.PWMCommands'> has annotated it as <class 'float'>
            ||
            || The above exception was the direct cause of the following exception:
            ||
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
            ||     handle_message_node(parsed, protocol, pc, node, context_data)
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
            ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
            ||     f(**kwargs)
            ||   File "solution.py", line 50, in on_received_get_commands
            ||     context.write('commands', commands)
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 136, in write
            ||     m[FIELD_DATA] = object_to_ipce(data, {}, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 35, in object_to_ipce
            ||     res = object_to_ipce_(ob, globals_, suggest_type=suggest_type, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 97, in object_to_ipce_
            ||     return serialize_dataclass(ob, globals_, with_schema=with_schema)
            ||   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 136, in serialize_dataclass
            ||     raise Exception(msg) from e
            || Exception: Cannot serialize attribute wheels  = PWMCommands(motor_left=0.4547297, motor_right=-0.11871486)
            || Type <class 'aido_schemas.schemas.Duckiebot1Commands'> has annotated it as <class 'aido_schemas.schemas.PWMCommands'>
            ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 127, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 280, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170952265Andrea Censi 🇨🇭PredictorMeanaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.27602779598084853
error_L20.0899524446012454


No reset possible
170942266Andrea Censi 🇨🇭PredictorRandomaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.3030667994366853
error_L20.14264499702969025


No reset possible
170932267Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1209853947455215
error_L20.023239851935755784


No reset possible
170722313FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:30:38
Timeout: Waited 180 [...]
Timeout:

Waited 1800.714684009552 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170702289Andrea Censi 🇨🇭PredictorRandomaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.29724595091203704
error_L20.13916078739280557


No reset possible
170692290Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-160070:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12408790536871075
error_L20.023584390804624905


No reset possible
170672291Andrea Censi 🇨🇭Minimal agentaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:07:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16166100868811975
agent_compute-ego_mean0.15851790030394866
agent_compute-ego_median0.15942267383017192
agent_compute-ego_min0.1552846256424399
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003145919126622817, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0682910119785982, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1552846256424399, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0806810224757475, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043758725418764, "sim_compute_performance-ego": 0.06619962173349717, "sim_compute_robot_state-ego": 0.2649695697952719}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003358337614271376, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06914934657868885, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15666186241876512, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07896861954340859, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04353718152121892, "sim_compute_performance-ego": 0.06988148840646895, "sim_compute_robot_state-ego": 0.08014552933829171}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0035532767956073467, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06946375553424541, "in-drivable-lane": 0, "agent_compute-ego": 0.16166100868811975, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07996058464050293, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04389031850374662, "sim_compute_performance-ego": 0.07005101350637583, "sim_compute_robot_state-ego": 0.0796161358173077}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003532956286174495, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06777732546736555, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15942267383017192, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08032450443360864, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04439485945352694, "sim_compute_performance-ego": 0.06889035643600835, "sim_compute_robot_state-ego": 0.0798158529328137}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003063805103302002, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06394846200942993, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15955933094024655, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07827025890350342, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04202385425567627, "sim_compute_performance-ego": 0.06550375699996948, "sim_compute_robot_state-ego": 0.0761937952041626}}
set_robot_commands_max0.0806810224757475
set_robot_commands_mean0.07964099799935422
set_robot_commands_median0.07996058464050293
set_robot_commands_min0.07827025890350342
sim_compute_performance-ego_max0.07005101350637583
sim_compute_performance-ego_mean0.06810524741646395
sim_compute_performance-ego_median0.06889035643600835
sim_compute_performance-ego_min0.06550375699996948
sim_compute_robot_state-ego_max0.2649695697952719
sim_compute_robot_state-ego_mean0.11614817661756952
sim_compute_robot_state-ego_median0.0798158529328137
sim_compute_robot_state-ego_min0.0761937952041626
sim_compute_sim_state_max0.04439485945352694
sim_compute_sim_state_mean0.043520987830586555
sim_compute_sim_state_median0.043758725418764
sim_compute_sim_state_min0.04202385425567627
sim_physics_max0.0035532767956073467
sim_physics_mean0.0033308589851956073
sim_physics_median0.003358337614271376
sim_physics_min0.003063805103302002
sim_render-ego_max0.06946375553424541
sim_render-ego_mean0.06772598031366558
sim_render-ego_median0.0682910119785982
sim_render-ego_min0.06394846200942993
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170522306Andrea Censi 🇨🇭Minimal agentaido2_LFVI_r1-v4step1-simulationsuccessnoidsc-rudolf-160070:14:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.1630873960607192
agent_compute-ego_mean0.15862500131196555
agent_compute-ego_median0.1572857435713423
agent_compute-ego_min0.1542690269874804
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0035577247882711475, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.07328236678550984, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.16217996991913894, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07909253383504933, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.041787422114405136, "sim_compute_performance-ego": 0.07142374762173356, "sim_compute_robot_state-ego": 0.16990175247192382, "sim_compute_robot_state-npc0": 0.07730874028699151, "sim_compute_robot_state-npc1": 0.07344106805735622, "sim_compute_robot_state-npc2": 0.0724806966452763, "sim_compute_robot_state-npc3": 0.0735570397870294}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003269831339518229, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.07207044326897824, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1542690269874804, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07647637164953983, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.03983796726573597, "sim_compute_performance-ego": 0.06709039211273193, "sim_compute_robot_state-ego": 0.08720953536756111, "sim_compute_robot_state-npc0": 0.07266387072476474, "sim_compute_robot_state-npc1": 0.07019538951642586, "sim_compute_robot_state-npc2": 0.07040124228506377, "sim_compute_robot_state-npc3": 0.07289500669999556}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.00332558662333387, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.06886448758713742, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.1572857435713423, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07766995785084177, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.038648511501068766, "sim_compute_performance-ego": 0.06720970539336509, "sim_compute_robot_state-ego": 0.0905964932543166, "sim_compute_robot_state-npc0": 0.07345486194529433, "sim_compute_robot_state-npc1": 0.06986520138192684, "sim_compute_robot_state-npc2": 0.06952852137545322, "sim_compute_robot_state-npc3": 0.06978284298105443}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.00318760871887207, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.06647391880259794, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1563028700211469, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07775120454676011, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.0365295830894919, "sim_compute_performance-ego": 0.06494663743411794, "sim_compute_robot_state-ego": 0.08826229151557474, "sim_compute_robot_state-npc0": 0.0727840591879452, "sim_compute_robot_state-npc1": 0.06604441754958208, "sim_compute_robot_state-npc2": 0.06399083137512207, "sim_compute_robot_state-npc3": 0.06492908141192268}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0034693479537963867, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.0727573598132414, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1630873960607192, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.07838806334663839, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.038834880380069506, "sim_compute_performance-ego": 0.07106546444051406, "sim_compute_robot_state-ego": 0.09081080380608052, "sim_compute_robot_state-npc0": 0.08220996225581449, "sim_compute_robot_state-npc1": 0.07164165552924662, "sim_compute_robot_state-npc2": 0.0683538037187913, "sim_compute_robot_state-npc3": 0.06888292116277359}}
set_robot_commands_max0.07909253383504933
set_robot_commands_mean0.07787562624576588
set_robot_commands_median0.07775120454676011
set_robot_commands_min0.07647637164953983
sim_compute_performance-ego_max0.07142374762173356
sim_compute_performance-ego_mean0.06834718940049252
sim_compute_performance-ego_median0.06720970539336509
sim_compute_performance-ego_min0.06494663743411794
sim_compute_robot_state-ego_max0.16990175247192382
sim_compute_robot_state-ego_mean0.10535617528309138
sim_compute_robot_state-ego_median0.0905964932543166
sim_compute_robot_state-ego_min0.08720953536756111
sim_compute_robot_state-npc0_max0.08220996225581449
sim_compute_robot_state-npc0_mean0.07568429888016205
sim_compute_robot_state-npc0_median0.07345486194529433
sim_compute_robot_state-npc0_min0.07266387072476474
sim_compute_robot_state-npc1_max0.07344106805735622
sim_compute_robot_state-npc1_mean0.07023754640690752
sim_compute_robot_state-npc1_median0.07019538951642586
sim_compute_robot_state-npc1_min0.06604441754958208
sim_compute_robot_state-npc2_max0.0724806966452763
sim_compute_robot_state-npc2_mean0.06895101907994133
sim_compute_robot_state-npc2_median0.06952852137545322
sim_compute_robot_state-npc2_min0.06399083137512207
sim_compute_robot_state-npc3_max0.0735570397870294
sim_compute_robot_state-npc3_mean0.07000937840855512
sim_compute_robot_state-npc3_median0.06978284298105443
sim_compute_robot_state-npc3_min0.06492908141192268
sim_compute_sim_state_max0.041787422114405136
sim_compute_sim_state_mean0.03912767287015425
sim_compute_sim_state_median0.038834880380069506
sim_compute_sim_state_min0.0365295830894919
sim_physics_max0.0035577247882711475
sim_physics_mean0.003362019884758341
sim_physics_median0.00332558662333387
sim_physics_min0.00318760871887207
sim_render-ego_max0.07328236678550984
sim_render-ego_mean0.07068971525149297
sim_render-ego_median0.07207044326897824
sim_render-ego_min0.06647391880259794
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
170472243Andrea Censi 🇨🇭Solution templateaido2_LF_r2-v4step1-simulationabortednoidsc-rudolf-160070:07:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15939441541346108
agent_compute-ego_mean0.1576512799728074
agent_compute-ego_median0.15762344140272874
agent_compute-ego_min0.15579524993896485
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034807149101706114, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07193427927353803, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15820273581673117, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07889779175029081, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04409091612871956, "sim_compute_performance-ego": 0.07092205566518447, "sim_compute_robot_state-ego": 0.28422005036297965}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003431157460288396, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07052924519493467, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15724055729215108, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.08029406789749388, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.0433802188388885, "sim_compute_performance-ego": 0.0702181165180509, "sim_compute_robot_state-ego": 0.07986928924681648}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.00346837410560021, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07279884631817157, "in-drivable-lane": 0, "agent_compute-ego": 0.15762344140272874, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07884716620812049, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04385721866901104, "sim_compute_performance-ego": 0.07172705943767842, "sim_compute_robot_state-ego": 0.08449189846332257}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003717128823443157, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07171415701145079, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15939441541346108, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07899249472269197, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04441499419328643, "sim_compute_performance-ego": 0.07033548413253413, "sim_compute_robot_state-ego": 0.08069092762179492}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003524179458618164, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07199149370193482, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15579524993896485, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07940498113632202, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.044747653007507326, "sim_compute_performance-ego": 0.0688549542427063, "sim_compute_robot_state-ego": 0.07802570819854736}}
set_robot_commands_max0.08029406789749388
set_robot_commands_mean0.07928730034298384
set_robot_commands_median0.07899249472269197
set_robot_commands_min0.07884716620812049
sim_compute_performance-ego_max0.07172705943767842
sim_compute_performance-ego_mean0.07041153399923084
sim_compute_performance-ego_median0.07033548413253413
sim_compute_performance-ego_min0.0688549542427063
sim_compute_robot_state-ego_max0.28422005036297965
sim_compute_robot_state-ego_mean0.12145957477869218
sim_compute_robot_state-ego_median0.08069092762179492
sim_compute_robot_state-ego_min0.07802570819854736
sim_compute_sim_state_max0.044747653007507326
sim_compute_sim_state_mean0.044098200167482574
sim_compute_sim_state_median0.04409091612871956
sim_compute_sim_state_min0.0433802188388885
sim_physics_max0.003717128823443157
sim_physics_mean0.003524310951624108
sim_physics_median0.0034807149101706114
sim_physics_min0.003431157460288396
sim_render-ego_max0.07279884631817157
sim_render-ego_mean0.07179360430000598
sim_render-ego_median0.07193427927353803
sim_render-ego_min0.07052924519493467
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170382250Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:30:54
Timeout: Waited 180 [...]
Timeout:

Waited 1801.3442862033844 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170362251Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:01:55
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170332260Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:00:39
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170242269Andrea Censi 🇨🇭Solution templateaido2_LFV_r1-v4step1-simulationsuccessnoidsc-rudolf-160070:12:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16808391780388066
agent_compute-ego_mean0.16507525489492025
agent_compute-ego_median0.16710413455963136
agent_compute-ego_min0.16071864915272546
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003634414252112894, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06863973421208999, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16152575787375956, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07969888869453878, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.043168786694021785, "sim_compute_performance-ego": 0.07214254491469439, "sim_compute_robot_state-ego": 0.24934212600483613, "sim_compute_robot_state-npc0": 0.08127305086921244, "sim_compute_robot_state-npc1": 0.08007352141773, "sim_compute_robot_state-npc2": 0.0817819588324603, "sim_compute_robot_state-npc3": 0.08066365298102884}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003626562300182524, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.0743202595483689, "in-drivable-lane": 0, "agent_compute-ego": 0.16071864915272546, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07935162196083674, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.0450927908458407, "sim_compute_performance-ego": 0.07709248860677083, "sim_compute_robot_state-ego": 0.09753579185122536, "sim_compute_robot_state-npc0": 0.08588536580403645, "sim_compute_robot_state-npc1": 0.08442697070893787, "sim_compute_robot_state-npc2": 0.08681423323495048, "sim_compute_robot_state-npc3": 0.08658496160355825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0034722108107346755, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07169910210829515, "in-drivable-lane": 0, "agent_compute-ego": 0.16794381508460413, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08201665144700271, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.04269138482900766, "sim_compute_performance-ego": 0.0730201977949876, "sim_compute_robot_state-ego": 0.09418801894554724, "sim_compute_robot_state-npc0": 0.0885657787322998, "sim_compute_robot_state-npc1": 0.08549874012286847, "sim_compute_robot_state-npc2": 0.0829394817352295, "sim_compute_robot_state-npc3": 0.08216959513150729}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035447783586455553, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0701163600130779, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16808391780388066, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08225168251409763, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04078609478182909, "sim_compute_performance-ego": 0.07303758074597615, "sim_compute_robot_state-ego": 0.09723825280259296, "sim_compute_robot_state-npc0": 0.08794499606620974, "sim_compute_robot_state-npc1": 0.08232658374600293, "sim_compute_robot_state-npc2": 0.08177200177820718, "sim_compute_robot_state-npc3": 0.08051273880935297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035022997856140135, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.06999177694320678, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16710413455963136, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08199993848800659, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04167727947235107, "sim_compute_performance-ego": 0.0692064619064331, "sim_compute_robot_state-ego": 0.09559743642807007, "sim_compute_robot_state-npc0": 0.08917153596878052, "sim_compute_robot_state-npc1": 0.08325286865234376, "sim_compute_robot_state-npc2": 0.08248684167861939, "sim_compute_robot_state-npc3": 0.08117295503616333}}
set_robot_commands_max0.08225168251409763
set_robot_commands_mean0.08106375662089649
set_robot_commands_median0.08199993848800659
set_robot_commands_min0.07935162196083674
sim_compute_performance-ego_max0.07709248860677083
sim_compute_performance-ego_mean0.07289985479377241
sim_compute_performance-ego_median0.0730201977949876
sim_compute_performance-ego_min0.0692064619064331
sim_compute_robot_state-ego_max0.24934212600483613
sim_compute_robot_state-ego_mean0.12678032520645435
sim_compute_robot_state-ego_median0.09723825280259296
sim_compute_robot_state-ego_min0.09418801894554724
sim_compute_robot_state-npc0_max0.08917153596878052
sim_compute_robot_state-npc0_mean0.08656814548810779
sim_compute_robot_state-npc0_median0.08794499606620974
sim_compute_robot_state-npc0_min0.08127305086921244
sim_compute_robot_state-npc1_max0.08549874012286847
sim_compute_robot_state-npc1_mean0.0831157369295766
sim_compute_robot_state-npc1_median0.08325286865234376
sim_compute_robot_state-npc1_min0.08007352141773
sim_compute_robot_state-npc2_max0.08681423323495048
sim_compute_robot_state-npc2_mean0.08315890345189339
sim_compute_robot_state-npc2_median0.08248684167861939
sim_compute_robot_state-npc2_min0.08177200177820718
sim_compute_robot_state-npc3_max0.08658496160355825
sim_compute_robot_state-npc3_mean0.08222078071232214
sim_compute_robot_state-npc3_median0.08117295503616333
sim_compute_robot_state-npc3_min0.08051273880935297
sim_compute_sim_state_max0.0450927908458407
sim_compute_sim_state_mean0.042683267324610065
sim_compute_sim_state_median0.04269138482900766
sim_compute_sim_state_min0.04078609478182909
sim_physics_max0.003634414252112894
sim_physics_mean0.003556053101457933
sim_physics_median0.0035447783586455553
sim_physics_min0.0034722108107346755
sim_render-ego_max0.0743202595483689
sim_render-ego_mean0.07095344656500775
sim_render-ego_median0.0701163600130779
sim_render-ego_min0.06863973421208999
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170192274Andrea Censi 🇨🇭Solution templateaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:07:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16283778583302216
agent_compute-ego_mean0.1603010760906541
agent_compute-ego_median0.16016491632612925
agent_compute-ego_min0.15684913873672485
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0032909021658055924, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06718476029003367, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16283778583302216, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08065788535510793, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04515722919912899, "sim_compute_performance-ego": 0.07078249314252068, "sim_compute_robot_state-ego": 0.27139050469678994}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003757257310170976, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07487068857465472, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16016491632612925, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07910485494704474, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04519602987501356, "sim_compute_performance-ego": 0.07856139304145934, "sim_compute_robot_state-ego": 0.0874073656778487}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0037046102377084585, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07560781698960524, "in-drivable-lane": 0, "agent_compute-ego": 0.1617363012754, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07954653960007887, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04512318464425894, "sim_compute_performance-ego": 0.0775378520672138, "sim_compute_robot_state-ego": 0.08555569281944862}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036102795019382385, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07507258508263565, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1599172382819943, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07924860861243271, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04497079732941418, "sim_compute_performance-ego": 0.07636581397638088, "sim_compute_robot_state-ego": 0.0853043736481085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0035601592063903807, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07068872690200806, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15684913873672485, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.0784910249710083, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04267159461975098, "sim_compute_performance-ego": 0.07273762226104737, "sim_compute_robot_state-ego": 0.0831803035736084}}
set_robot_commands_max0.08065788535510793
set_robot_commands_mean0.07940978269713451
set_robot_commands_median0.07924860861243271
set_robot_commands_min0.0784910249710083
sim_compute_performance-ego_max0.07856139304145934
sim_compute_performance-ego_mean0.07519703489772442
sim_compute_performance-ego_median0.07636581397638088
sim_compute_performance-ego_min0.07078249314252068
sim_compute_robot_state-ego_max0.27139050469678994
sim_compute_robot_state-ego_mean0.12256764808316084
sim_compute_robot_state-ego_median0.08555569281944862
sim_compute_robot_state-ego_min0.0831803035736084
sim_compute_sim_state_max0.04519602987501356
sim_compute_sim_state_mean0.044623767133513334
sim_compute_sim_state_median0.04512318464425894
sim_compute_sim_state_min0.04267159461975098
sim_physics_max0.003757257310170976
sim_physics_mean0.0035846416844027293
sim_physics_median0.0036102795019382385
sim_physics_min0.0032909021658055924
sim_render-ego_max0.07560781698960524
sim_render-ego_mean0.07268491556778747
sim_render-ego_median0.07487068857465472
sim_render-ego_min0.06718476029003367
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
170172276FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:01:40
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
170092284Andrea Censi 🇨🇭Minimal agentaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-160070:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1627621615634245
agent_compute-ego_mean0.1580051283417042
agent_compute-ego_median0.15995227722894578
agent_compute-ego_min0.14891865968704224
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003785256077261532, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07583954404382144, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1627621615634245, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07961623808916878, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04499404921251185, "sim_compute_performance-ego": 0.0788044298396391, "sim_compute_robot_state-ego": 0.25359169174643126}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003809062261430044, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07271443094526019, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15995227722894578, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.08009094283694312, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.045437585739862354, "sim_compute_performance-ego": 0.0753633559696258, "sim_compute_robot_state-ego": 0.08805493702964177}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0036105009225698616, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06888503661522498, "in-drivable-lane": 0, "agent_compute-ego": 0.1570212510915903, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07798894001887395, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04278404529278095, "sim_compute_performance-ego": 0.0738747083223783, "sim_compute_robot_state-ego": 0.08725806016188402}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0036819271925019057, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07075144314184421, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16137129213751816, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07950267559144555, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0450220805842702, "sim_compute_performance-ego": 0.0736456498867128, "sim_compute_robot_state-ego": 0.08687350517365991}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003335118293762207, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06847959756851196, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.14891865968704224, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07776521921157836, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.0459032154083252, "sim_compute_performance-ego": 0.0706647801399231, "sim_compute_robot_state-ego": 0.08570194244384766}}
set_robot_commands_max0.08009094283694312
set_robot_commands_mean0.07899280314960197
set_robot_commands_median0.07950267559144555
set_robot_commands_min0.07776521921157836
sim_compute_performance-ego_max0.0788044298396391
sim_compute_performance-ego_mean0.07447058483165582
sim_compute_performance-ego_median0.0738747083223783
sim_compute_performance-ego_min0.0706647801399231
sim_compute_robot_state-ego_max0.25359169174643126
sim_compute_robot_state-ego_mean0.12029602731109292
sim_compute_robot_state-ego_median0.08725806016188402
sim_compute_robot_state-ego_min0.08570194244384766
sim_compute_sim_state_max0.0459032154083252
sim_compute_sim_state_mean0.044828195247550114
sim_compute_sim_state_median0.0450220805842702
sim_compute_sim_state_min0.04278404529278095
sim_physics_max0.003809062261430044
sim_physics_mean0.00364437294950511
sim_physics_median0.0036819271925019057
sim_physics_min0.003335118293762207
sim_render-ego_max0.07583954404382144
sim_render-ego_mean0.07133401046293256
sim_render-ego_median0.07075144314184421
sim_render-ego_min0.06847959756851196
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
169992292Andrea Censi 🇨🇭Minimal agentaido2_LFV_r1-v4step1-simulationsuccessnoidsc-rudolf-160070:12:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.15372944611769457
agent_compute-ego_mean0.15239128612075786
agent_compute-ego_median0.15289469718933105
agent_compute-ego_min0.15048380809671738
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034940733629114486, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06711039122413187, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15048380809671738, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0794148655498729, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.03685632873983944, "sim_compute_performance-ego": 0.07221226131214815, "sim_compute_robot_state-ego": 0.26216384593178244, "sim_compute_robot_state-npc0": 0.08126101073096781, "sim_compute_robot_state-npc1": 0.07563026862985947, "sim_compute_robot_state-npc2": 0.07470356015598073, "sim_compute_robot_state-npc3": 0.0744590583969565}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0035014720190139044, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.06595869669838557, "in-drivable-lane": 0, "agent_compute-ego": 0.15363037018548875, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07827892379155235, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.0385101182120187, "sim_compute_performance-ego": 0.06853713308061872, "sim_compute_robot_state-ego": 0.09301940221635122, "sim_compute_robot_state-npc0": 0.07952776787773011, "sim_compute_robot_state-npc1": 0.07682101688687763, "sim_compute_robot_state-npc2": 0.07603029599265447, "sim_compute_robot_state-npc3": 0.07546444544716487}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003486134455754206, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07055807113647461, "in-drivable-lane": 0, "agent_compute-ego": 0.15372944611769457, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07999263176551231, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.039923840302687426, "sim_compute_performance-ego": 0.07680600973275992, "sim_compute_robot_state-ego": 0.09529679004962628, "sim_compute_robot_state-npc0": 0.08793601256150466, "sim_compute_robot_state-npc1": 0.08225555419921875, "sim_compute_robot_state-npc2": 0.08169957307668832, "sim_compute_robot_state-npc3": 0.07867088684668908}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035292346303055925, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06756207128850425, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15121810901455762, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07987898152048994, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04000618690397681, "sim_compute_performance-ego": 0.0705565243232541, "sim_compute_robot_state-ego": 0.09398673220378596, "sim_compute_robot_state-npc0": 0.08291148267141203, "sim_compute_robot_state-npc1": 0.07910543534813858, "sim_compute_robot_state-npc2": 0.07811049717228587, "sim_compute_robot_state-npc3": 0.07680997325152886}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0035335826873779297, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07302826404571533, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15289469718933105, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08109652996063232, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04188397884368897, "sim_compute_performance-ego": 0.07412758588790894, "sim_compute_robot_state-ego": 0.09575738906860352, "sim_compute_robot_state-npc0": 0.08542879343032837, "sim_compute_robot_state-npc1": 0.08244101285934448, "sim_compute_robot_state-npc2": 0.08226365327835083, "sim_compute_robot_state-npc3": 0.08101269960403443}}
set_robot_commands_max0.08109652996063232
set_robot_commands_mean0.07973238651761197
set_robot_commands_median0.07987898152048994
set_robot_commands_min0.07827892379155235
sim_compute_performance-ego_max0.07680600973275992
sim_compute_performance-ego_mean0.07244790286733796
sim_compute_performance-ego_median0.07221226131214815
sim_compute_performance-ego_min0.06853713308061872
sim_compute_robot_state-ego_max0.26216384593178244
sim_compute_robot_state-ego_mean0.12804483189402988
sim_compute_robot_state-ego_median0.09529679004962628
sim_compute_robot_state-ego_min0.09301940221635122
sim_compute_robot_state-npc0_max0.08793601256150466
sim_compute_robot_state-npc0_mean0.08341301345438859
sim_compute_robot_state-npc0_median0.08291148267141203
sim_compute_robot_state-npc0_min0.07952776787773011
sim_compute_robot_state-npc1_max0.08244101285934448
sim_compute_robot_state-npc1_mean0.07925065758468777
sim_compute_robot_state-npc1_median0.07910543534813858
sim_compute_robot_state-npc1_min0.07563026862985947
sim_compute_robot_state-npc2_max0.08226365327835083
sim_compute_robot_state-npc2_mean0.07856151593519205
sim_compute_robot_state-npc2_median0.07811049717228587
sim_compute_robot_state-npc2_min0.07470356015598073
sim_compute_robot_state-npc3_max0.08101269960403443
sim_compute_robot_state-npc3_mean0.07728341270927475
sim_compute_robot_state-npc3_median0.07680997325152886
sim_compute_robot_state-npc3_min0.0744590583969565
sim_compute_sim_state_max0.04188397884368897
sim_compute_sim_state_mean0.03943609060044227
sim_compute_sim_state_median0.039923840302687426
sim_compute_sim_state_min0.03685632873983944
sim_physics_max0.0035335826873779297
sim_physics_mean0.0035088994310726166
sim_physics_median0.0035014720190139044
sim_physics_min0.003486134455754206
sim_render-ego_max0.07302826404571533
sim_render-ego_mean0.06884349887864233
sim_render-ego_median0.06756207128850425
sim_render-ego_min0.06595869669838557
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
169982298Andrea Censi 🇨🇭Python templateaido2-AMOD-efficiencystep2-scoringerrornoidsc-rudolf-160070:01:25
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169972300Andrea Censi 🇨🇭Python templateaido2-AMOD-service_qualitystep2-scoringerrornoidsc-rudolf-160070:00:21
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169872243Andrea Censi 🇨🇭Solution templateaido2_LF_r2-v4step1-simulationabortednoidsc-rudolf-160070:08:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16312493911156287
agent_compute-ego_mean0.1573580124057111
agent_compute-ego_median0.15791380167007446
agent_compute-ego_min0.15188577989252602
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003091002211851232, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06536651008269366, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15205239197787115, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.0781448623713325, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04193110676372752, "sim_compute_performance-ego": 0.06669651410158943, "sim_compute_robot_state-ego": 0.26521479031618905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.0034351424565390934, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.07333130685109941, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.16181314937652105, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07978865078517369, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04501358289567251, "sim_compute_performance-ego": 0.07540485972449892, "sim_compute_robot_state-ego": 0.08872611938960968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0030934700599083535, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.07084873639620268, "in-drivable-lane": 0, "agent_compute-ego": 0.16312493911156287, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07900727345393255, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.0448212036719689, "sim_compute_performance-ego": 0.07245489634000338, "sim_compute_robot_state-ego": 0.08865005053006686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0030507256345051093, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07385134115451719, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15188577989252602, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07712486313610542, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0442464060899688, "sim_compute_performance-ego": 0.07223040301625322, "sim_compute_robot_state-ego": 0.08615870882825154}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0029666519165039065, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06773993968963624, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15791380167007446, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07776963710784912, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.043624072074890136, "sim_compute_performance-ego": 0.06916907787322998, "sim_compute_robot_state-ego": 0.08584633588790894}}
set_robot_commands_max0.07978865078517369
set_robot_commands_mean0.07836705737087865
set_robot_commands_median0.0781448623713325
set_robot_commands_min0.07712486313610542
sim_compute_performance-ego_max0.07540485972449892
sim_compute_performance-ego_mean0.071191150211115
sim_compute_performance-ego_median0.07223040301625322
sim_compute_performance-ego_min0.06669651410158943
sim_compute_robot_state-ego_max0.26521479031618905
sim_compute_robot_state-ego_mean0.1229192009904052
sim_compute_robot_state-ego_median0.08865005053006686
sim_compute_robot_state-ego_min0.08584633588790894
sim_compute_sim_state_max0.04501358289567251
sim_compute_sim_state_mean0.043927274299245575
sim_compute_sim_state_median0.0442464060899688
sim_compute_sim_state_min0.04193110676372752
sim_physics_max0.0034351424565390934
sim_physics_mean0.0031273984558615386
sim_physics_median0.003091002211851232
sim_physics_min0.0029666519165039065
sim_render-ego_max0.07385134115451719
sim_render-ego_mean0.07022756683482982
sim_render-ego_median0.07084873639620268
sim_render-ego_min0.06536651008269366
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
169862280FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-160070:30:41
Timeout: Waited 180 [...]
Timeout:

Waited 1803.0568063259125 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169812266Andrea Censi 🇨🇭PredictorRandomaido2-PREDstep1-simulationerrornoidsc-rudolf-160070:00:30
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
169772273Andrea Censi 🇨🇭PredictorRandomaido2-PREDstep1-simulationerrornoidsc-rudolf-160070:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible