Duckietown Challenges Home Challenges Submissions

Evaluator 2068

ID2068
evaluatorreg04-f31f3d66ff4f-1
ownerI don't have one 😀
machinearchimede
processreg04-f31f3d66ff4f-1
versiond-c:6.1.15;d-c-r:6.0.43
first heard
last heard
statusinactive
# evaluating
# success57 35590
# timeout1 35957
# failed
# error2 35944
# aborted2 35695
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
359579820Bea Baselines 🐤template-pytorchaido5-LFV-sim-testingLFVv-simtimeoutnoreg04-f31f3d66ff4f-11:05:01
I can see how the jo [...]
I can see how the job 35957 is timeout because passed 3901 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359569821Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg04-f31f3d66ff4f-10:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 165, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 633, in go
    wrap(cie)
  File "experiment_manager.py", line 618, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 294, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359449831Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-testingLFVIt-simerrornoreg04-f31f3d66ff4f-11:00:46
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359429806Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simsuccessnoreg04-f31f3d66ff4f-10:09:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5184528767834813
survival_time_median14.950000000000076
deviation-center-line_median0.5613536828720347
in-drivable-lane_median7.825000000000051


other stats
agent_compute-ego_max0.06371253410975139
agent_compute-ego_mean0.06101209163665772
agent_compute-ego_median0.06101209163665772
agent_compute-ego_min0.05831164916356405
complete-iteration_max0.5252495900789896
complete-iteration_mean0.5249963096777598
complete-iteration_median0.5249963096777598
complete-iteration_min0.5247430292765299
deviation-center-line_max0.9786410987388442
deviation-center-line_mean0.5613536828720347
deviation-center-line_min0.14406626700522515
deviation-heading_max5.109969112534788
deviation-heading_mean3.83310535562056
deviation-heading_median3.83310535562056
deviation-heading_min2.556241598706333
driven_any_max1.939163830859009
driven_any_mean1.9358587313770632
driven_any_median1.9358587313770632
driven_any_min1.932553631895118
driven_lanedir_consec_max0.5696143205468265
driven_lanedir_consec_mean0.5184528767834813
driven_lanedir_consec_min0.4672914330201361
driven_lanedir_max0.7775189380528431
driven_lanedir_mean0.6735666292998348
driven_lanedir_median0.6735666292998348
driven_lanedir_min0.5696143205468265
get_state_dump_max0.03592313528060913
get_state_dump_mean0.03495484153429667
get_state_dump_median0.03495484153429667
get_state_dump_min0.03398654778798421
get_ui_image_max0.09920247395833331
get_ui_image_mean0.09663707931836446
get_ui_image_median0.09663707931836446
get_ui_image_min0.0940716846783956
in-drivable-lane_max9.100000000000088
in-drivable-lane_mean7.825000000000051
in-drivable-lane_min6.550000000000014
per-episodes
details{"udem1-0-0-ego": {"driven_any": 1.932553631895118, "get_ui_image": 0.09920247395833331, "step_physics": 0.2331703972816467, "survival_time": 14.950000000000076, "driven_lanedir": 0.5696143205468265, "get_state_dump": 0.03398654778798421, "sim_render-ego": 0.008726335366566976, "in-drivable-lane": 9.100000000000088, "agent_compute-ego": 0.05831164916356405, "deviation-heading": 2.556241598706333, "complete-iteration": 0.5252495900789896, "set_robot_commands": 0.006463587284088135, "deviation-center-line": 0.14406626700522515, "driven_lanedir_consec": 0.5696143205468265, "sim_compute_sim_state": 0.020712144374847412, "sim_compute_performance-ego": 0.005577232837677002, "sim_compute_robot_state-ego": 0.009629093805948893, "sim_compute_robot_state-npc0": 0.010268175601959228, "sim_compute_robot_state-npc1": 0.0098608136177063, "sim_compute_robot_state-npc2": 0.009789063135782875, "sim_compute_robot_state-npc3": 0.009623864491780598, "sim_compute_robot_state-parked0": 0.009639863173166912}, "udem1-0-1-ego": {"driven_any": 1.939163830859009, "get_ui_image": 0.0940716846783956, "step_physics": 0.2307333834966024, "survival_time": 14.950000000000076, "driven_lanedir": 0.7775189380528431, "get_state_dump": 0.03592313528060913, "sim_render-ego": 0.008382413387298584, "in-drivable-lane": 6.550000000000014, "agent_compute-ego": 0.06371253410975139, "deviation-heading": 5.109969112534788, "complete-iteration": 0.5247430292765299, "set_robot_commands": 0.00643632968266805, "deviation-center-line": 0.9786410987388442, "driven_lanedir_consec": 0.4672914330201361, "sim_compute_sim_state": 0.02033652623494466, "sim_compute_performance-ego": 0.005643762747446696, "sim_compute_robot_state-ego": 0.010060649712880452, "sim_compute_robot_state-npc0": 0.009892536799112957, "sim_compute_robot_state-npc1": 0.01000277042388916, "sim_compute_robot_state-npc2": 0.009857088724772136, "sim_compute_robot_state-npc3": 0.009750154813130695, "sim_compute_robot_state-parked0": 0.009651633898417156}}
set_robot_commands_max0.006463587284088135
set_robot_commands_mean0.006449958483378092
set_robot_commands_median0.006449958483378092
set_robot_commands_min0.00643632968266805
sim_compute_performance-ego_max0.005643762747446696
sim_compute_performance-ego_mean0.0056104977925618485
sim_compute_performance-ego_median0.0056104977925618485
sim_compute_performance-ego_min0.005577232837677002
sim_compute_robot_state-ego_max0.010060649712880452
sim_compute_robot_state-ego_mean0.009844871759414672
sim_compute_robot_state-ego_median0.009844871759414672
sim_compute_robot_state-ego_min0.009629093805948893
sim_compute_robot_state-npc0_max0.010268175601959228
sim_compute_robot_state-npc0_mean0.010080356200536092
sim_compute_robot_state-npc0_median0.010080356200536092
sim_compute_robot_state-npc0_min0.009892536799112957
sim_compute_robot_state-npc1_max0.01000277042388916
sim_compute_robot_state-npc1_mean0.00993179202079773
sim_compute_robot_state-npc1_median0.00993179202079773
sim_compute_robot_state-npc1_min0.0098608136177063
sim_compute_robot_state-npc2_max0.009857088724772136
sim_compute_robot_state-npc2_mean0.009823075930277503
sim_compute_robot_state-npc2_median0.009823075930277503
sim_compute_robot_state-npc2_min0.009789063135782875
sim_compute_robot_state-npc3_max0.009750154813130695
sim_compute_robot_state-npc3_mean0.009687009652455648
sim_compute_robot_state-npc3_median0.009687009652455648
sim_compute_robot_state-npc3_min0.009623864491780598
sim_compute_robot_state-parked0_max0.009651633898417156
sim_compute_robot_state-parked0_mean0.009645748535792031
sim_compute_robot_state-parked0_median0.009645748535792031
sim_compute_robot_state-parked0_min0.009639863173166912
sim_compute_sim_state_max0.020712144374847412
sim_compute_sim_state_mean0.020524335304896037
sim_compute_sim_state_median0.020524335304896037
sim_compute_sim_state_min0.02033652623494466
sim_render-ego_max0.008726335366566976
sim_render-ego_mean0.00855437437693278
sim_render-ego_median0.00855437437693278
sim_render-ego_min0.008382413387298584
simulation-passed1
step_physics_max0.2331703972816467
step_physics_mean0.23195189038912456
step_physics_median0.23195189038912456
step_physics_min0.2307333834966024
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
359379778Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4755013638522412
survival_time_median9.925000000000006
deviation-center-line_median0.18434752309787425
in-drivable-lane_median3.450000000000021


other stats
agent_compute-ego_max0.08385247995357702
agent_compute-ego_mean0.08022153711040542
agent_compute-ego_median0.08022153711040542
agent_compute-ego_min0.07659059426723383
complete-iteration_max0.35653135918154577
complete-iteration_mean0.3497498375687329
complete-iteration_median0.3497498375687329
complete-iteration_min0.3429683159559201
deviation-center-line_max0.19094512836760308
deviation-center-line_mean0.18434752309787425
deviation-center-line_min0.17774991782814534
deviation-heading_max0.7412123865371725
deviation-heading_mean0.7135795186605717
deviation-heading_median0.7135795186605717
deviation-heading_min0.6859466507839709
driven_any_max2.329669289312401
driven_any_mean2.2976943872998845
driven_any_median2.2976943872998845
driven_any_min2.265719485287367
driven_lanedir_consec_max1.5030389559443071
driven_lanedir_consec_mean1.4755013638522412
driven_lanedir_consec_min1.4479637717601754
driven_lanedir_max1.5030389559443071
driven_lanedir_mean1.4755013638522412
driven_lanedir_median1.4755013638522412
driven_lanedir_min1.4479637717601754
get_state_dump_max0.0186409855833148
get_state_dump_mean0.017787050147684856
get_state_dump_median0.017787050147684856
get_state_dump_min0.016933114712054914
get_ui_image_max0.05814223900819436
get_ui_image_mean0.056950570675103486
get_ui_image_median0.056950570675103486
get_ui_image_min0.05575890234201261
in-drivable-lane_max3.500000000000024
in-drivable-lane_mean3.450000000000021
in-drivable-lane_min3.400000000000018
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.329669289312401, "get_ui_image": 0.05575890234201261, "step_physics": 0.12629518178429935, "survival_time": 10.100000000000009, "driven_lanedir": 1.5030389559443071, "get_state_dump": 0.0186409855833148, "sim_render-ego": 0.012077985423626286, "in-drivable-lane": 3.500000000000024, "agent_compute-ego": 0.08385247995357702, "deviation-heading": 0.7412123865371725, "complete-iteration": 0.35653135918154577, "set_robot_commands": 0.0070421601286028875, "deviation-center-line": 0.17774991782814534, "driven_lanedir_consec": 1.5030389559443071, "sim_compute_sim_state": 0.022095624763186616, "sim_compute_performance-ego": 0.008405300650266137, "sim_compute_robot_state-ego": 0.010635891763290556, "sim_compute_robot_state-parked0": 0.011504172098518598}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.265719485287367, "get_ui_image": 0.05814223900819436, "step_physics": 0.12556090232653497, "survival_time": 9.750000000000004, "driven_lanedir": 1.4479637717601754, "get_state_dump": 0.016933114712054914, "sim_render-ego": 0.008814182036962265, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.07659059426723383, "deviation-heading": 0.6859466507839709, "complete-iteration": 0.3429683159559201, "set_robot_commands": 0.00649877694936899, "deviation-center-line": 0.19094512836760308, "driven_lanedir_consec": 1.4479637717601754, "sim_compute_sim_state": 0.02366973803593562, "sim_compute_performance-ego": 0.00602875000391251, "sim_compute_robot_state-ego": 0.01057881453098395, "sim_compute_robot_state-parked0": 0.009960096310346554}}
set_robot_commands_max0.0070421601286028875
set_robot_commands_mean0.006770468538985939
set_robot_commands_median0.006770468538985939
set_robot_commands_min0.00649877694936899
sim_compute_performance-ego_max0.008405300650266137
sim_compute_performance-ego_mean0.007217025327089324
sim_compute_performance-ego_median0.007217025327089324
sim_compute_performance-ego_min0.00602875000391251
sim_compute_robot_state-ego_max0.010635891763290556
sim_compute_robot_state-ego_mean0.010607353147137254
sim_compute_robot_state-ego_median0.010607353147137254
sim_compute_robot_state-ego_min0.01057881453098395
sim_compute_robot_state-parked0_max0.011504172098518598
sim_compute_robot_state-parked0_mean0.010732134204432576
sim_compute_robot_state-parked0_median0.010732134204432576
sim_compute_robot_state-parked0_min0.009960096310346554
sim_compute_sim_state_max0.02366973803593562
sim_compute_sim_state_mean0.02288268139956112
sim_compute_sim_state_median0.02288268139956112
sim_compute_sim_state_min0.022095624763186616
sim_render-ego_max0.012077985423626286
sim_render-ego_mean0.010446083730294277
sim_render-ego_median0.010446083730294277
sim_render-ego_min0.008814182036962265
simulation-passed1
step_physics_max0.12629518178429935
step_physics_mean0.12592804205541716
step_physics_median0.12592804205541716
step_physics_min0.12556090232653497
survival_time_max10.100000000000009
survival_time_mean9.925000000000006
survival_time_min9.750000000000004
No reset possible
359359783Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5455589268072338
survival_time_median2.4249999999999994
deviation-center-line_median0.11437498744672908
in-drivable-lane_median0.8499999999999985


other stats
agent_compute-ego_max0.045199147725509384
agent_compute-ego_mean0.036493711446035554
agent_compute-ego_median0.036493711446035554
agent_compute-ego_min0.027788275166561727
complete-iteration_max0.3735646393339513
complete-iteration_mean0.3586287721792148
complete-iteration_median0.3586287721792148
complete-iteration_min0.3436929050244783
deviation-center-line_max0.1246386243322534
deviation-center-line_mean0.11437498744672908
deviation-center-line_min0.10411135056120474
deviation-heading_max0.27041081849249704
deviation-heading_mean0.26875999230405784
deviation-heading_median0.26875999230405784
deviation-heading_min0.26710916611561863
driven_any_max1.16193217979593
driven_any_mean0.94190556585777
driven_any_median0.94190556585777
driven_any_min0.7218789519196097
driven_lanedir_consec_max0.6085881804686812
driven_lanedir_consec_mean0.5455589268072338
driven_lanedir_consec_min0.4825296731457864
driven_lanedir_max0.6085881804686812
driven_lanedir_mean0.5455589268072338
driven_lanedir_median0.5455589268072338
driven_lanedir_min0.4825296731457864
get_state_dump_max0.025584895732039113
get_state_dump_mean0.02359632617336209
get_state_dump_median0.02359632617336209
get_state_dump_min0.02160775661468506
get_ui_image_max0.07099326990418516
get_ui_image_mean0.06710384872531806
get_ui_image_median0.06710384872531806
get_ui_image_min0.06321442754645097
in-drivable-lane_max1.1999999999999966
in-drivable-lane_mean0.8499999999999985
in-drivable-lane_min0.5000000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.07099326990418516, "step_physics": 0.14259528709670244, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.025584895732039113, "sim_render-ego": 0.015521259631140757, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.045199147725509384, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.3735646393339513, "set_robot_commands": 0.007683075080483647, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.026772988044609456, "sim_compute_performance-ego": 0.011006250219830012, "sim_compute_robot_state-ego": 0.016961247234021204, "sim_compute_robot_state-parked0": 0.011039527796082575}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.7218789519196097, "get_ui_image": 0.06321442754645097, "step_physics": 0.15978190773411802, "survival_time": 1.900000000000001, "driven_lanedir": 0.4825296731457864, "get_state_dump": 0.02160775661468506, "sim_render-ego": 0.008435393634595369, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.027788275166561727, "deviation-heading": 0.26710916611561863, "complete-iteration": 0.3436929050244783, "set_robot_commands": 0.01582847143474378, "deviation-center-line": 0.10411135056120474, "driven_lanedir_consec": 0.4825296731457864, "sim_compute_sim_state": 0.020749895196211964, "sim_compute_performance-ego": 0.00544743161452444, "sim_compute_robot_state-ego": 0.010285891984638414, "sim_compute_robot_state-parked0": 0.010342497574655631}}
set_robot_commands_max0.01582847143474378
set_robot_commands_mean0.011755773257613712
set_robot_commands_median0.011755773257613712
set_robot_commands_min0.007683075080483647
sim_compute_performance-ego_max0.011006250219830012
sim_compute_performance-ego_mean0.008226840917177226
sim_compute_performance-ego_median0.008226840917177226
sim_compute_performance-ego_min0.00544743161452444
sim_compute_robot_state-ego_max0.016961247234021204
sim_compute_robot_state-ego_mean0.01362356960932981
sim_compute_robot_state-ego_median0.01362356960932981
sim_compute_robot_state-ego_min0.010285891984638414
sim_compute_robot_state-parked0_max0.011039527796082575
sim_compute_robot_state-parked0_mean0.010691012685369103
sim_compute_robot_state-parked0_median0.010691012685369103
sim_compute_robot_state-parked0_min0.010342497574655631
sim_compute_sim_state_max0.026772988044609456
sim_compute_sim_state_mean0.02376144162041071
sim_compute_sim_state_median0.02376144162041071
sim_compute_sim_state_min0.020749895196211964
sim_render-ego_max0.015521259631140757
sim_render-ego_mean0.011978326632868064
sim_render-ego_median0.011978326632868064
sim_render-ego_min0.008435393634595369
simulation-passed1
step_physics_max0.15978190773411802
step_physics_mean0.15118859741541024
step_physics_median0.15118859741541024
step_physics_min0.14259528709670244
survival_time_max2.9499999999999975
survival_time_mean2.4249999999999994
survival_time_min1.900000000000001
No reset possible
359276728Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359236760Anthony Courchesne 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359156783Jiaxu Xingtemplate-randomaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359106801Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
359036804Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358966814Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358896821Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358806827Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358736832Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358676841Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358606845Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358546851Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358519228Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358439234Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358369236Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358339243Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358269248Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358219255Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358159261Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358089272Liam Paull 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
358039275Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357969279Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg04-f31f3d66ff4f-10:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357929286Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357879288Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357809299Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357749302Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357699309Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357629313Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357569317Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357499325Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357429329Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357389334Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357319336Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357259342Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357209357Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357129362Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357059364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
357019372Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356959377Jerome Labonte 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simabortednoreg04-f31f3d66ff4f-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356919381Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356859383Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356799388Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356739389Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356679393Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356619394Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356549693Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356499739Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simsuccessnoreg04-f31f3d66ff4f-10:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356459740Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simsuccessnoreg04-f31f3d66ff4f-10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356409752Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356319757Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simsuccessnoreg04-f31f3d66ff4f-10:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356269756Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356189762Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356109771Frank (Chude) Qian 🇨🇦template-tensorflowaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
356009768Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355969775Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
355909780Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg04-f31f3d66ff4f-10:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible