Duckietown Challenges Home Challenges Submissions

Evaluator 5254

ID5254
evaluatornogpu-production-b-spot-0-08
ownerI don't have one 😀
machinenogpu-production-b-spot-0_228a61c7e56b
processnogpu-production-b-spot-0-08_228a61c7e56b
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success14 77149
# timeout
# failed
# error1 77865
# aborted1 77292
# host-error2 77353
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors98%
RAM total (MB)184.7 GB
RAM free (MB)151.0 GB
Disk (MB)969.3 GB
Disk available (MB)292.1 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7786514795Bea Baselines 🐤baseline-duckietownaido-LFP-real-validationeval1-visualizeerrornonogpu-production-b-spot-0-080:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
    raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
zuper_commons.types.exceptions.ZValueError: Cannot find field 'x' in data for class FriendlyPose and no default available
│  anns: {x: float, y: float, theta_deg: float}
│     T: float
│ known: [data, dtype, shape]
│     f: Field(name='x',type=<class 'float'>,default=<dataclasses._MISSING_TYPE object at 0x7fdd8cd573d0>,default_factory=<dataclasses._MISSING_TYPE object at 0x7fdd8cd573d0>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'pose' of RobotConfiguration.
│ K_annotations: dict[2]
│                │ pose:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│                │ velocity:
│                │ dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │  field         x : float
│                │  field         y : float
│                │  field theta_deg : float
│   expect_type: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.FriendlyPose
│                 field         x : float
│                 field         y : float
│                 field theta_deg : float
│        K_name: RobotConfiguration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 177, in object_from_ipce_
    return object_from_ipce_dict(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 461, in object_from_ipce_dict
    attrs[k] = object_from_ipce_(v, et_V, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'configuration' of ScenarioRobotSpec.
│ K_annotations: dict[5]
│                │ configuration:
│                │ dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                │  field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │  field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                │                    field         x : float
│                │                    field         y : float
│                │                    field theta_deg : float
│                │ color: str
│                │ description: str
│                │ controllable: bool
│                │ protocol: Optional[ProtocolDesc ]
│   expect_type: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│         ann_K: dataclass aido_schemas.protocol_simulator.RobotConfiguration
│                 field     pose : dataclass aido_schemas.protocol_simulator.FriendlyPose
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│                 field velocity : dataclass aido_schemas.protocol_simulator.FriendlyVelocity
│                                   field         x : float
│                                   field         y : float
│                                   field theta_deg : float
│        K_name: ScenarioRobotSpec

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
    raise ZValueError(
zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'robots' of Scenario.
│ K_annotations: dict[6]
│                │ scenario_name: str
│                │ environment: Any
│                │ player_robots: List[str]
│                │ robots: Dict[str,ScenarioRobotSpec]
│                │ duckies: Dict[str,ScenarioDuckieSpec]
│                │ payload_yaml: str
│   expect_type: Dict[str,ScenarioRobotSpec]
│         ann_K: Dict[str,ScenarioRobotSpec]
│        K_name: Scenario

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 122, in evaluate_robotarium_log
    scenario = cast(Scenario, object_from_ipce(config_, Scenario))
  File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.protocol_simulator.Scenario
│               field scenario_name : str
│               field   environment : Any
│               field player_robots : List[str]
│               field        robots : Dict[str,ScenarioRobotSpec]
│               field       duckies : Dict[str,ScenarioDuckieSpec]
│               field  payload_yaml : str
│          mj: dict[5]
│              │ robots:
│              │ dict[1]
│              │ │ ego0:
│              │ │ dict[5]
│              │ │ │ color: red
│              │ │ │ protocol: PROTOCOL_NORMAL
│              │ │ │ description: Playable robot ego0
│              │ │ │ controllable: True
│              │ │ │ configuration:
│              │ │ │ dict[2]
│              │ │ │ │ pose: {data: 72 bytes b'\xfc\xd1u\xe6\xec,\xa7\xbc\x00\x00', dtype: float64, shape: [3, 3]}
│              │ │ │ │ velocity: {data: 72 bytes b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', dtype: float64, shape: [3, 3]}
│              │ duckies:
│              │ dict[10]
│              │ │ duckie00:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'\xde\xfb2\xcb\x15\x0c\xe2\xbf;\x95', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie01: {pose: {data: 72 bytes b'I\xa8\xaaF\\^\xeb\xbf\xffI', dtype: float64, shape: [3, 3]} , color: yellow}
│              │ │ duckie02: {pose: {data: 72 bytes b'\x0eA:Tl\xa4\xe7\xbf\xe9/', dtype: float64, shape: [3, 3]} , color: yellow}
│              │ │ duckie03:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'\x08\x94\xb2\xfa\xa8\xa0\xd4\xbf\x9d%', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie04:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'\xe8\x99\xf4S\xfb&\xb9\xbfa\x18', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie05: {pose: {data: 72 bytes b'\xa1\x12ud\xb9\xe0\xb7?Ag', dtype: float64, shape: [3, 3]} , color: yellow}
│              │ │ duckie06:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'\xe6\xd8\x89\xba\x05W\xed\xbf\xc4\xa6', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie07:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'7\xdd\x9b6\xa3I\xef\xbf\xab\xcf', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie08:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'`O\x9c\x03\xa6^\xe4\xbf\x1eQ', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ │ duckie09:
│              │ │ dict[2]
│              │ │ │ pose: {data: 72 bytes b'\xa6\xca\xbb\x82E\xaf\xeb?K\xe4', dtype: float64, shape: [3, 3]}
│              │ │ │ color: yellow
│              │ environment:
│              │ |objects:
│              │ |  tag334:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.647
│              │ |        - 1.708
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 334
│              │ |  tag335:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.2229999999999999
│              │ |        - 2.282
│              │ |        theta_deg: 180
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 335
│              │ |  tag336:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.202
│              │ |        - 2.7929999999999997
│              │ |        theta_deg: 315
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 336
│              │ |  tag337:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.698
│              │ |        - 1.8079999999999998
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 337
│              │ |  tag338:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.696
│              │ |        - 1.116
│              │ |        theta_deg: 90
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 338
│              │ |  tag339:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 1.222
│              │ |        - 0.647
│              │ |        theta_deg: 0
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 339
│              │ |  tag340:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 2.1959999999999997
│              │ |        - 0.155
│              │ |        theta_deg: 225
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 340
│              │ |  tag341:
│              │ |    kind: floor_tag
│              │ |    pose:
│              │ |      ~SE2Transform:
│              │ |        p:
│              │ |        - 0.648
│              │ |        - 1.2229999999999999
│              │ |        theta_deg: 270
│              │ |    tag:
│              │ |      ~TagInstance:
│              │ |        family: 36h11
│              │ |        size: 0.08
│              │ |        tag_id: 341
│              │ |tile_size: 0.585
│              │ |tiles:
│              │ |- - asphalt
│              │ |  - curve_left/W
│              │ |  - straight/W
│              │ |  - curve_left/N
│              │ |- - curve_left/W
│              │ |  - curve_right/S
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - straight/S
│              │ |  - asphalt
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - curve_left/S
│              │ |  - curve_right/E
│              │ |  - asphalt
│              │ |  - straight/N
│              │ |- - asphalt
│              │ |  - curve_left/S
│              │ |  - straight/E
│              │ |  - curve_left/E
│              │ |
│              │ player_robots: [ego0]
│              │ scenario_name: LFP-real-validation-001

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7777715726Haridas P Texercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-080:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8077686775955895


other stats
agent_compute-ego0_max0.010966799580133878
agent_compute-ego0_mean0.010966799580133878
agent_compute-ego0_median0.010966799580133878
agent_compute-ego0_min0.010966799580133878
complete-iteration_max0.24530632679279035
complete-iteration_mean0.24530632679279035
complete-iteration_median0.24530632679279035
complete-iteration_min0.24530632679279035
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8077686775955895
distance-from-start_median0.8077686775955895
distance-from-start_min0.8077686775955895
driven_any_max0.8289448533436626
driven_any_mean0.8289448533436626
driven_any_median0.8289448533436626
driven_any_min0.8289448533436626
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0776603680390578
get_duckie_state_mean0.0776603680390578
get_duckie_state_median0.0776603680390578
get_duckie_state_min0.0776603680390578
get_robot_state_max0.0037025614426686214
get_robot_state_mean0.0037025614426686214
get_robot_state_median0.0037025614426686214
get_robot_state_min0.0037025614426686214
get_state_dump_max0.01630060260112469
get_state_dump_mean0.01630060260112469
get_state_dump_median0.01630060260112469
get_state_dump_min0.01630060260112469
get_ui_image_max0.03961252249204195
get_ui_image_mean0.03961252249204195
get_ui_image_median0.03961252249204195
get_ui_image_min0.03961252249204195
in-drivable-lane_max10.350000000000012
in-drivable-lane_mean10.350000000000012
in-drivable-lane_median10.350000000000012
in-drivable-lane_min10.350000000000012
per-episodes
details{"d40-ego0": {"driven_any": 0.8289448533436626, "get_ui_image": 0.03961252249204195, "step_physics": 0.0794320679627932, "survival_time": 10.350000000000012, "driven_lanedir": 0.0, "get_state_dump": 0.01630060260112469, "get_robot_state": 0.0037025614426686214, "sim_render-ego0": 0.0036260886834217953, "get_duckie_state": 0.0776603680390578, "in-drivable-lane": 10.350000000000012, "deviation-heading": 0.0, "agent_compute-ego0": 0.010966799580133878, "complete-iteration": 0.24530632679279035, "set_robot_commands": 0.002170671637241657, "distance-from-start": 0.8077686775955895, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00987281478368319, "sim_compute_performance-ego0": 0.0018500204269702616}}
set_robot_commands_max0.002170671637241657
set_robot_commands_mean0.002170671637241657
set_robot_commands_median0.002170671637241657
set_robot_commands_min0.002170671637241657
sim_compute_performance-ego0_max0.0018500204269702616
sim_compute_performance-ego0_mean0.0018500204269702616
sim_compute_performance-ego0_median0.0018500204269702616
sim_compute_performance-ego0_min0.0018500204269702616
sim_compute_sim_state_max0.00987281478368319
sim_compute_sim_state_mean0.00987281478368319
sim_compute_sim_state_median0.00987281478368319
sim_compute_sim_state_min0.00987281478368319
sim_render-ego0_max0.0036260886834217953
sim_render-ego0_mean0.0036260886834217953
sim_render-ego0_median0.0036260886834217953
sim_render-ego0_min0.0036260886834217953
simulation-passed1
step_physics_max0.0794320679627932
step_physics_mean0.0794320679627932
step_physics_median0.0794320679627932
step_physics_min0.0794320679627932
survival_time_max10.350000000000012
survival_time_mean10.350000000000012
survival_time_median10.350000000000012
survival_time_min10.350000000000012
No reset possible
7762615678Haydar Talibexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-080:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.44634077504477


other stats
agent_compute-ego0_max0.010964222576307216
agent_compute-ego0_mean0.010964222576307216
agent_compute-ego0_median0.010964222576307216
agent_compute-ego0_min0.010964222576307216
complete-iteration_max0.30099368465613136
complete-iteration_mean0.30099368465613136
complete-iteration_median0.30099368465613136
complete-iteration_min0.30099368465613136
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.44634077504477
distance-from-start_median1.44634077504477
distance-from-start_min1.44634077504477
driven_any_max1.451525820285056
driven_any_mean1.451525820285056
driven_any_median1.451525820285056
driven_any_min1.451525820285056
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.11692267841433888
get_duckie_state_mean0.11692267841433888
get_duckie_state_median0.11692267841433888
get_duckie_state_min0.11692267841433888
get_robot_state_max0.003688236941461978
get_robot_state_mean0.003688236941461978
get_robot_state_median0.003688236941461978
get_robot_state_min0.003688236941461978
get_state_dump_max0.021712785922222255
get_state_dump_mean0.021712785922222255
get_state_dump_median0.021712785922222255
get_state_dump_min0.021712785922222255
get_ui_image_max0.0440680269869218
get_ui_image_mean0.0440680269869218
get_ui_image_median0.0440680269869218
get_ui_image_min0.0440680269869218
in-drivable-lane_max16.050000000000093
in-drivable-lane_mean16.050000000000093
in-drivable-lane_median16.050000000000093
in-drivable-lane_min16.050000000000093
per-episodes
details{"d60-ego0": {"driven_any": 1.451525820285056, "get_ui_image": 0.0440680269869218, "step_physics": 0.08624000801062733, "survival_time": 16.050000000000093, "driven_lanedir": 0.0, "get_state_dump": 0.021712785922222255, "get_robot_state": 0.003688236941461978, "sim_render-ego0": 0.0036131165782857383, "get_duckie_state": 0.11692267841433888, "in-drivable-lane": 16.050000000000093, "deviation-heading": 0.0, "agent_compute-ego0": 0.010964222576307216, "complete-iteration": 0.30099368465613136, "set_robot_commands": 0.002035242430171611, "distance-from-start": 1.44634077504477, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009792457456174105, "sim_compute_performance-ego0": 0.0018566683952852803}}
set_robot_commands_max0.002035242430171611
set_robot_commands_mean0.002035242430171611
set_robot_commands_median0.002035242430171611
set_robot_commands_min0.002035242430171611
sim_compute_performance-ego0_max0.0018566683952852803
sim_compute_performance-ego0_mean0.0018566683952852803
sim_compute_performance-ego0_median0.0018566683952852803
sim_compute_performance-ego0_min0.0018566683952852803
sim_compute_sim_state_max0.009792457456174105
sim_compute_sim_state_mean0.009792457456174105
sim_compute_sim_state_median0.009792457456174105
sim_compute_sim_state_min0.009792457456174105
sim_render-ego0_max0.0036131165782857383
sim_render-ego0_mean0.0036131165782857383
sim_render-ego0_median0.0036131165782857383
sim_render-ego0_min0.0036131165782857383
simulation-passed1
step_physics_max0.08624000801062733
step_physics_mean0.08624000801062733
step_physics_median0.08624000801062733
step_physics_min0.08624000801062733
survival_time_max16.050000000000093
survival_time_mean16.050000000000093
survival_time_median16.050000000000093
survival_time_min16.050000000000093
No reset possible
7759615664riccardo maggioniexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-080:09:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.752391865831688


other stats
agent_compute-ego0_max0.010456050181674233
agent_compute-ego0_mean0.010456050181674233
agent_compute-ego0_median0.010456050181674233
agent_compute-ego0_min0.010456050181674233
complete-iteration_max0.2530915145645723
complete-iteration_mean0.2530915145645723
complete-iteration_median0.2530915145645723
complete-iteration_min0.2530915145645723
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.752391865831688
distance-from-start_median2.752391865831688
distance-from-start_min2.752391865831688
driven_any_max3.278834805613151
driven_any_mean3.278834805613151
driven_any_median3.278834805613151
driven_any_min3.278834805613151
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08733949048993896
get_duckie_state_mean0.08733949048993896
get_duckie_state_median0.08733949048993896
get_duckie_state_min0.08733949048993896
get_robot_state_max0.003607872910027405
get_robot_state_mean0.003607872910027405
get_robot_state_median0.003607872910027405
get_robot_state_min0.003607872910027405
get_state_dump_max0.017397885483419025
get_state_dump_mean0.017397885483419025
get_state_dump_median0.017397885483419025
get_state_dump_min0.017397885483419025
get_ui_image_max0.040137804112315045
get_ui_image_mean0.040137804112315045
get_ui_image_median0.040137804112315045
get_ui_image_min0.040137804112315045
in-drivable-lane_max45.89999999999953
in-drivable-lane_mean45.89999999999953
in-drivable-lane_median45.89999999999953
in-drivable-lane_min45.89999999999953
per-episodes
details{"d45-ego0": {"driven_any": 3.278834805613151, "get_ui_image": 0.040137804112315045, "step_physics": 0.07845678137487634, "survival_time": 45.89999999999953, "driven_lanedir": 0.0, "get_state_dump": 0.017397885483419025, "get_robot_state": 0.003607872910027405, "sim_render-ego0": 0.003448182532525296, "get_duckie_state": 0.08733949048993896, "in-drivable-lane": 45.89999999999953, "deviation-heading": 0.0, "agent_compute-ego0": 0.010456050181674233, "complete-iteration": 0.2530915145645723, "set_robot_commands": 0.0020307905655820428, "distance-from-start": 2.752391865831688, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008262128902597188, "sim_compute_performance-ego0": 0.0018554735235602345}}
set_robot_commands_max0.0020307905655820428
set_robot_commands_mean0.0020307905655820428
set_robot_commands_median0.0020307905655820428
set_robot_commands_min0.0020307905655820428
sim_compute_performance-ego0_max0.0018554735235602345
sim_compute_performance-ego0_mean0.0018554735235602345
sim_compute_performance-ego0_median0.0018554735235602345
sim_compute_performance-ego0_min0.0018554735235602345
sim_compute_sim_state_max0.008262128902597188
sim_compute_sim_state_mean0.008262128902597188
sim_compute_sim_state_median0.008262128902597188
sim_compute_sim_state_min0.008262128902597188
sim_render-ego0_max0.003448182532525296
sim_render-ego0_mean0.003448182532525296
sim_render-ego0_median0.003448182532525296
sim_render-ego0_min0.003448182532525296
simulation-passed1
step_physics_max0.07845678137487634
step_physics_mean0.07845678137487634
step_physics_median0.07845678137487634
step_physics_min0.07845678137487634
survival_time_max45.89999999999953
survival_time_mean45.89999999999953
survival_time_median45.89999999999953
survival_time_min45.89999999999953
No reset possible
7750515643Awni Altabaaexercises_braitenbergaido-LFI-full-sim-validationsim-2of4successnonogpu-production-b-spot-0-080:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7750115643Awni Altabaaexercises_braitenbergaido-LFI-full-sim-validationsim-2of4successnonogpu-production-b-spot-0-080:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7749315643Awni Altabaaexercises_braitenbergaido-LFI-full-sim-validationsim-3of4successnonogpu-production-b-spot-0-080:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7749015642Awni Altabaaexercises_braitenbergaido-LFI-full-sim-testingsim-2of4successnonogpu-production-b-spot-0-080:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7741515607Liam Paull 🇨🇦objdet exercisemooc-visservoingsimsuccessnonogpu-production-b-spot-0-080:14:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.899999999999448
deviation-center-line_median4.763522637209633
driven_lanedir_consec_median5.420484394531957
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.023486397447038152
agent_compute-ego0_mean0.01983993635090265
agent_compute-ego0_median0.01983993635090265
agent_compute-ego0_min0.016193475254767147
complete-iteration_max0.1402110767602722
complete-iteration_mean0.13930718100735984
complete-iteration_median0.13930718100735984
complete-iteration_min0.13840328525444748
deviation-center-line_max5.340632304718403
deviation-center-line_mean4.763522637209633
deviation-center-line_min4.186412969700863
deviation-heading_max7.653326100238271
deviation-heading_mean5.7782375781274355
deviation-heading_median5.7782375781274355
deviation-heading_min3.9031490560166
distance-from-start_max1.5323801436181732
distance-from-start_mean1.2847634284570906
distance-from-start_median1.2847634284570906
distance-from-start_min1.0371467132960082
driven_any_max7.920860694378992
driven_any_mean7.917701108309985
driven_any_median7.917701108309985
driven_any_min7.914541522240978
driven_lanedir_consec_max6.525757516077108
driven_lanedir_consec_mean5.420484394531957
driven_lanedir_consec_min4.315211272986808
driven_lanedir_max6.525757516077108
driven_lanedir_mean5.420484394531957
driven_lanedir_median5.420484394531957
driven_lanedir_min4.315211272986808
get_duckie_state_max1.3846541126006648e-06
get_duckie_state_mean1.3643061489387913e-06
get_duckie_state_median1.3643061489387913e-06
get_duckie_state_min1.3439581852769175e-06
get_robot_state_max0.0033692779588659636
get_robot_state_mean0.003356843467159732
get_robot_state_median0.003356843467159732
get_robot_state_min0.0033444089754535
get_state_dump_max0.004395538722347161
get_state_dump_mean0.0043590627641701685
get_state_dump_median0.0043590627641701685
get_state_dump_min0.004322586805993175
get_ui_image_max0.04003622966642483
get_ui_image_mean0.03993988652511203
get_ui_image_median0.03993988652511203
get_ui_image_min0.039843543383799224
in-drivable-lane_max26.549999999999137
in-drivable-lane_mean17.899999999999448
in-drivable-lane_min9.249999999999758
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 7.920860694378992, "get_ui_image": 0.04003622966642483, "step_physics": 0.05835659497981266, "survival_time": 59.99999999999873, "driven_lanedir": 4.315211272986808, "get_state_dump": 0.004322586805993175, "get_robot_state": 0.0033444089754535, "sim_render-ego0": 0.003324241066455444, "get_duckie_state": 1.3439581852769175e-06, "in-drivable-lane": 26.549999999999137, "deviation-heading": 3.9031490560166, "agent_compute-ego0": 0.023486397447038152, "complete-iteration": 0.1402110767602722, "set_robot_commands": 0.0020133394881350908, "distance-from-start": 1.0371467132960082, "deviation-center-line": 4.186412969700863, "driven_lanedir_consec": 4.315211272986808, "sim_compute_sim_state": 0.0035384149972247044, "sim_compute_performance-ego0": 0.0017021097410330666}, "LF-small-loop-001-ego0": {"driven_any": 7.914541522240978, "get_ui_image": 0.039843543383799224, "step_physics": 0.06374562372275931, "survival_time": 59.99999999999873, "driven_lanedir": 6.525757516077108, "get_state_dump": 0.004395538722347161, "get_robot_state": 0.0033692779588659636, "sim_render-ego0": 0.003352215248381069, "get_duckie_state": 1.3846541126006648e-06, "in-drivable-lane": 9.249999999999758, "deviation-heading": 7.653326100238271, "agent_compute-ego0": 0.016193475254767147, "complete-iteration": 0.13840328525444748, "set_robot_commands": 0.0020394664719936553, "distance-from-start": 1.5323801436181732, "deviation-center-line": 5.340632304718403, "driven_lanedir_consec": 6.525757516077108, "sim_compute_sim_state": 0.003626485152804385, "sim_compute_performance-ego0": 0.0017480125633703482}}
set_robot_commands_max0.0020394664719936553
set_robot_commands_mean0.002026402980064373
set_robot_commands_median0.002026402980064373
set_robot_commands_min0.0020133394881350908
sim_compute_performance-ego0_max0.0017480125633703482
sim_compute_performance-ego0_mean0.0017250611522017074
sim_compute_performance-ego0_median0.0017250611522017074
sim_compute_performance-ego0_min0.0017021097410330666
sim_compute_sim_state_max0.003626485152804385
sim_compute_sim_state_mean0.003582450075014545
sim_compute_sim_state_median0.003582450075014545
sim_compute_sim_state_min0.0035384149972247044
sim_render-ego0_max0.003352215248381069
sim_render-ego0_mean0.0033382281574182568
sim_render-ego0_median0.0033382281574182568
sim_render-ego0_min0.003324241066455444
simulation-passed1
step_physics_max0.06374562372275931
step_physics_mean0.061051109351285986
step_physics_median0.061051109351285986
step_physics_min0.05835659497981266
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
7738915593Roberto Bochettemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-080:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01499176025390625
agent_compute-ego0_mean0.01499176025390625
agent_compute-ego0_median0.01499176025390625
agent_compute-ego0_min0.01499176025390625
complete-iteration_max0.12066087939522484
complete-iteration_mean0.12066087939522484
complete-iteration_median0.12066087939522484
complete-iteration_min0.12066087939522484
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.0039005171168934216
get_duckie_state_mean0.0039005171168934216
get_duckie_state_median0.0039005171168934216
get_duckie_state_min0.0039005171168934216
get_robot_state_max0.0032081333073702726
get_robot_state_mean0.0032081333073702726
get_robot_state_median0.0032081333073702726
get_robot_state_min0.0032081333073702726
get_state_dump_max0.004627953876148571
get_state_dump_mean0.004627953876148571
get_state_dump_median0.004627953876148571
get_state_dump_min0.004627953876148571
get_ui_image_max0.022638608108867295
get_ui_image_mean0.022638608108867295
get_ui_image_median0.022638608108867295
get_ui_image_min0.022638608108867295
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.022638608108867295, "step_physics": 0.05977653915231878, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.004627953876148571, "get_robot_state": 0.0032081333073702726, "sim_render-ego0": 0.0033563538031144576, "get_duckie_state": 0.0039005171168934216, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01499176025390625, "complete-iteration": 0.12066087939522484, "set_robot_commands": 0.0019409331408413973, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004370239647951993, "sim_compute_performance-ego0": 0.0017539262771606443}}
set_robot_commands_max0.0019409331408413973
set_robot_commands_mean0.0019409331408413973
set_robot_commands_median0.0019409331408413973
set_robot_commands_min0.0019409331408413973
sim_compute_performance-ego0_max0.0017539262771606443
sim_compute_performance-ego0_mean0.0017539262771606443
sim_compute_performance-ego0_median0.0017539262771606443
sim_compute_performance-ego0_min0.0017539262771606443
sim_compute_sim_state_max0.004370239647951993
sim_compute_sim_state_mean0.004370239647951993
sim_compute_sim_state_median0.004370239647951993
sim_compute_sim_state_min0.004370239647951993
sim_render-ego0_max0.0033563538031144576
sim_render-ego0_mean0.0033563538031144576
sim_render-ego0_median0.0033563538031144576
sim_render-ego0_min0.0033563538031144576
simulation-passed1
step_physics_max0.05977653915231878
step_physics_mean0.05977653915231878
step_physics_median0.05977653915231878
step_physics_min0.05977653915231878
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7737515585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-0of4host-errornonogpu-production-b-spot-0-080:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7735315585Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validationsim-2of4host-errornonogpu-production-b-spot-0-080:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7729213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-0-080:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7723515577Adriano Almeidatemplate-randommooc-objdetsimsuccessnonogpu-production-b-spot-0-080:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.250000000000252
driven_lanedir_consec_median2.7643259633965593


other stats
agent_compute-ego0_max0.011654660976705204
agent_compute-ego0_mean0.01157567541047028
agent_compute-ego0_median0.01157567541047028
agent_compute-ego0_min0.011496689844235356
complete-iteration_max0.2147922723641323
complete-iteration_mean0.21405975554290704
complete-iteration_median0.21405975554290704
complete-iteration_min0.2133272387216818
deviation-center-line_max0.6742775393186135
deviation-center-line_mean0.4924668146429858
deviation-center-line_median0.4924668146429858
deviation-center-line_min0.3106560899673582
deviation-heading_max1.446137875740923
deviation-heading_mean1.1690948785052022
deviation-heading_median1.1690948785052022
deviation-heading_min0.8920518812694817
distance-from-start_max13.040328082409216
distance-from-start_mean11.421530719906269
distance-from-start_median11.421530719906269
distance-from-start_min9.802733357403325
driven_any_max13.76149288628964
driven_any_mean11.861708296669304
driven_any_median11.861708296669304
driven_any_min9.961923707048967
driven_lanedir_consec_max3.6097693844991263
driven_lanedir_consec_mean2.7643259633965593
driven_lanedir_consec_min1.918882542293992
driven_lanedir_max3.6097693844991263
driven_lanedir_mean2.7643259633965593
driven_lanedir_median2.7643259633965593
driven_lanedir_min1.918882542293992
get_duckie_state_max0.019854355762355134
get_duckie_state_mean0.01950612528918469
get_duckie_state_median0.01950612528918469
get_duckie_state_min0.01915789481601424
get_robot_state_max0.0035109742181184357
get_robot_state_mean0.003468970530950042
get_robot_state_median0.003468970530950042
get_robot_state_min0.003426966843781648
get_state_dump_max0.0074073058068103
get_state_dump_mean0.007396058763787761
get_state_dump_median0.007396058763787761
get_state_dump_min0.007384811720765221
get_ui_image_max0.05717804571275274
get_ui_image_mean0.056704454324068426
get_ui_image_median0.056704454324068426
get_ui_image_min0.05623086293538412
in-drivable-lane_max22.90000000000029
in-drivable-lane_mean20.55000000000023
in-drivable-lane_median20.55000000000023
in-drivable-lane_min18.200000000000173
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 9.961923707048967, "get_ui_image": 0.05623086293538412, "step_physics": 0.07989126093247358, "survival_time": 22.90000000000019, "driven_lanedir": 1.918882542293992, "get_state_dump": 0.0074073058068103, "get_robot_state": 0.003426966843781648, "sim_render-ego0": 0.0035330335039458764, "get_duckie_state": 0.01915789481601424, "in-drivable-lane": 18.200000000000173, "deviation-heading": 0.8920518812694817, "agent_compute-ego0": 0.011496689844235356, "complete-iteration": 0.2147922723641323, "set_robot_commands": 0.0019606972571811383, "distance-from-start": 9.802733357403325, "deviation-center-line": 0.3106560899673582, "driven_lanedir_consec": 1.918882542293992, "sim_compute_sim_state": 0.029660257119239027, "sim_compute_performance-ego0": 0.0019243288144047224}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 13.76149288628964, "get_ui_image": 0.05717804571275274, "step_physics": 0.07580845465215649, "survival_time": 31.60000000000031, "driven_lanedir": 3.6097693844991263, "get_state_dump": 0.007384811720765221, "get_robot_state": 0.0035109742181184357, "sim_render-ego0": 0.0036092700928120063, "get_duckie_state": 0.019854355762355134, "in-drivable-lane": 22.90000000000029, "deviation-heading": 1.446137875740923, "agent_compute-ego0": 0.011654660976705204, "complete-iteration": 0.2133272387216818, "set_robot_commands": 0.002080940333964512, "distance-from-start": 13.040328082409216, "deviation-center-line": 0.6742775393186135, "driven_lanedir_consec": 3.6097693844991263, "sim_compute_sim_state": 0.030171121277892007, "sim_compute_performance-ego0": 0.0019834889054863372}}
set_robot_commands_max0.002080940333964512
set_robot_commands_mean0.0020208187955728252
set_robot_commands_median0.0020208187955728252
set_robot_commands_min0.0019606972571811383
sim_compute_performance-ego0_max0.0019834889054863372
sim_compute_performance-ego0_mean0.0019539088599455296
sim_compute_performance-ego0_median0.0019539088599455296
sim_compute_performance-ego0_min0.0019243288144047224
sim_compute_sim_state_max0.030171121277892007
sim_compute_sim_state_mean0.029915689198565517
sim_compute_sim_state_median0.029915689198565517
sim_compute_sim_state_min0.029660257119239027
sim_render-ego0_max0.0036092700928120063
sim_render-ego0_mean0.003571151798378942
sim_render-ego0_median0.003571151798378942
sim_render-ego0_min0.0035330335039458764
simulation-passed1
step_physics_max0.07989126093247358
step_physics_mean0.07784985779231504
step_physics_median0.07784985779231504
step_physics_min0.07580845465215649
survival_time_max31.60000000000031
survival_time_mean27.250000000000252
survival_time_min22.90000000000019
No reset possible
7722915536Umang Agrawaltemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-080:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011897731911052357
agent_compute-ego0_mean0.011897731911052357
agent_compute-ego0_median0.011897731911052357
agent_compute-ego0_min0.011897731911052357
complete-iteration_max0.1387154134837064
complete-iteration_mean0.1387154134837064
complete-iteration_median0.1387154134837064
complete-iteration_min0.1387154134837064
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004494683309034867
get_duckie_state_mean0.004494683309034867
get_duckie_state_median0.004494683309034867
get_duckie_state_min0.004494683309034867
get_robot_state_max0.003798804499886253
get_robot_state_mean0.003798804499886253
get_robot_state_median0.003798804499886253
get_robot_state_min0.003798804499886253
get_state_dump_max0.0056009671904824
get_state_dump_mean0.0056009671904824
get_state_dump_median0.0056009671904824
get_state_dump_min0.0056009671904824
get_ui_image_max0.02594942938197743
get_ui_image_mean0.02594942938197743
get_ui_image_median0.02594942938197743
get_ui_image_min0.02594942938197743
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02594942938197743, "step_physics": 0.0737874995578419, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0056009671904824, "get_robot_state": 0.003798804499886253, "sim_render-ego0": 0.003773353316567161, "get_duckie_state": 0.004494683309034867, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011897731911052357, "complete-iteration": 0.1387154134837064, "set_robot_commands": 0.002318105914375999, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005005300045013428, "sim_compute_performance-ego0": 0.0019985870881514115}}
set_robot_commands_max0.002318105914375999
set_robot_commands_mean0.002318105914375999
set_robot_commands_median0.002318105914375999
set_robot_commands_min0.002318105914375999
sim_compute_performance-ego0_max0.0019985870881514115
sim_compute_performance-ego0_mean0.0019985870881514115
sim_compute_performance-ego0_median0.0019985870881514115
sim_compute_performance-ego0_min0.0019985870881514115
sim_compute_sim_state_max0.005005300045013428
sim_compute_sim_state_mean0.005005300045013428
sim_compute_sim_state_median0.005005300045013428
sim_compute_sim_state_min0.005005300045013428
sim_render-ego0_max0.003773353316567161
sim_render-ego0_mean0.003773353316567161
sim_render-ego0_median0.003773353316567161
sim_render-ego0_min0.003773353316567161
simulation-passed1
step_physics_max0.0737874995578419
step_physics_mean0.0737874995578419
step_physics_median0.0737874995578419
step_physics_min0.0737874995578419
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7722315541Jackson Glunktemplate-randomaido-hello-sim-validation370successyesnogpu-production-b-spot-0-080:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.011383267966183748
agent_compute-ego0_mean0.011383267966183748
agent_compute-ego0_median0.011383267966183748
agent_compute-ego0_min0.011383267966183748
complete-iteration_max0.14057621630755338
complete-iteration_mean0.14057621630755338
complete-iteration_median0.14057621630755338
complete-iteration_min0.14057621630755338
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004540866071527655
get_duckie_state_mean0.004540866071527655
get_duckie_state_median0.004540866071527655
get_duckie_state_min0.004540866071527655
get_robot_state_max0.0036605650728399105
get_robot_state_mean0.0036605650728399105
get_robot_state_median0.0036605650728399105
get_robot_state_min0.0036605650728399105
get_state_dump_max0.005755039778622714
get_state_dump_mean0.005755039778622714
get_state_dump_median0.005755039778622714
get_state_dump_min0.005755039778622714
get_ui_image_max0.02603192221034657
get_ui_image_mean0.02603192221034657
get_ui_image_median0.02603192221034657
get_ui_image_min0.02603192221034657
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02603192221034657, "step_physics": 0.07621562480926514, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005755039778622714, "get_robot_state": 0.0036605650728399105, "sim_render-ego0": 0.00369925932450728, "get_duckie_state": 0.004540866071527655, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.011383267966183748, "complete-iteration": 0.14057621630755338, "set_robot_commands": 0.002271402965892445, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004994522441517223, "sim_compute_performance-ego0": 0.0019329948858781297}}
set_robot_commands_max0.002271402965892445
set_robot_commands_mean0.002271402965892445
set_robot_commands_median0.002271402965892445
set_robot_commands_min0.002271402965892445
sim_compute_performance-ego0_max0.0019329948858781297
sim_compute_performance-ego0_mean0.0019329948858781297
sim_compute_performance-ego0_median0.0019329948858781297
sim_compute_performance-ego0_min0.0019329948858781297
sim_compute_sim_state_max0.004994522441517223
sim_compute_sim_state_mean0.004994522441517223
sim_compute_sim_state_median0.004994522441517223
sim_compute_sim_state_min0.004994522441517223
sim_render-ego0_max0.00369925932450728
sim_render-ego0_mean0.00369925932450728
sim_render-ego0_median0.00369925932450728
sim_render-ego0_min0.00369925932450728
simulation-passed1
step_physics_max0.07621562480926514
step_physics_mean0.07621562480926514
step_physics_median0.07621562480926514
step_physics_min0.07621562480926514
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7721015558Adriano Almeidatemplate-randomaido-LF-sim-validationsim-2of4successnonogpu-production-b-spot-0-080:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7066636954531781
survival_time_median8.349999999999984
deviation-center-line_median0.15823532814711416
in-drivable-lane_median6.049999999999985


other stats
agent_compute-ego0_max0.012948626563662574
agent_compute-ego0_mean0.012948626563662574
agent_compute-ego0_median0.012948626563662574
agent_compute-ego0_min0.012948626563662574
complete-iteration_max0.1707059826169695
complete-iteration_mean0.1707059826169695
complete-iteration_median0.1707059826169695
complete-iteration_min0.1707059826169695
deviation-center-line_max0.15823532814711416
deviation-center-line_mean0.15823532814711416
deviation-center-line_min0.15823532814711416
deviation-heading_max0.9829424167176616
deviation-heading_mean0.9829424167176616
deviation-heading_median0.9829424167176616
deviation-heading_min0.9829424167176616
distance-from-start_max3.203726500553977
distance-from-start_mean3.203726500553977
distance-from-start_median3.203726500553977
distance-from-start_min3.203726500553977
driven_any_max3.2533721755241913
driven_any_mean3.2533721755241913
driven_any_median3.2533721755241913
driven_any_min3.2533721755241913
driven_lanedir_consec_max0.7066636954531781
driven_lanedir_consec_mean0.7066636954531781
driven_lanedir_consec_min0.7066636954531781
driven_lanedir_max0.7066636954531781
driven_lanedir_mean0.7066636954531781
driven_lanedir_median0.7066636954531781
driven_lanedir_min0.7066636954531781
get_duckie_state_max1.1126200358072915e-06
get_duckie_state_mean1.1126200358072915e-06
get_duckie_state_median1.1126200358072915e-06
get_duckie_state_min1.1126200358072915e-06
get_robot_state_max0.00407368228549049
get_robot_state_mean0.00407368228549049
get_robot_state_median0.00407368228549049
get_robot_state_min0.00407368228549049
get_state_dump_max0.006334125995635986
get_state_dump_mean0.006334125995635986
get_state_dump_median0.006334125995635986
get_state_dump_min0.006334125995635986
get_ui_image_max0.04544361006645929
get_ui_image_mean0.04544361006645929
get_ui_image_median0.04544361006645929
get_ui_image_min0.04544361006645929
in-drivable-lane_max6.049999999999985
in-drivable-lane_mean6.049999999999985
in-drivable-lane_min6.049999999999985
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 3.2533721755241913, "get_ui_image": 0.04544361006645929, "step_physics": 0.08424982854298182, "survival_time": 8.349999999999984, "driven_lanedir": 0.7066636954531781, "get_state_dump": 0.006334125995635986, "get_robot_state": 0.00407368228549049, "sim_render-ego0": 0.0034380796409788587, "get_duckie_state": 1.1126200358072915e-06, "in-drivable-lane": 6.049999999999985, "deviation-heading": 0.9829424167176616, "agent_compute-ego0": 0.012948626563662574, "complete-iteration": 0.1707059826169695, "set_robot_commands": 0.0022615251087007068, "distance-from-start": 3.203726500553977, "deviation-center-line": 0.15823532814711416, "driven_lanedir_consec": 0.7066636954531781, "sim_compute_sim_state": 0.01002523728779384, "sim_compute_performance-ego0": 0.0018493930498758953}}
set_robot_commands_max0.0022615251087007068
set_robot_commands_mean0.0022615251087007068
set_robot_commands_median0.0022615251087007068
set_robot_commands_min0.0022615251087007068
sim_compute_performance-ego0_max0.0018493930498758953
sim_compute_performance-ego0_mean0.0018493930498758953
sim_compute_performance-ego0_median0.0018493930498758953
sim_compute_performance-ego0_min0.0018493930498758953
sim_compute_sim_state_max0.01002523728779384
sim_compute_sim_state_mean0.01002523728779384
sim_compute_sim_state_median0.01002523728779384
sim_compute_sim_state_min0.01002523728779384
sim_render-ego0_max0.0034380796409788587
sim_render-ego0_mean0.0034380796409788587
sim_render-ego0_median0.0034380796409788587
sim_render-ego0_min0.0034380796409788587
simulation-passed1
step_physics_max0.08424982854298182
step_physics_mean0.08424982854298182
step_physics_median0.08424982854298182
step_physics_min0.08424982854298182
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_min8.349999999999984
No reset possible
7714915551dzmitry zeninexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-080:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.464543951820275


other stats
agent_compute-ego0_max0.010691165725555549
agent_compute-ego0_mean0.010691165725555549
agent_compute-ego0_median0.010691165725555549
agent_compute-ego0_min0.010691165725555549
complete-iteration_max0.2065268785729198
complete-iteration_mean0.2065268785729198
complete-iteration_median0.2065268785729198
complete-iteration_min0.2065268785729198
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.464543951820275
distance-from-start_median4.464543951820275
distance-from-start_min4.464543951820275
driven_any_max4.533084992325165
driven_any_mean4.533084992325165
driven_any_median4.533084992325165
driven_any_min4.533084992325165
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05577428334956363
get_duckie_state_mean0.05577428334956363
get_duckie_state_median0.05577428334956363
get_duckie_state_min0.05577428334956363
get_robot_state_max0.0035327592559102968
get_robot_state_mean0.0035327592559102968
get_robot_state_median0.0035327592559102968
get_robot_state_min0.0035327592559102968
get_state_dump_max0.013170972255544797
get_state_dump_mean0.013170972255544797
get_state_dump_median0.013170972255544797
get_state_dump_min0.013170972255544797
get_ui_image_max0.037460697183601066
get_ui_image_mean0.037460697183601066
get_ui_image_median0.037460697183601066
get_ui_image_min0.037460697183601066
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 4.533084992325165, "get_ui_image": 0.037460697183601066, "step_physics": 0.07039209726351088, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.013170972255544797, "get_robot_state": 0.0035327592559102968, "sim_render-ego0": 0.003383618211071259, "get_duckie_state": 0.05577428334956363, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010691165725555549, "complete-iteration": 0.2065268785729198, "set_robot_commands": 0.0020691083928726793, "distance-from-start": 4.464543951820275, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00819215766595464, "sim_compute_performance-ego0": 0.0017614777538798234}}
set_robot_commands_max0.0020691083928726793
set_robot_commands_mean0.0020691083928726793
set_robot_commands_median0.0020691083928726793
set_robot_commands_min0.0020691083928726793
sim_compute_performance-ego0_max0.0017614777538798234
sim_compute_performance-ego0_mean0.0017614777538798234
sim_compute_performance-ego0_median0.0017614777538798234
sim_compute_performance-ego0_min0.0017614777538798234
sim_compute_sim_state_max0.00819215766595464
sim_compute_sim_state_mean0.00819215766595464
sim_compute_sim_state_median0.00819215766595464
sim_compute_sim_state_min0.00819215766595464
sim_render-ego0_max0.003383618211071259
sim_render-ego0_mean0.003383618211071259
sim_render-ego0_median0.003383618211071259
sim_render-ego0_min0.003383618211071259
simulation-passed1
step_physics_max0.07039209726351088
step_physics_mean0.07039209726351088
step_physics_median0.07039209726351088
step_physics_min0.07039209726351088
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible