Duckietown Challenges Home Challenges Submissions

Submission 14398

Submission14398
Competingyes
Challengemooc-BV1
UserAndrey Naydenko
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113665 sim-1of5: 113666 sim-2of5: 113658 sim-3of5: 113660 sim-4of5: 113659
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

113666

Click the images to see detailed statistics about the episode.

d60

113665

Click the images to see detailed statistics about the episode.

d45

113660

Click the images to see detailed statistics about the episode.

d30

113659

Click the images to see detailed statistics about the episode.

d50

113658

Click the images to see detailed statistics about the episode.

d40

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113666sim-1of5successyes0:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.477006105388869


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.477006105388869
distance-from-start_median2.477006105388869
distance-from-start_min2.477006105388869
driven_any_max2.553892309955553
driven_any_mean2.553892309955553
driven_any_median2.553892309955553
driven_any_min2.553892309955553
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max29.450000000000284
in-drivable-lane_mean29.450000000000284
in-drivable-lane_median29.450000000000284
in-drivable-lane_min29.450000000000284
per-episodes
details{"d60-ego0": {"driven_any": 2.553892309955553, "survival_time": 29.450000000000284, "driven_lanedir": 0.0, "in-drivable-lane": 29.450000000000284, "deviation-heading": 0.0, "distance-from-start": 2.477006105388869, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max29.450000000000284
survival_time_mean29.450000000000284
survival_time_median29.450000000000284
survival_time_min29.450000000000284
No reset possible
113665sim-0of5successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9163985688877272


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9163985688877272
distance-from-start_median0.9163985688877272
distance-from-start_min0.9163985688877272
driven_any_max0.9608956209212955
driven_any_mean0.9608956209212955
driven_any_median0.9608956209212955
driven_any_min0.9608956209212955
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.750000000000032
in-drivable-lane_mean11.750000000000032
in-drivable-lane_median11.750000000000032
in-drivable-lane_min11.750000000000032
per-episodes
details{"d45-ego0": {"driven_any": 0.9608956209212955, "survival_time": 11.750000000000032, "driven_lanedir": 0.0, "in-drivable-lane": 11.750000000000032, "deviation-heading": 0.0, "distance-from-start": 0.9163985688877272, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.750000000000032
survival_time_mean11.750000000000032
survival_time_median11.750000000000032
survival_time_min11.750000000000032
No reset possible
113660sim-3of5successyes0:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.7904948937741083


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.7904948937741083
distance-from-start_median1.7904948937741083
distance-from-start_min1.7904948937741083
driven_any_max1.8563913198324928
driven_any_mean1.8563913198324928
driven_any_median1.8563913198324928
driven_any_min1.8563913198324928
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max21.700000000000173
in-drivable-lane_mean21.700000000000173
in-drivable-lane_median21.700000000000173
in-drivable-lane_min21.700000000000173
per-episodes
details{"d30-ego0": {"driven_any": 1.8563913198324928, "survival_time": 21.700000000000173, "driven_lanedir": 0.0, "in-drivable-lane": 21.700000000000173, "deviation-heading": 0.0, "distance-from-start": 1.7904948937741083, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max21.700000000000173
survival_time_mean21.700000000000173
survival_time_median21.700000000000173
survival_time_min21.700000000000173
No reset possible
113659sim-4of5successyes0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8842976826799838


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8842976826799838
distance-from-start_median0.8842976826799838
distance-from-start_min0.8842976826799838
driven_any_max0.906895783003794
driven_any_mean0.906895783003794
driven_any_median0.906895783003794
driven_any_min0.906895783003794
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.150000000000023
in-drivable-lane_mean11.150000000000023
in-drivable-lane_median11.150000000000023
in-drivable-lane_min11.150000000000023
per-episodes
details{"d50-ego0": {"driven_any": 0.906895783003794, "survival_time": 11.150000000000023, "driven_lanedir": 0.0, "in-drivable-lane": 11.150000000000023, "deviation-heading": 0.0, "distance-from-start": 0.8842976826799838, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean11.150000000000023
survival_time_median11.150000000000023
survival_time_min11.150000000000023
No reset possible
113658sim-2of5successyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1126461392689824


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1126461392689824
distance-from-start_median2.1126461392689824
distance-from-start_min2.1126461392689824
driven_any_max2.1938958099103507
driven_any_mean2.1938958099103507
driven_any_median2.1938958099103507
driven_any_min2.1938958099103507
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max25.450000000000227
in-drivable-lane_mean25.450000000000227
in-drivable-lane_median25.450000000000227
in-drivable-lane_min25.450000000000227
per-episodes
details{"d40-ego0": {"driven_any": 2.1938958099103507, "survival_time": 25.450000000000227, "driven_lanedir": 0.0, "in-drivable-lane": 25.450000000000227, "deviation-heading": 0.0, "distance-from-start": 2.1126461392689824, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max25.450000000000227
survival_time_mean25.450000000000227
survival_time_median25.450000000000227
survival_time_min25.450000000000227
No reset possible
113656sim-0of5successyes0:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113655sim-1of5successyes0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113654sim-3of5successyes0:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113653sim-4of5successyes0:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113651sim-2of5successyes0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113646sim-1of5successyes0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113645sim-0of5successyes0:02:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113644sim-2of5successyes0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113643sim-4of5successyes0:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113641sim-3of5successyes0:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94036sim-2of5successno0:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94035sim-1of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94033sim-2of5successno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94032sim-1of5successno0:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94031sim-3of5successno0:07:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94030sim-2of5successno0:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94027sim-1of5successno0:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94024sim-2of5successno0:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94021sim-3of5successno0:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94020sim-1of5successno0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94018sim-2of5successno0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94015sim-0of5successno0:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94014sim-4of5successno0:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94011sim-0of5successno0:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94006sim-4of5successno0:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93991sim-4of5successno0:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74280sim-1of5successno0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74276sim-2of5successno0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74261sim-0of5successno0:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74260sim-1of5successno0:02:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74259sim-2of5successno0:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74256sim-3of5successno0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74255sim-4of5successno0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70415sim-0of5errorno0:02:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70414sim-2of5errorno0:01:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70413sim-4of5errorno0:05:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70412sim-3of5errorno0:02:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70406sim-1of5errorno0:02:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67639sim-1of5successno0:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67634sim-1of5successno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67624sim-3of5successno0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67621sim-2of5successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67618sim-2of5successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67617sim-3of5successno0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
67616sim-1of5timeoutno----No reset possible