Duckietown Challenges Home Challenges Submissions

Submission 14469

Submission14469
Competingyes
Challengemooc-BV1
UserSampsa Ranta
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 113214 sim-1of5: 113219 sim-2of5: 113207 sim-3of5: 113215 sim-4of5: 113213
Next
User labelNeed Z to fly! This duck votes yellow.
Admin priority50
Blessingn/a
User priority50

113219

Click the images to see detailed statistics about the episode.

d60

113215

Click the images to see detailed statistics about the episode.

d30

113214

Click the images to see detailed statistics about the episode.

d45

113213

Click the images to see detailed statistics about the episode.

d50

113207

Click the images to see detailed statistics about the episode.

d40

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
113219sim-1of5successyes0:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.5058747245450643


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.5058747245450643
distance-from-start_median2.5058747245450643
distance-from-start_min2.5058747245450643
driven_any_max2.85680011905744
driven_any_mean2.85680011905744
driven_any_median2.85680011905744
driven_any_min2.85680011905744
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max13.600000000000058
in-drivable-lane_mean13.600000000000058
in-drivable-lane_median13.600000000000058
in-drivable-lane_min13.600000000000058
per-episodes
details{"d60-ego0": {"driven_any": 2.85680011905744, "survival_time": 13.600000000000058, "driven_lanedir": 0.0, "in-drivable-lane": 13.600000000000058, "deviation-heading": 0.0, "distance-from-start": 2.5058747245450643, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max13.600000000000058
survival_time_mean13.600000000000058
survival_time_median13.600000000000058
survival_time_min13.600000000000058
No reset possible
113215sim-3of5successyes0:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.568059975913822


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.568059975913822
distance-from-start_median4.568059975913822
distance-from-start_min4.568059975913822
driven_any_max4.9499574284499674
driven_any_mean4.9499574284499674
driven_any_median4.9499574284499674
driven_any_min4.9499574284499674
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max19.850000000000147
in-drivable-lane_mean19.850000000000147
in-drivable-lane_median19.850000000000147
in-drivable-lane_min19.850000000000147
per-episodes
details{"d30-ego0": {"driven_any": 4.9499574284499674, "survival_time": 19.850000000000147, "driven_lanedir": 0.0, "in-drivable-lane": 19.850000000000147, "deviation-heading": 0.0, "distance-from-start": 4.568059975913822, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max19.850000000000147
survival_time_mean19.850000000000147
survival_time_median19.850000000000147
survival_time_min19.850000000000147
No reset possible
113214sim-0of5successyes0:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.591823939289858


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.591823939289858
distance-from-start_median5.591823939289858
distance-from-start_min5.591823939289858
driven_any_max11.872884735786544
driven_any_mean11.872884735786544
driven_any_median11.872884735786544
driven_any_min11.872884735786544
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max50.049999999999294
in-drivable-lane_mean50.049999999999294
in-drivable-lane_median50.049999999999294
in-drivable-lane_min50.049999999999294
per-episodes
details{"d45-ego0": {"driven_any": 11.872884735786544, "survival_time": 50.049999999999294, "driven_lanedir": 0.0, "in-drivable-lane": 50.049999999999294, "deviation-heading": 0.0, "distance-from-start": 5.591823939289858, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max50.049999999999294
survival_time_mean50.049999999999294
survival_time_median50.049999999999294
survival_time_min50.049999999999294
No reset possible
113213sim-4of5successyes0:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.998933756046894


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.998933756046894
distance-from-start_median4.998933756046894
distance-from-start_min4.998933756046894
driven_any_max5.701156670515854
driven_any_mean5.701156670515854
driven_any_median5.701156670515854
driven_any_min5.701156670515854
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.90000000000022
in-drivable-lane_mean24.90000000000022
in-drivable-lane_median24.90000000000022
in-drivable-lane_min24.90000000000022
per-episodes
details{"d50-ego0": {"driven_any": 5.701156670515854, "survival_time": 24.90000000000022, "driven_lanedir": 0.0, "in-drivable-lane": 24.90000000000022, "deviation-heading": 0.0, "distance-from-start": 4.998933756046894, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.90000000000022
survival_time_mean24.90000000000022
survival_time_median24.90000000000022
survival_time_min24.90000000000022
No reset possible
113207sim-2of5successyes0:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.3062334531956585


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.3062334531956585
distance-from-start_median5.3062334531956585
distance-from-start_min5.3062334531956585
driven_any_max7.409721580112755
driven_any_mean7.409721580112755
driven_any_median7.409721580112755
driven_any_min7.409721580112755
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max31.450000000000312
in-drivable-lane_mean31.450000000000312
in-drivable-lane_median31.450000000000312
in-drivable-lane_min31.450000000000312
per-episodes
details{"d40-ego0": {"driven_any": 7.409721580112755, "survival_time": 31.450000000000312, "driven_lanedir": 0.0, "in-drivable-lane": 31.450000000000312, "deviation-heading": 0.0, "distance-from-start": 5.3062334531956585, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max31.450000000000312
survival_time_mean31.450000000000312
survival_time_median31.450000000000312
survival_time_min31.450000000000312
No reset possible
113206sim-1of5successyes0:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113204sim-3of5successyes0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113203sim-2of5successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113202sim-0of5successyes0:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
113201sim-4of5successyes0:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93526sim-1of5successno0:07:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93525sim-2of5successno0:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93523sim-3of5successno0:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93522sim-2of5successno0:02:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93520sim-1of5successno0:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93519sim-0of5successno0:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
93518sim-4of5successno0:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73929sim-3of5successno0:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73925sim-2of5successno0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73920sim-1of5successno0:04:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73918sim-0of5successno0:08:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
73910sim-4of5successno0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70188sim-0of5errorno0:03:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70187sim-1of5errorno0:02:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70186sim-4of5errorno0:07:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70185sim-3of5errorno0:05:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
70184sim-2of5errorno0:03:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 352, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 257, in read_and_draw
    log0 = read_simulator_log_cbor(ld, main_robot_name=robot_main)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 223, in read_simulator_log_cbor
    pose2 = SE2Transform.from_SE2(pose)
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/geo/transforms.py", line 102, in from_SE2
    translation, angle = geo.translation_angle_from_SE2(q)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 235, in translation_angle_from_SE2
    R, t, _, _ = extract_pieces(pose)
  File "/usr/local/lib/python3.8/site-packages/geometry/poses.py", line 144, in extract_pieces
    M = x.shape[0] - 1
AttributeError: 'FriendlyPose' object has no attribute 'shape'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 412, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68335sim-4of5successno0:05:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68334sim-1of5successno0:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68333sim-0of5successno0:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68332sim-2of5successno0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68331sim-4of5successno0:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
68330sim-3of5successno0:04:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible