Duckietown Challenges Home Challenges Submissions

Submission 28624

Submission28624
Competingyes
Challengelx22-BV1
Useruser9343
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 198415 sim-1of5: 198414 sim-2of5: 198411 sim-3of5: 198412 sim-4of5: 198417
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

198417

Click the images to see detailed statistics about the episode.

d60

198415

Click the images to see detailed statistics about the episode.

d30

198414

Click the images to see detailed statistics about the episode.

d60

198412

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
198417sim-4of5successyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1457670603484988


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1457670603484988
distance-from-start_median1.1457670603484988
distance-from-start_min1.1457670603484988
driven_any_max1.177664375259878
driven_any_mean1.177664375259878
driven_any_median1.177664375259878
driven_any_min1.177664375259878
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.099999999999986
in-drivable-lane_mean6.099999999999986
in-drivable-lane_median6.099999999999986
in-drivable-lane_min6.099999999999986
per-episodes
details{"d60-ego0": {"driven_any": 1.177664375259878, "survival_time": 6.099999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 6.099999999999986, "deviation-heading": 0.0, "distance-from-start": 1.1457670603484988, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.099999999999986
survival_time_mean6.099999999999986
survival_time_median6.099999999999986
survival_time_min6.099999999999986
No reset possible
198416sim-4of5successyes0:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198415sim-0of5successyes0:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5445516158334915


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5445516158334915
distance-from-start_median0.5445516158334915
distance-from-start_min0.5445516158334915
driven_any_max0.567450185413301
driven_any_mean0.567450185413301
driven_any_median0.567450185413301
driven_any_min0.567450185413301
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.799999999999991
in-drivable-lane_mean4.799999999999991
in-drivable-lane_median4.799999999999991
in-drivable-lane_min4.799999999999991
per-episodes
details{"d30-ego0": {"driven_any": 0.567450185413301, "survival_time": 4.799999999999991, "driven_lanedir": 0.0, "in-drivable-lane": 4.799999999999991, "deviation-heading": 0.0, "distance-from-start": 0.5445516158334915, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_median4.799999999999991
survival_time_min4.799999999999991
No reset possible
198414sim-1of5successyes0:14:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.460680343209195


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.460680343209195
distance-from-start_median1.460680343209195
distance-from-start_min1.460680343209195
driven_any_max1.5201890011543353
driven_any_mean1.5201890011543353
driven_any_median1.5201890011543353
driven_any_min1.5201890011543353
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.79999999999999
in-drivable-lane_mean8.79999999999999
in-drivable-lane_median8.79999999999999
in-drivable-lane_min8.79999999999999
per-episodes
details{"d60-ego0": {"driven_any": 1.5201890011543353, "survival_time": 8.79999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 8.79999999999999, "deviation-heading": 0.0, "distance-from-start": 1.460680343209195, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.79999999999999
survival_time_mean8.79999999999999
survival_time_median8.79999999999999
survival_time_min8.79999999999999
No reset possible
198413sim-0of5successyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198412sim-3of5successyes0:14:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.3580046348652037


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.3580046348652037
distance-from-start_median3.3580046348652037
distance-from-start_min3.3580046348652037
driven_any_max4.121498069154237
driven_any_mean4.121498069154237
driven_any_median4.121498069154237
driven_any_min4.121498069154237
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max17.20000000000011
in-drivable-lane_mean17.20000000000011
in-drivable-lane_median17.20000000000011
in-drivable-lane_min17.20000000000011
per-episodes
details{"d50-ego0": {"driven_any": 4.121498069154237, "survival_time": 17.20000000000011, "driven_lanedir": 0.0, "in-drivable-lane": 17.20000000000011, "deviation-heading": 0.0, "distance-from-start": 3.3580046348652037, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max17.20000000000011
survival_time_mean17.20000000000011
survival_time_median17.20000000000011
survival_time_min17.20000000000011
No reset possible
198411sim-2of5failedyes0:12:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198410sim-4of5successyes0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible