Duckietown Challenges Home Challenges Submissions

Submission 28730

Submission28730
Competingyes
Challengelx22-BV1
Useruser9667
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 199228 sim-1of5: 199222 sim-2of5: 199226 sim-3of5: 199227 sim-4of5: 199229
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

199229

Click the images to see detailed statistics about the episode.

d60

199228

Click the images to see detailed statistics about the episode.

d30

199227

Click the images to see detailed statistics about the episode.

d50

199226

Click the images to see detailed statistics about the episode.

d45

199222

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
199229sim-4of5successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.392272858554904


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.392272858554904
distance-from-start_median1.392272858554904
distance-from-start_min1.392272858554904
driven_any_max1.4601890878724748
driven_any_mean1.4601890878724748
driven_any_median1.4601890878724748
driven_any_min1.4601890878724748
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.699999999999984
in-drivable-lane_mean6.699999999999984
in-drivable-lane_median6.699999999999984
in-drivable-lane_min6.699999999999984
per-episodes
details{"d60-ego0": {"driven_any": 1.4601890878724748, "survival_time": 6.699999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 6.699999999999984, "deviation-heading": 0.0, "distance-from-start": 1.392272858554904, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_median6.699999999999984
survival_time_min6.699999999999984
No reset possible
199228sim-0of5successyes0:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.0096023386378725


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.0096023386378725
distance-from-start_median4.0096023386378725
distance-from-start_min4.0096023386378725
driven_any_max4.103085559483614
driven_any_mean4.103085559483614
driven_any_median4.103085559483614
driven_any_min4.103085559483614
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.850000000000104
in-drivable-lane_mean16.850000000000104
in-drivable-lane_median16.850000000000104
in-drivable-lane_min16.850000000000104
per-episodes
details{"d30-ego0": {"driven_any": 4.103085559483614, "survival_time": 16.850000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 16.850000000000104, "deviation-heading": 0.0, "distance-from-start": 4.0096023386378725, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.850000000000104
survival_time_mean16.850000000000104
survival_time_median16.850000000000104
survival_time_min16.850000000000104
No reset possible
199227sim-3of5successyes0:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9275155375311108


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9275155375311108
distance-from-start_median0.9275155375311108
distance-from-start_min0.9275155375311108
driven_any_max1.1641348991804432
driven_any_mean1.1641348991804432
driven_any_median1.1641348991804432
driven_any_min1.1641348991804432
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.94999999999999
in-drivable-lane_mean4.94999999999999
in-drivable-lane_median4.94999999999999
in-drivable-lane_min4.94999999999999
per-episodes
details{"d50-ego0": {"driven_any": 1.1641348991804432, "survival_time": 4.94999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 4.94999999999999, "deviation-heading": 0.0, "distance-from-start": 0.9275155375311108, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean4.94999999999999
survival_time_median4.94999999999999
survival_time_min4.94999999999999
No reset possible
199226sim-2of5successyes0:10:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.650495880345171


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.650495880345171
distance-from-start_median4.650495880345171
distance-from-start_min4.650495880345171
driven_any_max5.9367361318711485
driven_any_mean5.9367361318711485
driven_any_median5.9367361318711485
driven_any_min5.9367361318711485
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.40000000000021
in-drivable-lane_mean24.40000000000021
in-drivable-lane_median24.40000000000021
in-drivable-lane_min24.40000000000021
per-episodes
details{"d45-ego0": {"driven_any": 5.9367361318711485, "survival_time": 24.40000000000021, "driven_lanedir": 0.0, "in-drivable-lane": 24.40000000000021, "deviation-heading": 0.0, "distance-from-start": 4.650495880345171, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.40000000000021
survival_time_mean24.40000000000021
survival_time_median24.40000000000021
survival_time_min24.40000000000021
No reset possible
199225sim-2of5successyes0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199224sim-3of5successyes0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199223sim-2of5successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199222sim-1of5successyes0:14:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.7089423182031784


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.7089423182031784
distance-from-start_median3.7089423182031784
distance-from-start_min3.7089423182031784
driven_any_max6.339141583654159
driven_any_mean6.339141583654159
driven_any_median6.339141583654159
driven_any_min6.339141583654159
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max24.100000000000207
in-drivable-lane_mean24.100000000000207
in-drivable-lane_median24.100000000000207
in-drivable-lane_min24.100000000000207
per-episodes
details{"d60-ego0": {"driven_any": 6.339141583654159, "survival_time": 24.100000000000207, "driven_lanedir": 0.0, "in-drivable-lane": 24.100000000000207, "deviation-heading": 0.0, "distance-from-start": 3.7089423182031784, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max24.100000000000207
survival_time_mean24.100000000000207
survival_time_median24.100000000000207
survival_time_min24.100000000000207
No reset possible
199221sim-3of5successyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199220sim-2of5successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199219sim-4of5failedyes0:07:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 325, in read_reply
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout of 120 violated while waiting for None.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199218sim-0of5successyes0:10:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible