Duckietown Challenges Home Challenges Submissions

Submission 18901

Submission18901
Competingyes
Challengemooc-BV1
UserYan Long Huang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of5: 137052 sim-1of5: 137060 sim-2of5: 137055 sim-3of5: 137053 sim-4of5: 137049
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

137060

Click the images to see detailed statistics about the episode.

d45

137055

Click the images to see detailed statistics about the episode.

d40

137053

Click the images to see detailed statistics about the episode.

d50

137052

Click the images to see detailed statistics about the episode.

d30

137049

Click the images to see detailed statistics about the episode.

d60

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
137060sim-1of5successyes0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4076006073920062


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4076006073920062
distance-from-start_median1.4076006073920062
distance-from-start_min1.4076006073920062
driven_any_max3.437074000493848
driven_any_mean3.437074000493848
driven_any_median3.437074000493848
driven_any_min3.437074000493848
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max9.950000000000006
in-drivable-lane_mean9.950000000000006
in-drivable-lane_median9.950000000000006
in-drivable-lane_min9.950000000000006
per-episodes
details{"d45-ego0": {"driven_any": 3.437074000493848, "survival_time": 9.950000000000006, "driven_lanedir": 0.0, "in-drivable-lane": 9.950000000000006, "deviation-heading": 0.0, "distance-from-start": 1.4076006073920062, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max9.950000000000006
survival_time_mean9.950000000000006
survival_time_median9.950000000000006
survival_time_min9.950000000000006
No reset possible
137055sim-2of5successyes0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.3734366442152923


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.3734366442152923
distance-from-start_median1.3734366442152923
distance-from-start_min1.3734366442152923
driven_any_max2.211641666204794
driven_any_mean2.211641666204794
driven_any_median2.211641666204794
driven_any_min2.211641666204794
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.749999999999984
in-drivable-lane_mean6.749999999999984
in-drivable-lane_median6.749999999999984
in-drivable-lane_min6.749999999999984
per-episodes
details{"d40-ego0": {"driven_any": 2.211641666204794, "survival_time": 6.749999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 6.749999999999984, "deviation-heading": 0.0, "distance-from-start": 1.3734366442152923, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.749999999999984
survival_time_mean6.749999999999984
survival_time_median6.749999999999984
survival_time_min6.749999999999984
No reset possible
137054sim-1of5failedyes0:04:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137053sim-3of5successyes0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.159531432546323


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.159531432546323
distance-from-start_median3.159531432546323
distance-from-start_min3.159531432546323
driven_any_max5.270044358132796
driven_any_mean5.270044358132796
driven_any_median5.270044358132796
driven_any_min5.270044358132796
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max14.650000000000071
in-drivable-lane_mean14.650000000000071
in-drivable-lane_median14.650000000000071
in-drivable-lane_min14.650000000000071
per-episodes
details{"d50-ego0": {"driven_any": 5.270044358132796, "survival_time": 14.650000000000071, "driven_lanedir": 0.0, "in-drivable-lane": 14.650000000000071, "deviation-heading": 0.0, "distance-from-start": 3.159531432546323, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max14.650000000000071
survival_time_mean14.650000000000071
survival_time_median14.650000000000071
survival_time_min14.650000000000071
No reset possible
137052sim-0of5successyes0:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.2246946368152942


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.2246946368152942
distance-from-start_median2.2246946368152942
distance-from-start_min2.2246946368152942
driven_any_max6.2763237990361045
driven_any_mean6.2763237990361045
driven_any_median6.2763237990361045
driven_any_min6.2763237990361045
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max17.500000000000114
in-drivable-lane_mean17.500000000000114
in-drivable-lane_median17.500000000000114
in-drivable-lane_min17.500000000000114
per-episodes
details{"d30-ego0": {"driven_any": 6.2763237990361045, "survival_time": 17.500000000000114, "driven_lanedir": 0.0, "in-drivable-lane": 17.500000000000114, "deviation-heading": 0.0, "distance-from-start": 2.2246946368152942, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max17.500000000000114
survival_time_mean17.500000000000114
survival_time_median17.500000000000114
survival_time_min17.500000000000114
No reset possible
137050sim-2of5successyes0:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137049sim-4of5successyes0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.614794178949702


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.614794178949702
distance-from-start_median2.614794178949702
distance-from-start_min2.614794178949702
driven_any_max2.754679028705672
driven_any_mean2.754679028705672
driven_any_median2.754679028705672
driven_any_min2.754679028705672
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.199999999999982
in-drivable-lane_mean8.199999999999982
in-drivable-lane_median8.199999999999982
in-drivable-lane_min8.199999999999982
per-episodes
details{"d60-ego0": {"driven_any": 2.754679028705672, "survival_time": 8.199999999999982, "driven_lanedir": 0.0, "in-drivable-lane": 8.199999999999982, "deviation-heading": 0.0, "distance-from-start": 2.614794178949702, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.199999999999982
survival_time_mean8.199999999999982
survival_time_median8.199999999999982
survival_time_min8.199999999999982
No reset possible
137044sim-4of5successyes0:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible