Duckietown Challenges Home Challenges Submissions

Submission 18900

Submission18900
Competingyes
Challengemooc-BV1
UserYan Long Huang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 137036 sim-1of5: 137038 sim-2of5: 137035 sim-3of5: 137034 sim-4of5: 137037
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

137038

Click the images to see detailed statistics about the episode.

d45

137037

Click the images to see detailed statistics about the episode.

d60

137036

Click the images to see detailed statistics about the episode.

d30

137034

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
137038sim-1of5successyes0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.3314098882238083


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.3314098882238083
distance-from-start_median1.3314098882238083
distance-from-start_min1.3314098882238083
driven_any_max1.449176060041337
driven_any_mean1.449176060041337
driven_any_median1.449176060041337
driven_any_min1.449176060041337
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.899999999999991
in-drivable-lane_mean4.899999999999991
in-drivable-lane_median4.899999999999991
in-drivable-lane_min4.899999999999991
per-episodes
details{"d45-ego0": {"driven_any": 1.449176060041337, "survival_time": 4.899999999999991, "driven_lanedir": 0.0, "in-drivable-lane": 4.899999999999991, "deviation-heading": 0.0, "distance-from-start": 1.3314098882238083, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.899999999999991
survival_time_mean4.899999999999991
survival_time_median4.899999999999991
survival_time_min4.899999999999991
No reset possible
137037sim-4of5successyes0:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.607628198850607


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.607628198850607
distance-from-start_median2.607628198850607
distance-from-start_min2.607628198850607
driven_any_max2.7676462526762022
driven_any_mean2.7676462526762022
driven_any_median2.7676462526762022
driven_any_min2.7676462526762022
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.199999999999982
in-drivable-lane_mean8.199999999999982
in-drivable-lane_median8.199999999999982
in-drivable-lane_min8.199999999999982
per-episodes
details{"d60-ego0": {"driven_any": 2.7676462526762022, "survival_time": 8.199999999999982, "driven_lanedir": 0.0, "in-drivable-lane": 8.199999999999982, "deviation-heading": 0.0, "distance-from-start": 2.607628198850607, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.199999999999982
survival_time_mean8.199999999999982
survival_time_median8.199999999999982
survival_time_min8.199999999999982
No reset possible
137036sim-0of5successyes0:04:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.2787980963729044


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.2787980963729044
distance-from-start_median2.2787980963729044
distance-from-start_min2.2787980963729044
driven_any_max5.911611452071668
driven_any_mean5.911611452071668
driven_any_median5.911611452071668
driven_any_min5.911611452071668
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max16.6500000000001
in-drivable-lane_mean16.6500000000001
in-drivable-lane_median16.6500000000001
in-drivable-lane_min16.6500000000001
per-episodes
details{"d30-ego0": {"driven_any": 5.911611452071668, "survival_time": 16.6500000000001, "driven_lanedir": 0.0, "in-drivable-lane": 16.6500000000001, "deviation-heading": 0.0, "distance-from-start": 2.2787980963729044, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max16.6500000000001
survival_time_mean16.6500000000001
survival_time_median16.6500000000001
survival_time_min16.6500000000001
No reset possible
137035sim-2of5failedyes0:05:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137034sim-3of5successyes0:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.7841747789353828


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.7841747789353828
distance-from-start_median1.7841747789353828
distance-from-start_min1.7841747789353828
driven_any_max3.673433598170395
driven_any_mean3.673433598170395
driven_any_median3.673433598170395
driven_any_min3.673433598170395
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max10.600000000000016
in-drivable-lane_mean10.600000000000016
in-drivable-lane_median10.600000000000016
in-drivable-lane_min10.600000000000016
per-episodes
details{"d50-ego0": {"driven_any": 3.673433598170395, "survival_time": 10.600000000000016, "driven_lanedir": 0.0, "in-drivable-lane": 10.600000000000016, "deviation-heading": 0.0, "distance-from-start": 1.7841747789353828, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max10.600000000000016
survival_time_mean10.600000000000016
survival_time_median10.600000000000016
survival_time_min10.600000000000016
No reset possible
137033sim-1of5successyes0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137030sim-1of5successyes0:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137029sim-2of5successyes0:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137028sim-0of5successyes0:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137027sim-3of5successyes0:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible