Duckietown Challenges Home Challenges Submissions

Submission 13691

Submission13691
Competingyes
Challengeaido-LF-sim-validation
UserCaleb BGΒ πŸ‡ΊπŸ‡Έ
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
ResultπŸ’š
Jobssim-0of4: 116163 sim-1of4: 116155 sim-2of4: 116159 sim-3of4: 116171
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

116171

Click the images to see detailed statistics about the episode.

loop-000

116163

Click the images to see detailed statistics about the episode.

loop2-000

116159

Click the images to see detailed statistics about the episode.

autolab-000

116155

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
116171sim-3of4successyes0:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.864535797615141
survival_time_median34.30000000000019
deviation-center-line_median1.3606070875353249
in-drivable-lane_median9.40000000000007


other stats
deviation-center-line_max1.3606070875353249
deviation-center-line_mean1.3606070875353249
deviation-center-line_min1.3606070875353249
deviation-heading_max6.513387760280761
deviation-heading_mean6.513387760280761
deviation-heading_median6.513387760280761
deviation-heading_min6.513387760280761
distance-from-start_max2.4113039026541925
distance-from-start_mean2.4113039026541925
distance-from-start_median2.4113039026541925
distance-from-start_min2.4113039026541925
driven_any_max4.409259000633439
driven_any_mean4.409259000633439
driven_any_median4.409259000633439
driven_any_min4.409259000633439
driven_lanedir_consec_max2.864535797615141
driven_lanedir_consec_mean2.864535797615141
driven_lanedir_consec_min2.864535797615141
driven_lanedir_max2.9018992099914875
driven_lanedir_mean2.9018992099914875
driven_lanedir_median2.9018992099914875
driven_lanedir_min2.9018992099914875
in-drivable-lane_max9.40000000000007
in-drivable-lane_mean9.40000000000007
in-drivable-lane_min9.40000000000007
per-episodes
details{"loop-000-ego0": {"driven_any": 4.409259000633439, "survival_time": 34.30000000000019, "driven_lanedir": 2.9018992099914875, "in-drivable-lane": 9.40000000000007, "deviation-heading": 6.513387760280761, "distance-from-start": 2.4113039026541925, "deviation-center-line": 1.3606070875353249, "driven_lanedir_consec": 2.864535797615141}}
simulation-passed1
survival_time_max34.30000000000019
survival_time_mean34.30000000000019
survival_time_min34.30000000000019
No reset possible
116163sim-0of4successyes0:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.225690514434439
survival_time_median50.899999999999245
deviation-center-line_median3.5126542903510862
in-drivable-lane_median9.14999999999968


other stats
deviation-center-line_max3.5126542903510862
deviation-center-line_mean3.5126542903510862
deviation-center-line_min3.5126542903510862
deviation-heading_max8.907285148098161
deviation-heading_mean8.907285148098161
deviation-heading_median8.907285148098161
deviation-heading_min8.907285148098161
distance-from-start_max0.9985819900023648
distance-from-start_mean0.9985819900023648
distance-from-start_median0.9985819900023648
distance-from-start_min0.9985819900023648
driven_any_max6.613081132631151
driven_any_mean6.613081132631151
driven_any_median6.613081132631151
driven_any_min6.613081132631151
driven_lanedir_consec_max4.225690514434439
driven_lanedir_consec_mean4.225690514434439
driven_lanedir_consec_min4.225690514434439
driven_lanedir_max5.245801270199082
driven_lanedir_mean5.245801270199082
driven_lanedir_median5.245801270199082
driven_lanedir_min5.245801270199082
in-drivable-lane_max9.14999999999968
in-drivable-lane_mean9.14999999999968
in-drivable-lane_min9.14999999999968
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.613081132631151, "survival_time": 50.899999999999245, "driven_lanedir": 5.245801270199082, "in-drivable-lane": 9.14999999999968, "deviation-heading": 8.907285148098161, "distance-from-start": 0.9985819900023648, "deviation-center-line": 3.5126542903510862, "driven_lanedir_consec": 4.225690514434439}}
simulation-passed1
survival_time_max50.899999999999245
survival_time_mean50.899999999999245
survival_time_min50.899999999999245
No reset possible
116160sim-0of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116159sim-2of4successyes0:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.054417039616953
survival_time_median59.99999999999873
deviation-center-line_median4.458149944358229
in-drivable-lane_median5.149999999999869


other stats
deviation-center-line_max4.458149944358229
deviation-center-line_mean4.458149944358229
deviation-center-line_min4.458149944358229
deviation-heading_max7.879836103922473
deviation-heading_mean7.879836103922473
deviation-heading_median7.879836103922473
deviation-heading_min7.879836103922473
distance-from-start_max3.1540676478884033
distance-from-start_mean3.1540676478884033
distance-from-start_median3.1540676478884033
distance-from-start_min3.1540676478884033
driven_any_max7.91453678413064
driven_any_mean7.91453678413064
driven_any_median7.91453678413064
driven_any_min7.91453678413064
driven_lanedir_consec_max7.054417039616953
driven_lanedir_consec_mean7.054417039616953
driven_lanedir_consec_min7.054417039616953
driven_lanedir_max7.054417039616953
driven_lanedir_mean7.054417039616953
driven_lanedir_median7.054417039616953
driven_lanedir_min7.054417039616953
in-drivable-lane_max5.149999999999869
in-drivable-lane_mean5.149999999999869
in-drivable-lane_min5.149999999999869
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.91453678413064, "survival_time": 59.99999999999873, "driven_lanedir": 7.054417039616953, "in-drivable-lane": 5.149999999999869, "deviation-heading": 7.879836103922473, "distance-from-start": 3.1540676478884033, "deviation-center-line": 4.458149944358229, "driven_lanedir_consec": 7.054417039616953}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
116157sim-3of4successyes0:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
116155sim-1of4successyes0:05:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5111106221715818
survival_time_median59.99999999999873
deviation-center-line_median3.979742970388912
in-drivable-lane_median9.050000000000008


other stats
deviation-center-line_max3.979742970388912
deviation-center-line_mean3.979742970388912
deviation-center-line_min3.979742970388912
deviation-heading_max12.658061389468894
deviation-heading_mean12.658061389468894
deviation-heading_median12.658061389468894
deviation-heading_min12.658061389468894
distance-from-start_max2.4580826254845753
distance-from-start_mean2.4580826254845753
distance-from-start_median2.4580826254845753
distance-from-start_min2.4580826254845753
driven_any_max7.914348779068797
driven_any_mean7.914348779068797
driven_any_median7.914348779068797
driven_any_min7.914348779068797
driven_lanedir_consec_max3.5111106221715818
driven_lanedir_consec_mean3.5111106221715818
driven_lanedir_consec_min3.5111106221715818
driven_lanedir_max6.319631460121448
driven_lanedir_mean6.319631460121448
driven_lanedir_median6.319631460121448
driven_lanedir_min6.319631460121448
in-drivable-lane_max9.050000000000008
in-drivable-lane_mean9.050000000000008
in-drivable-lane_min9.050000000000008
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.914348779068797, "survival_time": 59.99999999999873, "driven_lanedir": 6.319631460121448, "in-drivable-lane": 9.050000000000008, "deviation-heading": 12.658061389468894, "distance-from-start": 2.4580826254845753, "deviation-center-line": 3.979742970388912, "driven_lanedir_consec": 3.5111106221715818}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
95673sim-3of4successno0:07:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95670sim-2of4successno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95667sim-3of4successno0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95666sim-2of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95664sim-1of4successno0:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95661sim-0of4successno0:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74961sim-2of4successno0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74956sim-3of4successno0:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74955sim-2of4successno0:01:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74954sim-0of4successno0:07:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74953sim-1of4successno0:09:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63532sim-1of4successno0:07:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63528sim-0of4successno0:08:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63525sim-2of4successno0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
63523sim-3of4successno0:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62302347successyes0:47:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62173347failedno0:04:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible