Duckietown Challenges Home Challenges Submissions

Submission 13979

Submission13979
Competingyes
Challengeaido-LF-sim-validation
UserAndrea Censi 🇨🇭
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 114864 sim-1of4: 114861 sim-2of4: 114860 sim-3of4: 114863
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

114864

Click the images to see detailed statistics about the episode.

loop2-000

114863

Click the images to see detailed statistics about the episode.

loop-000

114861

Click the images to see detailed statistics about the episode.

zigzag-000

114860

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
114864sim-0of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.347861907865195
survival_time_median6.5999999999999845
deviation-center-line_median0.14328193382839904
in-drivable-lane_median4.699999999999987


other stats
deviation-center-line_max0.14328193382839904
deviation-center-line_mean0.14328193382839904
deviation-center-line_min0.14328193382839904
deviation-heading_max1.3930913333206691
deviation-heading_mean1.3930913333206691
deviation-heading_median1.3930913333206691
deviation-heading_min1.3930913333206691
distance-from-start_max1.9077567815780865
distance-from-start_mean1.9077567815780865
distance-from-start_median1.9077567815780865
distance-from-start_min1.9077567815780865
driven_any_max1.9077567815780647
driven_any_mean1.9077567815780647
driven_any_median1.9077567815780647
driven_any_min1.9077567815780647
driven_lanedir_consec_max0.347861907865195
driven_lanedir_consec_mean0.347861907865195
driven_lanedir_consec_min0.347861907865195
driven_lanedir_max0.347861907865195
driven_lanedir_mean0.347861907865195
driven_lanedir_median0.347861907865195
driven_lanedir_min0.347861907865195
in-drivable-lane_max4.699999999999987
in-drivable-lane_mean4.699999999999987
in-drivable-lane_min4.699999999999987
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.9077567815780647, "survival_time": 6.5999999999999845, "driven_lanedir": 0.347861907865195, "in-drivable-lane": 4.699999999999987, "deviation-heading": 1.3930913333206691, "distance-from-start": 1.9077567815780865, "deviation-center-line": 0.14328193382839904, "driven_lanedir_consec": 0.347861907865195}}
simulation-passed1
survival_time_max6.5999999999999845
survival_time_mean6.5999999999999845
survival_time_min6.5999999999999845
No reset possible
114863sim-3of4successyes0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2136977806110365
survival_time_median3.4999999999999956
deviation-center-line_median0.07132669494216287
in-drivable-lane_median2.349999999999995


other stats
deviation-center-line_max0.07132669494216287
deviation-center-line_mean0.07132669494216287
deviation-center-line_min0.07132669494216287
deviation-heading_max0.6181080036454353
deviation-heading_mean0.6181080036454353
deviation-heading_median0.6181080036454353
deviation-heading_min0.6181080036454353
distance-from-start_max0.824598333281378
distance-from-start_mean0.824598333281378
distance-from-start_median0.824598333281378
distance-from-start_min0.824598333281378
driven_any_max0.8245983332813829
driven_any_mean0.8245983332813829
driven_any_median0.8245983332813829
driven_any_min0.8245983332813829
driven_lanedir_consec_max0.2136977806110365
driven_lanedir_consec_mean0.2136977806110365
driven_lanedir_consec_min0.2136977806110365
driven_lanedir_max0.2136977806110365
driven_lanedir_mean0.2136977806110365
driven_lanedir_median0.2136977806110365
driven_lanedir_min0.2136977806110365
in-drivable-lane_max2.349999999999995
in-drivable-lane_mean2.349999999999995
in-drivable-lane_min2.349999999999995
per-episodes
details{"loop-000-ego0": {"driven_any": 0.8245983332813829, "survival_time": 3.4999999999999956, "driven_lanedir": 0.2136977806110365, "in-drivable-lane": 2.349999999999995, "deviation-heading": 0.6181080036454353, "distance-from-start": 0.824598333281378, "deviation-center-line": 0.07132669494216287, "driven_lanedir_consec": 0.2136977806110365}}
simulation-passed1
survival_time_max3.4999999999999956
survival_time_mean3.4999999999999956
survival_time_min3.4999999999999956
No reset possible
114861sim-1of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15008013860756453
survival_time_median4.049999999999994
deviation-center-line_median0.0557984831694393
in-drivable-lane_median3.0499999999999936


other stats
deviation-center-line_max0.0557984831694393
deviation-center-line_mean0.0557984831694393
deviation-center-line_min0.0557984831694393
deviation-heading_max0.6388863461517207
deviation-heading_mean0.6388863461517207
deviation-heading_median0.6388863461517207
deviation-heading_min0.6388863461517207
distance-from-start_max1.0167714816215814
distance-from-start_mean1.0167714816215814
distance-from-start_median1.0167714816215814
distance-from-start_min1.0167714816215814
driven_any_max1.0167714816215816
driven_any_mean1.0167714816215816
driven_any_median1.0167714816215816
driven_any_min1.0167714816215816
driven_lanedir_consec_max0.15008013860756453
driven_lanedir_consec_mean0.15008013860756453
driven_lanedir_consec_min0.15008013860756453
driven_lanedir_max0.15008013860756453
driven_lanedir_mean0.15008013860756453
driven_lanedir_median0.15008013860756453
driven_lanedir_min0.15008013860756453
in-drivable-lane_max3.0499999999999936
in-drivable-lane_mean3.0499999999999936
in-drivable-lane_min3.0499999999999936
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.0167714816215816, "survival_time": 4.049999999999994, "driven_lanedir": 0.15008013860756453, "in-drivable-lane": 3.0499999999999936, "deviation-heading": 0.6388863461517207, "distance-from-start": 1.0167714816215814, "deviation-center-line": 0.0557984831694393, "driven_lanedir_consec": 0.15008013860756453}}
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean4.049999999999994
survival_time_min4.049999999999994
No reset possible
114860sim-2of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2137018337269314
survival_time_median5.449999999999989
deviation-center-line_median0.0713266763592705
in-drivable-lane_median4.299999999999988


other stats
deviation-center-line_max0.0713266763592705
deviation-center-line_mean0.0713266763592705
deviation-center-line_min0.0713266763592705
deviation-heading_max0.6181080036454353
deviation-heading_mean0.6181080036454353
deviation-heading_median0.6181080036454353
deviation-heading_min0.6181080036454353
distance-from-start_max1.5059398770416736
distance-from-start_mean1.5059398770416736
distance-from-start_median1.5059398770416736
distance-from-start_min1.5059398770416736
driven_any_max1.505939877041679
driven_any_mean1.505939877041679
driven_any_median1.505939877041679
driven_any_min1.505939877041679
driven_lanedir_consec_max0.2137018337269314
driven_lanedir_consec_mean0.2137018337269314
driven_lanedir_consec_min0.2137018337269314
driven_lanedir_max0.2137018337269314
driven_lanedir_mean0.2137018337269314
driven_lanedir_median0.2137018337269314
driven_lanedir_min0.2137018337269314
in-drivable-lane_max4.299999999999988
in-drivable-lane_mean4.299999999999988
in-drivable-lane_min4.299999999999988
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.505939877041679, "survival_time": 5.449999999999989, "driven_lanedir": 0.2137018337269314, "in-drivable-lane": 4.299999999999988, "deviation-heading": 0.6181080036454353, "distance-from-start": 1.5059398770416736, "deviation-center-line": 0.0713266763592705, "driven_lanedir_consec": 0.2137018337269314}}
simulation-passed1
survival_time_max5.449999999999989
survival_time_mean5.449999999999989
survival_time_min5.449999999999989
No reset possible
114859sim-0of4successyes0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114858sim-3of4successyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114857sim-2of4successyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114856sim-1of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114853sim-0of4successyes0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114852sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114849sim-1of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
114848sim-2of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62969347successyes0:07:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62968347failedyes0:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible