Duckietown Challenges Home Challenges Submissions

Submission 799

Submission799
Competingyes
Challengeaido1_LF1_r3-v3
UserJulian Zilly
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12007 step2-scoring: 12016 step3-videos: 12018 step4-viz: 12022
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

12022

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12018

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12022step4-vizsuccessyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7290791130831619
deviation-center-line_median0.1383209338597356
in-drivable-lane_median0


other stats
deviation-center-line_max0.23117905195187863
deviation-center-line_mean0.1286122790281276
deviation-center-line_min0.011241272932554412
deviation-heading_max0.5353070374202661
deviation-heading_mean0.32558190289103195
deviation-heading_median0.3659080367639887
deviation-heading_min0.1343750269413795
driven_any_max1.1530398164144573
driven_any_mean0.8735149977423344
driven_any_median0.7803400686545232
driven_any_min0.5706964466426169
driven_lanedir_max1.1151670335542505
driven_lanedir_mean0.6359491502975011
driven_lanedir_min0.00018281064735958807
in-drivable-lane_max2.9333333333333327
in-drivable-lane_mean0.5866666666666666
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0948054650418912, "driven_lanedir": 0.00018281064735958807, "in-drivable-lane": 2.9333333333333327, "deviation-heading": 0.3659080367639887, "deviation-center-line": 0.011241272932554412}, "ep001": {"driven_any": 0.5706964466426169, "driven_lanedir": 0.5681160368329197, "in-drivable-lane": 0, "deviation-heading": 0.15584812728515213, "deviation-center-line": 0.1383209338597356}, "ep002": {"driven_any": 0.7803400686545232, "driven_lanedir": 0.7290791130831619, "in-drivable-lane": 0, "deviation-heading": 0.5353070374202661, "deviation-center-line": 0.06829769252897111}, "ep003": {"driven_any": 0.7686931919581833, "driven_lanedir": 0.7672007573698136, "in-drivable-lane": 0, "deviation-heading": 0.1343750269413795, "deviation-center-line": 0.1940224438674983}, "ep004": {"driven_any": 1.1530398164144573, "driven_lanedir": 1.1151670335542505, "in-drivable-lane": 0, "deviation-heading": 0.4364712860443736, "deviation-center-line": 0.23117905195187863}}
No reset possible
12018step3-videossuccessyes0:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12016step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 96, "reward": -11.349668675932966, "good_angle": 1.7179557442033695, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 1.1666666666666623}, "ep001": {"nsteps": 51, "reward": -19.23204826359071, "good_angle": 0.015479024092027331, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 69, "reward": -14.100173311065072, "good_angle": 0.4302911959904313, "survival_time": 2.3000000000000016, "traveled_tiles": 2, "valid_direction": 0.8333333333333337}, "ep003": {"nsteps": 68, "reward": -14.367445885354432, "good_angle": 0.029254860426094834, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 101, "reward": -9.711912207176336, "good_angle": 0.40177689882877526, "survival_time": 3.3666666666666645, "traveled_tiles": 3, "valid_direction": 0.8666666666666636}}
good_angle_max1.7179557442033695
good_angle_mean0.5189515447081396
good_angle_median0.40177689882877526
good_angle_min0.015479024092027331
reward_max-9.711912207176336
reward_mean-13.752249668623904
reward_median-14.100173311065072
reward_min-19.23204826359071
survival_time_max3.3666666666666645
survival_time_mean2.5666666666666673
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max1.1666666666666623
valid_direction_mean0.573333333333332
valid_direction_median0.8333333333333337
valid_direction_min0
No reset possible
12007step1-simulationsuccessyes0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6796step4-vizsuccessyes0:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6564step4-vizabortedyes0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission799/step4-viz-nutonomy-P50-2210-job6564'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6438step4-vizabortedyes0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission799/step4-viz-nutonomy-P50-2570-job6438'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6325step4-vizsuccessno0:03:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6320step3-videossuccessyes0:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6316step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6310step1-simulationsuccessno0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5957step4-vizsuccessno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5956step3-videossuccessno0:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5955step2-scoringsuccessno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5954step2-scoringsuccessno0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5953step2-scoringsuccessno0:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5952step2-scoringabortedno0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5951step1-simulationabortedno0:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5949step4-vizabortedno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5948step4-vizabortedno0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5947step4-vizabortedno0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5946step3-videosabortedno0:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5945step3-videosabortedno0:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5944step3-videosabortedno0:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5943step2-scoringabortedno0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5942step2-scoringabortedno0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5932step1-simulationabortedno0:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5929step4-vizabortedno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5928step4-vizabortedno0:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5927step3-videosabortedno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5926step3-videosabortedno0:00:23
Error while running [...]

Creating job5926-3618_videos_1 ... error
stderr | ERROR: for job5926-3618_videos_1  Cannot start service videos: network job5926-3618_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job5926-3618_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5925step2-scoringabortedno0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5924step2-scoringabortedno0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5923step1-simulationabortedno0:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5922step1-simulationabortedno0:02:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible