Duckietown Challenges Home Challenges Submissions

Submission 17127

Submission17127
Competingyes
Challengeaido-LF-sim-validation
UserAbolfazl Lavaei
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 107807 sim-1of4: 107805 sim-2of4: 107811 sim-3of4: 107810
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

107811

Click the images to see detailed statistics about the episode.

autolab-000

107810

Click the images to see detailed statistics about the episode.

loop-000

107807

Click the images to see detailed statistics about the episode.

loop2-000

107805

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
107811sim-2of4successyes0:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.643731473796799
survival_time_median32.85000000000027
deviation-center-line_median0.9982962426219784
in-drivable-lane_median13.300000000000113


other stats
deviation-center-line_max0.9982962426219784
deviation-center-line_mean0.9982962426219784
deviation-center-line_min0.9982962426219784
deviation-heading_max5.45176875655377
deviation-heading_mean5.45176875655377
deviation-heading_median5.45176875655377
deviation-heading_min5.45176875655377
distance-from-start_max1.8421196359938588
distance-from-start_mean1.8421196359938588
distance-from-start_median1.8421196359938588
distance-from-start_min1.8421196359938588
driven_any_max4.216718945853398
driven_any_mean4.216718945853398
driven_any_median4.216718945853398
driven_any_min4.216718945853398
driven_lanedir_consec_max1.643731473796799
driven_lanedir_consec_mean1.643731473796799
driven_lanedir_consec_min1.643731473796799
driven_lanedir_max2.34682365166564
driven_lanedir_mean2.34682365166564
driven_lanedir_median2.34682365166564
driven_lanedir_min2.34682365166564
in-drivable-lane_max13.300000000000113
in-drivable-lane_mean13.300000000000113
in-drivable-lane_min13.300000000000113
per-episodes
details{"autolab-000-ego0": {"driven_any": 4.216718945853398, "survival_time": 32.85000000000027, "driven_lanedir": 2.34682365166564, "in-drivable-lane": 13.300000000000113, "deviation-heading": 5.45176875655377, "distance-from-start": 1.8421196359938588, "deviation-center-line": 0.9982962426219784, "driven_lanedir_consec": 1.643731473796799}}
simulation-passed1
survival_time_max32.85000000000027
survival_time_mean32.85000000000027
survival_time_min32.85000000000027
No reset possible
107810sim-3of4successyes0:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.567236732623785
survival_time_median59.99999999999873
deviation-center-line_median3.7519886077758127
in-drivable-lane_median4.14999999999991


other stats
deviation-center-line_max3.7519886077758127
deviation-center-line_mean3.7519886077758127
deviation-center-line_min3.7519886077758127
deviation-heading_max8.16264961405022
deviation-heading_mean8.16264961405022
deviation-heading_median8.16264961405022
deviation-heading_min8.16264961405022
distance-from-start_max2.205470572023306
distance-from-start_mean2.205470572023306
distance-from-start_median2.205470572023306
distance-from-start_min2.205470572023306
driven_any_max7.907778283726452
driven_any_mean7.907778283726452
driven_any_median7.907778283726452
driven_any_min7.907778283726452
driven_lanedir_consec_max4.567236732623785
driven_lanedir_consec_mean4.567236732623785
driven_lanedir_consec_min4.567236732623785
driven_lanedir_max7.092829324961172
driven_lanedir_mean7.092829324961172
driven_lanedir_median7.092829324961172
driven_lanedir_min7.092829324961172
in-drivable-lane_max4.14999999999991
in-drivable-lane_mean4.14999999999991
in-drivable-lane_min4.14999999999991
per-episodes
details{"loop-000-ego0": {"driven_any": 7.907778283726452, "survival_time": 59.99999999999873, "driven_lanedir": 7.092829324961172, "in-drivable-lane": 4.14999999999991, "deviation-heading": 8.16264961405022, "distance-from-start": 2.205470572023306, "deviation-center-line": 3.7519886077758127, "driven_lanedir_consec": 4.567236732623785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107807sim-0of4successyes0:04:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.315305308097315
survival_time_median59.99999999999873
deviation-center-line_median4.986613129169974
in-drivable-lane_median9.349999999999824


other stats
deviation-center-line_max4.986613129169974
deviation-center-line_mean4.986613129169974
deviation-center-line_min4.986613129169974
deviation-heading_max10.182654325988462
deviation-heading_mean10.182654325988462
deviation-heading_median10.182654325988462
deviation-heading_min10.182654325988462
distance-from-start_max1.0009433830058465
distance-from-start_mean1.0009433830058465
distance-from-start_median1.0009433830058465
distance-from-start_min1.0009433830058465
driven_any_max7.914298524265738
driven_any_mean7.914298524265738
driven_any_median7.914298524265738
driven_any_min7.914298524265738
driven_lanedir_consec_max6.315305308097315
driven_lanedir_consec_mean6.315305308097315
driven_lanedir_consec_min6.315305308097315
driven_lanedir_max6.398676738863498
driven_lanedir_mean6.398676738863498
driven_lanedir_median6.398676738863498
driven_lanedir_min6.398676738863498
in-drivable-lane_max9.349999999999824
in-drivable-lane_mean9.349999999999824
in-drivable-lane_min9.349999999999824
per-episodes
details{"loop2-000-ego0": {"driven_any": 7.914298524265738, "survival_time": 59.99999999999873, "driven_lanedir": 6.398676738863498, "in-drivable-lane": 9.349999999999824, "deviation-heading": 10.182654325988462, "distance-from-start": 1.0009433830058465, "deviation-center-line": 4.986613129169974, "driven_lanedir_consec": 6.315305308097315}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107805sim-1of4successyes0:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.54383980470204
survival_time_median59.99999999999873
deviation-center-line_median3.4590116430570994
in-drivable-lane_median17.899999999999963


other stats
deviation-center-line_max3.4590116430570994
deviation-center-line_mean3.4590116430570994
deviation-center-line_min3.4590116430570994
deviation-heading_max11.79096499219191
deviation-heading_mean11.79096499219191
deviation-heading_median11.79096499219191
deviation-heading_min11.79096499219191
distance-from-start_max4.3237750481894475
distance-from-start_mean4.3237750481894475
distance-from-start_median4.3237750481894475
distance-from-start_min4.3237750481894475
driven_any_max7.914355979144823
driven_any_mean7.914355979144823
driven_any_median7.914355979144823
driven_any_min7.914355979144823
driven_lanedir_consec_max4.54383980470204
driven_lanedir_consec_mean4.54383980470204
driven_lanedir_consec_min4.54383980470204
driven_lanedir_max5.150592315422793
driven_lanedir_mean5.150592315422793
driven_lanedir_median5.150592315422793
driven_lanedir_min5.150592315422793
in-drivable-lane_max17.899999999999963
in-drivable-lane_mean17.899999999999963
in-drivable-lane_min17.899999999999963
per-episodes
details{"zigzag-000-ego0": {"driven_any": 7.914355979144823, "survival_time": 59.99999999999873, "driven_lanedir": 5.150592315422793, "in-drivable-lane": 17.899999999999963, "deviation-heading": 11.79096499219191, "distance-from-start": 4.3237750481894475, "deviation-center-line": 3.4590116430570994, "driven_lanedir_consec": 4.54383980470204}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
88893sim-0of4successno0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88889sim-0of4successno0:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88888sim-3of4successno0:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88884sim-0of4successno0:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88880sim-3of4host-errorno0:02:37
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, nogpu-production-b-spot-0-02-job88880-642583, up, --no-start,
│          --renew-anon-volumes]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'nogpu-production-b-spot-0-02-job88880-642583', 'up', '--no-start', '--renew-anon-volumes']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88874sim-3of4successno0:08:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88873sim-0of4successno0:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88869sim-3of4successno0:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88866sim-3of4successno0:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88864sim-1of4successno0:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88856sim-2of4successno0:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88851sim-2of4successno0:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88848sim-2of4successno0:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88845sim-1of4successno0:07:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86217sim-1of4errorno0:01:17
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-1of4-montreal05_802404650a97-job86217-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86208sim-0of4errorno0:01:19
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-0of4-montreal02_b87fca61d0e7-job86208-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86206sim-2of4errorno0:01:17
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-2of4-montreal02_b87fca61d0e7-job86206-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86205sim-3of4errorno0:01:17
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86205-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86204sim-3of4errorno0:00:45
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/aido-LF-sim-validation/submission17127/sim-3of4-montreal05_802404650a97-job86204-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible