Duckietown Challenges Home Challenges Submissions

Submission 17124

Submission17124
Competingyes
Challengemooc-ros-template
UserAlihusein Kuwajerwala
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 132226
Next
User labelROS template
Admin priority50
Blessingn/a
User priority50

132226

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

LF-full-loop-002

LF-full-loop-003

LF-full-loop-004

LF-full-loop-005

LF-full-loop-006

LF-full-loop-007

LF-full-loop-008

LF-full-loop-009

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
132226simsuccessyes0:41:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median6.651299820468086


other stats
deviation-center-line_max4.898671368179232
deviation-center-line_mean3.635514597037821
deviation-center-line_median3.906431025287106
deviation-center-line_min0.29104680772415314
deviation-heading_max9.105333329091827
deviation-heading_mean6.684429702461436
deviation-heading_median6.992632586719214
deviation-heading_min1.245429022198374
distance-from-start_max3.238492457194317
distance-from-start_mean2.4554386502455023
distance-from-start_median2.539994506747988
distance-from-start_min0.6104735365188267
driven_any_max7.921214104216161
driven_any_mean7.0747502316005395
driven_any_median7.921147233811668
driven_any_min1.55472221071272
driven_lanedir_consec_max7.328071950861423
driven_lanedir_consec_mean5.859281775813475
driven_lanedir_consec_min0.642531907520747
driven_lanedir_max7.328071950861423
driven_lanedir_mean5.859281775813475
driven_lanedir_median6.651299820468086
driven_lanedir_min0.642531907520747
in-drivable-lane_max15.849999999999678
in-drivable-lane_mean8.16999999999987
in-drivable-lane_median7.799999999999811
in-drivable-lane_min2.950000000000042
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 7.921161479236111, "survival_time": 59.99999999999873, "driven_lanedir": 6.323200243810528, "in-drivable-lane": 10.599999999999842, "deviation-heading": 8.024491934983265, "distance-from-start": 2.274397512466606, "deviation-center-line": 3.939593634083243, "driven_lanedir_consec": 6.323200243810528}, "LF-full-loop-001-ego0": {"driven_any": 7.90790075866719, "survival_time": 59.99999999999873, "driven_lanedir": 5.66110504183064, "in-drivable-lane": 15.849999999999678, "deviation-heading": 6.707641619078305, "distance-from-start": 2.457910825704287, "deviation-center-line": 4.349630986851264, "driven_lanedir_consec": 5.66110504183064}, "LF-full-loop-002-ego0": {"driven_any": 7.921132988387225, "survival_time": 59.99999999999873, "driven_lanedir": 6.9227147773999285, "in-drivable-lane": 5.85, "deviation-heading": 9.105333329091827, "distance-from-start": 2.6042530872237255, "deviation-center-line": 4.898671368179232, "driven_lanedir_consec": 6.9227147773999285}, "LF-full-loop-003-ego0": {"driven_any": 7.921206335894475, "survival_time": 59.99999999999873, "driven_lanedir": 6.5822155747205064, "in-drivable-lane": 8.899999999999835, "deviation-heading": 6.973471764296219, "distance-from-start": 3.080220955783765, "deviation-center-line": 3.6206771051179745, "driven_lanedir_consec": 6.5822155747205064}, "LF-full-loop-004-ego0": {"driven_any": 7.921202505174257, "survival_time": 59.99999999999873, "driven_lanedir": 6.748750699948284, "in-drivable-lane": 7.649999999999786, "deviation-heading": 7.070304388582356, "distance-from-start": 3.238492457194317, "deviation-center-line": 3.8732684164909688, "driven_lanedir_consec": 6.748750699948284}, "LF-full-loop-005-ego0": {"driven_any": 7.921129651921801, "survival_time": 59.99999999999873, "driven_lanedir": 7.328071950861423, "in-drivable-lane": 2.950000000000042, "deviation-heading": 8.760298318871099, "distance-from-start": 2.604144244908308, "deviation-center-line": 3.810804250846627, "driven_lanedir_consec": 7.328071950861423}, "LF-full-loop-006-ego0": {"driven_any": 5.836626202574073, "survival_time": 44.99999999999958, "driven_lanedir": 4.9360217416820875, "in-drivable-lane": 6.549999999999869, "deviation-heading": 5.532443501786505, "distance-from-start": 2.000609402882512, "deviation-center-line": 2.93027889156476, "driven_lanedir_consec": 4.9360217416820875}, "LF-full-loop-007-ego0": {"driven_any": 1.55472221071272, "survival_time": 12.750000000000046, "driven_lanedir": 0.642531907520747, "in-drivable-lane": 7.3000000000000576, "deviation-heading": 1.245429022198374, "distance-from-start": 0.6104735365188267, "deviation-center-line": 0.29104680772415314, "driven_lanedir_consec": 0.642531907520747}, "LF-full-loop-008-ego0": {"driven_any": 7.921206079221391, "survival_time": 59.99999999999873, "driven_lanedir": 6.727821754144939, "in-drivable-lane": 8.099999999999774, "deviation-heading": 6.413089736584197, "distance-from-start": 2.475844768587668, "deviation-center-line": 4.391037009396681, "driven_lanedir_consec": 6.727821754144939}, "LF-full-loop-009-ego0": {"driven_any": 7.921214104216161, "survival_time": 59.99999999999873, "driven_lanedir": 6.720384066215667, "in-drivable-lane": 7.949999999999834, "deviation-heading": 7.011793409142208, "distance-from-start": 3.2080397111850036, "deviation-center-line": 4.250137500123306, "driven_lanedir_consec": 6.720384066215667}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean53.77499999999894
survival_time_min12.750000000000046
No reset possible
131519simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131519-928419, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131519-928419', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131514simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131514-462067, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131514-462067', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131512simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131512-738780, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131512-738780', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131507simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131507-429544, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131507-429544', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131502simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131502-8004, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131502-8004', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131493simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131493-179495, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131493-179495', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131491simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131491-698741, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131491-698741', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131448simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131448-600621, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131448-600621', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131440simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131440-825970, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131440-825970', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131437simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131437-78926, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131437-78926', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131430simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131430-197705, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131430-197705', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131428simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131428-452976, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131428-452976', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131420simhost-erroryes0:01:04
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-04-job131420-516485, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-04-job131420-516485', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131418simhost-erroryes0:01:56
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-02-job131418-798394, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-02-job131418-798394', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89084simsuccessno1:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88929simtimeoutno0:00:11
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88923simhost-errorno0:15:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17124/sim-nogpu-production-b-spot-0-02-job88923-a-wd/challenge-evaluation-output/episodes/LF-full-loop-004/log.gs2.cbor' -> '/tmp/tmp5zx32aaolog.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88916simhost-errorno1:08:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17124/sim-nogpu-production-b-spot-0-03-job88916-a-wd/challenge-evaluation-output/episodes/LF-full-loop-004/log.gs2.cbor' -> '/tmp/tmpiy1t93x_log.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88911simsuccessno1:18:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88905simhost-errorno0:10:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17124/sim-nogpu-production-b-spot-0-05-job88905-a-wd/docker-compose.yaml' -> '/tmp/tmprnm0p2todocker-compose.yaml'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88897simsuccessno1:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88896simsuccessno1:16:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88894simsuccessno1:18:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86202simerrorno0:03:05
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17124/sim-montreal02_b87fca61d0e7-job86202-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible