Duckietown Challenges Home Challenges Submissions

Submission 13876

Submission13876
Competingyes
Challengeaido-hello-sim-validation
UserChris Barnes
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobssanity-check: 129459
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
129459sanity-checkerroryes0:01:26
InvalidEvaluator: co [...]
InvalidEvaluator:
concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/concurrent/futures/process.py", line 239, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 461, in robot_stats
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/dist-packages/aido_analyze/utils_drawing.py", line 415, in read_and_draw
    draw_static(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_world/svg_drawing/misc.py", line 166, in draw_static
    os.makedirs(output_dir)
  File "/usr/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/scenarios/ego0'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 392, in main
    stats = future.result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
FileExistsError: [Errno 17] File exists: '/challenges/challenge-evaluation-output/episodes/scenarios/ego0'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 430, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129458sanity-checksuccessyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129457sanity-checksuccessyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129456sanity-checksuccessyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129455sanity-checksuccessyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129454sanity-checksuccessyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129453sanity-checksuccessyes0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129452sanity-checksuccessyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
129451sanity-checksuccessyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95254370successyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
95249370successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62743370successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62742370successyes0:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
62741370successyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible