Duckietown Challenges Home Challenges Submissions

Evaluator 105

ID105
evaluatornutonomy-P50-30037
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-30037
versionDC:3.1.42;DCR:3.2.4;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success22 481
# timeout1 654
# failed9 531
# error12 469
# aborted1 475
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6541Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationtimeoutnonutonomy-P50-300370:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6491Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6451Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6401Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6331Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6301Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6251Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6221Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6171Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6121Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6071Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6021Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5971Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5921Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5881Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnonutonomy-P50-300370:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
583221Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-300370:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
579216Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-300370:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
575150Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-300370:00:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
569282Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
564277Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job564-9980', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job564-9980', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
559272Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job559-8177', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job559-8177', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
556245Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job556-4252', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job556-4252', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
552149Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job552-2063', 'pull']:

   >  Command '['docker-compose', '-p', 'job552-2063', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
550303Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-300370:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean15.766666666666646
good_angle_mean18.75178798165288
valid_direction_mean12.379999999999974


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.6545683238618076, "good_angle": 20.62360246521738, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.166666666666629}, "ep001": {"nsteps": 500, "reward": -1.9717354961615057, "good_angle": 35.035932406460454, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.73333333333332}, "ep002": {"nsteps": 500, "reward": -1.354252554655075, "good_angle": 4.155580463453497, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 8.899999999999993}, "ep003": {"nsteps": 500, "reward": -0.9551559686834372, "good_angle": 13.700336014125652, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.899999999999968}, "ep004": {"nsteps": 373, "reward": -4.6365865061494045, "good_angle": 20.24348855900743, "survival_time": 12.366666666666632, "traveled_tiles": 3, "valid_direction": 11.199999999999966}}
good_angle_max35.035932406460454
good_angle_median20.24348855900743
good_angle_min4.155580463453497
reward_max-0.9551559686834372
reward_mean-2.114459769902246
reward_median-1.6545683238618076
reward_min-4.6365865061494045
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min12.366666666666632
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_min1
valid_direction_max14.166666666666629
valid_direction_median13.73333333333332
valid_direction_min8.899999999999993
No reset possible
546301Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesnutonomy-P50-300370:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 29, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', 'aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
545300Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationfailedyesnutonomy-P50-300370:00:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 74, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: no display name and no $DISPLAY environment variable
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
544299Mandana Samiei 🇨🇦Tensorflow templateaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-300370:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.0999999999999956
good_angle_mean0.8528424466559141
valid_direction_mean1.0799999999999996


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 40, "reward": -27.020476116240022, "good_angle": 0.3599462095929096, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.966666666666667}, "ep004": {"nsteps": 110, "reward": -9.886259459475564, "good_angle": 0.778024221452358, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.8333333333333317}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.708743580870792
reward_median-9.886259459475564
reward_min-27.020476116240022
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.8333333333333317
valid_direction_median0.966666666666667
valid_direction_min0.5333333333333314
No reset possible
542298Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-300370:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
541297Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesnutonomy-P50-300370:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 27, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', 'aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
539295Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesnutonomy-P50-300370:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 27, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', '/aidamod/target/aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
531287Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesnutonomy-P50-300370:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 570, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
530286Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 414, in run
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission286/step1-simulation-nutonomy-P50-30037-job530/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
529285Orlando Marquez 🇨🇦Solution templateaido1_luck-v3step1successyesnutonomy-P50-300370:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score112.18115790786743


No reset possible
528284Orlando Marquez 🇨🇦Solution templateaido1_luck-v3step1erroryesnutonomy-P50-300370:00:11
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job528-1944', 'pull']:

   >  Command '['docker-compose', '-p', 'job528-1944', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522279Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:38
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job522-100', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job522-100', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521278Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job521-5239', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job521-5239', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
515273Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job515-5165', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job515-5165', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
512270Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job512-3283', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job512-3283', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
505224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-300370:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
496267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-300370:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
493268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step2-scoringsuccessnonutonomy-P50-300370:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.266666666666658


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.740868409591562, "good_angle": 24.13654540141594, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 158, "reward": -6.873461185376855, "good_angle": 0.008315695200685494, "survival_time": 5.266666666666658, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 113, "reward": -10.008224710451223, "good_angle": 4.246423628012533, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.9999999999999964}, "ep003": {"nsteps": 43, "reward": -25.05015734739082, "good_angle": 0.04422878805940565, "survival_time": 1.4333333333333345, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 284, "reward": -4.065766896332719, "good_angle": 0.5813377043870267, "survival_time": 9.466666666666644, "traveled_tiles": 3, "valid_direction": 0}}
good_angle_max24.13654540141594
good_angle_mean5.803370243415118
good_angle_median0.5813377043870267
good_angle_min0.008315695200685494
reward_max-4.065766896332719
reward_mean-10.747695709828635
reward_median-7.740868409591562
reward_min-25.05015734739082
survival_time_max9.466666666666644
survival_time_mean5.119999999999991
survival_time_min1.4333333333333345
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean1.3799999999999968
valid_direction_median0
valid_direction_min0
No reset possible
487267Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-300370:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
48157Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step1successyesnutonomy-P50-300370:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible
475224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortednonutonomy-P50-300370:04:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
469194Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-300370:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 414, in run
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission194/step1-simulation-nutonomy-P50-30037-job469/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible