Duckietown Challenges Home Challenges Submissions

Evaluator 111

ID111
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
versionDC:3.1.42;DCR:3.2.4;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success21 486
# timeout1 672
# failed11 471
# error6 467
# aborted1 507
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6721Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationtimeoutnorudolf-30:11:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6661Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6611Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6551Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6501Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6441Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6391Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6351Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6281Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6231Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6181Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6141Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6081Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6031Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5991Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5951Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5891Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnorudolf-30:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
582221Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
578188Brian Wang 🇺🇸ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
572144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationfailednorudolf-30:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 60, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
571304Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
566279Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:32
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job566-4989', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job566-4989', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
561274Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job561-1804', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job561-1804', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
551148Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornorudolf-30:01:12
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job551-8803', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job551-8803', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
549303Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationsuccessyesrudolf-30:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
548302Benjamin Ramtoula 🇨🇦PyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean3.8399999999999936
good_angle_mean5.712324650075606
valid_direction_mean4.126666666666655


other stats
episodes
details{"ep000": {"nsteps": 326, "reward": -4.185904819269784, "good_angle": 17.00283158466511, "survival_time": 10.86666666666664, "traveled_tiles": 3, "valid_direction": 10.06666666666664}, "ep001": {"nsteps": 47, "reward": -21.78644858268981, "good_angle": 0.10304342308800532, "survival_time": 1.5666666666666682, "traveled_tiles": 1, "valid_direction": 0.033333333333333326}, "ep002": {"nsteps": 157, "reward": -7.487883093557765, "good_angle": 5.439783432683278, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 3.5999999999999943}, "ep003": {"nsteps": 500, "reward": -1.5760904029607772, "good_angle": 4.075916441194855, "survival_time": 0.8999999999999999, "traveled_tiles": 5, "valid_direction": 4.199999999999985}, "ep004": {"nsteps": 148, "reward": -9.375770025962108, "good_angle": 1.9400483687467784, "survival_time": 4.933333333333326, "traveled_tiles": 1, "valid_direction": 2.7333333333333236}}
good_angle_max17.00283158466511
good_angle_median4.075916441194855
good_angle_min0.10304342308800532
reward_max-1.5760904029607772
reward_mean-8.882419384888049
reward_median-7.487883093557765
reward_min-21.78644858268981
survival_time_max10.86666666666664
survival_time_median1.5666666666666682
survival_time_min0.8999999999999999
traveled_tiles_max5
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max10.06666666666664
valid_direction_median3.5999999999999943
valid_direction_min0.033333333333333326
No reset possible
540296Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 27, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', '/aidamod/target/aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
538294Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 26, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', '/aidamod/target/aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
537293Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 20, in run
    cis.info('in directory %s' % pwd)
NameError: global name 'pwd' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
536292Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', '/aidamod/target/aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
534290Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
NameError: global name 'cwd' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
533289Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
532288Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:01:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
527283Anton Mashikhin 🇷🇺PyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean3.94666666666666
good_angle_mean5.498296717142049
valid_direction_mean4.199999999999989


other stats
episodes
details{"ep000": {"nsteps": 327, "reward": -4.178794071622284, "good_angle": 16.715569083477064, "survival_time": 10.899999999999972, "traveled_tiles": 3, "valid_direction": 10.099999999999971}, "ep001": {"nsteps": 48, "reward": -21.32853613918026, "good_angle": 0.11785841075970252, "survival_time": 1.6000000000000016, "traveled_tiles": 1, "valid_direction": 0.33333333333333437}, "ep002": {"nsteps": 160, "reward": -7.405842852720525, "good_angle": 5.16241581020782, "survival_time": 1.1, "traveled_tiles": 2, "valid_direction": 3.533333333333328}, "ep003": {"nsteps": 500, "reward": -1.8052545309066772, "good_angle": 3.4591786027815057, "survival_time": 1.0666666666666669, "traveled_tiles": 5, "valid_direction": 4.366666666666651}, "ep004": {"nsteps": 152, "reward": -9.251631527354842, "good_angle": 2.036461678484153, "survival_time": 5.066666666666658, "traveled_tiles": 1, "valid_direction": 2.666666666666657}}
good_angle_max16.715569083477064
good_angle_median3.4591786027815057
good_angle_min0.11785841075970252
reward_max-1.8052545309066772
reward_mean-8.79401182435692
reward_median-7.405842852720525
reward_min-21.32853613918026
survival_time_max10.899999999999972
survival_time_median1.6000000000000016
survival_time_min1.0666666666666669
traveled_tiles_max5
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max10.099999999999971
valid_direction_median3.533333333333328
valid_direction_min0.33333333333333437
No reset possible
526283Anton Mashikhin 🇷🇺PyTorch DDPG templateaido1_LF1_r2-v3step1-simulationsuccessyesrudolf-30:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
514272Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job514-863', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job514-863', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
507224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortednorudolf-30:02:44
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job507-4555', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job507-4555', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
48623Manfred DiazSolution templateaido1_test_multistep-v3step2successyesrudolf-30:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step21


No reset possible
471220Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednorudolf-30:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
467149Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:13
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job467-8232', 'pull']:

   >  Command '['docker-compose', '-p', 'job467-8232', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible