Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 5633740Andrea Censi Copy of #15: sub 574 by trimcao (PyTorch template) aido1_LF1_r3-v3step3-videos success no s-MacBook-puro.local-136532018-11-05 13:19:19+00:00 2018-11-05 13:20:16+00:00 0:00:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5620737Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success no s-MacBook-puro.local-136532018-11-05 10:02:00+00:00 2018-11-05 10:14:20+00:00 0:12:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.7947607793244533, "good_angle": 50.871895001177585, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.79999999999997}, "ep001": {"nsteps": 500, "reward": -0.791930663626641, "good_angle": 36.79047601703185, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.233333333333344}, "ep002": {"nsteps": 500, "reward": -1.007000924691558, "good_angle": 1.2174371064857936, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 500, "reward": -0.8188124289009721, "good_angle": 42.098294342947696, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.466666666666679}, "ep004": {"nsteps": 500, "reward": -1.3624944336237386, "good_angle": 5.402375667365257, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.700000000000013}}good_angle_max 50.871895001177585 good_angle_mean 27.27609562700163 good_angle_median 36.79047601703185 good_angle_min 1.2174371064857936 reward_max -0.791930663626641 reward_mean -0.9549998460334724 reward_median -0.8188124289009721 reward_min -1.3624944336237386 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 7 traveled_tiles_mean 6.2 traveled_tiles_median 6 traveled_tiles_min 6 valid_direction_max 8.79999999999997 valid_direction_mean 6.26 valid_direction_median 6.700000000000013 valid_direction_min 2.0999999999999925
No reset possible 5613735Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no s-MacBook-puro.local-136532018-11-05 09:46:35+00:00 2018-11-05 09:46:55+00:00 0:00:20 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 119, in run
solve(params, cis)
File "solution.py", line 57, in solve
env = make_env(config, debug=debug)
File "solution.py", line 21, in make_env
frame_skip=config['frame_skip'])
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 164, in register
return registry.register(id, **kwargs)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 157, in register
raise error.Error('Cannot re-register id: {}'.format(id))
Error: Cannot re-register id: Duckietown-Lf-Lfv-Navv-Silent-v1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5612734Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no s-MacBook-puro.local-136532018-11-05 09:43:12+00:00 2018-11-05 09:43:46+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 117, in run
solve(params, cis)
File "solution.py", line 55, in solve
env = make_env(config, debug=debug)
File "solution.py", line 35, in make_env
env.env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5606731Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success no s-MacBook-puro.local-136532018-11-05 09:01:04+00:00 2018-11-05 09:03:17+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5602731Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success no s-MacBook-puro.local-136532018-11-05 08:48:10+00:00 2018-11-05 08:56:42+00:00 0:08:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.7952797837569379, "good_angle": 51.39317315088455, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.833333333333304}, "ep001": {"nsteps": 500, "reward": -0.791847265638411, "good_angle": 36.78996851775909, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.233333333333344}, "ep002": {"nsteps": 500, "reward": -1.007000924691558, "good_angle": 1.2174371064857936, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 500, "reward": -0.8188124289009721, "good_angle": 42.098294342947696, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.466666666666679}, "ep004": {"nsteps": 500, "reward": -1.3624944336237386, "good_angle": 5.402375667365257, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.700000000000013}}good_angle_max 51.39317315088455 good_angle_mean 27.38024975708848 good_angle_median 36.78996851775909 good_angle_min 1.2174371064857936 reward_max -0.791847265638411 reward_mean -0.9550869673223236 reward_median -0.8188124289009721 reward_min -1.3624944336237386 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 7 traveled_tiles_mean 6.2 traveled_tiles_median 6 traveled_tiles_min 6 valid_direction_max 8.833333333333304 valid_direction_mean 6.2666666666666675 valid_direction_median 6.700000000000013 valid_direction_min 2.0999999999999925
No reset possible 5595730Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no s-MacBook-puro.local-136532018-11-05 07:39:56+00:00 2018-11-05 07:49:49+00:00 0:09:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5591729Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success no s-MacBook-puro.local-136532018-11-05 07:19:33+00:00 2018-11-05 07:22:54+00:00 0:03:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5559723Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step3-videos success no s-MacBook-puro.local-136532018-11-05 01:06:55+00:00 2018-11-05 01:13:05+00:00 0:06:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5538719Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no s-MacBook-puro.local-136532018-11-05 00:49:20+00:00 2018-11-05 01:06:42+00:00 0:17:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5506710Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no s-MacBook-puro.local-136532018-11-04 19:17:53+00:00 2018-11-04 19:34:31+00:00 0:16:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5332675Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success no s-MacBook-puro.local-136532018-11-02 17:48:20+00:00 2018-11-02 17:50:48+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5275659Aleksandar Petrov Tuned lane controller - ETHZ baseline extension aido1_LF1_r3-v3step1-simulation failed no s-MacBook-puro.local-136532018-11-01 17:42:40+00:00 2018-11-01 17:53:01+00:00 0:10:21 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5273658Aleksandar Petrov Tuned lane controller - ETHZ baseline extension aido1_LF1_r3-v3step1-simulation failed no s-MacBook-puro.local-136532018-11-01 17:19:21+00:00 2018-11-01 17:29:45+00:00 0:10:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5270657Aleksandar Petrov ROS-based Lane Following (STest) aido1_LF1_r3-v3step1-simulation error no s-MacBook-puro.local-136532018-11-01 17:17:41+00:00 2018-11-01 17:18:18+00:00 0:00:37 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
cr = read_challenge_results(wd)
File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission657/step1-simulation-s-MacBook-puro.local-13653-job5270/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5263655Mikita Sazanovich DDPG aido1_LF1_r3-v3step2-scoring success no s-MacBook-puro.local-136532018-11-01 17:00:35+00:00 2018-11-01 17:02:31+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.366666666666657
other stats episodes details {"ep000": {"nsteps": 140, "reward": -9.65474681045328, "good_angle": 17.083551132545047, "survival_time": 4.66666666666666, "traveled_tiles": 2, "valid_direction": 3.366666666666659}, "ep001": {"nsteps": 161, "reward": -8.10296690982321, "good_angle": 0.5268797697708282, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 0.5999999999999982}, "ep002": {"nsteps": 197, "reward": -5.145319411371537, "good_angle": 0.280903624113773, "survival_time": 6.566666666666653, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 244, "reward": -6.435097360708674, "good_angle": 24.341748232050424, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 3.6333333333333218}, "ep004": {"nsteps": 65, "reward": -18.028497882989736, "good_angle": 0.19712566583044533, "survival_time": 2.1666666666666687, "traveled_tiles": 2, "valid_direction": 0.7666666666666688}}good_angle_max 24.341748232050424 good_angle_mean 8.486041684862105 good_angle_median 0.5268797697708282 good_angle_min 0.19712566583044533 reward_max -5.145319411371537 reward_mean -9.473325675069288 reward_median -8.10296690982321 reward_min -18.028497882989736 survival_time_max 8.133333333333315 survival_time_mean 5.37999999999999 survival_time_min 2.1666666666666687 traveled_tiles_max 3 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 3.6333333333333218 valid_direction_mean 1.6733333333333296 valid_direction_median 0.7666666666666688 valid_direction_min 0
No reset possible 5255653Iban Harlouchet Template for ROS Submission aido1_LF1_r3-v3step1-simulation success no s-MacBook-puro.local-136532018-11-01 16:29:15+00:00 2018-11-01 16:34:39+00:00 0:05:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5253652Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step3-videos success no s-MacBook-puro.local-136532018-11-01 16:13:54+00:00 2018-11-01 16:20:30+00:00 0:06:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5245648Julian Zilly Tuned lane controller - ETHZ baseline extension aido1_LF1_r3-v3step1-simulation error no s-MacBook-puro.local-136532018-11-01 15:58:02+00:00 2018-11-01 16:08:32+00:00 0:10:30 Timeout:
Waited 601 [...] Timeout:
Waited 601.855010986 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5236645Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success no s-MacBook-puro.local-136532018-11-01 15:32:39+00:00 2018-11-01 15:34:16+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.066666666666662
other stats episodes details {"ep000": {"nsteps": 122, "reward": -9.584048272156323, "good_angle": 4.15024539593361, "survival_time": 4.066666666666662, "traveled_tiles": 1, "valid_direction": 3.2999999999999954}, "ep001": {"nsteps": 125, "reward": -9.326586581707, "good_angle": 4.253873169300722, "survival_time": 4.166666666666662, "traveled_tiles": 1, "valid_direction": 3.366666666666662}, "ep002": {"nsteps": 150, "reward": -7.492702591568231, "good_angle": 5.0505519054772465, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 4.0999999999999925}, "ep003": {"nsteps": 97, "reward": -12.444948281209491, "good_angle": 2.6592831813146716, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.5666666666666647}, "ep004": {"nsteps": 70, "reward": -16.90499336378915, "good_angle": 1.0227292718412762, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.666666666666668}}good_angle_max 5.0505519054772465 good_angle_mean 3.427336584773505 good_angle_median 4.15024539593361 good_angle_min 1.0227292718412762 reward_max -7.492702591568231 reward_mean -11.15065581808604 reward_median -9.584048272156323 reward_min -16.90499336378915 survival_time_max 4.999999999999992 survival_time_mean 3.7599999999999967 survival_time_min 2.333333333333335 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 4.0999999999999925 valid_direction_mean 2.9999999999999964 valid_direction_median 3.2999999999999954 valid_direction_min 1.666666666666668
No reset possible 5226644Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success no s-MacBook-puro.local-136532018-11-01 15:28:29+00:00 2018-11-01 15:32:26+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.5269790861280635, "good_angle": 13.860983393856262, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999987}, "ep001": {"nsteps": 500, "reward": -0.5385801427662372, "good_angle": 28.4330701639556, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.49999999999999}, "ep002": {"nsteps": 500, "reward": -0.8243838335573673, "good_angle": 47.85120687516038, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.599999999999984}, "ep003": {"nsteps": 500, "reward": -1.0039927894249558, "good_angle": 13.88988153011114, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.833333333333323}, "ep004": {"nsteps": 20, "reward": -52.075557085871694, "good_angle": 0.7270306152193651, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}}good_angle_max 47.85120687516038 good_angle_mean 20.95243451566055 good_angle_median 13.88988153011114 good_angle_min 0.7270306152193651 reward_max -0.5269790861280635 reward_mean -10.993898587549664 reward_median -0.8243838335573673 reward_min -52.075557085871694 survival_time_max 16.666666666666654 survival_time_mean 13.466666666666658 survival_time_min 0.6666666666666666 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.599999999999984 valid_direction_mean 10.919999999999993 valid_direction_median 13.099999999999987 valid_direction_min 0.5666666666666665
No reset possible 5144595Anton Mashikhin PyTorch template aido1_LF1_r3-v3step3-videos timeout no s-MacBook-puro.local-136532018-10-31 18:08:07+00:00 2018-10-31 18:39:19+00:00 0:31:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5129605David Abraham Random execution aido1_LF1_r3-v3step4-viz success no s-MacBook-puro.local-136532018-10-31 17:43:08+00:00 2018-10-31 17:44:32+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5065611David Abraham Random execution aido1_LF1_r3-v3step4-viz success no s-MacBook-puro.local-136532018-10-31 17:15:55+00:00 2018-10-31 17:39:00+00:00 0:23:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5055612Ayush Soni Solution template aido1_luck-v3step1 success yes s-MacBook-puro.local-136532018-10-31 17:11:01+00:00 2018-10-31 17:11:52+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5046598Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no s-MacBook-puro.local-136532018-10-31 16:59:18+00:00 2018-10-31 17:08:33+00:00 0:09:15 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 18, in make_env
env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Yun Chen 🇨🇦
