Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 5944799Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos aborted no rudolf-72018-11-07 15:41:59+00:00 2018-11-07 15:42:53+00:00 0:00:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5940786Marta Tintore AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 15:38:17+00:00 2018-11-07 15:39:03+00:00 0:00:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5933786Marta Tintore AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 15:35:55+00:00 2018-11-07 15:37:53+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5929799Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step4-viz aborted no rudolf-72018-11-07 13:54:30+00:00 2018-11-07 13:55:39+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5922799Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation aborted no rudolf-72018-11-07 13:47:30+00:00 2018-11-07 13:50:02+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5915798Luca Bonamini Random execution aido1_LF1_r3-v3step2-scoring success no rudolf-72018-11-07 13:38:30+00:00 2018-11-07 13:38:49+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.999999999999979
other stats episodes details {"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}good_angle_max 27.571145449058 good_angle_mean 16.355745883456553 good_angle_median 24.218758506416364 good_angle_min 0.1268074882377727 reward_max -3.039140198254471 reward_mean -5.362412869085995 reward_median -5.542087158836701 reward_min -7.729742120232499 survival_time_max 12.7333333333333 survival_time_mean 9.459999999999976 survival_time_min 5.6999999999999895 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 4.066666666666652 valid_direction_mean 2.9866666666666566 valid_direction_median 3.93333333333332 valid_direction_min 0
No reset possible 5913797Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no rudolf-72018-11-07 13:26:15+00:00 2018-11-07 13:29:12+00:00 0:02:57 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 118, in run
solve(params, cis)
File "solution.py", line 83, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/wrappers.py", line 86, in step
ob, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5911795Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 13:11:35+00:00 2018-11-07 13:12:48+00:00 0:01:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5906794Manish Prajapat AMOD18-AIDO aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 13:09:02+00:00 2018-11-07 13:09:57+00:00 0:00:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5898793Luca Bonamini Solution template aido1_luck-v3step1 success yes rudolf-72018-11-07 13:04:17+00:00 2018-11-07 13:04:59+00:00 0:00:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5888792Edoardo Gabbi Random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 13:00:33+00:00 2018-11-07 13:02:15+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5884789Mikita Sazanovich ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 12:05:50+00:00 2018-11-07 12:07:16+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5876789Mikita Sazanovich ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 11:54:00+00:00 2018-11-07 12:01:29+00:00 0:07:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5874785Francesco Milano AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 11:29:09+00:00 2018-11-07 11:29:43+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5871788Aoming Liu Random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 11:19:03+00:00 2018-11-07 11:20:11+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5863784hanxue liang Random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 11:00:37+00:00 2018-11-07 11:01:26+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5857782Zijian Dong AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 10:59:03+00:00 2018-11-07 10:59:53+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5848782Zijian Dong AMOD18-AIDO not that random execution aido1_LF1_r3-v3step2-scoring success no rudolf-72018-11-07 10:56:50+00:00 2018-11-07 10:58:57+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.033333333333312
other stats episodes details {"ep000": {"nsteps": 170, "reward": -7.712571316957474, "good_angle": 25.023844936044405, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 376, "reward": -3.592209410199777, "good_angle": 23.219706056138055, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 389, "reward": -2.583105791011343, "good_angle": 0.11764789041300484, "survival_time": 12.966666666666631, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -6.194280704936466, "good_angle": 25.345004752583304, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.501812648533318, "good_angle": 4.538982516695632, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.966666666666657}}good_angle_max 25.345004752583304 good_angle_mean 15.649037230374878 good_angle_median 23.219706056138055 good_angle_min 0.11764789041300484 reward_max -2.583105791011343 reward_mean -5.116795974327675 reward_median -5.501812648533318 reward_min -7.712571316957474 survival_time_max 12.966666666666631 survival_time_mean 9.76666666666664 survival_time_min 5.666666666666656 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.933333333333321 valid_direction_mean 2.953333333333324 valid_direction_median 3.9333333333333194 valid_direction_min 0
No reset possible 5845781Aneri Muni AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 10:55:28+00:00 2018-11-07 10:56:30+00:00 0:01:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5838783Cliff Li AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation error no rudolf-72018-11-07 10:53:54+00:00 2018-11-07 10:54:46+00:00 0:00:52 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
evaluator.score(cie)
File "eval.py", line 96, in score
raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5830780Amaury Camus AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 10:43:44+00:00 2018-11-07 10:44:34+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5823780Amaury Camus AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 10:41:19+00:00 2018-11-07 10:42:56+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5811778Alessandro Morra AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 10:37:41+00:00 2018-11-07 10:39:09+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5808775Tim Franzmeyer AMOD18-AIDO not tht random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 10:36:24+00:00 2018-11-07 10:37:35+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5802777Yannick Berdou AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 10:34:54+00:00 2018-11-07 10:36:17+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5800772Tomasz Firynowicz AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 10:34:08+00:00 2018-11-07 10:34:48+00:00 0:00:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5788775Tim Franzmeyer AMOD18-AIDO not tht random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 10:31:16+00:00 2018-11-07 10:33:45+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5781771Maximilien Picquet AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation failed no rudolf-72018-11-07 10:27:44+00:00 2018-11-07 10:28:21+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 64, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 39, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 105, in step
assert len(action) == 2
AssertionError
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5778770Simon Schaefer AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 10:24:24+00:00 2018-11-07 10:25:24+00:00 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5771768Dzenan Lapandic Random execution aido1_LF1_r3-v3step3-videos success no rudolf-72018-11-07 09:58:59+00:00 2018-11-07 09:59:43+00:00 0:00:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5767768Dzenan Lapandic Random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 09:56:37+00:00 2018-11-07 09:58:35+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5761765Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success no rudolf-72018-11-07 04:02:59+00:00 2018-11-07 04:04:50+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5751766Andrea Censi Random execution aido1_LFV_r1-v3step3-videos success no rudolf-72018-11-07 04:01:51+00:00 2018-11-07 04:02:44+00:00 0:00:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5743765Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation success no rudolf-72018-11-07 03:57:51+00:00 2018-11-07 03:59:56+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
