Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 10657150Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:49:06+00:00 2018-11-18 03:49:39+00:00 0:00:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
solution.run(cis)
File "solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10649216Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:48:22+00:00 2018-11-18 03:48:59+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10607282Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 03:37:40+00:00 2018-11-18 03:48:15+00:00 0:10:35 Timeout:
Waited 602 [...] Timeout:
Waited 602.300241947 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10601311Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:36:54+00:00 2018-11-18 03:37:33+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 61, in run
solve(params, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 35, in solve
action = model.predict(observation)
File "/workspace/model.py", line 64, in predict
self._observation: [state],
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
run_metadata_ptr)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10597316Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:36:17+00:00 2018-11-18 03:36:47+00:00 0:00:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 88, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10594319Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:35:35+00:00 2018-11-18 03:36:09+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 88, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10586306Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:32:50+00:00 2018-11-18 03:35:26+00:00 0:02:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 64, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 39, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10583309Andrea Censi PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 03:32:11+00:00 2018-11-18 03:32:43+00:00 0:00:32 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10569350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 03:27:35+00:00 2018-11-18 03:32:03+00:00 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.957104968155909 deviation-center-line_median 0.7247238632408081 in-drivable-lane_median 0.6666666666666643
other stats deviation-center-line_max 0.8558600659644088 deviation-center-line_mean 0.5303206218884994 deviation-center-line_min 0.14072291605953918 deviation-heading_max 2.6783711227860767 deviation-heading_mean 1.7398067848802503 deviation-heading_median 2.427801074207694 deviation-heading_min 0.3348345054110024 driven_any_max 5.573678738813689 driven_any_mean 3.6396075513152466 driven_any_median 5.4776200803724135 driven_any_min 0.5063193345377046 driven_lanedir_max 5.1011520889022055 driven_lanedir_mean 3.3258327113616835 driven_lanedir_min 0.4868507497890653 in-drivable-lane_max 1.166666666666666 in-drivable-lane_mean 0.5000000000000007 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 5.573678738813689, "driven_lanedir": 4.957104968155909, "in-drivable-lane": 1.166666666666666, "deviation-heading": 2.5835160794424943, "deviation-center-line": 0.7589039731909486}, "ep001": {"driven_any": 0.5063193345377046, "driven_lanedir": 0.4868507497890653, "in-drivable-lane": 0, "deviation-heading": 0.3348345054110024, "deviation-center-line": 0.14072291605953918}, "ep002": {"driven_any": 5.556806530029744, "driven_lanedir": 5.1011520889022055, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 2.6783711227860767, "deviation-center-line": 0.7247238632408081}, "ep003": {"driven_any": 5.4776200803724135, "driven_lanedir": 5.050297849005792, "in-drivable-lane": 0.6666666666666732, "deviation-heading": 2.427801074207694, "deviation-center-line": 0.8558600659644088}, "ep004": {"driven_any": 1.0836130728226845, "driven_lanedir": 1.033757900955444, "in-drivable-lane": 0, "deviation-heading": 0.674511142553985, "deviation-center-line": 0.1713922909867925}}
No reset possible 10565349Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 03:26:04+00:00 2018-11-18 03:27:28+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10561349Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 03:25:37+00:00 2018-11-18 03:25:56+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.399999999999987
other stats episodes details {"ep000": {"nsteps": 75, "reward": -13.604170745698116, "good_angle": 1.2301917502973174, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.1000000000000005}, "ep001": {"nsteps": 192, "reward": -6.595385138668159, "good_angle": 16.434846620280414, "survival_time": 6.399999999999987, "traveled_tiles": 2, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 243, "reward": -4.708477047295501, "good_angle": 2.9835800616583676, "survival_time": 8.099999999999982, "traveled_tiles": 4, "valid_direction": 5.433333333333317}, "ep003": {"nsteps": 235, "reward": -5.313450702277825, "good_angle": 0.9382884341781615, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 3.8333333333333215}, "ep004": {"nsteps": 182, "reward": -6.635858653987, "good_angle": 1.485718414663734, "survival_time": 6.066666666666655, "traveled_tiles": 2, "valid_direction": 4.4666666666666535}}good_angle_max 16.434846620280414 good_angle_mean 4.6145250562156 good_angle_median 1.485718414663734 good_angle_min 0.9382884341781615 reward_max -4.708477047295501 reward_mean -7.37146845758532 reward_median -6.595385138668159 reward_min -13.604170745698116 survival_time_max 8.099999999999982 survival_time_mean 6.179999999999988 survival_time_min 2.500000000000001 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.433333333333317 valid_direction_mean 3.946666666666656 valid_direction_median 3.899999999999986 valid_direction_min 2.1000000000000005
No reset possible 10554321Andrea Censi PyTorch DDPG template aido1_LFV_r1-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:24:19+00:00 2018-11-18 03:25:26+00:00 0:01:07 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 87, in run
solve(params, cis)
File "solution.py", line 62, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10550334Andrea Censi Tensorflow template aido1_LFV_r1-v3step4-viz success no idsc-rudolf-176902018-11-18 03:22:17+00:00 2018-11-18 03:24:12+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.14056212882966856 in-drivable-lane_median 0
other stats deviation-center-line_max 0.2088482491745832 deviation-center-line_mean 0.15471185572303592 deviation-center-line_min 0.11857116864988688 deviation-heading_max 0.6909281020566628 deviation-heading_mean 0.54082895501694 deviation-heading_median 0.5051233802717945 deviation-heading_min 0.43235700221045265 driven_any_max 2.7094732207334946 driven_any_mean 1.500430197030569 driven_any_median 1.3951946942847553 driven_any_min 0.7722235922831703 driven_lanedir_max 2.189437723172276 driven_lanedir_mean 1.3699010835235828 driven_lanedir_median 1.3758390579958164 driven_lanedir_min 0.7422319306479934 in-drivable-lane_max 1.266666666666667 in-drivable-lane_mean 0.2533333333333334 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.7094732207334946, "driven_lanedir": 2.189437723172276, "in-drivable-lane": 1.266666666666667, "deviation-heading": 0.6410149290523307, "deviation-center-line": 0.2088482491745832}, "ep001": {"driven_any": 0.7722235922831703, "driven_lanedir": 0.7422319306479934, "in-drivable-lane": 0, "deviation-heading": 0.43235700221045265, "deviation-center-line": 0.11857116864988688}, "ep002": {"driven_any": 1.195056730021914, "driven_lanedir": 1.1450018401336526, "in-drivable-lane": 0, "deviation-heading": 0.6909281020566628, "deviation-center-line": 0.1805652050091962}, "ep003": {"driven_any": 1.4302027478295092, "driven_lanedir": 1.3969948656681752, "in-drivable-lane": 0, "deviation-heading": 0.5051233802717945, "deviation-center-line": 0.14056212882966856}, "ep004": {"driven_any": 1.3951946942847553, "driven_lanedir": 1.3758390579958164, "in-drivable-lane": 0, "deviation-heading": 0.43472136149345897, "deviation-center-line": 0.12501252695184475}}
No reset possible 10546334Andrea Censi Tensorflow template aido1_LFV_r1-v3step3-videos success yes idsc-rudolf-176902018-11-18 03:21:07+00:00 2018-11-18 03:22:03+00:00 0:00:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10544334Andrea Censi Tensorflow template aido1_LFV_r1-v3step2-scoring success yes idsc-rudolf-176902018-11-18 03:20:38+00:00 2018-11-18 03:20:58+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.466666666666661
other stats episodes details {"ep000": {"nsteps": 243, "reward": -4.3291447396737945, "good_angle": 0.581499576920051, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5666666666666665}, "ep001": {"nsteps": 78, "reward": -13.021996507850975, "good_angle": 0.42176923689785734, "survival_time": 2.6000000000000005, "traveled_tiles": 3, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 118, "reward": -8.68112879300932, "good_angle": 0.4726089712352656, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep003": {"nsteps": 139, "reward": -7.295423986885521, "good_angle": 0.27100701034671554, "survival_time": 4.633333333333327, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 134, "reward": -7.560127618597949, "good_angle": 1.0827692353518417, "survival_time": 4.466666666666661, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}}good_angle_max 1.0827692353518417 good_angle_mean 0.5659308061503463 good_angle_median 0.4726089712352656 good_angle_min 0.27100701034671554 reward_max -4.3291447396737945 reward_mean -8.177564329203515 reward_median -7.560127618597949 reward_min -13.021996507850975 survival_time_max 8.099999999999982 survival_time_mean 4.74666666666666 survival_time_min 2.6000000000000005 traveled_tiles_max 5 traveled_tiles_mean 3.4 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 0.6666666666666643 valid_direction_mean 0.5733333333333317 valid_direction_median 0.5666666666666647 valid_direction_min 0.5333333333333314
No reset possible 10533334Andrea Censi Tensorflow template aido1_LFV_r1-v3step1-simulation success no idsc-rudolf-176902018-11-18 03:18:18+00:00 2018-11-18 03:20:25+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10524364Pravish Sainath PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 03:16:04+00:00 2018-11-18 03:18:11+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5595474272820549 deviation-center-line_median 0.28694183703818704 in-drivable-lane_median 3.266666666666655
other stats deviation-center-line_max 0.5604621640188293 deviation-center-line_mean 0.3088653044866211 deviation-center-line_min 0.15469694830615136 deviation-heading_max 3.6140301383805906 deviation-heading_mean 1.4974190774376648 deviation-heading_median 1.0668466076435914 deviation-heading_min 0.31545320326952786 driven_any_max 1.950092311294152 driven_any_mean 0.9747195659796196 driven_any_median 1.1829301176841596 driven_any_min 0.12776479806561683 driven_lanedir_max 0.9420818020679832 driven_lanedir_mean 0.4962804615613585 driven_lanedir_min 0.12241453975447893 in-drivable-lane_max 5.0333333333333155 in-drivable-lane_mean 2.579999999999991 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3747020105583748, "driven_lanedir": 0.1538791159023375, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.598145774419718, "deviation-center-line": 0.1745379082770337}, "ep001": {"driven_any": 0.12776479806561683, "driven_lanedir": 0.12241453975447893, "in-drivable-lane": 0, "deviation-heading": 0.31545320326952786, "deviation-center-line": 0.15469694830615136}, "ep002": {"driven_any": 1.950092311294152, "driven_lanedir": 0.9420818020679832, "in-drivable-lane": 5.0333333333333155, "deviation-heading": 3.6140301383805906, "deviation-center-line": 0.5604621640188293}, "ep003": {"driven_any": 1.1829301176841596, "driven_lanedir": 0.5595474272820549, "in-drivable-lane": 4.066666666666652, "deviation-heading": 0.8926196634748961, "deviation-center-line": 0.28694183703818704}, "ep004": {"driven_any": 1.238108592295796, "driven_lanedir": 0.7034794227999377, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.0668466076435914, "deviation-center-line": 0.36768766479290393}}
No reset possible 10519358Anton Mashikhin PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 03:15:31+00:00 2018-11-18 03:15:54+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.199999999999984
other stats episodes details {"ep000": {"nsteps": 69, "reward": -14.744397077041311, "good_angle": 0.9002840182850722, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 1.8666666666666685}, "ep001": {"nsteps": 195, "reward": -6.667362828789136, "good_angle": 17.536791284684597, "survival_time": 6.499999999999987, "traveled_tiles": 2, "valid_direction": 4.5999999999999845}, "ep002": {"nsteps": 230, "reward": -4.756876854896141, "good_angle": 2.4849022245898893, "survival_time": 7.666666666666649, "traveled_tiles": 3, "valid_direction": 3.69999999999999}, "ep003": {"nsteps": 216, "reward": -5.893432596459105, "good_angle": 1.093232124761194, "survival_time": 7.199999999999984, "traveled_tiles": 3, "valid_direction": 5.299999999999983}, "ep004": {"nsteps": 231, "reward": -5.421133343231142, "good_angle": 8.610002623285633, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 4.499999999999984}}good_angle_max 17.536791284684597 good_angle_mean 6.125042455121276 good_angle_median 2.4849022245898893 good_angle_min 0.9002840182850722 reward_max -4.756876854896141 reward_mean -7.496640540083368 reward_median -5.893432596459105 reward_min -14.744397077041311 survival_time_max 7.699999999999982 survival_time_mean 6.273333333333321 survival_time_min 2.3000000000000016 traveled_tiles_max 3 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.299999999999983 valid_direction_mean 3.9933333333333225 valid_direction_median 4.499999999999984 valid_direction_min 1.8666666666666685
No reset possible 10502358Anton Mashikhin PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 03:10:57+00:00 2018-11-18 03:15:24+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10497361Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 03:10:22+00:00 2018-11-18 03:10:48+00:00 0:00:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 96, in run
solve(params, cis)
File "solution.py", line 28, in solve
env = gym.make(params['env'])
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
return registry.make(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
spec = self.spec(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10468396Anna Tsalapova simple submition aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 03:03:58+00:00 2018-11-18 03:10:13+00:00 0:06:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7199114328934264 deviation-center-line_median 0.725651349029092 in-drivable-lane_median 0
other stats deviation-center-line_max 1.610356179034906 deviation-center-line_mean 0.8676533233647288 deviation-center-line_min 0.4922185378333373 deviation-heading_max 4.100867133286692 deviation-heading_mean 1.339475690890793 deviation-heading_median 1.1240165941114446 deviation-heading_min 0.07942104943374231 driven_any_max 6.6400000000001045 driven_any_mean 6.640000000000072 driven_any_median 6.640000000000084 driven_any_min 6.640000000000005 driven_lanedir_max 1.4933261824878092 driven_lanedir_mean 0.6576413857612371 driven_lanedir_min 0.0905657460899354 in-drivable-lane_max 9.266666666666666 in-drivable-lane_mean 1.853333333333333 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 6.6400000000001045, "driven_lanedir": 0.0905657460899354, "in-drivable-lane": 9.266666666666666, "deviation-heading": 4.100867133286692, "deviation-center-line": 0.8693818689862097}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.15960164900917606, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.610356179034906}, "ep002": {"driven_any": 6.640000000000005, "driven_lanedir": 0.7199114328934264, "in-drivable-lane": 0, "deviation-heading": 0.2671562683613517, "deviation-center-line": 0.725651349029092}, "ep003": {"driven_any": 6.640000000000079, "driven_lanedir": 1.4933261824878092, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374231, "deviation-center-line": 0.6406586819400985}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8248019183258386, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4922185378333373}}
No reset possible 10456396Anna Tsalapova simple submition aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 03:00:48+00:00 2018-11-18 03:03:50+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10451396Anna Tsalapova simple submition aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 03:00:15+00:00 2018-11-18 03:00:41+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.21171160599775612, "good_angle": 1.7908999000353618, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 7.39999999999999}, "ep001": {"nsteps": 500, "reward": -0.49661089354753496, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.182835554510355, "good_angle": 0.03030352864283182, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.14843576791882515, "good_angle": 0.03284738421522274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.2250587911726907, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}good_angle_max 1.7908999000353618 good_angle_mean 0.4012442705904789 good_angle_median 0.07595671165358207 good_angle_min 0.03030352864283182 reward_max 0.2250587911726907 reward_mean -0.16290700616035608 reward_median -0.182835554510355 reward_min -0.49661089354753496 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 7.39999999999999 valid_direction_mean 1.479999999999998 valid_direction_median 0 valid_direction_min 0
No reset possible 10436398Maxim Kuzmin Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 02:57:07+00:00 2018-11-18 03:00:08+00:00 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.100212150265079 deviation-center-line_median 0.3319764478185237 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.8779627467315307 deviation-center-line_mean 0.4685416857206235 deviation-center-line_min 0.2143967335335437 deviation-heading_max 2.7778411958080516 deviation-heading_mean 1.4556369648291063 deviation-heading_median 1.344696073358676 deviation-heading_min 0.17442151568286787 driven_any_max 2.117546243441621 driven_any_mean 1.1284342875345947 driven_any_median 1.1271275539762102 driven_any_min 0.3670302240713871 driven_lanedir_max 2.0512202757657048 driven_lanedir_mean 0.9788472337625772 driven_lanedir_min 0.1546323139106669 in-drivable-lane_max 2.166666666666659 in-drivable-lane_mean 0.5799999999999984 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3670302240713871, "driven_lanedir": 0.1546323139106669, "in-drivable-lane": 0.6, "deviation-heading": 2.060706133431772, "deviation-center-line": 0.2143967335335437}, "ep001": {"driven_any": 0.41852819517312134, "driven_lanedir": 0.41780791702524733, "in-drivable-lane": 0, "deviation-heading": 0.17442151568286787, "deviation-center-line": 0.3319764478185237}, "ep002": {"driven_any": 1.1271275539762102, "driven_lanedir": 1.100212150265079, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9205199058641648, "deviation-center-line": 0.5925302469351246}, "ep003": {"driven_any": 2.117546243441621, "driven_lanedir": 2.0512202757657048, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.344696073358676, "deviation-center-line": 0.3258422535843949}, "ep004": {"driven_any": 1.6119392210106345, "driven_lanedir": 1.170363511846189, "in-drivable-lane": 2.166666666666659, "deviation-heading": 2.7778411958080516, "deviation-center-line": 0.8779627467315307}}
No reset possible 10427398Maxim Kuzmin Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 02:55:59+00:00 2018-11-18 02:56:59+00:00 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10425398Maxim Kuzmin Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:55:29+00:00 2018-11-18 02:55:49+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.133333333333315
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.599018872318858, "good_angle": 1.2199876007295178, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 92, "reward": -11.436616245819176, "good_angle": 0.010323141356750592, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 244, "reward": -4.649135648043917, "good_angle": 0.9288137793883512, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 456, "reward": -2.3612767614957257, "good_angle": 1.3724275229750202, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.3666666666666583}, "ep004": {"nsteps": 348, "reward": -3.748740924725004, "good_angle": 23.0249771772223, "survival_time": 11.59999999999997, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 23.0249771772223 good_angle_mean 5.311305844334388 good_angle_median 1.2199876007295178 good_angle_min 0.010323141356750592 reward_max -2.3612767614957257 reward_mean -6.958957690480536 reward_median -4.649135648043917 reward_min -12.599018872318858 survival_time_max 15.199999999999957 survival_time_mean 8.139999999999981 survival_time_min 2.7 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.1399999999999944 valid_direction_median 2.2666666666666666 valid_direction_min 0
No reset possible 10421410Liam Paull Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 02:53:30+00:00 2018-11-18 02:55:19+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.4234837373444573 deviation-center-line_median 0.16483417063736874 in-drivable-lane_median 2.466666666666658
other stats deviation-center-line_max 0.28924845715410685 deviation-center-line_mean 0.19272202697959837 deviation-center-line_min 0.1253833219935629 deviation-heading_max 1.2301769728897156 deviation-heading_mean 0.9549473930107688 deviation-heading_median 1.0684684712414263 deviation-heading_min 0.477930265319624 driven_any_max 2.013832697585437 driven_any_mean 1.0185367564458176 driven_any_median 0.8697044725327119 driven_any_min 0.37472506406383016 driven_lanedir_max 0.6221646501296145 driven_lanedir_mean 0.4048640519105616 driven_lanedir_min 0.15083821255592256 in-drivable-lane_max 7.86666666666664 in-drivable-lane_mean 2.8799999999999906 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.37472506406383016, "driven_lanedir": 0.15083821255592256, "in-drivable-lane": 0.5666666666666669, "deviation-heading": 1.2301769728897156, "deviation-center-line": 0.1253833219935629}, "ep001": {"driven_any": 1.1960298271488394, "driven_lanedir": 0.4234837373444573, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 1.1795678461784105, "deviation-center-line": 0.22259042055281617}, "ep002": {"driven_any": 0.6383917208982697, "driven_lanedir": 0.6221646501296145, "in-drivable-lane": 0, "deviation-heading": 0.477930265319624, "deviation-center-line": 0.16483417063736874}, "ep003": {"driven_any": 0.8697044725327119, "driven_lanedir": 0.39915843911274695, "in-drivable-lane": 2.466666666666658, "deviation-heading": 0.8185934094246683, "deviation-center-line": 0.16155376456013726}, "ep004": {"driven_any": 2.013832697585437, "driven_lanedir": 0.4286752204100668, "in-drivable-lane": 7.86666666666664, "deviation-heading": 1.0684684712414263, "deviation-center-line": 0.28924845715410685}}
No reset possible 10417408Liam Paull PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:52:57+00:00 2018-11-18 02:53:20+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.133333333333332
other stats episodes details {"ep000": {"nsteps": 73, "reward": -13.913316035566671, "good_angle": 1.045392562444471, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 86, "reward": -11.956789544220408, "good_angle": 3.02166692046445, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 2.033333333333333}, "ep002": {"nsteps": 156, "reward": -7.691832452564715, "good_angle": 1.562632668279302, "survival_time": 5.199999999999991, "traveled_tiles": 4, "valid_direction": 3.2999999999999936}, "ep003": {"nsteps": 119, "reward": -9.212272953297887, "good_angle": 1.330101325560742, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 3.099999999999996}, "ep004": {"nsteps": 94, "reward": -11.344474870533226, "good_angle": 1.3763510691387104, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.633333333333332}}good_angle_max 3.02166692046445 good_angle_mean 1.6672289091775354 good_angle_median 1.3763510691387104 good_angle_min 1.045392562444471 reward_max -7.691832452564715 reward_mean -10.823737171236584 reward_median -11.344474870533226 reward_min -13.913316035566671 survival_time_max 5.199999999999991 survival_time_mean 3.519999999999998 survival_time_min 2.4333333333333345 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.2999999999999936 valid_direction_mean 2.6066666666666647 valid_direction_median 2.633333333333332 valid_direction_min 1.966666666666668
No reset possible 10404408Liam Paull PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 02:50:21+00:00 2018-11-18 02:52:50+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10401409Liam Paull ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 02:49:24+00:00 2018-11-18 02:50:14+00:00 0:00:50 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 89, in run
raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag:
'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10399413Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:48:55+00:00 2018-11-18 02:49:17+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.8333333333333295
other stats episodes details {"ep000": {"nsteps": 158, "reward": -6.461606025404025, "good_angle": 1.3059732882872144, "survival_time": 5.266666666666658, "traveled_tiles": 2, "valid_direction": 1.7666666666666604}, "ep001": {"nsteps": 93, "reward": -11.3460173318463, "good_angle": 0.028273924228359372, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 123, "reward": -8.611848360154687, "good_angle": 0.230575734261408, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep003": {"nsteps": 115, "reward": -9.07730649586605, "good_angle": 0.13338177073337495, "survival_time": 3.8333333333333295, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 66, "reward": -15.63405049343904, "good_angle": 0.3547177459559659, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}good_angle_max 1.3059732882872144 good_angle_mean 0.41058449269326447 good_angle_median 0.230575734261408 good_angle_min 0.028273924228359372 reward_max -6.461606025404025 reward_mean -10.22616574134202 reward_median -9.07730649586605 reward_min -15.63405049343904 survival_time_max 5.266666666666658 survival_time_mean 3.6999999999999966 survival_time_min 2.200000000000002 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 1.7666666666666604 valid_direction_mean 0.6133333333333317 valid_direction_median 0.4333333333333318 valid_direction_min 0
No reset possible 10387413Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 02:45:15+00:00 2018-11-18 02:48:47+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10367428????????? ??????? Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 02:38:37+00:00 2018-11-18 02:45:05+00:00 0:06:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7198854330971003 deviation-center-line_median 0.6993923666374686 in-drivable-lane_median 0
other stats deviation-center-line_max 1.536236930464029 deviation-center-line_mean 0.8128197848981245 deviation-center-line_min 0.46218760059102654 deviation-heading_max 3.2844048986051786 deviation-heading_mean 1.1761832439544904 deviation-heading_median 1.1240165941114446 deviation-heading_min 0.07942104943374192 driven_any_max 6.640000000000109 driven_any_mean 6.64000000000007 driven_any_median 6.640000000000084 driven_any_min 6.639999999999995 driven_lanedir_max 1.6799844318612076 driven_lanedir_mean 0.6880583663417399 driven_lanedir_min 0.07977707085548635 in-drivable-lane_max 10.733333333333334 in-drivable-lane_mean 2.146666666666667 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 6.640000000000109, "driven_lanedir": 0.13584553075677963, "in-drivable-lane": 10.733333333333334, "deviation-heading": 3.2844048986051786, "deviation-center-line": 0.7281699018240043}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.07977707085548635, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.536236930464029}, "ep002": {"driven_any": 6.639999999999995, "driven_lanedir": 0.7198854330971003, "in-drivable-lane": 0, "deviation-heading": 0.26715626836135253, "deviation-center-line": 0.6993923666374686}, "ep003": {"driven_any": 6.640000000000073, "driven_lanedir": 1.6799844318612076, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374192, "deviation-center-line": 0.6381121249740939}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8247993651381256, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.46218760059102654}}
No reset possible 10359428????????? ??????? Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 02:35:23+00:00 2018-11-18 02:38:28+00:00 0:03:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10356426Anton Mashikhin PyTorch template aido1_LF1_r3-v3step3-videos aborted yes idsc-rudolf-176902018-11-18 02:35:00+00:00 2018-11-18 02:35:13+00:00 0:00:13 Error while running [...]
Creating job10356-935_videos_1 ... error
stderr | ERROR: for job10356-935_videos_1 Cannot start service videos: network job10356-935_evaluation not found
stderr |
stderr | ERROR: for videos Cannot start service videos: network job10356-935_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10353426Anton Mashikhin PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:34:30+00:00 2018-11-18 02:34:53+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.133333333333315
other stats episodes details {"ep000": {"nsteps": 75, "reward": -13.619904056129355, "good_angle": 1.296344350450928, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.000000000000001}, "ep001": {"nsteps": 200, "reward": -6.67220719177858, "good_angle": 19.33263181642809, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 5.499999999999986}, "ep002": {"nsteps": 248, "reward": -4.533551920119921, "good_angle": 3.2297073074693565, "survival_time": 8.266666666666648, "traveled_tiles": 4, "valid_direction": 5.233333333333316}, "ep003": {"nsteps": 244, "reward": -5.259607985593783, "good_angle": 0.9615504649098168, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 5.166666666666651}, "ep004": {"nsteps": 259, "reward": -4.950044048173375, "good_angle": 11.964128500622458, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 2.6999999999999913}}good_angle_max 19.33263181642809 good_angle_mean 7.356872487976131 good_angle_median 3.2297073074693565 good_angle_min 0.9615504649098168 reward_max -4.533551920119921 reward_mean -7.007063040359003 reward_median -5.259607985593783 reward_min -13.619904056129355 survival_time_max 8.633333333333313 survival_time_mean 6.8399999999999865 survival_time_min 2.500000000000001 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.499999999999986 valid_direction_mean 4.119999999999989 valid_direction_median 5.166666666666651 valid_direction_min 2.000000000000001
No reset possible 10350440Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step3-videos aborted yes idsc-rudolf-176902018-11-18 02:34:10+00:00 2018-11-18 02:34:23+00:00 0:00:13 Error while running [...]
Creating job10350-8471_videos_1 ... error
stderr | ERROR: for job10350-8471_videos_1 Cannot start service videos: network job10350-8471_evaluation not found
stderr |
stderr | ERROR: for videos Cannot start service videos: network job10350-8471_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10346440Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:33:38+00:00 2018-11-18 02:34:03+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.6382543184608221, "good_angle": 26.18110894363119, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999978}, "ep001": {"nsteps": 500, "reward": -0.4151158498296281, "good_angle": 13.553417258114488, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.89999999999999}, "ep002": {"nsteps": 500, "reward": -0.2500560587957734, "good_angle": 13.658932232202693, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.17730202129750977, "good_angle": 13.64760310090124, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep004": {"nsteps": 500, "reward": -0.29369213936530286, "good_angle": 13.728997991349493, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}}good_angle_max 26.18110894363119 good_angle_mean 16.15401190523982 good_angle_median 13.658932232202693 good_angle_min 13.553417258114488 reward_max -0.17730202129750977 reward_mean -0.3548840775498073 reward_median -0.29369213936530286 reward_min -0.6382543184608221 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 13.033333333333326 valid_direction_mean 12.719999999999988 valid_direction_median 12.96666666666666 valid_direction_min 11.699999999999978
No reset possible 10342432Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 02:31:29+00:00 2018-11-18 02:33:31+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10340438Benjamin Ramtoula ROS-based Lane Following aido1_LF1_r3-v3step4-viz aborted yes idsc-rudolf-176902018-11-18 02:31:06+00:00 2018-11-18 02:31:20+00:00 0:00:14 Error while running [...]
Creating job10340-3082_visualization_1 ... error
stderr | ERROR: for job10340-3082_visualization_1 Cannot start service visualization: network job10340-3082_evaluation not found
stderr |
stderr | ERROR: for visualization Cannot start service visualization: network job10340-3082_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10339432Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:30:36+00:00 2018-11-18 02:30:59+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.8999999999999995
other stats episodes details {"ep000": {"nsteps": 100, "reward": -10.179613821655511, "good_angle": 0.3620843450670401, "survival_time": 3.3333333333333313, "traveled_tiles": 2, "valid_direction": 1.5666666666666669}, "ep001": {"nsteps": 31, "reward": -32.847541288983436, "good_angle": 0.04835720120402734, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 56, "reward": -18.323521735678828, "good_angle": 0.09308440087844524, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.2666666666666674}, "ep003": {"nsteps": 87, "reward": -11.565834969185806, "good_angle": 0.27039609574992746, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 240, "reward": -4.979632231296273, "good_angle": 15.012059567050626, "survival_time": 7.999999999999981, "traveled_tiles": 3, "valid_direction": 2.9333333333333247}}good_angle_max 15.012059567050626 good_angle_mean 3.157196321990013 good_angle_median 0.27039609574992746 good_angle_min 0.04835720120402734 reward_max -4.979632231296273 reward_mean -15.57922880935997 reward_median -11.565834969185806 reward_min -32.847541288983436 survival_time_max 7.999999999999981 survival_time_mean 3.426666666666663 survival_time_min 1.0333333333333332 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 2.9333333333333247 valid_direction_mean 1.133333333333331 valid_direction_median 0.8333333333333304 valid_direction_min 0.06666666666666665
No reset possible 10328432Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 02:26:49+00:00 2018-11-18 02:30:29+00:00 0:03:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10326441Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring aborted yes idsc-rudolf-176902018-11-18 02:26:27+00:00 2018-11-18 02:26:43+00:00 0:00:16 Error while running [...]
Creating job10326-6804_scorer_1 ... error
stderr | ERROR: for job10326-6804_scorer_1 Cannot start service scorer: network job10326-6804_evaluation not found
stderr |
stderr | ERROR: for scorer Cannot start service scorer: network job10326-6804_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10325433Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 02:25:46+00:00 2018-11-18 02:26:21+00:00 0:00:35 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10324434Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 02:25:05+00:00 2018-11-18 02:25:39+00:00 0:00:34 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10322437Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 02:24:25+00:00 2018-11-18 02:24:58+00:00 0:00:33 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10318439Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-176902018-11-18 02:23:43+00:00 2018-11-18 02:24:17+00:00 0:00:34 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10306464Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 02:17:08+00:00 2018-11-18 02:23:35+00:00 0:06:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.100249689175728 deviation-center-line_median 1.3449474516272864 in-drivable-lane_median 1.6999999999999946
other stats deviation-center-line_max 1.3768982623538213 deviation-center-line_mean 1.1562875543915694 deviation-center-line_min 0.3685860053560791 deviation-heading_max 11.68388141943642 deviation-heading_mean 9.352449839692795 deviation-heading_median 10.618271797823088 deviation-heading_min 3.660740042655455 driven_any_max 4.979113636122271 driven_any_mean 4.852610389758444 driven_any_median 4.979031772314665 driven_any_min 4.346832205322924 driven_lanedir_max 3.167659217109948 driven_lanedir_mean 2.624352949811872 driven_lanedir_min 0.676559070177116 in-drivable-lane_max 10.433333333333302 in-drivable-lane_mean 3.339999999999989 in-drivable-lane_min 0.8666666666666638 per-episodes details {"ep000": {"driven_any": 4.346832205322924, "driven_lanedir": 0.676559070177116, "in-drivable-lane": 10.433333333333302, "deviation-heading": 3.660740042655455, "deviation-center-line": 0.3685860053560791}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.979031772314665, "driven_lanedir": 3.1223517073098175, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.846312140368983, "deviation-center-line": 1.3449474516272864}, "ep003": {"driven_any": 4.978960698910106, "driven_lanedir": 3.167659217109948, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 11.68388141943642, "deviation-center-line": 1.342293455826984}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
No reset possible 10280464Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 02:12:54+00:00 2018-11-18 02:16:56+00:00 0:04:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10276464Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 02:12:25+00:00 2018-11-18 02:12:48+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 437, "reward": -2.9288726860958496, "good_angle": 23.9779702734845, "survival_time": 14.566666666666626, "traveled_tiles": 1, "valid_direction": 10.433333333333303}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25310920631792394, "good_angle": 13.56356330463625, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 500, "reward": -0.1725637492822534, "good_angle": 13.543601805681016, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999986}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 23.9779702734845 good_angle_mean 15.668053312695392 good_angle_median 13.56356330463625 good_angle_min 13.49085374796333 reward_max -0.1725637492822534 reward_mean -0.808093436285598 reward_median -0.3079843127221684 reward_min -2.9288726860958496 survival_time_max 16.666666666666654 survival_time_mean 16.24666666666665 survival_time_min 14.566666666666626 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.459999999999985 valid_direction_median 12.96666666666665 valid_direction_min 10.433333333333303
No reset possible 10250464Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 02:03:02+00:00 2018-11-18 02:12:18+00:00 0:09:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10234488Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 01:57:53+00:00 2018-11-18 02:02:56+00:00 0:05:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9484799136944472 deviation-center-line_median 0.5677877054113932 in-drivable-lane_median 8.600000000000005
other stats deviation-center-line_max 2.028264730701824 deviation-center-line_mean 0.7845677824160513 deviation-center-line_min 0 deviation-heading_max 3.855478019303108 deviation-heading_mean 1.8401736616315607 deviation-heading_median 1.2599816114188076 deviation-heading_min 0 driven_any_max 2.3498124000699914 driven_any_mean 1.5674342795309453 driven_any_median 1.6626210159854036 driven_any_min 0.8266315486538579 driven_lanedir_max 2.2167245049148843 driven_lanedir_mean 0.9400170857578052 driven_lanedir_min 0 in-drivable-lane_max 13.233333333333324 in-drivable-lane_mean 7.80666666666666 in-drivable-lane_min 0.3333333333333499 per-episodes details {"ep000": {"driven_any": 1.6626210159854036, "driven_lanedir": 0, "in-drivable-lane": 11.466666666666637, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.2304390214165508, "driven_lanedir": 0.9484799136944472, "in-drivable-lane": 8.600000000000005, "deviation-heading": 2.9701903473088436, "deviation-center-line": 0.5677877054113932}, "ep002": {"driven_any": 0.8266315486538579, "driven_lanedir": 0.4717396946818984, "in-drivable-lane": 13.233333333333324, "deviation-heading": 1.2599816114188076, "deviation-center-line": 0.2952874933258186}, "ep003": {"driven_any": 1.7676674115289226, "driven_lanedir": 1.0631413154977951, "in-drivable-lane": 5.399999999999982, "deviation-heading": 1.1152183301270446, "deviation-center-line": 1.0314989826412202}, "ep004": {"driven_any": 2.3498124000699914, "driven_lanedir": 2.2167245049148843, "in-drivable-lane": 0.3333333333333499, "deviation-heading": 3.855478019303108, "deviation-center-line": 2.028264730701824}}
No reset possible 10218488Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 01:54:18+00:00 2018-11-18 01:57:43+00:00 0:03:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10216488Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 01:53:48+00:00 2018-11-18 01:54:12+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 345, "reward": -4.313861366026644, "good_angle": 1.546963724020236, "survival_time": 11.49999999999997, "traveled_tiles": 4, "valid_direction": 3.29999999999999}, "ep001": {"nsteps": 500, "reward": -1.4437675743107683, "good_angle": 36.38482725489614, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.533333333333326}, "ep002": {"nsteps": 500, "reward": -2.2561783680744703, "good_angle": 17.112066147994756, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.299999999999986}, "ep003": {"nsteps": 381, "reward": -3.5520301861364993, "good_angle": 2.049322127125053, "survival_time": 12.699999999999966, "traveled_tiles": 4, "valid_direction": 3.5333333333333212}, "ep004": {"nsteps": 500, "reward": -0.2958944531888701, "good_angle": 15.908114050280265, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.8999999999999897}}good_angle_max 36.38482725489614 good_angle_mean 14.60025866086329 good_angle_median 15.908114050280265 good_angle_min 1.546963724020236 reward_max -0.2958944531888701 reward_mean -2.3723463895474506 reward_median -2.2561783680744703 reward_min -4.313861366026644 survival_time_max 16.666666666666654 survival_time_mean 14.83999999999998 survival_time_min 11.49999999999997 traveled_tiles_max 5 traveled_tiles_mean 3.8 traveled_tiles_median 4 traveled_tiles_min 3 valid_direction_max 15.299999999999986 valid_direction_mean 7.913333333333323 valid_direction_median 3.8999999999999897 valid_direction_min 3.29999999999999
No reset possible 102151267Mateusz Ruszczyk Solution template aido1_luck-v3step1 success yes idsc-rudolf-176902018-11-18 01:52:51+00:00 2018-11-18 01:53:41+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10190489Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 01:42:45+00:00 2018-11-18 01:52:43+00:00 0:09:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10185495Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring aborted yes idsc-rudolf-176902018-11-18 01:42:25+00:00 2018-11-18 01:42:38+00:00 0:00:13 Error while running [...]
Creating job10185-7607_scorer_1 ... error
stderr | ERROR: for job10185-7607_scorer_1 Cannot start service scorer: network job10185-7607_evaluation not found
stderr |
stderr | ERROR: for scorer Cannot start service scorer: network job10185-7607_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10179492Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 01:41:38+00:00 2018-11-18 01:42:18+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 93, in run
solve(params, cis)
File "solution.py", line 33, in solve
env = ScaleObservations(env)
File "/workspace/wrappers.py", line 65, in __init__
super().__init__(env)
TypeError: super() takes at least 1 argument (0 given)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10166504Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 01:37:38+00:00 2018-11-18 01:41:31+00:00 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.0941251577979232 deviation-center-line_median 0.1049754905501176 in-drivable-lane_median 14.96666666666665
other stats deviation-center-line_max 0.15852697775707889 deviation-center-line_mean 0.10181130671066452 deviation-center-line_min 0 deviation-heading_max 7.493452325397093 deviation-heading_mean 2.3905845928234184 deviation-heading_median 1.4465686023627768 deviation-heading_min 0 driven_any_max 0.6068662327667798 driven_any_mean 0.5144064444799654 driven_any_median 0.5200624914823357 driven_any_min 0.38447408955460327 driven_lanedir_max 0.20131010512618275 driven_lanedir_mean 0.10520494816477814 driven_lanedir_min 0 in-drivable-lane_max 16.63333333333332 in-drivable-lane_mean 14.57999999999999 in-drivable-lane_min 10.866666666666664 per-episodes details {"ep000": {"driven_any": 0.38447408955460327, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5200624914823357, "driven_lanedir": 0.0941251577979232, "in-drivable-lane": 14.83333333333332, "deviation-heading": 1.8447023684636368, "deviation-center-line": 0.15852697775707889}, "ep002": {"driven_any": 0.5892270118460103, "driven_lanedir": 0.16879272881447172, "in-drivable-lane": 10.866666666666664, "deviation-heading": 7.493452325397093, "deviation-center-line": 0.14728183195328062}, "ep003": {"driven_any": 0.4714023967500981, "driven_lanedir": 0.061796749085313074, "in-drivable-lane": 15.599999999999984, "deviation-heading": 1.1681996678935862, "deviation-center-line": 0.09827223329284553}, "ep004": {"driven_any": 0.6068662327667798, "driven_lanedir": 0.20131010512618275, "in-drivable-lane": 14.96666666666665, "deviation-heading": 1.4465686023627768, "deviation-center-line": 0.1049754905501176}}
No reset possible 10162501Manfred Diaz Tensorflow template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 01:37:09+00:00 2018-11-18 01:37:31+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.533333333333314
other stats episodes details {"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}good_angle_max 0.8928199947802034 good_angle_mean 0.44726467462067304 good_angle_median 0.33400722083424306 good_angle_min 0.060537386068120175 reward_max -0.28626655193418266 reward_mean -5.91151246140921 reward_median -4.076980934218227 reward_min -15.93245312479826 survival_time_max 16.666666666666654 survival_time_mean 8.973333333333319 survival_time_min 2.1666666666666687 traveled_tiles_max 6 traveled_tiles_mean 3.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.4999999999999956 valid_direction_mean 0.7466666666666641 valid_direction_median 0.6666666666666643 valid_direction_min 0.09999999999999964
No reset possible 10151501Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 01:34:41+00:00 2018-11-18 01:37:01+00:00 0:02:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10131506Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 01:26:51+00:00 2018-11-18 01:34:35+00:00 0:07:44 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10097517Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 01:19:56+00:00 2018-11-18 01:26:45+00:00 0:06:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10086523Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 01:18:28+00:00 2018-11-18 01:19:45+00:00 0:01:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.04411107874427467 deviation-center-line_median 0.03382312812944439 in-drivable-lane_median 0
other stats deviation-center-line_max 0.036932541750262865 deviation-center-line_mean 0.025155405677972437 deviation-center-line_min 0 deviation-heading_max 0.33344468140579925 deviation-heading_mean 0.22039329655951928 deviation-heading_median 0.26280377843412867 deviation-heading_min 0 driven_any_max 3.3176367416071093 driven_any_mean 0.7248170230659711 driven_any_median 0.07328113284674392 driven_any_min 0.05329536934308598 driven_lanedir_max 0.04675978410254445 driven_lanedir_mean 0.034855625077198346 driven_lanedir_min 0 in-drivable-lane_max 16.63333333333332 in-drivable-lane_mean 3.3733333333333304 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 3.3176367416071093, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05329536934308598, "driven_lanedir": 0.03825011064919037, "in-drivable-lane": 0, "deviation-heading": 0.21638555899448664, "deviation-center-line": 0.034025485829071465}, "ep002": {"driven_any": 0.07328113284674392, "driven_lanedir": 0.04515715188998226, "in-drivable-lane": 0, "deviation-heading": 0.33344468140579925, "deviation-center-line": 0.036932541750262865}, "ep003": {"driven_any": 0.11325265985405814, "driven_lanedir": 0.04411107874427467, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.28933246396318174, "deviation-center-line": 0.020995872681083456}, "ep004": {"driven_any": 0.0666192116788584, "driven_lanedir": 0.04675978410254445, "in-drivable-lane": 0, "deviation-heading": 0.26280377843412867, "deviation-center-line": 0.03382312812944439}}
No reset possible 10083520Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 01:17:42+00:00 2018-11-18 01:18:20+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 102, in run
solve(params, cis)
File "solution.py", line 65, in solve
action = model.predict(observation)
File "/workspace/model.py", line 19, in predict
assert state.shape[1] == 120, "Passed shape, {}".format(state.shape)
AssertionError: Passed shape, (3, 480, 640)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10079527Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz aborted yes idsc-rudolf-176902018-11-18 01:17:20+00:00 2018-11-18 01:17:34+00:00 0:00:14 Error while running [...]
Creating job10079-4478_visualization_1 ... error
stderr | ERROR: for job10079-4478_visualization_1 Cannot start service visualization: network job10079-4478_evaluation not found
stderr |
stderr | ERROR: for visualization Cannot start service visualization: network job10079-4478_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10071527Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 01:14:42+00:00 2018-11-18 01:17:13+00:00 0:02:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10068527Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 01:14:12+00:00 2018-11-18 01:14:35+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.366666666666661
other stats episodes details {"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}good_angle_max 4.804851725848225 good_angle_mean 4.350085033566717 good_angle_median 4.636373361798506 good_angle_min 3.212081557270962 reward_max -6.709294177134309 reward_mean -7.84581404120635 reward_median -8.178489692882414 reward_min -8.459673733430305 survival_time_max 5.6999999999999895 survival_time_mean 4.659999999999993 survival_time_min 4.233333333333328 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 3.833333333333327 valid_direction_mean 3.499999999999994 valid_direction_median 3.6666666666666607 valid_direction_min 2.79999999999999
No reset possible 10054526Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 01:07:12+00:00 2018-11-18 01:14:03+00:00 0:06:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10050536Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 01:05:25+00:00 2018-11-18 01:07:00+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.41394887044043016 deviation-center-line_median 0.16756217708037385 in-drivable-lane_median 0.9333333333333308
other stats deviation-center-line_max 0.2102576219175792 deviation-center-line_mean 0.16537338620109854 deviation-center-line_min 0.11687463832659307 deviation-heading_max 2.1375979812093284 deviation-heading_mean 1.062444246296126 deviation-heading_median 0.7351144237952995 deviation-heading_min 0.7101333660511545 driven_any_max 0.8922290980920313 driven_any_mean 0.7007453863014537 driven_any_median 0.7427064856026734 driven_any_min 0.3518726212483181 driven_lanedir_max 0.5429536253783105 driven_lanedir_mean 0.38314420802987936 driven_lanedir_min 0.12263231341020107 in-drivable-lane_max 1.0666666666666629 in-drivable-lane_mean 0.8866666666666646 in-drivable-lane_min 0.6666666666666666 per-episodes details {"ep000": {"driven_any": 0.3518726212483181, "driven_lanedir": 0.12263231341020107, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.1375979812093284, "deviation-center-line": 0.19919529762014984}, "ep001": {"driven_any": 0.8922290980920313, "driven_lanedir": 0.5429536253783105, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 1.0172572681808212, "deviation-center-line": 0.2102576219175792}, "ep002": {"driven_any": 0.7427064856026734, "driven_lanedir": 0.41394887044043016, "in-drivable-lane": 0.9333333333333308, "deviation-heading": 0.7351144237952995, "deviation-center-line": 0.13297719606079678}, "ep003": {"driven_any": 0.8167191083574574, "driven_lanedir": 0.4617633572818338, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 0.7121181922440264, "deviation-center-line": 0.16756217708037385}, "ep004": {"driven_any": 0.7001996182067881, "driven_lanedir": 0.37442287363862126, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.7101333660511545, "deviation-center-line": 0.11687463832659307}}
No reset possible 10046536Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 01:04:13+00:00 2018-11-18 01:05:19+00:00 0:01:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10045536Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 01:03:44+00:00 2018-11-18 01:04:06+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.7666666666666666
other stats episodes details {"ep000": {"nsteps": 80, "reward": -12.75244092210196, "good_angle": 1.3066275386172672, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 112, "reward": -9.292650389300045, "good_angle": 5.325693931373402, "survival_time": 3.73333333333333, "traveled_tiles": 2, "valid_direction": 2.93333333333333}, "ep002": {"nsteps": 83, "reward": -12.741244890480246, "good_angle": 1.4080609011818457, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 2.0999999999999996}, "ep003": {"nsteps": 97, "reward": -10.95527533372413, "good_angle": 1.2018329464235085, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.4999999999999982}, "ep004": {"nsteps": 72, "reward": -14.63379717091771, "good_angle": 1.423569750375535, "survival_time": 2.4000000000000012, "traveled_tiles": 2, "valid_direction": 2.000000000000001}}good_angle_max 5.325693931373402 good_angle_mean 2.133157013594311 good_angle_median 1.4080609011818457 good_angle_min 1.2018329464235085 reward_max -9.292650389300045 reward_mean -12.075081741304816 reward_median -12.741244890480246 reward_min -14.63379717091771 survival_time_max 3.73333333333333 survival_time_mean 2.9599999999999995 survival_time_min 2.4000000000000012 traveled_tiles_max 2 traveled_tiles_mean 1.8 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 2.93333333333333 valid_direction_mean 2.3466666666666653 valid_direction_median 2.2 valid_direction_min 2.000000000000001
No reset possible 10040537Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 01:02:47+00:00 2018-11-18 01:03:36+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10036537Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 01:02:18+00:00 2018-11-18 01:02:40+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.9666666666666666
other stats episodes details {"ep000": {"nsteps": 41, "reward": -26.03552148472972, "good_angle": 3.0844503624032997, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 1.233333333333334}, "ep001": {"nsteps": 31, "reward": -34.00843090960576, "good_angle": 0.9595897654984332, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.9666666666666665}, "ep002": {"nsteps": 24, "reward": -43.26566152833402, "good_angle": 0.991599544622662, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.7333333333333332}, "ep003": {"nsteps": 28, "reward": -37.53936479277244, "good_angle": 1.156671689445627, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep004": {"nsteps": 29, "reward": -36.280787767778186, "good_angle": 0.8047930596681112, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.8999999999999998}}good_angle_max 3.0844503624032997 good_angle_mean 1.3994208843276268 good_angle_median 0.991599544622662 good_angle_min 0.8047930596681112 reward_max -26.03552148472972 reward_mean -35.425953296644025 reward_median -36.280787767778186 reward_min -43.26566152833402 survival_time_max 1.3666666666666676 survival_time_mean 1.02 survival_time_min 0.7999999999999999 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.233333333333334 valid_direction_mean 0.9399999999999998 valid_direction_median 0.8999999999999998 valid_direction_min 0.7333333333333332
No reset possible 10031537Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 01:00:57+00:00 2018-11-18 01:02:11+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10023543Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:58:46+00:00 2018-11-18 01:00:48+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.556511482949603 deviation-center-line_median 0.27999622831039583 in-drivable-lane_median 1.8999999999999948
other stats deviation-center-line_max 1.0923573999517773 deviation-center-line_mean 0.3724609376105471 deviation-center-line_min 0 deviation-heading_max 2.812228279935465 deviation-heading_mean 1.1241329388970351 deviation-heading_median 0.7236008447660953 deviation-heading_min 0 driven_any_max 4.014281751451181 driven_any_mean 1.7513904822053277 driven_any_median 1.3053964573512806 driven_any_min 0.8694291840591771 driven_lanedir_max 1.9536100225069195 driven_lanedir_mean 0.7747287187844668 driven_lanedir_min 0 in-drivable-lane_max 7.899999999999973 in-drivable-lane_mean 3.393333333333324 in-drivable-lane_min 0.6333333333333311 per-episodes details {"ep000": {"driven_any": 1.3706023338601256, "driven_lanedir": 0, "in-drivable-lane": 4.66666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3053964573512806, "driven_lanedir": 0.9462014920882916, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 1.4360808982249993, "deviation-center-line": 0.3276055880041256}, "ep002": {"driven_any": 0.8694291840591771, "driven_lanedir": 0.4173205963775197, "in-drivable-lane": 1.8999999999999948, "deviation-heading": 0.7236008447660953, "deviation-center-line": 0.16234547178643677}, "ep003": {"driven_any": 1.1972426843048751, "driven_lanedir": 0.556511482949603, "in-drivable-lane": 1.86666666666666, "deviation-heading": 0.6487546715586159, "deviation-center-line": 0.27999622831039583}, "ep004": {"driven_any": 4.014281751451181, "driven_lanedir": 1.9536100225069195, "in-drivable-lane": 7.899999999999973, "deviation-heading": 2.812228279935465, "deviation-center-line": 1.0923573999517773}}
No reset possible 10016543Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:57:27+00:00 2018-11-18 00:58:39+00:00 0:01:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10010542Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:56:27+00:00 2018-11-18 00:57:17+00:00 0:00:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.19503683289986729 deviation-center-line_median 0.02802053009519329 in-drivable-lane_median 0.5333333333333332
other stats deviation-center-line_max 0.051997452446258946 deviation-center-line_mean 0.0330616234564004 deviation-center-line_min 0.024439441715664523 deviation-heading_max 0.6727610204778094 deviation-heading_mean 0.32117820019293025 deviation-heading_median 0.25202402706215876 deviation-heading_min 0.2110863127918992 driven_any_max 0.8807057078679261 driven_any_mean 0.6293775838252362 driven_any_median 0.5688055139620741 driven_any_min 0.5359312103086633 driven_lanedir_max 0.2693026765029015 driven_lanedir_mean 0.21839582002031613 driven_lanedir_min 0.1903540021568055 in-drivable-lane_max 0.8333333333333338 in-drivable-lane_mean 0.5466666666666667 in-drivable-lane_min 0.26666666666666666 per-episodes details {"ep000": {"driven_any": 0.8807057078679261, "driven_lanedir": 0.2693026765029015, "in-drivable-lane": 0.8333333333333338, "deviation-heading": 0.25584701411493577, "deviation-center-line": 0.02802053009519329}, "ep001": {"driven_any": 0.6187478995778053, "driven_lanedir": 0.24658602653714337, "in-drivable-lane": 0.5333333333333332, "deviation-heading": 0.25202402706215876, "deviation-center-line": 0.03484926287266754}, "ep002": {"driven_any": 0.5426975874097125, "driven_lanedir": 0.19069956200486304, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.6727610204778094, "deviation-center-line": 0.051997452446258946}, "ep003": {"driven_any": 0.5359312103086633, "driven_lanedir": 0.1903540021568055, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.2110863127918992, "deviation-center-line": 0.02600143015221769}, "ep004": {"driven_any": 0.5688055139620741, "driven_lanedir": 0.19503683289986729, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.21417262651784796, "deviation-center-line": 0.024439441715664523}}
No reset possible 10003542Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:55:39+00:00 2018-11-18 00:56:18+00:00 0:00:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10000542Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 00:55:13+00:00 2018-11-18 00:55:32+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.9333333333333332
other stats episodes details {"ep000": {"nsteps": 37, "reward": -28.360527072806615, "good_angle": 2.6052579409068777, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 1.1000000000000003}, "ep001": {"nsteps": 28, "reward": -37.34995021960848, "good_angle": 0.9385993003310564, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep002": {"nsteps": 27, "reward": -37.97064161797365, "good_angle": 1.2633080131148096, "survival_time": 0.8999999999999999, "traveled_tiles": 2, "valid_direction": 0.8333333333333331}, "ep003": {"nsteps": 24, "reward": -43.28004418802448, "good_angle": 0.8152663290129198, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.7333333333333332}, "ep004": {"nsteps": 29, "reward": -36.26324317594669, "good_angle": 1.016251950937411, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.8999999999999998}}good_angle_max 2.6052579409068777 good_angle_mean 1.327736706860615 good_angle_median 1.016251950937411 good_angle_min 0.8152663290129198 reward_max -28.360527072806615 reward_mean -36.644881254871976 reward_median -37.34995021960848 reward_min -43.28004418802448 survival_time_max 1.2333333333333338 survival_time_mean 0.9666666666666666 survival_time_min 0.7999999999999999 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.1000000000000003 valid_direction_mean 0.8866666666666665 valid_direction_median 0.8666666666666665 valid_direction_min 0.7333333333333332
No reset possible 9996550Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring aborted yes idsc-rudolf-176902018-11-18 00:54:52+00:00 2018-11-18 00:55:06+00:00 0:00:14 Error while running [...]
Creating job9996-2545_scorer_1 ... error
stderr | ERROR: for job9996-2545_scorer_1 Cannot start service scorer: network job9996-2545_evaluation not found
stderr |
stderr | ERROR: for scorer Cannot start service scorer: network job9996-2545_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9981548Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 00:52:33+00:00 2018-11-18 00:54:46+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9975558Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:50:06+00:00 2018-11-18 00:52:26+00:00 0:02:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.8310775732718574 deviation-center-line_median 0.358587896243237 in-drivable-lane_median 2.5666666666666575
other stats deviation-center-line_max 1.3719539375269192 deviation-center-line_mean 0.459777576598594 deviation-center-line_min 0 deviation-heading_max 2.6407440419377446 deviation-heading_mean 1.2093936883196572 deviation-heading_median 0.7776821886704663 deviation-heading_min 0 driven_any_max 4.470132966843854 driven_any_mean 1.9645306089924752 driven_any_median 1.5143328068832085 driven_any_min 0.8232277310327957 driven_lanedir_max 2.6613849463150387 driven_lanedir_mean 1.020442414377809 driven_lanedir_min 0 in-drivable-lane_max 5.666666666666682 in-drivable-lane_mean 3.1266666666666643 in-drivable-lane_min 0.9999999999999964 per-episodes details {"ep000": {"driven_any": 1.4478513931552153, "driven_lanedir": 0, "in-drivable-lane": 5.333333333333324, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.5143328068832085, "driven_lanedir": 1.1042868663110277, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.987654212366769, "deviation-center-line": 0.41757706343780304}, "ep002": {"driven_any": 0.8232277310327957, "driven_lanedir": 0.5054626859911222, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 0.7776821886704663, "deviation-center-line": 0.15076898578501108}, "ep003": {"driven_any": 1.5671081470473025, "driven_lanedir": 0.8310775732718574, "in-drivable-lane": 2.5666666666666575, "deviation-heading": 0.6408879986233063, "deviation-center-line": 0.358587896243237}, "ep004": {"driven_any": 4.470132966843854, "driven_lanedir": 2.6613849463150387, "in-drivable-lane": 5.666666666666682, "deviation-heading": 2.6407440419377446, "deviation-center-line": 1.3719539375269192}}
No reset possible 9967558Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:48:33+00:00 2018-11-18 00:49:57+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9963558Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 00:48:04+00:00 2018-11-18 00:48:26+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.966666666666655
other stats episodes details {"ep000": {"nsteps": 161, "reward": -8.229781145819967, "good_angle": 0.3544784221021973, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.6999999999999991}, "ep001": {"nsteps": 193, "reward": -5.659544882157074, "good_angle": 12.644083654058043, "survival_time": 6.43333333333332, "traveled_tiles": 3, "valid_direction": 3.966666666666655}, "ep002": {"nsteps": 102, "reward": -10.579663636464188, "good_angle": 2.159795561900263, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 2.1999999999999975}, "ep003": {"nsteps": 179, "reward": -6.362599972474217, "good_angle": 0.8787199042538155, "survival_time": 5.966666666666655, "traveled_tiles": 3, "valid_direction": 1.2333333333333296}, "ep004": {"nsteps": 500, "reward": -0.7066865459436085, "good_angle": 25.651328513820513, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.7999999999999874}}good_angle_max 25.651328513820513 good_angle_mean 8.337681211226968 good_angle_median 2.159795561900263 good_angle_min 0.3544784221021973 reward_max -0.7066865459436085 reward_mean -6.3076552365718115 reward_median -6.362599972474217 reward_min -10.579663636464188 survival_time_max 16.666666666666654 survival_time_mean 7.5666666666666575 survival_time_min 3.3999999999999977 traveled_tiles_max 9 traveled_tiles_mean 4 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.966666666666655 valid_direction_mean 2.3799999999999932 valid_direction_median 2.1999999999999975 valid_direction_min 0.6999999999999991
No reset possible 9950558Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 00:43:32+00:00 2018-11-18 00:47:57+00:00 0:04:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9937570Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:40:11+00:00 2018-11-18 00:43:25+00:00 0:03:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9926578Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:37:40+00:00 2018-11-18 00:40:03+00:00 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1112780059021603 deviation-center-line_median 0.14826000833213157 in-drivable-lane_median 4.399999999999994
other stats deviation-center-line_max 0.932971221209534 deviation-center-line_mean 0.3341223577953655 deviation-center-line_min 0 deviation-heading_max 2.824074396092524 deviation-heading_mean 1.2458190664588202 deviation-heading_median 0.6911087184990405 deviation-heading_min 0 driven_any_max 4.942355489727362 driven_any_mean 2.5082233305496 driven_any_median 2.338484933390528 driven_any_min 1.3638335951679057 driven_lanedir_max 2.7092869900977936 driven_lanedir_mean 1.24084248250569 driven_lanedir_min 0 in-drivable-lane_max 6.7666666666666435 in-drivable-lane_mean 4.073333333333329 in-drivable-lane_min 1.1333333333333293 per-episodes details {"ep000": {"driven_any": 1.3638335951679057, "driven_lanedir": 0, "in-drivable-lane": 4.399999999999994, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.50009968648738, "driven_lanedir": 1.1112780059021603, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 2.228603310315176, "deviation-center-line": 0.44173951160764063}, "ep002": {"driven_any": 2.3963429479748264, "driven_lanedir": 0.7210890070690643, "in-drivable-lane": 6.7666666666666435, "deviation-heading": 0.6911087184990405, "deviation-center-line": 0.14826000833213157}, "ep003": {"driven_any": 2.338484933390528, "driven_lanedir": 1.6625584094594317, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.4853089073873599, "deviation-center-line": 0.1476410478275212}, "ep004": {"driven_any": 4.942355489727362, "driven_lanedir": 2.7092869900977936, "in-drivable-lane": 5.666666666666683, "deviation-heading": 2.824074396092524, "deviation-center-line": 0.932971221209534}}
No reset possible 9919578Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:36:05+00:00 2018-11-18 00:37:31+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9904583Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:32:46+00:00 2018-11-18 00:35:57+00:00 0:03:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9974379100572336 deviation-center-line_median 0.6560590207850371 in-drivable-lane_median 3.699999999999987
other stats deviation-center-line_max 1.8788618819421845 deviation-center-line_mean 0.7440539779834248 deviation-center-line_min 0 deviation-heading_max 3.6541289260109022 deviation-heading_mean 1.7614495500973806 deviation-heading_median 1.3203671878871144 deviation-heading_min 0 driven_any_max 2.444226372077783 driven_any_mean 1.6843065428712958 driven_any_median 1.6572132165268052 driven_any_min 0.9085628560098704 driven_lanedir_max 2.2570891926315286 driven_lanedir_mean 0.9682329297041452 driven_lanedir_min 0 in-drivable-lane_max 11.099999999999971 in-drivable-lane_mean 4.733333333333325 in-drivable-lane_min 0.6333333333333648 per-episodes details {"ep000": {"driven_any": 1.6572132165268052, "driven_lanedir": 0, "in-drivable-lane": 11.099999999999971, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6544189234489706, "driven_lanedir": 1.1038938191780283, "in-drivable-lane": 3.699999999999987, "deviation-heading": 2.7077627268438604, "deviation-center-line": 0.6560590207850371}, "ep002": {"driven_any": 0.9085628560098704, "driven_lanedir": 0.48274372665393583, "in-drivable-lane": 2.79999999999999, "deviation-heading": 1.3203671878871144, "deviation-center-line": 0.30032301321125654}, "ep003": {"driven_any": 1.75711134629305, "driven_lanedir": 0.9974379100572336, "in-drivable-lane": 5.433333333333315, "deviation-heading": 1.1249889097450263, "deviation-center-line": 0.885025973978646}, "ep004": {"driven_any": 2.444226372077783, "driven_lanedir": 2.2570891926315286, "in-drivable-lane": 0.6333333333333648, "deviation-heading": 3.6541289260109022, "deviation-center-line": 1.8788618819421845}}
No reset possible 9890577Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 00:28:52+00:00 2018-11-18 00:32:38+00:00 0:03:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9864584Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:22:17+00:00 2018-11-18 00:28:45+00:00 0:06:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9859593Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:21:37+00:00 2018-11-18 00:22:11+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 102, in run
solve(params, cis)
File "solution.py", line 42, in solve
env = make_env(config)
File "solution.py", line 23, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9853597Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:20:57+00:00 2018-11-18 00:21:30+00:00 0:00:33 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 18, in make_env
env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9845599Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:20:14+00:00 2018-11-18 00:20:50+00:00 0:00:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9840602Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-18 00:19:33+00:00 2018-11-18 00:20:07+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9828613Laurent Mandrile PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:17:35+00:00 2018-11-18 00:19:26+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5661020704594424 deviation-center-line_median 0.2740354783309631 in-drivable-lane_median 3.266666666666655
other stats deviation-center-line_max 0.5603588606390013 deviation-center-line_mean 0.3120589482029849 deviation-center-line_min 0.19846746065156567 deviation-heading_max 3.214183416776645 deviation-heading_mean 1.6059425773309546 deviation-heading_median 1.2834201828497314 deviation-heading_min 0.8871462076947535 driven_any_max 1.3560961776989535 driven_any_mean 1.04737111715508 driven_any_median 1.1251706898040728 driven_any_min 0.3746769082831119 driven_lanedir_max 0.6715017430237435 driven_lanedir_mean 0.5148131075456355 driven_lanedir_min 0.15612622869521509 in-drivable-lane_max 4.799999999999983 in-drivable-lane_mean 2.99999999999999 in-drivable-lane_min 0.5333333333333333 per-episodes details {"ep000": {"driven_any": 0.3746769082831119, "driven_lanedir": 0.15612622869521509, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.7338392601903574, "deviation-center-line": 0.19846746065156567}, "ep001": {"driven_any": 1.1251706898040728, "driven_lanedir": 0.6292605959907072, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 1.2834201828497314, "deviation-center-line": 0.3138953503935618}, "ep002": {"driven_any": 1.3560961776989535, "driven_lanedir": 0.6715017430237435, "in-drivable-lane": 3.266666666666655, "deviation-heading": 3.214183416776645, "deviation-center-line": 0.5603588606390013}, "ep003": {"driven_any": 1.2984217247544845, "driven_lanedir": 0.5510748995590697, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.911123819143286, "deviation-center-line": 0.2740354783309631}, "ep004": {"driven_any": 1.0824900852347763, "driven_lanedir": 0.5661020704594424, "in-drivable-lane": 3.533333333333321, "deviation-heading": 0.8871462076947535, "deviation-center-line": 0.21353759099983263}}
No reset possible 9820613Laurent Mandrile PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:16:00+00:00 2018-11-18 00:17:29+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9816613Laurent Mandrile PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 00:15:27+00:00 2018-11-18 00:15:52+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.53333333333332
other stats episodes details {"ep000": {"nsteps": 69, "reward": -14.755288307703491, "good_angle": 0.9631811344985584, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 1.9000000000000017}, "ep001": {"nsteps": 196, "reward": -6.650094018956856, "good_angle": 18.18657823217711, "survival_time": 6.53333333333332, "traveled_tiles": 2, "valid_direction": 4.933333333333319}, "ep002": {"nsteps": 252, "reward": -4.722392324177134, "good_angle": 3.9299346565474216, "survival_time": 8.39999999999998, "traveled_tiles": 4, "valid_direction": 6.533333333333316}, "ep003": {"nsteps": 233, "reward": -5.56180613676222, "good_angle": 0.9968810333366812, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.73333333333332}, "ep004": {"nsteps": 195, "reward": -6.338301128024558, "good_angle": 1.4994381334640132, "survival_time": 6.499999999999987, "traveled_tiles": 2, "valid_direction": 4.799999999999985}}good_angle_max 18.18657823217711 good_angle_mean 5.115202638004757 good_angle_median 1.4994381334640132 good_angle_min 0.9631811344985584 reward_max -4.722392324177134 reward_mean -7.605576383124853 reward_median -6.338301128024558 reward_min -14.755288307703491 survival_time_max 8.39999999999998 survival_time_mean 6.299999999999987 survival_time_min 2.3000000000000016 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 6.533333333333316 valid_direction_mean 4.5799999999999885 valid_direction_median 4.799999999999985 valid_direction_min 1.9000000000000017
No reset possible 9811614Samuel Lavoie PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 00:14:57+00:00 2018-11-18 00:15:19+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.333333333333321
other stats episodes details {"ep000": {"nsteps": 75, "reward": -13.598021065033972, "good_angle": 1.11901761045598, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.133333333333334}, "ep001": {"nsteps": 51, "reward": -20.165890015807808, "good_angle": 0.0671978157848164, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 230, "reward": -4.791167088502856, "good_angle": 2.5516459539091634, "survival_time": 7.666666666666649, "traveled_tiles": 3, "valid_direction": 4.5999999999999845}, "ep003": {"nsteps": 208, "reward": -6.038359020527703, "good_angle": 1.0460847425227788, "survival_time": 6.9333333333333185, "traveled_tiles": 3, "valid_direction": 5.7666666666666515}, "ep004": {"nsteps": 190, "reward": -6.313083494276323, "good_angle": 1.5298196489724811, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 3.7999999999999865}}good_angle_max 2.5516459539091634 good_angle_mean 1.2627531543290438 good_angle_median 1.11901761045598 good_angle_min 0.0671978157848164 reward_max -4.791167088502856 reward_mean -10.181304136829732 reward_median -6.313083494276323 reward_min -20.165890015807808 survival_time_max 7.666666666666649 survival_time_mean 5.026666666666658 survival_time_min 1.700000000000002 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.7666666666666515 valid_direction_mean 3.259999999999991 valid_direction_median 3.7999999999999865 valid_direction_min 0
No reset possible 9801614Samuel Lavoie PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-18 00:12:13+00:00 2018-11-18 00:14:51+00:00 0:02:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9790628Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-176902018-11-18 00:08:16+00:00 2018-11-18 00:12:06+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -0.839634730476746 deviation-center-line_median 0.3876309937395394 in-drivable-lane_median 8.29999999999999
other stats deviation-center-line_max 0.5747826826548895 deviation-center-line_mean 0.3643303634439444 deviation-center-line_min 0.13729734885380554 deviation-heading_max 6.58245575091181 deviation-heading_mean 5.302655958935572 deviation-heading_median 6.539566120620427 deviation-heading_min 0.32328388756500265 driven_any_max 2.6532777821831983 driven_any_mean 2.6532777821831908 driven_any_median 2.6532777821831885 driven_any_min 2.653277782183184 driven_lanedir_max -0.2575588697397758 driven_lanedir_mean -0.7245298252797052 driven_lanedir_min -0.8446015392792754 in-drivable-lane_max 14.933333333333325 in-drivable-lane_mean 9.633333333333322 in-drivable-lane_min 8.299999999999988 per-episodes details {"ep000": {"driven_any": 2.6532777821831983, "driven_lanedir": -0.2575588697397758, "in-drivable-lane": 14.933333333333325, "deviation-heading": 0.32328388756500265, "deviation-center-line": 0.3959689180795801}, "ep001": {"driven_any": 2.6532777821831877, "driven_lanedir": -0.8392146675166066, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.58245575091181, "deviation-center-line": 0.5747826826548895}, "ep002": {"driven_any": 2.653277782183195, "driven_lanedir": -0.8416393193861229, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.556737670234658, "deviation-center-line": 0.3259718738919073}, "ep003": {"driven_any": 2.653277782183184, "driven_lanedir": -0.839634730476746, "in-drivable-lane": 8.333333333333323, "deviation-heading": 6.511236365345967, "deviation-center-line": 0.13729734885380554}, "ep004": {"driven_any": 2.6532777821831885, "driven_lanedir": -0.8446015392792754, "in-drivable-lane": 8.299999999999988, "deviation-heading": 6.539566120620427, "deviation-center-line": 0.3876309937395394}}
No reset possible 9775628Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-176902018-11-18 00:04:34+00:00 2018-11-18 00:08:04+00:00 0:03:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9771628Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-176902018-11-18 00:04:07+00:00 2018-11-18 00:04:28+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.0979843356609345, "good_angle": 50.512573961104266, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.53333333333332}, "ep001": {"nsteps": 500, "reward": -1.4751862567067149, "good_angle": 13.737403256340093, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.833333333333323}, "ep002": {"nsteps": 500, "reward": -1.2926475285887715, "good_angle": 13.709315082596058, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.199999999999989}, "ep003": {"nsteps": 500, "reward": -1.103815818578005, "good_angle": 13.72145423128464, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.033333333333324}, "ep004": {"nsteps": 500, "reward": -1.3380856087207795, "good_angle": 13.731167035162231, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}}good_angle_max 50.512573961104266 good_angle_mean 21.082382713297456 good_angle_median 13.731167035162231 good_angle_min 13.709315082596058 reward_max -1.0979843356609345 reward_mean -1.261543909651041 reward_median -1.2926475285887715 reward_min -1.4751862567067149 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.53333333333332 valid_direction_mean 13.306666666666654 valid_direction_median 13.033333333333324 valid_direction_min 12.833333333333323
No reset possible 9743628Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-17 23:54:40+00:00 2018-11-18 00:04:00+00:00 0:09:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9737631Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-176902018-11-17 23:53:56+00:00 2018-11-17 23:54:34+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 104, in run
solve(params, cis)
File "solution.py", line 69, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 331, in step
action = self.action(action)
File "/workspace/wrappers.py", line 207, in action
vel, angle = action
TypeError: 'numpy.int64' object is not iterable
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9724639Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-176902018-11-17 23:50:33+00:00 2018-11-17 23:53:49+00:00 0:03:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
