Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 10651194Florian Golemo PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:48:30+00:00 2018-11-18 03:59:13+00:00 0:10:43 Timeout:
Waited 601 [...] Timeout:
Waited 601.880375862 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106463Andrea Censi null aido1_LF1-v3step2-scoring success yes idsc-rudolf-183282018-11-18 03:47:13+00:00 2018-11-18 03:48:23+00:00 0:01:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats ep000 details {"nsteps": 171, "reward": -6.168826045855139}ep001 details {"nsteps": 88, "reward": -13.200233698759058}ep002 details {"nsteps": 18, "reward": -58.63515728049808}ep003 details {"nsteps": 80, "reward": -13.576747538545169}ep004 details {"nsteps": 23, "reward": -45.71124377457992}
No reset possible 10641144Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:46:31+00:00 2018-11-18 03:47:01+00:00 0:00:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
solution.run(cis)
File "solution.py", line 60, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 35, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10637220Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:45:47+00:00 2018-11-18 03:46:21+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 107, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10625210Andrea Censi Python template aido1_amod_service_quality_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-18 03:43:31+00:00 2018-11-18 03:45:38+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.518643881660594
other stats efficiency -63.427135526639645 fleet_size -1000000000
No reset possible 10620274Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:42:46+00:00 2018-11-18 03:43:21+00:00 0:00:35 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10617276Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:42:08+00:00 2018-11-18 03:42:38+00:00 0:00:30 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10615277Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:41:26+00:00 2018-11-18 03:41:57+00:00 0:00:31 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10612279Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:40:32+00:00 2018-11-18 03:41:19+00:00 0:00:47 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10611267Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:38:20+00:00 2018-11-18 03:40:25+00:00 0:02:05 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 64, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 39, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10605298Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:37:34+00:00 2018-11-18 03:38:12+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 61, in run
solve(params, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 35, in solve
action = model.predict(observation)
File "/workspace/model.py", line 64, in predict
self._observation: [state],
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
run_metadata_ptr)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10567337Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:26:46+00:00 2018-11-18 03:37:25+00:00 0:10:39 Timeout:
Waited 602 [...] Timeout:
Waited 602.74119401 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10564344Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:25:55+00:00 2018-11-18 03:26:39+00:00 0:00:44 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10560349Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring aborted yes idsc-rudolf-183282018-11-18 03:25:33+00:00 2018-11-18 03:25:46+00:00 0:00:13 Error while running [...]
Creating job10560-8079_scorer_1 ... error
stderr | ERROR: for job10560-8079_scorer_1 Cannot start service scorer: network job10560-8079_evaluation not found
stderr |
stderr | ERROR: for scorer Cannot start service scorer: network job10560-8079_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10556321Andrea Censi PyTorch DDPG template aido1_LFV_r1-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:24:22+00:00 2018-11-18 03:25:25+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 87, in run
solve(params, cis)
File "solution.py", line 62, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10548350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 03:21:13+00:00 2018-11-18 03:24:12+00:00 0:02:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10537336Andrea Censi Tensorflow template aido1_LFV_r1-v3step4-viz success no idsc-rudolf-183282018-11-18 03:19:11+00:00 2018-11-18 03:21:02+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.16958028453105295 in-drivable-lane_median 0
other stats deviation-center-line_max 0.22421030467466235 deviation-center-line_mean 0.1634583834192209 deviation-center-line_min 0.10995274174798784 deviation-heading_max 0.6914924698329948 deviation-heading_mean 0.5927453930596538 deviation-heading_median 0.6785315163413053 deviation-heading_min 0.45172830747555553 driven_any_max 2.7320453507042295 driven_any_mean 1.5137876234261718 driven_any_median 1.386705344540306 driven_any_min 0.7864654166530175 driven_lanedir_max 2.1967731589892927 driven_lanedir_mean 1.3757879534350568 driven_lanedir_median 1.3638938451285922 driven_lanedir_min 0.7541729987229193 in-drivable-lane_max 1.3000000000000005 in-drivable-lane_mean 0.2600000000000001 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.7320453507042295, "driven_lanedir": 2.1967731589892927, "in-drivable-lane": 1.3000000000000005, "deviation-heading": 0.6914924698329948, "deviation-center-line": 0.22421030467466235}, "ep001": {"driven_any": 0.7864654166530175, "driven_lanedir": 0.7541729987229193, "in-drivable-lane": 0, "deviation-heading": 0.4550438261437452, "deviation-center-line": 0.12152779068333867}, "ep002": {"driven_any": 1.1979477646195056, "driven_lanedir": 1.1509025865655182, "in-drivable-lane": 0, "deviation-heading": 0.6869308455046688, "deviation-center-line": 0.19202079545906273}, "ep003": {"driven_any": 1.4657742406137992, "driven_lanedir": 1.4131971777689611, "in-drivable-lane": 0, "deviation-heading": 0.6785315163413053, "deviation-center-line": 0.16958028453105295}, "ep004": {"driven_any": 1.386705344540306, "driven_lanedir": 1.3638938451285922, "in-drivable-lane": 0, "deviation-heading": 0.45172830747555553, "deviation-center-line": 0.10995274174798784}}
No reset possible 10531336Andrea Censi Tensorflow template aido1_LFV_r1-v3step3-videos success yes idsc-rudolf-183282018-11-18 03:18:00+00:00 2018-11-18 03:19:00+00:00 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10530336Andrea Censi Tensorflow template aido1_LFV_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-18 03:17:31+00:00 2018-11-18 03:17:52+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.433333333333327
other stats episodes details {"ep000": {"nsteps": 245, "reward": -4.31576563379839, "good_angle": 0.6367076996391192, "survival_time": 8.166666666666648, "traveled_tiles": 5, "valid_direction": 0.7333333333333331}, "ep001": {"nsteps": 79, "reward": -12.870941895920833, "good_angle": 0.6042799859354175, "survival_time": 2.6333333333333337, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 118, "reward": -8.69808287972237, "good_angle": 0.4619509270684549, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 0.6999999999999975}, "ep003": {"nsteps": 144, "reward": -7.082740642952356, "good_angle": 0.4475062201788648, "survival_time": 4.799999999999993, "traveled_tiles": 4, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 133, "reward": -7.592870433689217, "good_angle": 0.8284296764231629, "survival_time": 4.433333333333327, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}}good_angle_max 0.8284296764231629 good_angle_mean 0.595774901849004 good_angle_median 0.6042799859354175 good_angle_min 0.4475062201788648 reward_max -4.31576563379839 reward_mean -8.112080297216632 reward_median -7.592870433689217 reward_min -12.870941895920833 survival_time_max 8.166666666666648 survival_time_mean 4.793333333333327 survival_time_min 2.6333333333333337 traveled_tiles_max 5 traveled_tiles_mean 3.6 traveled_tiles_median 4 traveled_tiles_min 2 valid_direction_max 0.7333333333333331 valid_direction_mean 0.6466666666666648 valid_direction_median 0.6999999999999975 valid_direction_min 0.5333333333333314
No reset possible 10520369Bhairav Mehta Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 03:15:37+00:00 2018-11-18 03:17:24+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3396744644477483 deviation-center-line_median 0.16366821769543885 in-drivable-lane_median 0
other stats deviation-center-line_max 0.5899606612232077 deviation-center-line_mean 0.2839614802919384 deviation-center-line_min 0.12067855357218568 deviation-heading_max 1.9019230643088223 deviation-heading_mean 0.9660544180273664 deviation-heading_median 1.064471446342098 deviation-heading_min 0.26087752854775853 driven_any_max 1.6790783329094108 driven_any_mean 0.8266395870852726 driven_any_median 0.4139704745143878 driven_any_min 0.2564798803690534 driven_lanedir_max 1.6131624816272911 driven_lanedir_mean 0.6425377583683377 driven_lanedir_min 0.15516600797482294 in-drivable-lane_max 2.633333333333324 in-drivable-lane_mean 0.7133333333333316 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.4139704745143878, "driven_lanedir": 0.15516600797482294, "in-drivable-lane": 0.933333333333334, "deviation-heading": 1.064471446342098, "deviation-center-line": 0.13657628514783032}, "ep001": {"driven_any": 0.34539421123332426, "driven_lanedir": 0.3396744644477483, "in-drivable-lane": 0, "deviation-heading": 0.26087752854775853, "deviation-center-line": 0.16366821769543885}, "ep002": {"driven_any": 0.2564798803690534, "driven_lanedir": 0.2458475290507125, "in-drivable-lane": 0, "deviation-heading": 0.3467034955512837, "deviation-center-line": 0.12067855357218568}, "ep003": {"driven_any": 1.6790783329094108, "driven_lanedir": 1.6131624816272911, "in-drivable-lane": 0, "deviation-heading": 1.9019230643088223, "deviation-center-line": 0.5899606612232077}, "ep004": {"driven_any": 1.438275036400187, "driven_lanedir": 0.8588383087411136, "in-drivable-lane": 2.633333333333324, "deviation-heading": 1.2562965553868697, "deviation-center-line": 0.4089236838210296}}
No reset possible 10517355Pravish Sainath PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 03:15:07+00:00 2018-11-18 03:15:30+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.3999999999999977
other stats episodes details {"ep000": {"nsteps": 77, "reward": -13.27473422367271, "good_angle": 1.3931389831292844, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 55, "reward": -18.753109360283073, "good_angle": 0.06622572752411456, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 245, "reward": -4.671564130571538, "good_angle": 3.4578286402681497, "survival_time": 8.166666666666648, "traveled_tiles": 4, "valid_direction": 5.799999999999982}, "ep003": {"nsteps": 102, "reward": -10.124401146801665, "good_angle": 0.1221495800628078, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 203, "reward": -5.947036716799863, "good_angle": 2.7319222174845073, "survival_time": 6.766666666666652, "traveled_tiles": 3, "valid_direction": 4.066666666666652}}good_angle_max 3.4578286402681497 good_angle_mean 1.5542530296937729 good_angle_median 1.3931389831292844 good_angle_min 0.06622572752411456 reward_max -4.671564130571538 reward_mean -10.55416911562577 reward_median -10.124401146801665 reward_min -18.753109360283073 survival_time_max 8.166666666666648 survival_time_mean 4.546666666666661 survival_time_min 1.8333333333333357 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.799999999999982 valid_direction_mean 2.40666666666666 valid_direction_median 2.166666666666667 valid_direction_min 0
No reset possible 10504355Pravish Sainath PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 03:11:18+00:00 2018-11-18 03:14:58+00:00 0:03:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10500359Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:10:42+00:00 2018-11-18 03:11:11+00:00 0:00:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 96, in run
solve(params, cis)
File "solution.py", line 28, in solve
env = gym.make(params['env'])
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
return registry.make(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
spec = self.spec(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10494362Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:10:07+00:00 2018-11-18 03:10:33+00:00 0:00:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 93, in run
solve(params, cis)
File "solution.py", line 28, in solve
env = gym.make(params['env'])
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
return registry.make(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
spec = self.spec(id)
File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10490366Mandana Samiei PyTorch DDPG template aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 03:09:12+00:00 2018-11-18 03:09:57+00:00 0:00:45 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 87, in run
solve(params, cis)
File "solution.py", line 60, in solve
action = model.predict(observation)
File "/workspace/model.py", line 176, in predict
return self.actor(state).cpu().data.numpy().flatten()
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/workspace/model.py", line 72, in forward
x = self.lr(self.lin1(x))
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
return F.linear(input, self.weight, self.bias)
File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10486373Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 03:08:31+00:00 2018-11-18 03:09:04+00:00 0:00:33 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10472394Maxim Kuzmin Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 03:04:42+00:00 2018-11-18 03:08:23+00:00 0:03:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.110633414650633 deviation-center-line_median 0.6366967459250991 in-drivable-lane_median 0.33333333333333215
other stats deviation-center-line_max 0.9010004922605236 deviation-center-line_mean 0.5582306491689347 deviation-center-line_min 0.20462402185732745 deviation-heading_max 2.5468596547901714 deviation-heading_mean 1.563915809585908 deviation-heading_median 2.091561493425691 deviation-heading_min 0.17374756164805774 driven_any_max 2.1149462496393547 driven_any_mean 1.1134417390036384 driven_any_median 1.1776904838175923 driven_any_min 0.3225205502784029 driven_lanedir_max 1.9814934374177464 driven_lanedir_mean 0.9545390341833409 driven_lanedir_min 0.13691954561835296 in-drivable-lane_max 1.566666666666661 in-drivable-lane_mean 0.5533333333333317 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.35355118947426456, "driven_lanedir": 0.13691954561835296, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 2.091561493425691, "deviation-center-line": 0.20462402185732745}, "ep001": {"driven_any": 0.3225205502784029, "driven_lanedir": 0.32160316964748903, "in-drivable-lane": 0, "deviation-heading": 0.17374756164805774, "deviation-center-line": 0.2552392826046893}, "ep002": {"driven_any": 1.1776904838175923, "driven_lanedir": 1.110633414650633, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 0.8613206999660672, "deviation-center-line": 0.6366967459250991}, "ep003": {"driven_any": 2.1149462496393547, "driven_lanedir": 1.9814934374177464, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 2.146089638099553, "deviation-center-line": 0.9010004922605236}, "ep004": {"driven_any": 1.5985002218085778, "driven_lanedir": 1.2220456035824818, "in-drivable-lane": 1.566666666666661, "deviation-heading": 2.5468596547901714, "deviation-center-line": 0.7935927031970339}}
No reset possible 10469385Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 03:04:14+00:00 2018-11-18 03:04:35+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.266666666666665
other stats episodes details {"ep000": {"nsteps": 83, "reward": -12.305866422406568, "good_angle": 1.366498662601964, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 2.3}, "ep001": {"nsteps": 98, "reward": -10.609360168564455, "good_angle": 4.099154169908216, "survival_time": 3.266666666666665, "traveled_tiles": 2, "valid_direction": 2.3999999999999986}, "ep002": {"nsteps": 107, "reward": -10.413855349168475, "good_angle": 1.7846734864261156, "survival_time": 3.566666666666664, "traveled_tiles": 4, "valid_direction": 2.9999999999999973}, "ep003": {"nsteps": 116, "reward": -9.313145812964148, "good_angle": 1.2520766003384018, "survival_time": 3.8666666666666623, "traveled_tiles": 2, "valid_direction": 2.966666666666663}, "ep004": {"nsteps": 73, "reward": -14.475996773398949, "good_angle": 1.475414296628798, "survival_time": 2.4333333333333345, "traveled_tiles": 2, "valid_direction": 2.033333333333334}}good_angle_max 4.099154169908216 good_angle_mean 1.9955634431806992 good_angle_median 1.475414296628798 good_angle_min 1.2520766003384018 reward_max -9.313145812964148 reward_mean -11.42364490530052 reward_median -10.609360168564455 reward_min -14.475996773398949 survival_time_max 3.8666666666666623 survival_time_mean 3.1799999999999984 survival_time_min 2.4333333333333345 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 2.9999999999999973 valid_direction_mean 2.5399999999999983 valid_direction_median 2.3999999999999986 valid_direction_min 2.033333333333334
No reset possible 10454386Bhairav Mehta PyTorch DDPG baseline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 03:00:39+00:00 2018-11-18 03:04:05+00:00 0:03:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10450387Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:59:45+00:00 2018-11-18 03:00:32+00:00 0:00:47 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 89, in run
raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag:
'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10446394Maxim Kuzmin Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 02:59:15+00:00 2018-11-18 02:59:38+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 78, "reward": -13.073740402221656, "good_angle": 1.2822185210774788, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 71, "reward": -14.64982845078052, "good_angle": 0.01315761006529569, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 255, "reward": -4.574526128406618, "good_angle": 1.054991355859468, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.466666666666659}, "ep003": {"nsteps": 456, "reward": -2.163129653090676, "good_angle": 1.4434967110165102, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.4333333333333247}, "ep004": {"nsteps": 345, "reward": -3.663357601692711, "good_angle": 16.137431452383584, "survival_time": 11.49999999999997, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}good_angle_max 16.137431452383584 good_angle_mean 3.9862591300804673 good_angle_median 1.2822185210774788 good_angle_min 0.01315761006529569 reward_max -2.163129653090676 reward_mean -7.624916447238436 reward_median -4.574526128406618 reward_min -14.64982845078052 survival_time_max 15.199999999999957 survival_time_mean 8.033333333333315 survival_time_min 2.366666666666668 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.93333333333332 valid_direction_mean 2.206666666666661 valid_direction_median 2.4333333333333247 valid_direction_min 0
No reset possible 10443382Andrea Censi Tensorflow template aido1_LFV_r1-v3step3-videos aborted yes idsc-rudolf-183282018-11-18 02:58:54+00:00 2018-11-18 02:59:06+00:00 0:00:12 Error while running [...]
Creating job10443-2976_videos_1 ... error
stderr | ERROR: for job10443-2976_videos_1 Cannot start service videos: network job10443-2976_evaluation not found
stderr |
stderr | ERROR: for videos Cannot start service videos: network job10443-2976_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10440382Andrea Censi Tensorflow template aido1_LFV_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-18 02:58:25+00:00 2018-11-18 02:58:47+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.533333333333327
other stats episodes details {"ep000": {"nsteps": 243, "reward": -4.316350231487055, "good_angle": 0.5664042779933937, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.6333333333333333}, "ep001": {"nsteps": 79, "reward": -12.885249126419614, "good_angle": 1.085086062259322, "survival_time": 2.6333333333333337, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep002": {"nsteps": 118, "reward": -8.696456273512567, "good_angle": 0.526865204300088, "survival_time": 3.933333333333329, "traveled_tiles": 3, "valid_direction": 0.6666666666666643}, "ep003": {"nsteps": 138, "reward": -7.337596013759047, "good_angle": 0.24936517824282384, "survival_time": 4.599999999999993, "traveled_tiles": 3, "valid_direction": 0.5333333333333314}, "ep004": {"nsteps": 136, "reward": -7.458794191721074, "good_angle": 0.4742387516236173, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 0.6333333333333311}}good_angle_max 1.085086062259322 good_angle_mean 0.5803918948838489 good_angle_median 0.526865204300088 good_angle_min 0.24936517824282384 reward_max -4.316350231487055 reward_mean -8.13888916737987 reward_median -7.458794191721074 reward_min -12.885249126419614 survival_time_max 8.099999999999982 survival_time_mean 4.759999999999994 survival_time_min 2.6333333333333337 traveled_tiles_max 5 traveled_tiles_mean 3.4 traveled_tiles_median 3 traveled_tiles_min 3 valid_direction_max 0.6666666666666643 valid_direction_mean 0.6066666666666649 valid_direction_median 0.6333333333333311 valid_direction_min 0.5333333333333314
No reset possible 10428382Andrea Censi Tensorflow template aido1_LFV_r1-v3step1-simulation success no idsc-rudolf-183282018-11-18 02:56:02+00:00 2018-11-18 02:58:18+00:00 0:02:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10388412Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:45:16+00:00 2018-11-18 02:55:55+00:00 0:10:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10370440Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 02:39:08+00:00 2018-11-18 02:45:06+00:00 0:05:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.0786607390399845 deviation-center-line_median 1.3556511426038445 in-drivable-lane_median 1.6999999999999946
other stats deviation-center-line_max 1.3908307461933556 deviation-center-line_mean 1.169035604132801 deviation-center-line_min 0.38390019037673695 deviation-heading_max 11.686485350648164 deviation-heading_mean 9.427982625495332 deviation-heading_median 10.691319250448204 deviation-heading_min 4.103973034163737 driven_any_max 4.969465406728449 driven_any_mean 4.967841435364298 driven_any_median 4.968652413650665 driven_any_min 4.965179079877877 driven_lanedir_max 3.1500484150972476 driven_lanedir_mean 2.6171002865692214 driven_lanedir_min 0.7335569134262709 in-drivable-lane_max 12.133333333333333 in-drivable-lane_mean 3.726666666666663 in-drivable-lane_min 0.8999999999999971 per-episodes details {"ep000": {"driven_any": 4.965179079877877, "driven_lanedir": 0.7335569134262709, "in-drivable-lane": 12.133333333333333, "deviation-heading": 4.103973034163737, "deviation-center-line": 0.38390019037673695}, "ep001": {"driven_any": 4.968812841326389, "driven_lanedir": 3.017990410291395, "in-drivable-lane": 2.3999999999999924, "deviation-heading": 9.761078996683448, "deviation-center-line": 1.3908307461933556}, "ep002": {"driven_any": 4.967097435238112, "driven_lanedir": 3.1052449549912113, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.89705649553311, "deviation-center-line": 1.348431061805968}, "ep003": {"driven_any": 4.969465406728449, "driven_lanedir": 3.1500484150972476, "in-drivable-lane": 0.8999999999999971, "deviation-heading": 11.686485350648164, "deviation-center-line": 1.3556511426038445}, "ep004": {"driven_any": 4.968652413650665, "driven_lanedir": 3.0786607390399845, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.691319250448204, "deviation-center-line": 1.3663648796841}}
No reset possible 10343441Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 02:32:29+00:00 2018-11-18 02:39:00+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.0518752631006807 deviation-center-line_median 1.3512740972580728 in-drivable-lane_median 1.9999999999999936
other stats deviation-center-line_max 1.397120621557742 deviation-center-line_mean 1.1644235361284097 deviation-center-line_min 0.3618737802825904 deviation-heading_max 11.628786011024133 deviation-heading_mean 9.36084424147263 deviation-heading_median 10.30304935894446 deviation-heading_min 4.129113363573511 driven_any_max 4.970715200225414 driven_any_mean 4.967778990820433 driven_any_median 4.9678959255496755 driven_any_min 4.9654917239874035 driven_lanedir_max 3.1512109922818654 driven_lanedir_mean 2.6075332997065765 driven_lanedir_min 0.7037709430774679 in-drivable-lane_max 12.199999999999998 in-drivable-lane_mean 3.793333333333328 in-drivable-lane_min 0.9333333333333302 per-episodes details {"ep000": {"driven_any": 4.9654917239874035, "driven_lanedir": 0.7037709430774679, "in-drivable-lane": 12.199999999999998, "deviation-heading": 4.129113363573511, "deviation-center-line": 0.3618737802825904}, "ep001": {"driven_any": 4.968930450582603, "driven_lanedir": 3.0204946795441985, "in-drivable-lane": 2.366666666666659, "deviation-heading": 9.807027125752798, "deviation-center-line": 1.397120621557742}, "ep002": {"driven_any": 4.9678959255496755, "driven_lanedir": 3.1103146205286714, "in-drivable-lane": 1.466666666666662, "deviation-heading": 10.936245348068253, "deviation-center-line": 1.3485479488747352}, "ep003": {"driven_any": 4.970715200225414, "driven_lanedir": 3.1512109922818654, "in-drivable-lane": 0.9333333333333302, "deviation-heading": 11.628786011024133, "deviation-center-line": 1.3512740972580728}, "ep004": {"driven_any": 4.965861653757066, "driven_lanedir": 3.0518752631006807, "in-drivable-lane": 1.9999999999999936, "deviation-heading": 10.30304935894446, "deviation-center-line": 1.3633012326689085}}
No reset possible 10329441Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 02:27:00+00:00 2018-11-18 02:32:22+00:00 0:05:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10327441Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 02:26:31+00:00 2018-11-18 02:26:53+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.6392520840875805, "good_angle": 26.105561231675527, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999978}, "ep001": {"nsteps": 500, "reward": -0.414262099902553, "good_angle": 13.57251882892323, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333325}, "ep002": {"nsteps": 500, "reward": -0.24497245893173383, "good_angle": 13.674877803758102, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.17917946749940164, "good_angle": 13.621829647331085, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}, "ep004": {"nsteps": 500, "reward": -0.33717168274195863, "good_angle": 13.689051384582603, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}}good_angle_max 26.105561231675527 good_angle_mean 16.13276777925411 good_angle_median 13.674877803758102 good_angle_min 13.57251882892323 reward_max -0.17917946749940164 reward_mean -0.3629675586326456 reward_median -0.33717168274195863 reward_min -0.6392520840875805 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 12.96666666666666 valid_direction_mean 12.693333333333324 valid_direction_median 12.933333333333325 valid_direction_min 11.699999999999978
No reset possible 10311441Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 02:18:01+00:00 2018-11-18 02:26:23+00:00 0:08:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10309442Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:17:29+00:00 2018-11-18 02:17:54+00:00 0:00:25 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 58, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10301443Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:16:56+00:00 2018-11-18 02:17:22+00:00 0:00:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 58, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10294454Orlando Marquez PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 02:16:26+00:00 2018-11-18 02:16:49+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.6358119174102321, "good_angle": 26.119034103876217, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999974}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25285773413255813, "good_angle": 13.562961716495696, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 26.119034103876217 good_angle_mean 16.095647580263446 good_angle_median 13.562961716495696 good_angle_min 13.49085374796333 reward_max -0.17246611558226868 reward_mean -0.3494114613714046 reward_median -0.3079843127221684 reward_min -0.6358119174102321 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.699999999999983 valid_direction_median 12.96666666666665 valid_direction_min 11.699999999999974
No reset possible 10281448Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 02:13:11+00:00 2018-11-18 02:16:18+00:00 0:03:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10277450Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:12:33+00:00 2018-11-18 02:13:02+00:00 0:00:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10272452Jonathan Plante Random execution aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 02:11:58+00:00 2018-11-18 02:12:26+00:00 0:00:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10260456Hristo Vrigazov ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 02:06:37+00:00 2018-11-18 02:11:51+00:00 0:05:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10252468Ruixiang Zhang PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 02:03:58+00:00 2018-11-18 02:06:30+00:00 0:02:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.6278980302903938 deviation-center-line_median 0.3200361643537645 in-drivable-lane_median 2.666666666666657
other stats deviation-center-line_max 0.5604527879158694 deviation-center-line_mean 0.32275559221816347 deviation-center-line_min 0.17530351398474425 deviation-heading_max 3.07948493100588 deviation-heading_mean 1.70564225180607 deviation-heading_median 1.6051217228453003 deviation-heading_min 0.8806499384299412 driven_any_max 1.3532337463173956 driven_any_mean 1.043823229796202 driven_any_median 1.1390097490936024 driven_any_min 0.3361494118738248 driven_lanedir_max 0.7490480971279596 driven_lanedir_mean 0.5352977546799813 driven_lanedir_min 0.1012024375063787 in-drivable-lane_max 4.666666666666651 in-drivable-lane_mean 2.753333333333324 in-drivable-lane_min 0.7999999999999999 per-episodes details {"ep000": {"driven_any": 0.3361494118738248, "driven_lanedir": 0.1012024375063787, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 1.9954812764203704, "deviation-center-line": 0.17530351398474425}, "ep001": {"driven_any": 1.1390097490936024, "driven_lanedir": 0.6548776618137382, "in-drivable-lane": 2.333333333333325, "deviation-heading": 1.6051217228453003, "deviation-center-line": 0.33793849002689447}, "ep002": {"driven_any": 1.3532337463173956, "driven_lanedir": 0.7490480971279596, "in-drivable-lane": 2.666666666666657, "deviation-heading": 3.07948493100588, "deviation-center-line": 0.5604527879158694}, "ep003": {"driven_any": 1.3382229930753748, "driven_lanedir": 0.6278980302903938, "in-drivable-lane": 4.666666666666651, "deviation-heading": 0.9674733903288576, "deviation-center-line": 0.3200361643537645}, "ep004": {"driven_any": 1.052500248620813, "driven_lanedir": 0.5434625466614362, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 0.8806499384299412, "deviation-center-line": 0.2200470048095449}}
No reset possible 10247468Ruixiang Zhang PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 02:02:26+00:00 2018-11-18 02:03:51+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10245468Ruixiang Zhang PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 02:01:56+00:00 2018-11-18 02:02:20+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.299999999999987
other stats episodes details {"ep000": {"nsteps": 77, "reward": -13.285036901427832, "good_angle": 1.3812330281837997, "survival_time": 2.5666666666666673, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 189, "reward": -6.810056384027043, "good_angle": 16.09326694350935, "survival_time": 6.299999999999987, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 241, "reward": -4.792067446572034, "good_angle": 3.299939802000829, "survival_time": 8.033333333333315, "traveled_tiles": 4, "valid_direction": 5.699999999999982}, "ep003": {"nsteps": 251, "reward": -5.118078481105427, "good_angle": 0.9707472905581044, "survival_time": 8.366666666666648, "traveled_tiles": 3, "valid_direction": 4.766666666666651}, "ep004": {"nsteps": 184, "reward": -6.669165432999802, "good_angle": 1.5704259716787683, "survival_time": 6.133333333333321, "traveled_tiles": 2, "valid_direction": 4.63333333333332}}good_angle_max 16.09326694350935 good_angle_mean 4.66312260718617 good_angle_median 1.5704259716787683 good_angle_min 0.9707472905581044 reward_max -4.792067446572034 reward_mean -7.334880929226427 reward_median -6.669165432999802 reward_min -13.285036901427832 survival_time_max 8.366666666666648 survival_time_mean 6.279999999999988 survival_time_min 2.5666666666666673 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.699999999999982 valid_direction_mean 4.233333333333322 valid_direction_median 4.63333333333332 valid_direction_min 2.1333333333333337
No reset possible 10226472Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 01:56:19+00:00 2018-11-18 02:01:47+00:00 0:05:28 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10222475Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 01:55:25+00:00 2018-11-18 01:56:12+00:00 0:00:47 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10202485Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 01:44:42+00:00 2018-11-18 01:55:18+00:00 0:10:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10195494Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 01:43:34+00:00 2018-11-18 01:44:35+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.19303217919505933 deviation-center-line_median 0.13202001615408243 in-drivable-lane_median 0
other stats deviation-center-line_max 0.16616409096751508 deviation-center-line_mean 0.13574885345523155 deviation-center-line_min 0.09937488280591132 deviation-heading_max 0.8553840985009603 deviation-heading_mean 0.5909122818509827 deviation-heading_median 0.5349751117769646 deviation-heading_min 0.36485468496866386 driven_any_max 0.32145029900952454 driven_any_mean 0.22641281930236035 driven_any_median 0.22361759931097583 driven_any_min 0.14907839954064755 driven_lanedir_max 0.20733918868000736 driven_lanedir_mean 0.15129694649143954 driven_lanedir_min 0.011448408900461835 in-drivable-lane_max 1.7333333333333345 in-drivable-lane_mean 0.34666666666666685 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.32145029900952454, "driven_lanedir": 0.011448408900461835, "in-drivable-lane": 1.7333333333333345, "deviation-heading": 0.8553840985009603, "deviation-center-line": 0.09937488280591132}, "ep001": {"driven_any": 0.14907839954064755, "driven_lanedir": 0.13950665611047963, "in-drivable-lane": 0, "deviation-heading": 0.36485468496866386, "deviation-center-line": 0.13202001615408243}, "ep002": {"driven_any": 0.2096414993540364, "driven_lanedir": 0.19303217919505933, "in-drivable-lane": 0, "deviation-heading": 0.5349751117769646, "deviation-center-line": 0.151352932830969}, "ep003": {"driven_any": 0.2282762992966175, "driven_lanedir": 0.2051582995711896, "in-drivable-lane": 0, "deviation-heading": 0.6679471505798023, "deviation-center-line": 0.12983234451767997}, "ep004": {"driven_any": 0.22361759931097583, "driven_lanedir": 0.20733918868000736, "in-drivable-lane": 0, "deviation-heading": 0.5314003634285224, "deviation-center-line": 0.16616409096751508}}
No reset possible 10188494Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 01:42:39+00:00 2018-11-18 01:43:26+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10184494Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 01:42:11+00:00 2018-11-18 01:42:32+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.6666666666666683
other stats episodes details {"ep000": {"nsteps": 71, "reward": -14.602974558681984, "good_angle": 3.247631246192459, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 2.1000000000000014}, "ep001": {"nsteps": 34, "reward": -30.055296871592017, "good_angle": 0.15666542067063838, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.5333333333333335}, "ep002": {"nsteps": 47, "reward": -21.804280122543904, "good_angle": 0.2687824934873088, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.8000000000000016}, "ep003": {"nsteps": 51, "reward": -20.02064744324661, "good_angle": 0.3725400452344469, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0.9666666666666688}, "ep004": {"nsteps": 50, "reward": -20.54394795835018, "good_angle": 0.2633737134127251, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0.8000000000000019}}good_angle_max 3.247631246192459 good_angle_mean 0.8617985837995157 good_angle_median 0.2687824934873088 good_angle_min 0.15666542067063838 reward_max -14.602974558681984 reward_mean -21.405429390882937 reward_median -20.54394795835018 reward_min -30.055296871592017 survival_time_max 2.366666666666668 survival_time_mean 1.686666666666668 survival_time_min 1.1333333333333335 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 2.1000000000000014 valid_direction_mean 1.0400000000000014 valid_direction_median 0.8000000000000019 valid_direction_min 0.5333333333333335
No reset possible 10177494Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:40:19+00:00 2018-11-18 01:42:03+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10172498Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 01:39:48+00:00 2018-11-18 01:40:09+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.366666666666661
other stats episodes details {"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}good_angle_max 4.804851725848225 good_angle_mean 4.350085033566717 good_angle_median 4.636373361798506 good_angle_min 3.212081557270962 reward_max -6.709294177134309 reward_mean -7.84581404120635 reward_median -8.178489692882414 reward_min -8.459673733430305 survival_time_max 5.6999999999999895 survival_time_mean 4.659999999999993 survival_time_min 4.233333333333328 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 3.833333333333327 valid_direction_mean 3.499999999999994 valid_direction_median 3.6666666666666607 valid_direction_min 2.79999999999999
No reset possible 10161498Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:36:58+00:00 2018-11-18 01:39:41+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10149512Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 01:33:07+00:00 2018-11-18 01:36:49+00:00 0:03:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9209879724108954 deviation-center-line_median 0.4689912177548896 in-drivable-lane_median 9.533333333333337
other stats deviation-center-line_max 1.853337884235602 deviation-center-line_mean 0.6717788293026569 deviation-center-line_min 0 deviation-heading_max 3.628030980806938 deviation-heading_mean 1.6089473489951018 deviation-heading_median 1.1427723730712696 deviation-heading_min 0 driven_any_max 2.55283094392624 driven_any_mean 1.6335979013868287 driven_any_median 1.651760231612668 driven_any_min 0.82963842770936 driven_lanedir_max 2.1486038204142033 driven_lanedir_mean 0.9051091953072266 driven_lanedir_min 0 in-drivable-lane_max 13.566666666666656 in-drivable-lane_mean 8.253333333333327 in-drivable-lane_min 1.8666666666666956 per-episodes details {"ep000": {"driven_any": 1.651760231612668, "driven_lanedir": 0, "in-drivable-lane": 10.533333333333308, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3783988617625167, "driven_lanedir": 0.989226704837072, "in-drivable-lane": 9.533333333333337, "deviation-heading": 2.240846655608999, "deviation-center-line": 0.4689912177548896}, "ep002": {"driven_any": 0.82963842770936, "driven_lanedir": 0.4667274788739617, "in-drivable-lane": 13.566666666666656, "deviation-heading": 1.1427723730712696, "deviation-center-line": 0.26274387752554856}, "ep003": {"driven_any": 1.755361041923359, "driven_lanedir": 0.9209879724108954, "in-drivable-lane": 5.766666666666647, "deviation-heading": 1.033086735488301, "deviation-center-line": 0.7738211669972446}, "ep004": {"driven_any": 2.55283094392624, "driven_lanedir": 2.1486038204142033, "in-drivable-lane": 1.8666666666666956, "deviation-heading": 3.628030980806938, "deviation-center-line": 1.853337884235602}}
No reset possible 10140512Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 01:31:00+00:00 2018-11-18 01:33:00+00:00 0:02:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10138512Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 01:30:32+00:00 2018-11-18 01:30:54+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 317, "reward": -4.6051123724186835, "good_angle": 1.449020127135737, "survival_time": 10.56666666666664, "traveled_tiles": 4, "valid_direction": 2.999999999999991}, "ep001": {"nsteps": 500, "reward": -1.7696727788299322, "good_angle": 33.320255146932425, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.933333333333325}, "ep002": {"nsteps": 500, "reward": -2.3688311167489737, "good_angle": 18.4088431117771, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.666666666666652}, "ep003": {"nsteps": 348, "reward": -3.8478188502505937, "good_angle": 1.8661239948196051, "survival_time": 11.59999999999997, "traveled_tiles": 4, "valid_direction": 3.1666666666666563}, "ep004": {"nsteps": 500, "reward": -0.357737303284579, "good_angle": 15.672619836096708, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.866666666666657}}good_angle_max 33.320255146932425 good_angle_mean 14.143372443352314 good_angle_median 15.672619836096708 good_angle_min 1.449020127135737 reward_max -0.357737303284579 reward_mean -2.5898344843065524 reward_median -2.3688311167489737 reward_min -4.6051123724186835 survival_time_max 16.666666666666654 survival_time_mean 14.433333333333314 survival_time_min 10.56666666666664 traveled_tiles_max 5 traveled_tiles_mean 3.8 traveled_tiles_median 4 traveled_tiles_min 3 valid_direction_max 15.666666666666652 valid_direction_mean 7.926666666666657 valid_direction_median 3.866666666666657 valid_direction_min 2.999999999999991
No reset possible 10119512Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:23:53+00:00 2018-11-18 01:30:24+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10105516Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:21:13+00:00 2018-11-18 01:23:47+00:00 0:02:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10100521Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 01:20:06+00:00 2018-11-18 01:21:06+00:00 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.19303217919505933 deviation-center-line_median 0.13202001615408243 in-drivable-lane_median 0
other stats deviation-center-line_max 0.16616409096751508 deviation-center-line_mean 0.13574885345523155 deviation-center-line_min 0.09937488280591132 deviation-heading_max 0.8553840985009603 deviation-heading_mean 0.5909122818509827 deviation-heading_median 0.5349751117769646 deviation-heading_min 0.36485468496866386 driven_any_max 0.32145029900952454 driven_any_mean 0.22641281930236035 driven_any_median 0.22361759931097583 driven_any_min 0.14907839954064755 driven_lanedir_max 0.20733918868000736 driven_lanedir_mean 0.15129694649143954 driven_lanedir_min 0.011448408900461835 in-drivable-lane_max 1.7333333333333345 in-drivable-lane_mean 0.34666666666666685 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.32145029900952454, "driven_lanedir": 0.011448408900461835, "in-drivable-lane": 1.7333333333333345, "deviation-heading": 0.8553840985009603, "deviation-center-line": 0.09937488280591132}, "ep001": {"driven_any": 0.14907839954064755, "driven_lanedir": 0.13950665611047963, "in-drivable-lane": 0, "deviation-heading": 0.36485468496866386, "deviation-center-line": 0.13202001615408243}, "ep002": {"driven_any": 0.2096414993540364, "driven_lanedir": 0.19303217919505933, "in-drivable-lane": 0, "deviation-heading": 0.5349751117769646, "deviation-center-line": 0.151352932830969}, "ep003": {"driven_any": 0.2282762992966175, "driven_lanedir": 0.2051582995711896, "in-drivable-lane": 0, "deviation-heading": 0.6679471505798023, "deviation-center-line": 0.12983234451767997}, "ep004": {"driven_any": 0.22361759931097583, "driven_lanedir": 0.20733918868000736, "in-drivable-lane": 0, "deviation-heading": 0.5314003634285224, "deviation-center-line": 0.16616409096751508}}
No reset possible 10092521Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 01:19:13+00:00 2018-11-18 01:19:56+00:00 0:00:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10089521Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 01:18:44+00:00 2018-11-18 01:19:06+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.6666666666666683
other stats episodes details {"ep000": {"nsteps": 71, "reward": -14.602974558681984, "good_angle": 3.247631246192459, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 2.1000000000000014}, "ep001": {"nsteps": 34, "reward": -30.055296871592017, "good_angle": 0.15666542067063838, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 0.5333333333333335}, "ep002": {"nsteps": 47, "reward": -21.804280122543904, "good_angle": 0.2687824934873088, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.8000000000000016}, "ep003": {"nsteps": 51, "reward": -20.02064744324661, "good_angle": 0.3725400452344469, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0.9666666666666688}, "ep004": {"nsteps": 50, "reward": -20.54394795835018, "good_angle": 0.2633737134127251, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0.8000000000000019}}good_angle_max 3.247631246192459 good_angle_mean 0.8617985837995157 good_angle_median 0.2687824934873088 good_angle_min 0.15666542067063838 reward_max -14.602974558681984 reward_mean -21.405429390882937 reward_median -20.54394795835018 reward_min -30.055296871592017 survival_time_max 2.366666666666668 survival_time_mean 1.686666666666668 survival_time_min 1.1333333333333335 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 2.1000000000000014 valid_direction_mean 1.0400000000000014 valid_direction_median 0.8000000000000019 valid_direction_min 0.5333333333333335
No reset possible 10077521Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:16:53+00:00 2018-11-18 01:18:38+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10073531Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 01:14:57+00:00 2018-11-18 01:16:45+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.28977579066348724 deviation-center-line_median 0.2596306626838413 in-drivable-lane_median 0.8999999999999968
other stats deviation-center-line_max 0.3495269439274484 deviation-center-line_mean 0.2816719556808085 deviation-center-line_min 0.23084578070496203 deviation-heading_max 3.140638799446339 deviation-heading_mean 2.412886947725279 deviation-heading_median 2.769138296409296 deviation-heading_min 0.834297520530139 driven_any_max 0.7873202975740567 driven_any_mean 0.6419688580219205 driven_any_median 0.6009722981482444 driven_any_min 0.5823374982056604 driven_lanedir_max 0.34105884308565093 driven_lanedir_mean 0.3003442252313668 driven_lanedir_min 0.28535129762116584 in-drivable-lane_max 3.3333333333333277 in-drivable-lane_mean 1.3666666666666631 in-drivable-lane_min 0.7333333333333307 per-episodes details {"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
No reset possible 10061531Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 01:12:33+00:00 2018-11-18 01:14:51+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10060531Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 01:12:04+00:00 2018-11-18 01:12:26+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.366666666666661
other stats episodes details {"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}good_angle_max 4.804851725848225 good_angle_mean 4.350085033566717 good_angle_median 4.636373361798506 good_angle_min 3.212081557270962 reward_max -6.709294177134309 reward_mean -7.84581404120635 reward_median -8.178489692882414 reward_min -8.459673733430305 survival_time_max 5.6999999999999895 survival_time_mean 4.659999999999993 survival_time_min 4.233333333333328 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 3.833333333333327 valid_direction_mean 3.499999999999994 valid_direction_median 3.6666666666666607 valid_direction_min 2.79999999999999
No reset possible 10048531Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:04:51+00:00 2018-11-18 01:11:57+00:00 0:07:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10043537Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 01:03:40+00:00 2018-11-18 01:04:41+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.19839021629551645 deviation-center-line_median 0.026892949624649044 in-drivable-lane_median 0.6333333333333332
other stats deviation-center-line_max 0.03470304301881854 deviation-center-line_mean 0.029098229282228133 deviation-center-line_min 0.02425751862089922 deviation-heading_max 0.2502811076721805 deviation-heading_mean 0.2216207237983671 deviation-heading_median 0.2174546153073063 deviation-heading_min 0.20367890538449185 driven_any_max 0.7934332474149146 driven_any_mean 0.6203470772963854 driven_any_median 0.5940892873700189 driven_any_min 0.5268005768593016 driven_lanedir_max 0.24838713693963585 driven_lanedir_mean 0.21495470955382895 driven_lanedir_min 0.1878690715124578 in-drivable-lane_max 1.0000000000000009 in-drivable-lane_mean 0.6666666666666669 in-drivable-lane_min 0.4666666666666666 per-episodes details {"ep000": {"driven_any": 0.7934332474149146, "driven_lanedir": 0.24838713693963585, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 0.2203377148725361, "deviation-center-line": 0.03431462664200679}, "ep001": {"driven_any": 0.6320560624194703, "driven_lanedir": 0.24748320916279457, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.2502811076721805, "deviation-center-line": 0.03470304301881854}, "ep002": {"driven_any": 0.5553562124182219, "driven_lanedir": 0.1878690715124578, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.2174546153073063, "deviation-center-line": 0.025323008504767073}, "ep003": {"driven_any": 0.5268005768593016, "driven_lanedir": 0.19839021629551645, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 0.20367890538449185, "deviation-center-line": 0.026892949624649044}, "ep004": {"driven_any": 0.5940892873700189, "driven_lanedir": 0.1926439138587401, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.21635127575532087, "deviation-center-line": 0.02425751862089922}}
No reset possible 10032536Benjamin Ramtoula PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 01:01:35+00:00 2018-11-18 01:03:34+00:00 0:01:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10018551Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:57:34+00:00 2018-11-18 01:01:27+00:00 0:03:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3576978746005717 deviation-center-line_median 0.2233841557282331 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3503940953154788 deviation-center-line_mean 0.19738717890852345 deviation-center-line_min 0 deviation-heading_max 12.77547708270898 deviation-heading_mean 5.865458865467552 deviation-heading_median 7.097049538801558 deviation-heading_min 0 driven_any_max 1.2739283137934605 driven_any_mean 0.6107395487412631 driven_any_median 0.5166434073868348 driven_any_min 0.01531878084989824 driven_lanedir_max 0.8619271176621262 driven_lanedir_mean 0.3497392406430405 driven_lanedir_min 0 in-drivable-lane_max 16.63333333333332 in-drivable-lane_mean 3.333333333333331 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.2739283137934605, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.3719349073541322, "driven_lanedir": 0.3576978746005717, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.2824915590704668, "deviation-center-line": 0.1192082148314856}, "ep002": {"driven_any": 0.5166434073868348, "driven_lanedir": 0.5149982021318316, "in-drivable-lane": 0, "deviation-heading": 12.77547708270898, "deviation-center-line": 0.3503940953154788}, "ep003": {"driven_any": 0.01531878084989824, "driven_lanedir": 0.014073008820673303, "in-drivable-lane": 0, "deviation-heading": 7.097049538801558, "deviation-center-line": 0.2939494286674196}, "ep004": {"driven_any": 0.8758723343219902, "driven_lanedir": 0.8619271176621262, "in-drivable-lane": 0, "deviation-heading": 9.17227614675676, "deviation-center-line": 0.2233841557282331}}
No reset possible 9999551Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 00:55:08+00:00 2018-11-18 00:57:27+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9995551Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:54:41+00:00 2018-11-18 00:55:02+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.9915735043883325, "good_angle": 2.953277850433357, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.033333333333329}, "ep001": {"nsteps": 41, "reward": -24.947025884215424, "good_angle": 0.3621553754560622, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0.2666666666666675}, "ep002": {"nsteps": 500, "reward": -0.15607701748982072, "good_angle": 10.913104204852193, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 15.13333333333332}, "ep003": {"nsteps": 500, "reward": -0.05172294469177723, "good_angle": 3.312909787869147, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 8.36666666666666}, "ep004": {"nsteps": 500, "reward": -0.026097689567599447, "good_angle": 5.930381242691954, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.099999999999987}}good_angle_max 10.913104204852193 good_angle_mean 4.694365692260542 good_angle_median 3.312909787869147 good_angle_min 0.3621553754560622 reward_max -0.026097689567599447 reward_mean -5.434499408070591 reward_median -0.15607701748982072 reward_min -24.947025884215424 survival_time_max 16.666666666666654 survival_time_mean 13.606666666666658 survival_time_min 1.3666666666666676 traveled_tiles_max 3 traveled_tiles_mean 1.8 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 15.13333333333332 valid_direction_mean 8.979999999999993 valid_direction_median 8.36666666666666 valid_direction_min 0.2666666666666675
No reset possible 9987542Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:53:18+00:00 2018-11-18 00:54:34+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9982547Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 00:52:40+00:00 2018-11-18 00:53:11+00:00 0:00:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: unsupported operand type(s) for *: 'NoneType' and 'float'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9976556Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:50:14+00:00 2018-11-18 00:52:33+00:00 0:02:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.8388284868739044 deviation-center-line_median 0.40829492065067136 in-drivable-lane_median 2.499999999999991
other stats deviation-center-line_max 1.3850159057442797 deviation-center-line_mean 0.48439504792980176 deviation-center-line_min 0 deviation-heading_max 2.731003842399908 deviation-heading_mean 1.3742023573853992 deviation-heading_median 1.4780934594585675 deviation-heading_min 0 driven_any_max 4.4334392551804225 driven_any_mean 1.955847885381844 driven_any_median 1.507655100784167 driven_any_min 0.8058573698638208 driven_lanedir_max 2.68890241611442 driven_lanedir_mean 1.028354317558895 driven_lanedir_min 0 in-drivable-lane_max 5.400000000000015 in-drivable-lane_mean 2.939999999999998 in-drivable-lane_min 0.5999999999999979 per-episodes details {"ep000": {"driven_any": 1.463847084307186, "driven_lanedir": 0, "in-drivable-lane": 5.2333333333333245, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.507655100784167, "driven_lanedir": 1.1062055517564664, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 2.0291461931279025, "deviation-center-line": 0.4340463123399711}, "ep002": {"driven_any": 0.8058573698638208, "driven_lanedir": 0.5078351330496838, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 1.4780934594585675, "deviation-center-line": 0.1946181009140865}, "ep003": {"driven_any": 1.5684406167736238, "driven_lanedir": 0.8388284868739044, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.6327682919406171, "deviation-center-line": 0.40829492065067136}, "ep004": {"driven_any": 4.4334392551804225, "driven_lanedir": 2.68890241611442, "in-drivable-lane": 5.400000000000015, "deviation-heading": 2.731003842399908, "deviation-center-line": 1.3850159057442797}}
No reset possible 9968556Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 00:48:41+00:00 2018-11-18 00:50:07+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9964556Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:48:11+00:00 2018-11-18 00:48:35+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.866666666666656
other stats episodes details {"ep000": {"nsteps": 158, "reward": -8.226458886944794, "good_angle": 0.3987989909270385, "survival_time": 5.266666666666658, "traveled_tiles": 3, "valid_direction": 0.7333333333333321}, "ep001": {"nsteps": 195, "reward": -5.596896435606938, "good_angle": 13.01806533260478, "survival_time": 6.499999999999987, "traveled_tiles": 3, "valid_direction": 4.033333333333321}, "ep002": {"nsteps": 102, "reward": -10.25298324893982, "good_angle": 2.2763576284661613, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 2.299999999999997}, "ep003": {"nsteps": 176, "reward": -6.477739483984723, "good_angle": 0.8882213719605685, "survival_time": 5.866666666666656, "traveled_tiles": 3, "valid_direction": 1.2666666666666626}, "ep004": {"nsteps": 500, "reward": -0.6602654142612592, "good_angle": 25.35249403616481, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.8333333333333206}}good_angle_max 25.35249403616481 good_angle_mean 8.386787472024672 good_angle_median 2.2763576284661613 good_angle_min 0.3987989909270385 reward_max -0.6602654142612592 reward_mean -6.242868693947508 reward_median -6.477739483984723 reward_min -10.25298324893982 survival_time_max 16.666666666666654 survival_time_mean 7.53999999999999 survival_time_min 3.3999999999999977 traveled_tiles_max 9 traveled_tiles_mean 4 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 4.033333333333321 valid_direction_mean 2.4333333333333265 valid_direction_median 2.299999999999997 valid_direction_min 0.7333333333333321
No reset possible 9952556Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:43:40+00:00 2018-11-18 00:48:05+00:00 0:04:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9938570Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 00:40:13+00:00 2018-11-18 00:43:31+00:00 0:03:18 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9928577Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:38:01+00:00 2018-11-18 00:40:03+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.556511482949603 deviation-center-line_median 0.27999622831039583 in-drivable-lane_median 1.8999999999999948
other stats deviation-center-line_max 1.0923573999517773 deviation-center-line_mean 0.3762508402977914 deviation-center-line_min 0.01894951343622136 deviation-heading_max 2.812228279935465 deviation-heading_mean 1.1750749123509934 deviation-heading_median 0.7236008447660953 deviation-heading_min 0.2547098672697907 driven_any_max 4.014281751451181 driven_any_mean 1.7571030075714682 driven_any_median 1.3053964573512806 driven_any_min 0.8694291840591771 driven_lanedir_max 1.9536100225069195 driven_lanedir_mean 0.7749555096591664 driven_lanedir_min 0.0011339543734978363 in-drivable-lane_max 7.899999999999973 in-drivable-lane_mean 3.3799999999999906 in-drivable-lane_min 0.6333333333333311 per-episodes details {"ep000": {"driven_any": 1.3991649606908276, "driven_lanedir": 0.0011339543734978363, "in-drivable-lane": 4.599999999999993, "deviation-heading": 0.2547098672697907, "deviation-center-line": 0.01894951343622136}, "ep001": {"driven_any": 1.3053964573512806, "driven_lanedir": 0.9462014920882916, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 1.4360808982249993, "deviation-center-line": 0.3276055880041256}, "ep002": {"driven_any": 0.8694291840591771, "driven_lanedir": 0.4173205963775197, "in-drivable-lane": 1.8999999999999948, "deviation-heading": 0.7236008447660953, "deviation-center-line": 0.16234547178643677}, "ep003": {"driven_any": 1.1972426843048751, "driven_lanedir": 0.556511482949603, "in-drivable-lane": 1.86666666666666, "deviation-heading": 0.6487546715586159, "deviation-center-line": 0.27999622831039583}, "ep004": {"driven_any": 4.014281751451181, "driven_lanedir": 1.9536100225069195, "in-drivable-lane": 7.899999999999973, "deviation-heading": 2.812228279935465, "deviation-center-line": 1.0923573999517773}}
No reset possible 9924574Tri Cao PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:37:32+00:00 2018-11-18 00:37:53+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999986
other stats episodes details {"ep000": {"nsteps": 80, "reward": -12.778064692998305, "good_angle": 1.363450733314574, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 201, "reward": -6.827081204537969, "good_angle": 19.104660003353956, "survival_time": 6.699999999999986, "traveled_tiles": 2, "valid_direction": 5.0999999999999845}, "ep002": {"nsteps": 233, "reward": -4.7389612369191365, "good_angle": 2.735797349240424, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep003": {"nsteps": 219, "reward": -5.790552143207921, "good_angle": 0.9611469731525416, "survival_time": 7.299999999999984, "traveled_tiles": 3, "valid_direction": 4.733333333333321}, "ep004": {"nsteps": 188, "reward": -6.103605419414692, "good_angle": 1.3756424229144788, "survival_time": 6.266666666666654, "traveled_tiles": 2, "valid_direction": 3.399999999999988}}good_angle_max 19.104660003353956 good_angle_mean 5.108139496395195 good_angle_median 1.3756424229144788 good_angle_min 0.9611469731525416 reward_max -4.7389612369191365 reward_mean -7.247652939415606 reward_median -6.103605419414692 reward_min -12.778064692998305 survival_time_max 7.766666666666649 survival_time_mean 6.139999999999988 survival_time_min 2.666666666666667 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.0999999999999845 valid_direction_mean 4.026666666666655 valid_direction_median 4.699999999999984 valid_direction_min 2.2
No reset possible 9913580Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:35:19+00:00 2018-11-18 00:37:23+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.605032309759258 deviation-center-line_median 0.28260873292862065 in-drivable-lane_median 4.133333333333319
other stats deviation-center-line_max 0.40892351065133614 deviation-center-line_mean 0.2513807902906945 deviation-center-line_min 0 deviation-heading_max 1.887652217500996 deviation-heading_mean 0.9933705458365376 deviation-heading_median 1.0339325559787642 deviation-heading_min 0 driven_any_max 2.222597913361271 driven_any_mean 1.3050234632564128 driven_any_median 1.1366454653288849 driven_any_min 0.8219729708052431 driven_lanedir_max 0.898787879229028 driven_lanedir_mean 0.523130807652274 driven_lanedir_min 0 in-drivable-lane_max 8.033333333333307 in-drivable-lane_mean 4.179999999999987 in-drivable-lane_min 0.7999999999999972 per-episodes details {"ep000": {"driven_any": 0.8219729708052431, "driven_lanedir": 0, "in-drivable-lane": 4.733333333333326, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.4719354714009725, "driven_lanedir": 0.898787879229028, "in-drivable-lane": 3.1999999999999895, "deviation-heading": 1.0976026087630633, "deviation-center-line": 0.40892351065133614}, "ep002": {"driven_any": 0.8719654953856926, "driven_lanedir": 0.605032309759258, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.887652217500996, "deviation-center-line": 0.28260873292862065}, "ep003": {"driven_any": 1.1366454653288849, "driven_lanedir": 0.3626524501973716, "in-drivable-lane": 4.133333333333319, "deviation-heading": 0.9476653469398644, "deviation-center-line": 0.18738591944669053}, "ep004": {"driven_any": 2.222597913361271, "driven_lanedir": 0.7491813990757126, "in-drivable-lane": 8.033333333333307, "deviation-heading": 1.0339325559787642, "deviation-center-line": 0.37798578842682495}}
No reset possible 9907582Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:33:19+00:00 2018-11-18 00:35:12+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.7333333333333
other stats episodes details {"ep000": {"nsteps": 333, "reward": -4.404894249038295, "good_angle": 1.5043131393236884, "survival_time": 11.099999999999971, "traveled_tiles": 4, "valid_direction": 3.433333333333323}, "ep001": {"nsteps": 391, "reward": -3.307857882565833, "good_angle": 21.58771939039822, "survival_time": 13.033333333333298, "traveled_tiles": 5, "valid_direction": 8.46666666666664}, "ep002": {"nsteps": 202, "reward": -5.8618497351895655, "good_angle": 2.6251113463110407, "survival_time": 6.733333333333319, "traveled_tiles": 4, "valid_direction": 4.899999999999985}, "ep003": {"nsteps": 382, "reward": -3.5018563633713033, "good_angle": 1.95074065575134, "survival_time": 12.7333333333333, "traveled_tiles": 4, "valid_direction": 3.399999999999988}, "ep004": {"nsteps": 500, "reward": -0.28399274131911806, "good_angle": 17.07575215139702, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.5999999999999908}}good_angle_max 21.58771939039822 good_angle_mean 8.948727336636262 good_angle_median 2.6251113463110407 good_angle_min 1.5043131393236884 reward_max -0.28399274131911806 reward_mean -3.472090194296823 reward_median -3.5018563633713033 reward_min -5.8618497351895655 survival_time_max 16.666666666666654 survival_time_mean 12.053333333333308 survival_time_min 6.733333333333319 traveled_tiles_max 5 traveled_tiles_mean 4.4 traveled_tiles_median 4 traveled_tiles_min 4 valid_direction_max 8.46666666666664 valid_direction_mean 4.759999999999986 valid_direction_median 3.5999999999999908 valid_direction_min 3.399999999999988
No reset possible 9889578Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:28:29+00:00 2018-11-18 00:33:13+00:00 0:04:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9880595Anton Mashikhin PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:26:04+00:00 2018-11-18 00:28:22+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.55051472122708 deviation-center-line_median 0.29477862850039127 in-drivable-lane_median 3.266666666666655
other stats deviation-center-line_max 0.49802291989440306 deviation-center-line_mean 0.30668333839910394 deviation-center-line_min 0.177238888402093 deviation-heading_max 2.6979462349680485 deviation-heading_mean 1.5455686771252173 deviation-heading_median 1.2045236421402643 deviation-heading_min 0.9497524785792189 driven_any_max 1.2625451582899918 driven_any_mean 1.022041299359235 driven_any_median 1.183412567333336 driven_any_min 0.34650700511837895 driven_lanedir_max 0.8808916705365143 driven_lanedir_mean 0.5432996048703389 driven_lanedir_min 0.12059746380215151 in-drivable-lane_max 4.433333333333318 in-drivable-lane_mean 2.6599999999999913 in-drivable-lane_min 0.8666666666666666 per-episodes details {"ep000": {"driven_any": 0.34650700511837895, "driven_lanedir": 0.12059746380215151, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 1.8972189002308293, "deviation-center-line": 0.177238888402093}, "ep001": {"driven_any": 1.183412567333336, "driven_lanedir": 0.6413769201476682, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.2045236421402643, "deviation-center-line": 0.29477862850039127}, "ep002": {"driven_any": 1.256240246954395, "driven_lanedir": 0.8808916705365143, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 2.6979462349680485, "deviation-center-line": 0.49802291989440306}, "ep003": {"driven_any": 1.2625451582899918, "driven_lanedir": 0.55051472122708, "in-drivable-lane": 4.433333333333318, "deviation-heading": 0.9784021297077256, "deviation-center-line": 0.33306468964228786}, "ep004": {"driven_any": 1.0615015191000727, "driven_lanedir": 0.5231172486382809, "in-drivable-lane": 3.3666666666666547, "deviation-heading": 0.9497524785792189, "deviation-center-line": 0.23031156555634455}}
No reset possible 9872592Liu Sam PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 00:25:01+00:00 2018-11-18 00:25:54+00:00 0:00:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9861608David Abraham Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:21:56+00:00 2018-11-18 00:24:52+00:00 0:02:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.124889626096797 deviation-center-line_median 0.3466612585722251 in-drivable-lane_median 0.2333333333333325
other stats deviation-center-line_max 0.9663022256849592 deviation-center-line_mean 0.42645497228947055 deviation-center-line_min 0.19738729660804713 deviation-heading_max 3.019093733670186 deviation-heading_mean 1.7126389655953038 deviation-heading_median 1.9529478692500464 deviation-heading_min 0.1805287453865518 driven_any_max 2.1150451043579395 driven_any_mean 1.103726542787468 driven_any_median 1.1794103506464533 driven_any_min 0.27509169215123813 driven_lanedir_max 2.000359271169093 driven_lanedir_mean 0.9563723000133644 driven_lanedir_min 0.131792306652601 in-drivable-lane_max 1.099999999999996 in-drivable-lane_mean 0.3866666666666657 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3503254438974362, "driven_lanedir": 0.131792306652601, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 2.0470295317199687, "deviation-center-line": 0.19738729660804713}, "ep001": {"driven_any": 0.27509169215123813, "driven_lanedir": 0.27392316333572353, "in-drivable-lane": 0, "deviation-heading": 0.1805287453865518, "deviation-center-line": 0.21707615645268297}, "ep002": {"driven_any": 1.1794103506464533, "driven_lanedir": 1.124889626096797, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.363594947949766, "deviation-center-line": 0.3466612585722251}, "ep003": {"driven_any": 2.1150451043579395, "driven_lanedir": 2.000359271169093, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 1.9529478692500464, "deviation-center-line": 0.9663022256849592}, "ep004": {"driven_any": 1.5987601228842734, "driven_lanedir": 1.2508971328126075, "in-drivable-lane": 1.099999999999996, "deviation-heading": 3.019093733670186, "deviation-center-line": 0.4048479241294383}}
No reset possible 9849608David Abraham Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 00:20:39+00:00 2018-11-18 00:21:50+00:00 0:01:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9844600Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 00:19:56+00:00 2018-11-18 00:20:31+00:00 0:00:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9839603Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 00:19:16+00:00 2018-11-18 00:19:50+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9836604Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 00:18:35+00:00 2018-11-18 00:19:10+00:00 0:00:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 99, in run
solve(params, cis)
File "solution.py", line 39, in solve
env = make_env(config)
File "solution.py", line 20, in make_env
env = FrameStackWrappper(env=env, k=3)
File "/workspace/wrappers.py", line 77, in __init__
self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9834606Samuel Lavoie PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:18:07+00:00 2018-11-18 00:18:29+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.366666666666657
other stats episodes details {"ep000": {"nsteps": 70, "reward": -14.607456982455084, "good_angle": 1.095954534919471, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 1.9000000000000017}, "ep001": {"nsteps": 50, "reward": -20.55613838434219, "good_angle": 0.02415700680834799, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.9529858551458456, "good_angle": 8.527673308976071, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 14.666666666666655}, "ep003": {"nsteps": 161, "reward": -6.543477667090685, "good_angle": 0.06933218230230452, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 177, "reward": -6.904600331546623, "good_angle": 1.6306539537990166, "survival_time": 5.899999999999989, "traveled_tiles": 2, "valid_direction": 4.733333333333322}}good_angle_max 8.527673308976071 good_angle_mean 2.2695541973610425 good_angle_median 1.095954534919471 good_angle_min 0.02415700680834799 reward_max -0.9529858551458456 reward_mean -9.912931844116088 reward_median -6.904600331546623 reward_min -20.55613838434219 survival_time_max 16.666666666666654 survival_time_mean 6.3866666666666605 survival_time_min 1.6666666666666683 traveled_tiles_max 7 traveled_tiles_mean 2.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 14.666666666666655 valid_direction_mean 4.259999999999995 valid_direction_median 1.9000000000000017 valid_direction_min 0
No reset possible 9814606Samuel Lavoie PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:15:15+00:00 2018-11-18 00:18:01+00:00 0:02:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9804611David Abraham Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:12:22+00:00 2018-11-18 00:15:05+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9792628Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:08:18+00:00 2018-11-18 00:12:15+00:00 0:03:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -0.839634730476746 deviation-center-line_median 0.3876309937395394 in-drivable-lane_median 8.29999999999999
other stats deviation-center-line_max 0.5747826826548895 deviation-center-line_mean 0.3643303634439444 deviation-center-line_min 0.13729734885380554 deviation-heading_max 6.58245575091181 deviation-heading_mean 5.302655958935572 deviation-heading_median 6.539566120620427 deviation-heading_min 0.32328388756500265 driven_any_max 2.6532777821831983 driven_any_mean 2.6532777821831908 driven_any_median 2.6532777821831885 driven_any_min 2.653277782183184 driven_lanedir_max -0.2575588697397758 driven_lanedir_mean -0.7245298252797052 driven_lanedir_min -0.8446015392792754 in-drivable-lane_max 14.933333333333325 in-drivable-lane_mean 9.633333333333322 in-drivable-lane_min 8.299999999999988 per-episodes details {"ep000": {"driven_any": 2.6532777821831983, "driven_lanedir": -0.2575588697397758, "in-drivable-lane": 14.933333333333325, "deviation-heading": 0.32328388756500265, "deviation-center-line": 0.3959689180795801}, "ep001": {"driven_any": 2.6532777821831877, "driven_lanedir": -0.8392146675166066, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.58245575091181, "deviation-center-line": 0.5747826826548895}, "ep002": {"driven_any": 2.653277782183195, "driven_lanedir": -0.8416393193861229, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.556737670234658, "deviation-center-line": 0.3259718738919073}, "ep003": {"driven_any": 2.653277782183184, "driven_lanedir": -0.839634730476746, "in-drivable-lane": 8.333333333333323, "deviation-heading": 6.511236365345967, "deviation-center-line": 0.13729734885380554}, "ep004": {"driven_any": 2.6532777821831885, "driven_lanedir": -0.8446015392792754, "in-drivable-lane": 8.299999999999988, "deviation-heading": 6.539566120620427, "deviation-center-line": 0.3876309937395394}}
No reset possible 9785616Laurent Mandrile PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 00:07:48+00:00 2018-11-18 00:08:09+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.666666666666653
other stats episodes details {"ep000": {"nsteps": 75, "reward": -13.562199121403198, "good_angle": 1.26949689742489, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.0666666666666673}, "ep001": {"nsteps": 200, "reward": -6.514699144755141, "good_angle": 17.281248937762122, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 4.366666666666651}, "ep002": {"nsteps": 223, "reward": -5.014658310939245, "good_angle": 2.437588995849982, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 4.4666666666666535}, "ep003": {"nsteps": 204, "reward": -6.140058025798484, "good_angle": 1.0525442183302467, "survival_time": 6.799999999999986, "traveled_tiles": 3, "valid_direction": 4.8999999999999835}, "ep004": {"nsteps": 183, "reward": -6.683695821099167, "good_angle": 1.4870958369043044, "survival_time": 6.099999999999988, "traveled_tiles": 2, "valid_direction": 4.766666666666654}}good_angle_max 17.281248937762122 good_angle_mean 4.705594977254309 good_angle_median 1.4870958369043044 good_angle_min 1.0525442183302467 reward_max -5.014658310939245 reward_mean -7.583062084799048 reward_median -6.514699144755141 reward_min -13.562199121403198 survival_time_max 7.433333333333317 survival_time_mean 5.899999999999989 survival_time_min 2.500000000000001 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 4.8999999999999835 valid_direction_mean 4.113333333333322 valid_direction_median 4.4666666666666535 valid_direction_min 2.0666666666666673
No reset possible 9777616Laurent Mandrile PyTorch template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 00:04:49+00:00 2018-11-18 00:07:41+00:00 0:02:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9764635Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 00:01:00+00:00 2018-11-18 00:04:41+00:00 0:03:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9383190694439334 deviation-center-line_median 0.7240131484038275 in-drivable-lane_median 3.73333333333332
other stats deviation-center-line_max 1.9619654491777856 deviation-center-line_mean 0.7753943411997068 deviation-center-line_min 0 deviation-heading_max 3.793329521177811 deviation-heading_mean 1.8795327391597776 deviation-heading_median 1.3995957880828112 deviation-heading_min 0 driven_any_max 2.3535470851994265 driven_any_mean 1.669351307699607 driven_any_median 1.686390230302575 driven_any_min 0.9052097758720424 driven_lanedir_max 2.2058171493534338 driven_lanedir_mean 0.944658395699251 driven_lanedir_min 0 in-drivable-lane_max 11.333333333333304 in-drivable-lane_mean 4.833333333333322 in-drivable-lane_min 0.4000000000000199 per-episodes details {"ep000": {"driven_any": 1.6485230247174922, "driven_lanedir": 0, "in-drivable-lane": 11.333333333333304, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.686390230302575, "driven_lanedir": 1.1126443406905695, "in-drivable-lane": 3.73333333333332, "deviation-heading": 3.0064294534060703, "deviation-center-line": 0.7240131484038275}, "ep002": {"driven_any": 0.9052097758720424, "driven_lanedir": 0.4665114190083184, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.3995957880828112, "deviation-center-line": 0.32430418341812345}, "ep003": {"driven_any": 1.753086422406498, "driven_lanedir": 0.9383190694439334, "in-drivable-lane": 5.79999999999998, "deviation-heading": 1.1983089331321926, "deviation-center-line": 0.8666889249987981}, "ep004": {"driven_any": 2.3535470851994265, "driven_lanedir": 2.2058171493534338, "in-drivable-lane": 0.4000000000000199, "deviation-heading": 3.793329521177811, "deviation-center-line": 1.9619654491777856}}
No reset possible 9753635Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-17 23:58:23+00:00 2018-11-18 00:00:52+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9751635Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-17 23:57:52+00:00 2018-11-17 23:58:15+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.7333333333333
other stats episodes details {"ep000": {"nsteps": 341, "reward": -4.357813439848137, "good_angle": 1.5226509458060522, "survival_time": 11.366666666666635, "traveled_tiles": 4, "valid_direction": 3.466666666666656}, "ep001": {"nsteps": 391, "reward": -3.307857882565833, "good_angle": 21.58771939039822, "survival_time": 13.033333333333298, "traveled_tiles": 5, "valid_direction": 8.46666666666664}, "ep002": {"nsteps": 202, "reward": -5.8618497351895655, "good_angle": 2.6251113463110407, "survival_time": 6.733333333333319, "traveled_tiles": 4, "valid_direction": 4.899999999999985}, "ep003": {"nsteps": 382, "reward": -3.5018563633713033, "good_angle": 1.95074065575134, "survival_time": 12.7333333333333, "traveled_tiles": 4, "valid_direction": 3.399999999999988}, "ep004": {"nsteps": 500, "reward": -0.28399274131911806, "good_angle": 17.07575215139702, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.5999999999999908}}good_angle_max 21.58771939039822 good_angle_mean 8.952394897932734 good_angle_median 2.6251113463110407 good_angle_min 1.5226509458060522 reward_max -0.28399274131911806 reward_mean -3.4626740324587915 reward_median -3.5018563633713033 reward_min -5.8618497351895655 survival_time_max 16.666666666666654 survival_time_mean 12.10666666666664 survival_time_min 6.733333333333319 traveled_tiles_max 5 traveled_tiles_mean 4.4 traveled_tiles_median 4 traveled_tiles_min 4 valid_direction_max 8.46666666666664 valid_direction_mean 4.766666666666652 valid_direction_median 3.5999999999999908 valid_direction_min 3.399999999999988
No reset possible 9749637Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos aborted yes idsc-rudolf-183282018-11-17 23:57:32+00:00 2018-11-17 23:57:46+00:00 0:00:14 Error while running [...]
Creating job9749-8663_videos_1 ... error
stderr | ERROR: for job9749-8663_videos_1 Cannot start service videos: network job9749-8663_evaluation not found
stderr |
stderr | ERROR: for videos Cannot start service videos: network job9749-8663_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9729635Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-17 23:51:02+00:00 2018-11-17 23:57:26+00:00 0:06:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9721642Mikita Sazanovich Random execution aido1_LF1_r3-v3step1-simulation aborted no idsc-rudolf-183282018-11-17 23:50:27+00:00 2018-11-17 23:50:47+00:00 0:00:20 Error while running [...]
Creating job9721-1839_evaluator_1 ... error
stderr | ERROR: for job9721-1839_evaluator_1 Cannot start service evaluator: network job9721-1839_evaluation not found
stderr |
stderr | ERROR: for solution Cannot start service solution: network job9721-1839_evaluation not found
stderr |
stderr | ERROR: for evaluator Cannot start service evaluator: network job9721-1839_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
