Duckietown Challenges Home Challenges Submissions

Evaluator 348

ID348
evaluatoridsc-rudolf-17957
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-17957
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success79 9722
# timeout
# failed15 9731
# error7 10330
# aborted6 9739
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
106481Andrea Censi 🇨🇭nullaido1_LF1-v3step2-scoringsuccessyesidsc-rudolf-179570:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-25.610877964711214


other stats
ep000
details{"nsteps": 238, "reward": -4.1838779895617275}
ep001
details{"nsteps": 45, "reward": -23.60061939292484}
ep002
details{"nsteps": 79, "reward": -14.30111469875408}
ep003
details{"nsteps": 15, "reward": -69.1512230873108}
ep004
details{"nsteps": 64, "reward": -16.817554655004642}
No reset possible
10603304Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:10:35
Timeout: Waited 602 [...]
Timeout:

Waited 602.030158043 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10599315Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10596317Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:31
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10592322Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10587306Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10584308Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortednoidsc-rudolf-179570:00:25
Error while running [...]

Creating job10584-1521_solution_1  ... error
stderr | ERROR: for job10584-1521_solution_1  Cannot start service solution: network job10584-1521_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job10584-1521_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job10584-1521_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10580310Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:29
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10574346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 167, "reward": -6.515347850733454, "good_angle": 2.532258188954429, "survival_time": 5.566666666666657, "traveled_tiles": 2, "valid_direction": 3.199999999999992}, "ep001": {"nsteps": 103, "reward": -10.640297905523871, "good_angle": 2.650111377593275, "survival_time": 3.433333333333331, "traveled_tiles": 1, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 96, "reward": -11.343306209426371, "good_angle": 2.520034595090713, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 2.533333333333331}, "ep003": {"nsteps": 95, "reward": -11.461269298437248, "good_angle": 2.2344889091875815, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 2.466666666666665}, "ep004": {"nsteps": 95, "reward": -11.476688610899606, "good_angle": 2.4523413910134386, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.5999999999999988}}
good_angle_max2.650111377593275
good_angle_mean2.4778468923678876
good_angle_median2.520034595090713
good_angle_min2.2344889091875815
reward_max-6.515347850733454
reward_mean-10.287381975004111
reward_median-11.343306209426371
reward_min-11.476688610899606
survival_time_max5.566666666666657
survival_time_mean3.7066666666666626
survival_time_min3.166666666666665
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.199999999999992
valid_direction_mean2.679999999999997
valid_direction_median2.599999999999998
valid_direction_min2.466666666666665
No reset possible
10559346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:05:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10555321Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LFV_r1-v3step1-simulationfailednoidsc-rudolf-179570:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 62, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10549334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-179570:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.14056212882966856
in-drivable-lane_median0


other stats
deviation-center-line_max0.2088482491745832
deviation-center-line_mean0.15471185572303592
deviation-center-line_min0.11857116864988688
deviation-heading_max0.6909281020566628
deviation-heading_mean0.54082895501694
deviation-heading_median0.5051233802717945
deviation-heading_min0.43235700221045265
driven_any_max2.7094732207334946
driven_any_mean1.500430197030569
driven_any_median1.3951946942847553
driven_any_min0.7722235922831703
driven_lanedir_max2.189437723172276
driven_lanedir_mean1.3699010835235828
driven_lanedir_median1.3758390579958164
driven_lanedir_min0.7422319306479934
in-drivable-lane_max1.266666666666667
in-drivable-lane_mean0.2533333333333334
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.7094732207334946, "driven_lanedir": 2.189437723172276, "in-drivable-lane": 1.266666666666667, "deviation-heading": 0.6410149290523307, "deviation-center-line": 0.2088482491745832}, "ep001": {"driven_any": 0.7722235922831703, "driven_lanedir": 0.7422319306479934, "in-drivable-lane": 0, "deviation-heading": 0.43235700221045265, "deviation-center-line": 0.11857116864988688}, "ep002": {"driven_any": 1.195056730021914, "driven_lanedir": 1.1450018401336526, "in-drivable-lane": 0, "deviation-heading": 0.6909281020566628, "deviation-center-line": 0.1805652050091962}, "ep003": {"driven_any": 1.4302027478295092, "driven_lanedir": 1.3969948656681752, "in-drivable-lane": 0, "deviation-heading": 0.5051233802717945, "deviation-center-line": 0.14056212882966856}, "ep004": {"driven_any": 1.3951946942847553, "driven_lanedir": 1.3758390579958164, "in-drivable-lane": 0, "deviation-heading": 0.43472136149345897, "deviation-center-line": 0.12501252695184475}}
No reset possible
10545334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step3-videossuccessyesidsc-rudolf-179570:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10543334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step2-scoringsuccessyesidsc-rudolf-179570:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.466666666666661


other stats
episodes
details{"ep000": {"nsteps": 243, "reward": -4.3291447396737945, "good_angle": 0.581499576920051, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5666666666666665}, "ep001": {"nsteps": 78, "reward": -13.021996507850975, "good_angle": 0.42176923689785734, "survival_time": 2.6000000000000005, "traveled_tiles": 3, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 118, "reward": -8.68112879300932, "good_angle": 0.4726089712352656, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep003": {"nsteps": 139, "reward": -7.295423986885521, "good_angle": 0.27100701034671554, "survival_time": 4.633333333333327, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 134, "reward": -7.560127618597949, "good_angle": 1.0827692353518417, "survival_time": 4.466666666666661, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}}
good_angle_max1.0827692353518417
good_angle_mean0.5659308061503463
good_angle_median0.4726089712352656
good_angle_min0.27100701034671554
reward_max-4.3291447396737945
reward_mean-8.177564329203515
reward_median-7.560127618597949
reward_min-13.021996507850975
survival_time_max8.099999999999982
survival_time_mean4.74666666666666
survival_time_min2.6000000000000005
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.6666666666666643
valid_direction_mean0.5733333333333317
valid_direction_median0.5666666666666647
valid_direction_min0.5333333333333314
No reset possible
10534334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step1-simulationsuccessnoidsc-rudolf-179570:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10525364Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5595474272820549
deviation-center-line_median0.28694183703818704
in-drivable-lane_median3.266666666666655


other stats
deviation-center-line_max0.5604621640188293
deviation-center-line_mean0.3088653044866211
deviation-center-line_min0.15469694830615136
deviation-heading_max3.6140301383805906
deviation-heading_mean1.4974190774376648
deviation-heading_median1.0668466076435914
deviation-heading_min0.31545320326952786
driven_any_max1.950092311294152
driven_any_mean0.9747195659796196
driven_any_median1.1829301176841596
driven_any_min0.12776479806561683
driven_lanedir_max0.9420818020679832
driven_lanedir_mean0.4962804615613585
driven_lanedir_min0.12241453975447893
in-drivable-lane_max5.0333333333333155
in-drivable-lane_mean2.579999999999991
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3747020105583748, "driven_lanedir": 0.1538791159023375, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.598145774419718, "deviation-center-line": 0.1745379082770337}, "ep001": {"driven_any": 0.12776479806561683, "driven_lanedir": 0.12241453975447893, "in-drivable-lane": 0, "deviation-heading": 0.31545320326952786, "deviation-center-line": 0.15469694830615136}, "ep002": {"driven_any": 1.950092311294152, "driven_lanedir": 0.9420818020679832, "in-drivable-lane": 5.0333333333333155, "deviation-heading": 3.6140301383805906, "deviation-center-line": 0.5604621640188293}, "ep003": {"driven_any": 1.1829301176841596, "driven_lanedir": 0.5595474272820549, "in-drivable-lane": 4.066666666666652, "deviation-heading": 0.8926196634748961, "deviation-center-line": 0.28694183703818704}, "ep004": {"driven_any": 1.238108592295796, "driven_lanedir": 0.7034794227999377, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.0668466076435914, "deviation-center-line": 0.36768766479290393}}
No reset possible
10514364Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10512364Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.166666666666651


other stats
episodes
details{"ep000": {"nsteps": 65, "reward": -15.602159214191712, "good_angle": 0.8908102692297621, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 1.7666666666666686}, "ep001": {"nsteps": 44, "reward": -23.288227537816223, "good_angle": 0.07924766366011593, "survival_time": 1.466666666666668, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 333, "reward": -3.920274457401249, "good_angle": 5.955846981021035, "survival_time": 11.099999999999971, "traveled_tiles": 5, "valid_direction": 8.933333333333305}, "ep003": {"nsteps": 215, "reward": -5.8246885330557046, "good_angle": 1.0871031391327923, "survival_time": 7.166666666666651, "traveled_tiles": 3, "valid_direction": 4.833333333333316}, "ep004": {"nsteps": 220, "reward": -5.639107334945583, "good_angle": 6.190392372831381, "survival_time": 7.333333333333317, "traveled_tiles": 3, "valid_direction": 3.63333333333332}}
good_angle_max6.190392372831381
good_angle_mean2.840680085175017
good_angle_median1.0871031391327923
good_angle_min0.07924766366011593
reward_max-3.920274457401249
reward_mean-10.854891415482095
reward_median-5.8246885330557046
reward_min-23.288227537816223
survival_time_max11.099999999999971
survival_time_mean5.846666666666655
survival_time_min1.466666666666668
traveled_tiles_max5
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max8.933333333333305
valid_direction_mean3.8333333333333224
valid_direction_median3.63333333333332
valid_direction_min0
No reset possible
10493364Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10488371Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10484374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:46
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10481377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10479385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.40042748022306873
deviation-center-line_median0.19797737094934056
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.21956861225777544
deviation-center-line_mean0.18454641429566265
deviation-center-line_min0.12653575426067704
deviation-heading_max2.1481203879344917
deviation-heading_mean1.1039534563538027
deviation-heading_median0.839455467501349
deviation-heading_min0.7447392920559431
driven_any_max0.8619792939852762
driven_any_mean0.7187855785443618
driven_any_median0.8405640739580701
driven_any_min0.3454603061278296
driven_lanedir_max0.49920575365524766
driven_lanedir_mean0.37519572349650954
driven_lanedir_min0.1199441306838558
in-drivable-lane_max1.7666666666666615
in-drivable-lane_mean1.1066666666666638
in-drivable-lane_min0.7333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3454603061278296, "driven_lanedir": 0.1199441306838558, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.1481203879344917, "deviation-center-line": 0.19797737094934056}, "ep001": {"driven_any": 0.841350875066122, "driven_lanedir": 0.49920575365524766, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 0.9511706660427174, "deviation-center-line": 0.21147937623107185}, "ep002": {"driven_any": 0.8405640739580701, "driven_lanedir": 0.40042748022306873, "in-drivable-lane": 1.7666666666666615, "deviation-heading": 0.8362814682345122, "deviation-center-line": 0.16717095777944824}, "ep003": {"driven_any": 0.8619792939852762, "driven_lanedir": 0.4806942274012469, "in-drivable-lane": 1.3333333333333286, "deviation-heading": 0.839455467501349, "deviation-center-line": 0.21956861225777544}, "ep004": {"driven_any": 0.7045733435845106, "driven_lanedir": 0.3757070255191286, "in-drivable-lane": 0.7999999999999994, "deviation-heading": 0.7447392920559431, "deviation-center-line": 0.12653575426067704}}
No reset possible
10471385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10458385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10448395Maxim Kuzmin 🇷🇺Random executionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10444395Maxim Kuzmin 🇷🇺Random executionaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.466666666666647


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.59728134561468, "good_angle": 1.2398966961954525, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 109, "reward": -9.730809066000337, "good_angle": 0.008850572760630239, "survival_time": 3.63333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.4375982951578195, "good_angle": 0.9318896597406168, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 1.9999999999999936}, "ep003": {"nsteps": 457, "reward": -2.71261982396408, "good_angle": 0.6839778908298664, "survival_time": 15.23333333333329, "traveled_tiles": 4, "valid_direction": 1.6666666666666607}, "ep004": {"nsteps": 346, "reward": -3.5770770021715173, "good_angle": 18.99679018263806, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max18.99679018263806
good_angle_mean4.372281000432925
good_angle_median0.9318896597406168
good_angle_min0.008850572760630239
reward_max-2.71261982396408
reward_mean-6.6110771065816865
reward_median-4.4375982951578195
reward_min-12.59728134561468
survival_time_max15.23333333333329
survival_time_mean8.313333333333315
survival_time_min2.7
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean1.9799999999999949
valid_direction_median1.9999999999999936
valid_direction_min0
No reset possible
10433394Maxim Kuzmin 🇷🇺Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10391411Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:10:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10385417Philippe LacaillePyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4344020985554325
deviation-center-line_median0.1655867520423447
in-drivable-lane_median1.1666666666666623


other stats
deviation-center-line_max0.26297666148199333
deviation-center-line_mean0.17383189367821497
deviation-center-line_min0.13242546757756862
deviation-heading_max1.2780613239807024
deviation-heading_mean0.9339557096156704
deviation-heading_median0.8363765542368337
deviation-heading_min0.6599457669513374
driven_any_max0.9530400285814143
driven_any_mean0.7561281870717343
driven_any_median0.8318338651350995
driven_any_min0.4262847133744857
driven_lanedir_max0.5754064187241195
driven_lanedir_mean0.4015116184240157
driven_lanedir_min0.1893877720078737
in-drivable-lane_max1.7999999999999938
in-drivable-lane_mean1.2666666666666635
in-drivable-lane_min0.8333333333333328
per-episodes
details{"ep000": {"driven_any": 0.4262847133744857, "driven_lanedir": 0.1893877720078737, "in-drivable-lane": 1.0000000000000018, "deviation-heading": 1.2780613239807024, "deviation-center-line": 0.1655867520423447}, "ep001": {"driven_any": 0.9530400285814143, "driven_lanedir": 0.5754064187241195, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 1.1490870375424536, "deviation-center-line": 0.26297666148199333}, "ep002": {"driven_any": 0.8705903968641396, "driven_lanedir": 0.4344020985554325, "in-drivable-lane": 1.533333333333328, "deviation-heading": 0.8363765542368337, "deviation-center-line": 0.16948833072784578}, "ep003": {"driven_any": 0.8318338651350995, "driven_lanedir": 0.43457008798995345, "in-drivable-lane": 1.7999999999999938, "deviation-heading": 0.6599457669513374, "deviation-center-line": 0.13868225656132244}, "ep004": {"driven_any": 0.6988919314035326, "driven_lanedir": 0.37379171484269946, "in-drivable-lane": 0.8333333333333328, "deviation-heading": 0.7463078653670248, "deviation-center-line": 0.13242546757756862}}
No reset possible
10383417Philippe LacaillePyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10381417Philippe LacaillePyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.63333333333333


other stats
episodes
details{"ep000": {"nsteps": 78, "reward": -13.018325557841214, "good_angle": 0.897202341910843, "survival_time": 2.6000000000000005, "traveled_tiles": 1, "valid_direction": 2.166666666666667}, "ep001": {"nsteps": 129, "reward": -8.288987570063233, "good_angle": 6.927990660664545, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 3.366666666666661}, "ep002": {"nsteps": 109, "reward": -10.09078948261588, "good_angle": 1.5600858031084643, "survival_time": 3.63333333333333, "traveled_tiles": 4, "valid_direction": 2.799999999999997}, "ep003": {"nsteps": 112, "reward": -9.78940520636804, "good_angle": 1.3795123360921788, "survival_time": 3.73333333333333, "traveled_tiles": 2, "valid_direction": 2.8666666666666636}, "ep004": {"nsteps": 73, "reward": -14.489495893417258, "good_angle": 1.4476096000349687, "survival_time": 2.4333333333333345, "traveled_tiles": 2, "valid_direction": 2.000000000000001}}
good_angle_max6.927990660664545
good_angle_mean2.4424801483621996
good_angle_median1.4476096000349687
good_angle_min0.897202341910843
reward_max-8.288987570063233
reward_mean-11.135400742061124
reward_median-10.09078948261588
reward_min-14.489495893417258
survival_time_max4.2999999999999945
survival_time_mean3.3399999999999976
survival_time_min2.4333333333333345
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.366666666666661
valid_direction_mean2.639999999999998
valid_direction_median2.799999999999997
valid_direction_min2.000000000000001
No reset possible
10375417Philippe LacaillePyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10361426Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6386696547709549
deviation-center-line_median0.337897301046609
in-drivable-lane_median3.133333333333322


other stats
deviation-center-line_max0.592001671922036
deviation-center-line_mean0.3812499096613381
deviation-center-line_min0.16235592461642517
deviation-heading_max3.513503862469668
deviation-heading_mean1.7543502442680488
deviation-heading_median1.2388455966134266
deviation-heading_min0.956112254109275
driven_any_max1.4202831338781985
driven_any_mean1.1129361908231303
driven_any_median1.335847943979615
driven_any_min0.3288486622681891
driven_lanedir_max0.8138196490364431
driven_lanedir_mean0.5830153252285684
driven_lanedir_min0.1011930772193702
in-drivable-lane_max4.366666666666652
in-drivable-lane_mean2.819999999999991
in-drivable-lane_min0.8333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3288486622681891, "driven_lanedir": 0.1011930772193702, "in-drivable-lane": 0.8333333333333333, "deviation-heading": 1.877610518607082, "deviation-center-line": 0.16235592461642517}, "ep001": {"driven_any": 1.135629447559216, "driven_lanedir": 0.6120165054966769, "in-drivable-lane": 3.133333333333322, "deviation-heading": 1.2388455966134266, "deviation-center-line": 0.3142658743330464}, "ep002": {"driven_any": 1.335847943979615, "driven_lanedir": 0.7493777396193966, "in-drivable-lane": 2.3666666666666583, "deviation-heading": 3.513503862469668, "deviation-center-line": 0.592001671922036}, "ep003": {"driven_any": 1.344071766430432, "driven_lanedir": 0.6386696547709549, "in-drivable-lane": 4.366666666666652, "deviation-heading": 0.956112254109275, "deviation-center-line": 0.337897301046609}, "ep004": {"driven_any": 1.4202831338781985, "driven_lanedir": 0.8138196490364431, "in-drivable-lane": 3.399999999999989, "deviation-heading": 1.1856789895407924, "deviation-center-line": 0.4997287763885735}}
No reset possible
10344423Mandana Samiei 🇨🇦PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10341438Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1839913306494396
deviation-center-line_median0.18269046047102808
in-drivable-lane_median0


other stats
deviation-center-line_max0.5965570325630887
deviation-center-line_mean0.2527565689893537
deviation-center-line_min0.1278133632070594
deviation-heading_max1.758162492364205
deviation-heading_mean0.7769512933463043
deviation-heading_median0.5994909588101925
deviation-heading_min0.20204719090155387
driven_any_max1.0572063502422389
driven_any_mean0.3692934317270636
driven_any_median0.20354753442663057
driven_any_min0.16070707345904764
driven_lanedir_max0.8224324606757396
driven_lanedir_mean0.31107994728114513
driven_lanedir_min0.14019441850253256
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0572063502422389, "driven_lanedir": 0.8224324606757396, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.758162492364205, "deviation-center-line": 0.5965570325630887}, "ep001": {"driven_any": 0.18572283320055857, "driven_lanedir": 0.1839913306494396, "in-drivable-lane": 0, "deviation-heading": 0.20204719090155387, "deviation-center-line": 0.18269046047102808}, "ep002": {"driven_any": 0.16070707345904764, "driven_lanedir": 0.14019441850253256, "in-drivable-lane": 0, "deviation-heading": 0.5994909588101925, "deviation-center-line": 0.1278133632070594}, "ep003": {"driven_any": 0.20354753442663057, "driven_lanedir": 0.1832028130040184, "in-drivable-lane": 0, "deviation-heading": 0.7658076435156855, "deviation-center-line": 0.14379320907862353}, "ep004": {"driven_any": 0.2392833673068421, "driven_lanedir": 0.2255787135739955, "in-drivable-lane": 0, "deviation-heading": 0.5592481811398844, "deviation-center-line": 0.2129287796269687}}
No reset possible
10335438Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10332438Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9666666666666697


other stats
episodes
details{"ep000": {"nsteps": 298, "reward": -3.6021894331845288, "good_angle": 0.6526370173329004, "survival_time": 9.933333333333309, "traveled_tiles": 3, "valid_direction": 0.666666666666665}, "ep001": {"nsteps": 54, "reward": -19.048030414515072, "good_angle": 0.03307216049490547, "survival_time": 1.8000000000000025, "traveled_tiles": 1, "valid_direction": 0.03333333333333344}, "ep002": {"nsteps": 47, "reward": -21.73273384063802, "good_angle": 0.4758305482796794, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.6666666666666682}, "ep003": {"nsteps": 59, "reward": -17.342414045106555, "good_angle": 0.4605250325490527, "survival_time": 1.9666666666666697, "traveled_tiles": 1, "valid_direction": 1.066666666666669}, "ep004": {"nsteps": 69, "reward": -14.98741868354272, "good_angle": 0.31523290263678283, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.5666666666666662}}
good_angle_max0.6526370173329004
good_angle_mean0.38745953225866414
good_angle_median0.4605250325490527
good_angle_min0.03307216049490547
reward_max-3.6021894331845288
reward_mean-15.342557283397378
reward_median-17.342414045106555
reward_min-21.73273384063802
survival_time_max9.933333333333309
survival_time_mean3.5133333333333296
survival_time_min1.5666666666666682
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.066666666666669
valid_direction_mean0.6000000000000003
valid_direction_median0.666666666666665
valid_direction_min0.03333333333333344
No reset possible
10331430Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10330431Benjamin Ramtoula 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-179570:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10313455Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:06:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.100249689175728
deviation-center-line_median1.3487125967936766
in-drivable-lane_median1.6999999999999946


other stats
deviation-center-line_max1.3739433036609572
deviation-center-line_mean1.1413390905359944
deviation-center-line_min0.2868581315474922
deviation-heading_max11.728842752525235
deviation-heading_mean9.192774018878731
deviation-heading_median10.618271797823088
deviation-heading_min2.855926499812233
driven_any_max4.979113636122271
driven_any_mean4.660836098236078
driven_any_median4.979113636122253
driven_any_min3.38800592084359
driven_lanedir_max3.169624548409674
driven_lanedir_mean2.593762174310787
driven_lanedir_min0.525330093179901
in-drivable-lane_max8.13333333333331
in-drivable-lane_mean2.879999999999991
in-drivable-lane_min0.8333333333333306
per-episodes
details{"ep000": {"driven_any": 3.38800592084359, "driven_lanedir": 0.525330093179901, "in-drivable-lane": 8.13333333333331, "deviation-heading": 2.855926499812233, "deviation-center-line": 0.2868581315474922}, "ep001": {"driven_any": 4.978833661970003, "driven_lanedir": 3.0512136753689676, "in-drivable-lane": 2.2333333333333263, "deviation-heading": 9.91411018895156, "deviation-center-line": 1.3739433036609572}, "ep002": {"driven_any": 4.979113636122253, "driven_lanedir": 3.122392865419666, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.846718855281546, "deviation-center-line": 1.3473974939913989}, "ep003": {"driven_any": 4.979113636122271, "driven_lanedir": 3.169624548409674, "in-drivable-lane": 0.8333333333333306, "deviation-heading": 11.728842752525235, "deviation-center-line": 1.349783926686447}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
No reset possible
10293455Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10264454Orlando Marquez 🇨🇦PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10248465Jonathan Plante 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10235488Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:04:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9484799136944472
deviation-center-line_median0.5677877054113932
in-drivable-lane_median8.600000000000005


other stats
deviation-center-line_max2.028264730701824
deviation-center-line_mean0.7845677824160513
deviation-center-line_min0
deviation-heading_max3.855478019303108
deviation-heading_mean1.8401736616315607
deviation-heading_median1.2599816114188076
deviation-heading_min0
driven_any_max2.3498124000699914
driven_any_mean1.5674342795309453
driven_any_median1.6626210159854036
driven_any_min0.8266315486538579
driven_lanedir_max2.2167245049148843
driven_lanedir_mean0.9400170857578052
driven_lanedir_min0
in-drivable-lane_max13.233333333333324
in-drivable-lane_mean7.80666666666666
in-drivable-lane_min0.3333333333333499
per-episodes
details{"ep000": {"driven_any": 1.6626210159854036, "driven_lanedir": 0, "in-drivable-lane": 11.466666666666637, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.2304390214165508, "driven_lanedir": 0.9484799136944472, "in-drivable-lane": 8.600000000000005, "deviation-heading": 2.9701903473088436, "deviation-center-line": 0.5677877054113932}, "ep002": {"driven_any": 0.8266315486538579, "driven_lanedir": 0.4717396946818984, "in-drivable-lane": 13.233333333333324, "deviation-heading": 1.2599816114188076, "deviation-center-line": 0.2952874933258186}, "ep003": {"driven_any": 1.7676674115289226, "driven_lanedir": 1.0631413154977951, "in-drivable-lane": 5.399999999999982, "deviation-heading": 1.1152183301270446, "deviation-center-line": 1.0314989826412202}, "ep004": {"driven_any": 2.3498124000699914, "driven_lanedir": 2.2167245049148843, "in-drivable-lane": 0.3333333333333499, "deviation-heading": 3.855478019303108, "deviation-center-line": 2.028264730701824}}
No reset possible
10219488Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10217488Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 345, "reward": -4.313861366026644, "good_angle": 1.546963724020236, "survival_time": 11.49999999999997, "traveled_tiles": 4, "valid_direction": 3.29999999999999}, "ep001": {"nsteps": 500, "reward": -1.4437675743107683, "good_angle": 36.38482725489614, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.533333333333326}, "ep002": {"nsteps": 500, "reward": -2.2561783680744703, "good_angle": 17.112066147994756, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.299999999999986}, "ep003": {"nsteps": 381, "reward": -3.5520301861364993, "good_angle": 2.049322127125053, "survival_time": 12.699999999999966, "traveled_tiles": 4, "valid_direction": 3.5333333333333212}, "ep004": {"nsteps": 500, "reward": -0.2958944531888701, "good_angle": 15.908114050280265, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.8999999999999897}}
good_angle_max36.38482725489614
good_angle_mean14.60025866086329
good_angle_median15.908114050280265
good_angle_min1.546963724020236
reward_max-0.2958944531888701
reward_mean-2.3723463895474506
reward_median-2.2561783680744703
reward_min-4.313861366026644
survival_time_max16.666666666666654
survival_time_mean14.83999999999998
survival_time_min11.49999999999997
traveled_tiles_max5
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max15.299999999999986
valid_direction_mean7.913333333333323
valid_direction_median3.8999999999999897
valid_direction_min3.29999999999999
No reset possible
102141267Mateusz Ruszczyk 🇵🇱Solution templateaido1_luck-v3step1successyesidsc-rudolf-179570:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score130.34157432242239


No reset possible
10192488Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10186495Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.4333333333333333


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.68614059394598, "good_angle": 59.948933459239534, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.13333333333332}, "ep001": {"nsteps": 10, "reward": -100.64196230173113, "good_angle": 0.2519482119431119, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep002": {"nsteps": 13, "reward": -77.50082855499707, "good_angle": 0.42986404853629945, "survival_time": 0.4333333333333333, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep003": {"nsteps": 19, "reward": -54.13723141543175, "good_angle": 0.6432325258251529, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 12, "reward": -83.87529777487119, "good_angle": 0.3259875752032355, "survival_time": 0.4, "traveled_tiles": 1, "valid_direction": 0.29999999999999993}}
good_angle_max59.948933459239534
good_angle_mean12.319993164149468
good_angle_median0.42986404853629945
good_angle_min0.2519482119431119
reward_max-1.68614059394598
reward_mean-63.568292128195424
reward_median-77.50082855499707
reward_min-100.64196230173113
survival_time_max16.666666666666654
survival_time_mean3.6933333333333302
survival_time_min0.3333333333333333
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max15.13333333333332
valid_direction_mean3.3266666666666644
valid_direction_median0.3666666666666666
valid_direction_min0.2666666666666666
No reset possible
10173495Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10170496Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 32, in solve
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 76, in __init__
    self.undistort = UndistortWrapper(env)
  File "/workspace/wrappers.py", line 182, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10168503Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.699999999999966


other stats
episodes
details{"ep000": {"nsteps": 346, "reward": -4.309889873931174, "good_angle": 1.553894597639857, "survival_time": 11.533333333333305, "traveled_tiles": 4, "valid_direction": 3.3333333333333233}, "ep001": {"nsteps": 378, "reward": -3.454990730872846, "good_angle": 22.438626555884493, "survival_time": 12.599999999999966, "traveled_tiles": 5, "valid_direction": 7.999999999999975}, "ep002": {"nsteps": 500, "reward": -2.4034598331125454, "good_angle": 16.978831335603765, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.299999999999986}, "ep003": {"nsteps": 381, "reward": -3.5520301861364993, "good_angle": 2.049322127125053, "survival_time": 12.699999999999966, "traveled_tiles": 4, "valid_direction": 3.5333333333333212}, "ep004": {"nsteps": 500, "reward": -0.2958944531888701, "good_angle": 15.908114050280265, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.8999999999999897}}
good_angle_max22.438626555884493
good_angle_mean11.785757733306689
good_angle_median15.908114050280265
good_angle_min1.553894597639857
reward_max-0.2958944531888701
reward_mean-2.803253015448387
reward_median-3.454990730872846
reward_min-4.309889873931174
survival_time_max16.666666666666654
survival_time_mean14.033333333333308
survival_time_min11.533333333333305
traveled_tiles_max5
traveled_tiles_mean4.2
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max15.299999999999986
valid_direction_mean6.813333333333318
valid_direction_median3.8999999999999897
valid_direction_min3.3333333333333233
No reset possible
10144503Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10134515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.441346419252589
deviation-center-line_median0.475443203904307
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.8928446787182662
deviation-center-line_mean0.5409045380505465
deviation-center-line_min0.292160150573776
deviation-heading_max2.432001830566156
deviation-heading_mean1.67843726333518
deviation-heading_median1.613297174346244
deviation-heading_min0.950089853554849
driven_any_max1.9333785426469663
driven_any_mean1.4061619423712286
driven_any_median1.5063230723519694
driven_any_min0.5357524764781381
driven_lanedir_max1.9210683760128144
driven_lanedir_mean1.340064019082472
driven_lanedir_min0.5084034561928898
in-drivable-lane_max1.066666666666667
in-drivable-lane_mean0.23333333333333336
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.9333765079754035, "driven_lanedir": 1.7550904020885971, "in-drivable-lane": 1.066666666666667, "deviation-heading": 2.432001830566156, "deviation-center-line": 0.8928446787182662}, "ep001": {"driven_any": 0.5357524764781381, "driven_lanedir": 0.5084034561928898, "in-drivable-lane": 0, "deviation-heading": 0.950089853554849, "deviation-center-line": 0.4633403308133458}, "ep002": {"driven_any": 1.5063230723519694, "driven_lanedir": 1.441346419252589, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.3082848051836877, "deviation-center-line": 0.5807343262430376}, "ep003": {"driven_any": 1.9333785426469663, "driven_lanedir": 1.9210683760128144, "in-drivable-lane": 0, "deviation-heading": 1.0885126530249634, "deviation-center-line": 0.475443203904307}, "ep004": {"driven_any": 1.1219791124036649, "driven_lanedir": 1.0744114418654702, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.613297174346244, "deviation-center-line": 0.292160150573776}}
No reset possible
10129515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10125515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.999999999999964


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.194689963654615, "good_angle": 0.4609717757732299, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.933333333333334}, "ep001": {"nsteps": 140, "reward": -7.67487527685506, "good_angle": 0.5334618295157368, "survival_time": 4.66666666666666, "traveled_tiles": 1, "valid_direction": 0.9999999999999964}, "ep002": {"nsteps": 390, "reward": -2.8082431686230196, "good_angle": 0.8056607639157276, "survival_time": 12.999999999999964, "traveled_tiles": 4, "valid_direction": 1.399999999999995}, "ep003": {"nsteps": 500, "reward": -0.11725767087766872, "good_angle": 0.032161736569720045, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 291, "reward": -3.549292758276408, "good_angle": 2.2099661417209053, "survival_time": 9.699999999999976, "traveled_tiles": 3, "valid_direction": 1.566666666666661}}
good_angle_max2.2099661417209053
good_angle_mean0.808444449499064
good_angle_median0.5334618295157368
good_angle_min0.032161736569720045
reward_max-0.11725767087766872
reward_mean-2.868871767657354
reward_median-2.8082431686230196
reward_min-7.67487527685506
survival_time_max16.666666666666654
survival_time_mean12.13999999999998
survival_time_min4.66666666666666
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max1.566666666666661
valid_direction_mean0.9799999999999972
valid_direction_median0.9999999999999964
valid_direction_min0
No reset possible
10113518Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-179570:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.27437204460282266
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.6566744860983517
deviation-center-line_mean0.34226953124551185
deviation-center-line_min0.20196242975032477
deviation-heading_max1.8620526151394752
deviation-heading_mean1.5901657892831784
deviation-heading_median1.5167081196165464
deviation-heading_min1.4617511284979876
driven_any_max1.4907965376246517
driven_any_mean1.1250836810463754
driven_any_median1.2268006750710918
driven_any_min0.6716278496173103
driven_lanedir_max1.4452025130802306
driven_lanedir_mean0.9678885107322328
driven_lanedir_median1.1807543242858347
driven_lanedir_min0.0702368073466415
in-drivable-lane_max4.199999999999994
in-drivable-lane_mean0.8533333333333321
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6716278496173103, "driven_lanedir": 0.0702368073466415, "in-drivable-lane": 4.199999999999994, "deviation-heading": 1.8620526151394752, "deviation-center-line": 0.20196242975032477}, "ep001": {"driven_any": 0.8113956845771013, "driven_lanedir": 0.7637984078999172, "in-drivable-lane": 0, "deviation-heading": 1.4630791151844362, "deviation-center-line": 0.32683731675521305}, "ep002": {"driven_any": 1.2268006750710918, "driven_lanedir": 1.1807543242858347, "in-drivable-lane": 0, "deviation-heading": 1.6472379679774465, "deviation-center-line": 0.6566744860983517}, "ep003": {"driven_any": 1.4907965376246517, "driven_lanedir": 1.4452025130802306, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.5167081196165464, "deviation-center-line": 0.27437204460282266}, "ep004": {"driven_any": 1.4247976583417226, "driven_lanedir": 1.37945050104854, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.4617511284979876, "deviation-center-line": 0.25150137902084707}}
No reset possible
10107518Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step3-videossuccessyesidsc-rudolf-179570:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10104518Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessyesidsc-rudolf-179570:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.599999999999971


other stats
episodes
details{"ep000": {"nsteps": 175, "reward": -7.988105109343305, "good_angle": 11.519606421603791, "survival_time": 5.833333333333322, "traveled_tiles": 1, "valid_direction": 5.133333333333322}, "ep001": {"nsteps": 211, "reward": -4.957823465336807, "good_angle": 1.4000516260649898, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep002": {"nsteps": 318, "reward": -3.452888801011807, "good_angle": 1.9489760950583528, "survival_time": 10.599999999999971, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep003": {"nsteps": 386, "reward": -2.6257651863070635, "good_angle": 2.1669466807992785, "survival_time": 12.866666666666632, "traveled_tiles": 4, "valid_direction": 1.533333333333328}, "ep004": {"nsteps": 369, "reward": -2.7427475200604765, "good_angle": 2.1624423474338945, "survival_time": 12.299999999999969, "traveled_tiles": 4, "valid_direction": 1.533333333333328}}
good_angle_max11.519606421603791
good_angle_mean3.8396046341920615
good_angle_median2.1624423474338945
good_angle_min1.4000516260649898
reward_max-2.6257651863070635
reward_mean-4.3534660164118915
reward_median-3.452888801011807
reward_min-7.988105109343305
survival_time_max12.866666666666632
survival_time_mean9.726666666666642
survival_time_min5.833333333333322
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.133333333333322
valid_direction_mean2.2266666666666604
valid_direction_median1.533333333333328
valid_direction_min1.4666666666666617
No reset possible
10087518Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationsuccessnoidsc-rudolf-179570:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10084519Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 65, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 19, in predict
    assert state.shape[1] == 120
AssertionError


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10080527Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizabortedyesidsc-rudolf-179570:00:17
Error while running [...]

Creating job10080-4015_visualization_1 ... error
stderr | ERROR: for job10080-4015_visualization_1  Cannot start service visualization: network job10080-4015_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job10080-4015_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10072527Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10069527Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}
good_angle_max4.804851725848225
good_angle_mean4.350085033566717
good_angle_median4.636373361798506
good_angle_min3.212081557270962
reward_max-6.709294177134309
reward_mean-7.84581404120635
reward_median-8.178489692882414
reward_min-8.459673733430305
survival_time_max5.6999999999999895
survival_time_mean4.659999999999993
survival_time_min4.233333333333328
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.833333333333327
valid_direction_mean3.499999999999994
valid_direction_median3.6666666666666607
valid_direction_min2.79999999999999
No reset possible
10053527Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:07:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10051529Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: invalid syntax (LF_JP.py, line 21)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10027560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessnoidsc-rudolf-179570:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.6966981932489035
in-drivable-lane_median3.4333333333333567


other stats
deviation-center-line_max0.8396911967223216
deviation-center-line_mean0.618579445562464
deviation-center-line_min0.111235643799134
deviation-heading_max2.871292479414406
deviation-heading_mean2.1289509190319302
deviation-heading_median2.2184872548011763
deviation-heading_min0.9169930535457488
driven_any_max1.933375680664721
driven_any_mean1.7019888713055498
driven_any_median1.9333739957688072
driven_any_min0.7880917906528434
driven_lanedir_max1.7005911978677994
driven_lanedir_mean1.168578031825227
driven_lanedir_median1.459353942030693
driven_lanedir_min0.00953202253090346
in-drivable-lane_max7.000000000000011
in-drivable-lane_mean3.9533333333333487
in-drivable-lane_min1.2666666666666924
per-episodes
details{"ep000": {"driven_any": 0.7880917906528434, "driven_lanedir": 0.00953202253090346, "in-drivable-lane": 6.1666666666666545, "deviation-heading": 0.9169930535457488, "deviation-center-line": 0.111235643799134}, "ep001": {"driven_any": 1.9333739957688072, "driven_lanedir": 1.0342380330110823, "in-drivable-lane": 7.000000000000011, "deviation-heading": 2.426604799300448, "deviation-center-line": 0.6966981932489035}, "ep002": {"driven_any": 1.933375680664721, "driven_lanedir": 1.459353942030693, "in-drivable-lane": 3.4333333333333567, "deviation-heading": 2.871292479414406, "deviation-center-line": 0.66709367947772}, "ep003": {"driven_any": 1.921727714285188, "driven_lanedir": 1.7005911978677994, "in-drivable-lane": 1.2666666666666924, "deviation-heading": 2.211377008097873, "deviation-center-line": 0.8396911967223216}, "ep004": {"driven_any": 1.9333751751561896, "driven_lanedir": 1.6391749636856572, "in-drivable-lane": 1.9000000000000288, "deviation-heading": 2.2184872548011763, "deviation-center-line": 0.7781785145642409}}
No reset possible
10019539Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6856844631045431
deviation-center-line_median0.6366107824610655
in-drivable-lane_median0.7666666666666639


other stats
deviation-center-line_max0.9184368025123302
deviation-center-line_mean0.5751538413442515
deviation-center-line_min0.20501328354875345
deviation-heading_max3.7697026666574174
deviation-heading_mean2.45999827065182
deviation-heading_median2.7747209258210765
deviation-heading_min0.31826858310410966
driven_any_max2.1438987008658117
driven_any_mean1.173373456236046
driven_any_median1.0617638124370874
driven_any_min0.3607265720417164
driven_lanedir_max1.5340178139653664
driven_lanedir_mean0.8660456335227952
driven_lanedir_min0.14762057421415797
in-drivable-lane_max3.066666666666656
in-drivable-lane_mean1.159999999999996
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3607265720417164, "driven_lanedir": 0.14762057421415797, "in-drivable-lane": 0.6, "deviation-heading": 2.05590683271037, "deviation-center-line": 0.20501328354875345}, "ep001": {"driven_any": 1.0617638124370874, "driven_lanedir": 0.6801081411434995, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 2.7747209258210765, "deviation-center-line": 0.6932085391477323}, "ep002": {"driven_any": 0.6874717131914969, "driven_lanedir": 0.6856844631045431, "in-drivable-lane": 0, "deviation-heading": 0.31826858310410966, "deviation-center-line": 0.4224997990513761}, "ep003": {"driven_any": 2.1438987008658117, "driven_lanedir": 1.5340178139653664, "in-drivable-lane": 3.066666666666656, "deviation-heading": 3.381392344966126, "deviation-center-line": 0.9184368025123302}, "ep004": {"driven_any": 1.6130064826441182, "driven_lanedir": 1.2827971751864091, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.7697026666574174, "deviation-center-line": 0.6366107824610655}}
No reset possible
10015543Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videosabortedyesidsc-rudolf-179570:00:12
Error while running [...]

Creating job10015-7203_videos_1 ... error
stderr | ERROR: for job10015-7203_videos_1  Cannot start service videos: network job10015-7203_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job10015-7203_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10009542Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.19503683289986729
deviation-center-line_median0.02802053009519329
in-drivable-lane_median0.5333333333333332


other stats
deviation-center-line_max0.051997452446258946
deviation-center-line_mean0.0330616234564004
deviation-center-line_min0.024439441715664523
deviation-heading_max0.6727610204778094
deviation-heading_mean0.32117820019293025
deviation-heading_median0.25202402706215876
deviation-heading_min0.2110863127918992
driven_any_max0.8807057078679261
driven_any_mean0.6293775838252362
driven_any_median0.5688055139620741
driven_any_min0.5359312103086633
driven_lanedir_max0.2693026765029015
driven_lanedir_mean0.21839582002031613
driven_lanedir_min0.1903540021568055
in-drivable-lane_max0.8333333333333338
in-drivable-lane_mean0.5466666666666667
in-drivable-lane_min0.26666666666666666
per-episodes
details{"ep000": {"driven_any": 0.8807057078679261, "driven_lanedir": 0.2693026765029015, "in-drivable-lane": 0.8333333333333338, "deviation-heading": 0.25584701411493577, "deviation-center-line": 0.02802053009519329}, "ep001": {"driven_any": 0.6187478995778053, "driven_lanedir": 0.24658602653714337, "in-drivable-lane": 0.5333333333333332, "deviation-heading": 0.25202402706215876, "deviation-center-line": 0.03484926287266754}, "ep002": {"driven_any": 0.5426975874097125, "driven_lanedir": 0.19069956200486304, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.6727610204778094, "deviation-center-line": 0.051997452446258946}, "ep003": {"driven_any": 0.5359312103086633, "driven_lanedir": 0.1903540021568055, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.2110863127918992, "deviation-center-line": 0.02600143015221769}, "ep004": {"driven_any": 0.5688055139620741, "driven_lanedir": 0.19503683289986729, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.21417262651784796, "deviation-center-line": 0.024439441715664523}}
No reset possible
10002548Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9998548Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -25.92848188960208, "good_angle": 0.4203406927784181, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 1.033333333333334}, "ep001": {"nsteps": 28, "reward": -36.270419410296846, "good_angle": 0.004123794322536422, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 93, "reward": -11.231004618669068, "good_angle": 0.20274620684392491, "survival_time": 3.0999999999999988, "traveled_tiles": 3, "valid_direction": 0.8333333333333304}, "ep003": {"nsteps": 169, "reward": -6.262488938383097, "good_angle": 0.24968290193817655, "survival_time": 5.633333333333323, "traveled_tiles": 4, "valid_direction": 1.0333333333333297}, "ep004": {"nsteps": 151, "reward": -7.310223735361638, "good_angle": 8.288843662099902, "survival_time": 5.033333333333325, "traveled_tiles": 3, "valid_direction": 2.3666666666666583}}
good_angle_max8.288843662099902
good_angle_mean1.8331474515965915
good_angle_median0.24968290193817655
good_angle_min0.004123794322536422
reward_max-6.262488938383097
reward_mean-17.400523718462544
reward_median-11.231004618669068
reward_min-36.270419410296846
survival_time_max5.633333333333323
survival_time_mean3.1999999999999957
survival_time_min0.9333333333333332
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max2.3666666666666583
valid_direction_mean1.0533333333333306
valid_direction_median1.0333333333333297
valid_direction_min0
No reset possible
9994551Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringabortedyesidsc-rudolf-179570:00:13
Error while running [...]

Creating job9994-9515_scorer_1 ... error
stderr | ERROR: for job9994-9515_scorer_1  Cannot start service scorer: network job9994-9515_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9994-9515_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9959551Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:07:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9944565Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:05:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9934574Tri Cao 🇺🇸PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6188370420169667
deviation-center-line_median0.29148022051280753
in-drivable-lane_median2.2666666666666586


other stats
deviation-center-line_max0.5166066146708912
deviation-center-line_mean0.3204480969330191
deviation-center-line_min0.18211215601862168
deviation-heading_max3.0240989127744937
deviation-heading_mean1.6318985016146563
deviation-heading_median1.1593496192447377
deviation-heading_min0.9161646042922288
driven_any_max1.32686445785009
driven_any_mean1.044646633975423
driven_any_median1.1590106610719335
driven_any_min0.34459809595259455
driven_lanedir_max0.7627713010920065
driven_lanedir_mean0.5575417610022392
driven_lanedir_min0.1257892345568936
in-drivable-lane_max4.166666666666652
in-drivable-lane_mean2.526666666666658
in-drivable-lane_min0.6666666666666666
per-episodes
details{"ep000": {"driven_any": 0.34459809595259455, "driven_lanedir": 0.1257892345568936, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.083336194694414, "deviation-center-line": 0.18211215601862168}, "ep001": {"driven_any": 1.1471469051953915, "driven_lanedir": 0.6188370420169667, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 1.1593496192447377, "deviation-center-line": 0.27920093478994756}, "ep002": {"driven_any": 1.32686445785009, "driven_lanedir": 0.7627713010920065, "in-drivable-lane": 2.199999999999992, "deviation-heading": 3.0240989127744937, "deviation-center-line": 0.5166066146708912}, "ep003": {"driven_any": 1.245613049807105, "driven_lanedir": 0.5637192924605152, "in-drivable-lane": 4.166666666666652, "deviation-heading": 0.9161646042922288, "deviation-center-line": 0.33284055867282764}, "ep004": {"driven_any": 1.1590106610719335, "driven_lanedir": 0.7165919348848135, "in-drivable-lane": 2.2666666666666586, "deviation-heading": 0.9765431770674085, "deviation-center-line": 0.29148022051280753}}
No reset possible
9931574Tri Cao 🇺🇸PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9918579Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7269360772684326
deviation-center-line_median0.1516173576083181
in-drivable-lane_median4.166666666666662


other stats
deviation-center-line_max0.9881219990698914
deviation-center-line_mean0.3312545331594837
deviation-center-line_min0
deviation-heading_max2.068416631849293
deviation-heading_mean0.7127590478890345
deviation-heading_median0.5041212178199654
deviation-heading_min0
driven_any_max5.493661028781503
driven_any_mean2.4421884894852224
driven_any_median2.41771245363674
driven_any_min0.4532403897677328
driven_lanedir_max3.4900572754102406
driven_lanedir_mean1.2732421827198832
driven_lanedir_min0
in-drivable-lane_max6.233333333333312
in-drivable-lane_mean3.826666666666656
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.3512198939463251, "driven_lanedir": 0, "in-drivable-lane": 4.166666666666662, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.4532403897677328, "driven_lanedir": 0.4398509475923922, "in-drivable-lane": 0, "deviation-heading": 0.2902265382403343, "deviation-center-line": 0.14138744642802734}, "ep002": {"driven_any": 2.41771245363674, "driven_lanedir": 0.7269360772684326, "in-drivable-lane": 6.233333333333312, "deviation-heading": 0.7010308515355802, "deviation-center-line": 0.1516173576083181}, "ep003": {"driven_any": 2.495108681293811, "driven_lanedir": 1.7093666133283512, "in-drivable-lane": 2.8999999999999906, "deviation-heading": 0.5041212178199654, "deviation-center-line": 0.37514586269118166}, "ep004": {"driven_any": 5.493661028781503, "driven_lanedir": 3.4900572754102406, "in-drivable-lane": 5.8333333333333135, "deviation-heading": 2.068416631849293, "deviation-center-line": 0.9881219990698914}}
No reset possible
9911579Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9910579Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.49999999999998


other stats
episodes
details{"ep000": {"nsteps": 126, "reward": -9.775855645537376, "good_angle": 0.32231569431919593, "survival_time": 4.199999999999995, "traveled_tiles": 3, "valid_direction": 0.8999999999999989}, "ep001": {"nsteps": 47, "reward": -21.750445918833957, "good_angle": 0.1736675690236694, "survival_time": 1.5666666666666682, "traveled_tiles": 1, "valid_direction": 0.2333333333333341}, "ep002": {"nsteps": 255, "reward": -5.667569453488378, "good_angle": 2.63243043287098, "survival_time": 8.49999999999998, "traveled_tiles": 5, "valid_direction": 2.899999999999994}, "ep003": {"nsteps": 256, "reward": -4.5246718378348305, "good_angle": 1.8839175076880696, "survival_time": 8.533333333333314, "traveled_tiles": 5, "valid_direction": 1.1999999999999955}, "ep004": {"nsteps": 500, "reward": -0.7788310965006822, "good_angle": 20.88625962261295, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.66666666666665}}
good_angle_max20.88625962261295
good_angle_mean5.179718165302974
good_angle_median1.8839175076880696
good_angle_min0.1736675690236694
reward_max-0.7788310965006822
reward_mean-8.499474790439045
reward_median-5.667569453488378
reward_min-21.750445918833957
survival_time_max16.666666666666654
survival_time_mean7.893333333333322
survival_time_min1.5666666666666682
traveled_tiles_max10
traveled_tiles_mean4.8
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max4.66666666666665
valid_direction_mean1.9799999999999949
valid_direction_median1.1999999999999955
valid_direction_min0.2333333333333341
No reset possible
9896574Tri Cao 🇺🇸PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9892576Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9884590Allen OuTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1802755024585134
deviation-center-line_median0.5754096123679283
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.1831827320618895
deviation-center-line_mean0.6341360178813958
deviation-center-line_min0.22474959476747397
deviation-heading_max2.6463413950694106
deviation-heading_mean1.4716556367984308
deviation-heading_median1.655338948591104
deviation-heading_min0.24402069512793112
driven_any_max2.888481976798732
driven_any_mean1.5185948664746167
driven_any_median1.3336938584292013
driven_any_min0.3169846704443646
driven_lanedir_max2.5715150173412997
driven_lanedir_mean1.34575575171303
driven_lanedir_min0.30535009450292927
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3133333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.267982984756009, "driven_lanedir": 1.8912094979622496, "in-drivable-lane": 0.7333333333333332, "deviation-heading": 2.6463413950694106, "deviation-center-line": 0.7006105605048246}, "ep001": {"driven_any": 0.3169846704443646, "driven_lanedir": 0.30535009450292927, "in-drivable-lane": 0, "deviation-heading": 0.24402069512793112, "deviation-center-line": 0.22474959476747397}, "ep002": {"driven_any": 1.3336938584292013, "driven_lanedir": 1.1802755024585134, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.4607810007432205, "deviation-center-line": 0.5754096123679283}, "ep003": {"driven_any": 2.888481976798732, "driven_lanedir": 2.5715150173412997, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.655338948591104, "deviation-center-line": 1.1831827320618895}, "ep004": {"driven_any": 0.7858308419447766, "driven_lanedir": 0.7804286463001577, "in-drivable-lane": 0, "deviation-heading": 0.35179614446048796, "deviation-center-line": 0.4867275897048623}}
No reset possible
9876590Allen OuTensorflow templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9873590Allen OuTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}
good_angle_max0.8928199947802034
good_angle_mean0.44726467462067304
good_angle_median0.33400722083424306
good_angle_min0.060537386068120175
reward_max-0.28626655193418266
reward_mean-5.91151246140921
reward_median-4.076980934218227
reward_min-15.93245312479826
survival_time_max16.666666666666654
survival_time_mean8.973333333333319
survival_time_min2.1666666666666687
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.4999999999999956
valid_direction_mean0.7466666666666641
valid_direction_median0.6666666666666643
valid_direction_min0.09999999999999964
No reset possible
9868592Liu Sam 🇹🇼PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999989


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.400087172387622, "good_angle": 1.3142241469019869, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 52, "reward": -19.78199272660109, "good_angle": 0.08163371101430023, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 229, "reward": -4.757955190636407, "good_angle": 2.1314649418355702, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 4.099999999999986}, "ep003": {"nsteps": 229, "reward": -5.533671027996504, "good_angle": 1.1018644129241444, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 5.399999999999981}, "ep004": {"nsteps": 174, "reward": -6.955468747807645, "good_angle": 1.4543242829737104, "survival_time": 5.799999999999989, "traveled_tiles": 2, "valid_direction": 4.866666666666656}}
good_angle_max2.1314649418355702
good_angle_mean1.2167022991299423
good_angle_median1.3142241469019869
good_angle_min0.08163371101430023
reward_max-4.757955190636407
reward_mean-10.085834973085852
reward_median-6.955468747807645
reward_min-19.78199272660109
survival_time_max7.633333333333316
survival_time_mean5.0666666666666575
survival_time_min1.7333333333333354
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.399999999999981
valid_direction_mean3.2999999999999914
valid_direction_median4.099999999999986
valid_direction_min0
No reset possible
9857595Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9850598Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 18, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9830609David AbrahamRandom executionaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0939110529663254
deviation-center-line_median0.5740854050384169
in-drivable-lane_median0.6


other stats
deviation-center-line_max0.9079834048674484
deviation-center-line_mean0.5768790790127947
deviation-center-line_min0.20244709637101535
deviation-heading_max4.023459436538266
deviation-heading_mean2.4803642044270884
deviation-heading_median2.0194643404857633
deviation-heading_min1.804897470245454
driven_any_max2.1212026615282777
driven_any_mean1.2665625311832192
driven_any_median1.18451937736707
driven_any_min0.357193088523399
driven_lanedir_max1.9345893222921329
driven_lanedir_mean1.020072551666085
driven_lanedir_min0.1410919707625874
in-drivable-lane_max1.8333333333333268
in-drivable-lane_mean0.7666666666666644
in-drivable-lane_min0.13333333333333286
per-episodes
details{"ep000": {"driven_any": 0.357193088523399, "driven_lanedir": 0.1410919707625874, "in-drivable-lane": 0.6, "deviation-heading": 2.0194643404857633, "deviation-center-line": 0.20244709637101535}, "ep001": {"driven_any": 1.064481066270895, "driven_lanedir": 0.6918417562760395, "in-drivable-lane": 1.8333333333333268, "deviation-heading": 1.923296961332736, "deviation-center-line": 0.5740854050384169}, "ep002": {"driven_any": 1.18451937736707, "driven_lanedir": 1.0939110529663254, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 1.804897470245454, "deviation-center-line": 0.3842624596755284}, "ep003": {"driven_any": 2.1212026615282777, "driven_lanedir": 1.9345893222921329, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 2.630702813533223, "deviation-center-line": 0.9079834048674484}, "ep004": {"driven_any": 1.6054164622264542, "driven_lanedir": 1.2389286560333397, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 4.023459436538266, "deviation-center-line": 0.8156170291115642}}
No reset possible
9827607Samuel LavoiePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.766666666666652


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -13.787438218072811, "good_angle": 1.119777471345656, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.9333333333333345}, "ep001": {"nsteps": 203, "reward": -6.593767599032944, "good_angle": 18.49659831115776, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 5.2666666666666515}, "ep002": {"nsteps": 225, "reward": -4.836047241100006, "good_angle": 2.099535963172931, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep003": {"nsteps": 231, "reward": -5.5219402299282745, "good_angle": 1.026867242839075, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 5.599999999999982}, "ep004": {"nsteps": 188, "reward": -6.54944158991504, "good_angle": 1.5930068507168955, "survival_time": 6.266666666666654, "traveled_tiles": 2, "valid_direction": 4.899999999999986}}
good_angle_max18.49659831115776
good_angle_mean4.867157167846463
good_angle_median1.5930068507168955
good_angle_min1.026867242839075
reward_max-4.836047241100006
reward_mean-7.457726975609816
reward_median-6.54944158991504
reward_min-13.787438218072811
survival_time_max7.699999999999982
survival_time_mean6.139999999999988
survival_time_min2.4666666666666677
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.599999999999982
valid_direction_mean4.319999999999988
valid_direction_median4.899999999999986
valid_direction_min1.9333333333333345
No reset possible
9818611David AbrahamRandom executionaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9806609David AbrahamRandom executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9802613Laurent MandrilePyTorch templateaido1_LF1_r3-v3step1-simulationabortednoidsc-rudolf-179570:00:14
Error while running [...]

Creating job9802-2764_solution_1  ... error
stderr | ERROR: for job9802-2764_solution_1  Cannot start service solution: network job9802-2764_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9802-2764_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9802-2764_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9791628Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:03:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.839634730476746
deviation-center-line_median0.3876309937395394
in-drivable-lane_median8.29999999999999


other stats
deviation-center-line_max0.5747826826548895
deviation-center-line_mean0.3643303634439444
deviation-center-line_min0.13729734885380554
deviation-heading_max6.58245575091181
deviation-heading_mean5.302655958935572
deviation-heading_median6.539566120620427
deviation-heading_min0.32328388756500265
driven_any_max2.6532777821831983
driven_any_mean2.6532777821831908
driven_any_median2.6532777821831885
driven_any_min2.653277782183184
driven_lanedir_max-0.2575588697397758
driven_lanedir_mean-0.7245298252797052
driven_lanedir_min-0.8446015392792754
in-drivable-lane_max14.933333333333325
in-drivable-lane_mean9.633333333333322
in-drivable-lane_min8.299999999999988
per-episodes
details{"ep000": {"driven_any": 2.6532777821831983, "driven_lanedir": -0.2575588697397758, "in-drivable-lane": 14.933333333333325, "deviation-heading": 0.32328388756500265, "deviation-center-line": 0.3959689180795801}, "ep001": {"driven_any": 2.6532777821831877, "driven_lanedir": -0.8392146675166066, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.58245575091181, "deviation-center-line": 0.5747826826548895}, "ep002": {"driven_any": 2.653277782183195, "driven_lanedir": -0.8416393193861229, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.556737670234658, "deviation-center-line": 0.3259718738919073}, "ep003": {"driven_any": 2.653277782183184, "driven_lanedir": -0.839634730476746, "in-drivable-lane": 8.333333333333323, "deviation-heading": 6.511236365345967, "deviation-center-line": 0.13729734885380554}, "ep004": {"driven_any": 2.6532777821831885, "driven_lanedir": -0.8446015392792754, "in-drivable-lane": 8.299999999999988, "deviation-heading": 6.539566120620427, "deviation-center-line": 0.3876309937395394}}
No reset possible
9776628Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9770620Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9768622Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 51, in solve
    num_actions=5)
  File "/workspace/model.py", line 15, in __init__
    self.net = dqn.RainbowDQN(*args, **kwargs).to(self.device)
TypeError: __init__() takes exactly 6 arguments (3 given)


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9765626Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessyesidsc-rudolf-179570:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.31330944855783205
deviation-center-line_median0.20205856209397596
in-drivable-lane_median0.6


other stats
deviation-center-line_max0.5434630097017449
deviation-center-line_mean0.2747519236959051
deviation-center-line_min0.1874449649105084
deviation-heading_max3.146719795152261
deviation-heading_mean1.402857819213102
deviation-heading_median0.9901141218680316
deviation-heading_min0.41714055184905785
driven_any_max1.3326087744450388
driven_any_mean0.6257438716343252
driven_any_median0.35890887081874334
driven_any_min0.15380515248063223
driven_lanedir_max0.7186269943060501
driven_lanedir_mean0.36938332867678186
driven_lanedir_min0.1408166343100281
in-drivable-lane_max2.466666666666658
in-drivable-lane_mean1.03333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35890887081874334, "driven_lanedir": 0.1408166343100281, "in-drivable-lane": 0.6, "deviation-heading": 1.906159026491048, "deviation-center-line": 0.1874449649105084}, "ep001": {"driven_any": 0.15380515248063223, "driven_lanedir": 0.14725129394194705, "in-drivable-lane": 0, "deviation-heading": 0.41714055184905785, "deviation-center-line": 0.20205856209397596}, "ep002": {"driven_any": 1.3326087744450388, "driven_lanedir": 0.7186269943060501, "in-drivable-lane": 2.466666666666658, "deviation-heading": 3.146719795152261, "deviation-center-line": 0.5434630097017449}, "ep003": {"driven_any": 0.3232889005383706, "driven_lanedir": 0.31330944855783205, "in-drivable-lane": 0, "deviation-heading": 0.5541556007051125, "deviation-center-line": 0.19830223446839365}, "ep004": {"driven_any": 0.960107659888841, "driven_lanedir": 0.5269122722680519, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9901141218680316, "deviation-center-line": 0.24249084730490283}}
No reset possible
9759626Yun Chen 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9754629Samuel LavoiePyTorch templateaido1_LF1_r3-v3step3-videossuccessyesidsc-rudolf-179570:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9752629Samuel LavoiePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 70, "reward": -14.546520205281142, "good_angle": 0.9528251488350012, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 2.0000000000000018}, "ep001": {"nsteps": 202, "reward": -6.390987972982486, "good_angle": 17.565154864598664, "survival_time": 6.733333333333319, "traveled_tiles": 2, "valid_direction": 4.099999999999985}, "ep002": {"nsteps": 221, "reward": -4.718259711916047, "good_angle": 1.4657973931453732, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 2.6999999999999904}, "ep003": {"nsteps": 267, "reward": -4.832598982948817, "good_angle": 0.9417108941428132, "survival_time": 8.899999999999979, "traveled_tiles": 3, "valid_direction": 4.56666666666665}, "ep004": {"nsteps": 161, "reward": -7.220770596387733, "good_angle": 1.482643264027838, "survival_time": 5.366666666666657, "traveled_tiles": 2, "valid_direction": 4.233333333333324}}
good_angle_max17.565154864598664
good_angle_mean4.481626312949937
good_angle_median1.4657973931453732
good_angle_min0.9417108941428132
reward_max-4.718259711916047
reward_mean-7.541827493903244
reward_median-6.390987972982486
reward_min-14.546520205281142
survival_time_max8.899999999999979
survival_time_mean6.139999999999988
survival_time_min2.333333333333335
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.56666666666665
valid_direction_mean3.5199999999999902
valid_direction_median4.099999999999985
valid_direction_min2.0000000000000018
No reset possible
9741629Samuel LavoiePyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:03:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9739638Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyesidsc-rudolf-179570:00:13
Error while running [...]

Creating job9739-1400_videos_1 ... error
stderr | ERROR: for job9739-1400_videos_1  Cannot start service videos: network job9739-1400_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9739-1400_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9735638Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyesidsc-rudolf-179570:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.3000000000000016


other stats
episodes
details{"ep000": {"nsteps": 226, "reward": -4.58659128757478, "good_angle": 0.7692588119480632, "survival_time": 7.533333333333316, "traveled_tiles": 2, "valid_direction": 1.399999999999995}, "ep001": {"nsteps": 19, "reward": -53.271410325640126, "good_angle": 0.37632097512003554, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4333333333333333}, "ep002": {"nsteps": 49, "reward": -20.86360121199063, "good_angle": 0.4289982369679214, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.7000000000000016}, "ep003": {"nsteps": 129, "reward": -8.15579949394446, "good_angle": 0.31446643616808956, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 0.3999999999999986}, "ep004": {"nsteps": 69, "reward": -14.966496082319727, "good_angle": 0.4469049643259113, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 0.6333333333333331}}
good_angle_max0.7692588119480632
good_angle_mean0.4671898849060042
good_angle_median0.4289982369679214
good_angle_min0.31446643616808956
reward_max-4.58659128757478
reward_mean-20.368779680293944
reward_median-14.966496082319727
reward_min-53.271410325640126
survival_time_max7.533333333333316
survival_time_mean3.2799999999999963
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.399999999999995
valid_direction_mean0.7133333333333324
valid_direction_median0.6333333333333331
valid_direction_min0.3999999999999986
No reset possible
9731632Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-179570:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 103, in run
    solve(params, cis)
  File "solution.py", line 44, in solve
    env = make_env(config)
  File "solution.py", line 22, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9722642Mikita Sazanovich 🇷🇺Random executionaido1_LF1_r3-v3step1-simulationsuccessnoidsc-rudolf-179570:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible