Duckietown Challenges Home Challenges Submissions

Evaluator 269

ID269
evaluatornutonomy-P50-2570
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-2570
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success50 5343
# timeout
# failed9 5341
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5740764Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.299999999999978


other stats
episodes
details{"ep000": {"nsteps": 151, "reward": -7.049707989082348, "good_angle": 3.2308304545972866, "survival_time": 5.033333333333325, "traveled_tiles": 1, "valid_direction": 4.199999999999992}, "ep001": {"nsteps": 279, "reward": -3.891245903510694, "good_angle": 0.9299167932474692, "survival_time": 9.299999999999978, "traveled_tiles": 2, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 500, "reward": -0.31183041554270313, "good_angle": 0.42334523255448425, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 203, "reward": -5.425280580441054, "good_angle": 2.0918994328631215, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 5.499999999999988}, "ep004": {"nsteps": 500, "reward": -1.5710352215059102, "good_angle": 42.97100593665618, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 11.499999999999991}}
good_angle_max42.97100593665618
good_angle_mean9.929399569983708
good_angle_median2.0918994328631215
good_angle_min0.42334523255448425
reward_max-0.31183041554270313
reward_mean-3.6498200220165415
reward_median-3.891245903510694
reward_min-7.049707989082348
survival_time_max16.666666666666654
survival_time_mean10.886666666666653
survival_time_min5.033333333333325
traveled_tiles_max6
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max11.499999999999991
valid_direction_mean4.90666666666666
valid_direction_median4.199999999999992
valid_direction_min0.7333333333333307
No reset possible
5736763Bhairav MehtaTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5733762Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5727761Maxim Kuzmin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5724761Maxim Kuzmin 🇷🇺ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 149, "reward": -7.392234276105094, "good_angle": 13.035006652002206, "survival_time": 4.966666666666659, "traveled_tiles": 3, "valid_direction": 2.933333333333324}, "ep001": {"nsteps": 500, "reward": -0.3217624191492796, "good_angle": 18.06820610150098, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 500, "reward": -0.38393971337378024, "good_angle": 0.04169037891178736, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 266, "reward": -4.495429577824092, "good_angle": 12.341967398129391, "survival_time": 8.866666666666646, "traveled_tiles": 4, "valid_direction": 2.866666666666658}, "ep004": {"nsteps": 500, "reward": -0.7817404213696718, "good_angle": 2.8608257095229974, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.066666666666652}}
good_angle_max18.06820610150098
good_angle_mean9.269539248013473
good_angle_median12.341967398129391
good_angle_min0.04169037891178736
reward_max-0.3217624191492796
reward_mean-2.6750212815643835
reward_median-0.7817404213696718
reward_min-7.392234276105094
survival_time_max16.666666666666654
survival_time_mean12.766666666666657
survival_time_min4.966666666666659
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max6.066666666666652
valid_direction_mean2.959999999999991
valid_direction_median2.933333333333323
valid_direction_min0
No reset possible
5722760Yu-Jhen ChenSolution templateaido1_luck-v3step1successyesnutonomy-P50-25700:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score170.4790248470247


No reset possible
5717759Gunshi Gupta 🇨🇦Baseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.833333333333306


other stats
episodes
details{"ep000": {"nsteps": 204, "reward": -6.82617858607395, "good_angle": 29.052760615620816, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 4.699999999999983}, "ep001": {"nsteps": 452, "reward": -3.266038857532286, "good_angle": 28.412707913017694, "survival_time": 15.066666666666624, "traveled_tiles": 3, "valid_direction": 4.699999999999983}, "ep002": {"nsteps": 500, "reward": -0.08889611337642418, "good_angle": 0.1127756778563064, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}, "ep003": {"nsteps": 310, "reward": -5.325173655248458, "good_angle": 31.515511266871705, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep004": {"nsteps": 325, "reward": -4.907598058059811, "good_angle": 5.662633962039346, "survival_time": 10.833333333333306, "traveled_tiles": 3, "valid_direction": 3.566666666666655}}
good_angle_max31.515511266871705
good_angle_mean18.951277887081172
good_angle_median28.412707913017694
good_angle_min0.1127756778563064
reward_max-0.08889611337642418
reward_mean-4.082777054058186
reward_median-4.907598058059811
reward_min-6.82617858607395
survival_time_max16.666666666666654
survival_time_mean11.939999999999976
survival_time_min6.799999999999986
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.699999999999984
valid_direction_mean3.5333333333333217
valid_direction_median4.699999999999983
valid_direction_min0
No reset possible
5711758Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5702756Martin Shin 🇭🇰PyTorch templateaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5695756Martin Shin 🇭🇰PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5693755Mikita Sazanovich 🇷🇺RL solutionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5677750Martin Shin 🇭🇰Solution templateaido1_luck-v3step1successyesnutonomy-P50-25700:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score147.01263780933539


No reset possible
5673748Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5657746Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:08:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5653745Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5648745Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5646743Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:10:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5644742Philippe LacailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5637741Manish PrajapatSolution templateaido1_luck-v3step1successyesnutonomy-P50-25700:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score143.27358327758777


No reset possible
5636740Andrea Censi 🇨🇭Copy of #15: sub 574 by trimcao (PyTorch template)aido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5622737Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7947607793244533, "good_angle": 50.871895001177585, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.79999999999997}, "ep001": {"nsteps": 500, "reward": -0.791930663626641, "good_angle": 36.79047601703185, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.233333333333344}, "ep002": {"nsteps": 500, "reward": -1.007000924691558, "good_angle": 1.2174371064857936, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 500, "reward": -0.8188124289009721, "good_angle": 42.098294342947696, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.466666666666679}, "ep004": {"nsteps": 500, "reward": -1.3624944336237386, "good_angle": 5.402375667365257, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.700000000000013}}
good_angle_max50.871895001177585
good_angle_mean27.27609562700163
good_angle_median36.79047601703185
good_angle_min1.2174371064857936
reward_max-0.791930663626641
reward_mean-0.9549998460334724
reward_median-0.8188124289009721
reward_min-1.3624944336237386
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max7
traveled_tiles_mean6.2
traveled_tiles_median6
traveled_tiles_min6
valid_direction_max8.79999999999997
valid_direction_mean6.26
valid_direction_median6.700000000000013
valid_direction_min2.0999999999999925
No reset possible
5615736Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 55, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 21, in make_env
    kwargs={"frame_skip": config['frame_skip']})
TypeError: make() got an unexpected keyword argument 'kwargs'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5604731Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5583726Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5577726Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5568720Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5566724Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5558722Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5549723Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5511713Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:05:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5499712Liam Paull 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5491711Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:08:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5487709Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5482709Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5480708Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5473705Jonathan Plante 🇨🇦JP pipelineaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5469704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:02:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5464704Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5460703Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5456703Jonathan Plante 🇨🇦Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:02:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5453702Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5450700Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5441700Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5432699Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:07:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5427697Benjamin Ramtoula 🇨🇦My modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:05:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5421695Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5417693Benjamin Ramtoula 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5413692Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5410692Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5231579206675815, "good_angle": 28.464478016032334, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.333333333333348}, "ep001": {"nsteps": 500, "reward": -0.31609272902086377, "good_angle": 17.538302246765024, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.8999999999999897}, "ep002": {"nsteps": 500, "reward": -0.38211745707690714, "good_angle": 0.04292090082765797, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 271, "reward": -4.448645181651485, "good_angle": 11.543214536801488, "survival_time": 9.033333333333312, "traveled_tiles": 4, "valid_direction": 2.866666666666658}, "ep004": {"nsteps": 500, "reward": -0.7898046460151672, "good_angle": 2.789892196969417, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.333333333333318}}
good_angle_max28.464478016032334
good_angle_mean12.075761579479185
good_angle_median11.543214536801488
good_angle_min0.04292090082765797
reward_max-0.31609272902086377
reward_mean-1.291963586886401
reward_median-0.5231579206675815
reward_min-4.448645181651485
survival_time_max16.666666666666654
survival_time_mean15.139999999999985
survival_time_min9.033333333333312
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.333333333333348
valid_direction_mean3.6866666666666625
valid_direction_median2.8999999999999897
valid_direction_min0
No reset possible
5408691Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:04:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5402690Yun Chen 🇨🇦Random executionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5399689Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:06:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5390687Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5372683Vadim Volodin 🇷🇺Random executionaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.099999999999978


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.906903265163913, "good_angle": 23.167319904536384, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 383, "reward": -3.2070510478580236, "good_angle": 16.473773167522435, "survival_time": 12.766666666666632, "traveled_tiles": 4, "valid_direction": 4.033333333333319}, "ep002": {"nsteps": 500, "reward": -0.006893814329640009, "good_angle": 0.49274114419548326, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.2333333333333645}, "ep003": {"nsteps": 235, "reward": -6.704229172239912, "good_angle": 19.915258517632104, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 273, "reward": -5.652174131810583, "good_angle": 5.997302694493859, "survival_time": 9.099999999999978, "traveled_tiles": 3, "valid_direction": 3.09999999999999}}
good_angle_max23.167319904536384
good_angle_mean13.209279085676052
good_angle_median16.473773167522435
good_angle_min0.49274114419548326
reward_max-0.006893814329640009
reward_mean-4.695450286280414
reward_median-5.652174131810583
reward_min-7.906903265163913
survival_time_max16.666666666666654
survival_time_mean10.413333333333314
survival_time_min5.6999999999999895
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.033333333333319
valid_direction_mean3.0866666666666633
valid_direction_median3.09999999999999
valid_direction_min1.2333333333333645
No reset possible
5362681Maxim Kuzmin 🇷🇺Template for ROS Submissionaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-25700:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5355680Vadim Volodin 🇷🇺Random executionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-25700:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
5346680Vadim Volodin 🇷🇺Random executionaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-25700:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
5343679Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-25700:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5562462318208999, "good_angle": 29.14299777536943, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.56666666666668}, "ep001": {"nsteps": 408, "reward": -2.897838855249004, "good_angle": 8.031778959820222, "survival_time": 13.599999999999962, "traveled_tiles": 4, "valid_direction": 2.5666666666666575}, "ep002": {"nsteps": 500, "reward": -0.3696697205603123, "good_angle": 0.04233579610914566, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 260, "reward": -4.583290520654275, "good_angle": 8.244836990294793, "survival_time": 8.666666666666647, "traveled_tiles": 4, "valid_direction": 2.633333333333325}, "ep004": {"nsteps": 500, "reward": -0.7933614415351767, "good_angle": 2.7771075905646283, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.133333333333319}}
good_angle_max29.14299777536943
good_angle_mean9.647811422431642
good_angle_median8.031778959820222
good_angle_min0.04233579610914566
reward_max-0.3696697205603123
reward_mean-1.8400813539639336
reward_median-0.7933614415351767
reward_min-4.583290520654275
survival_time_max16.666666666666654
survival_time_mean14.453333333333314
survival_time_min8.666666666666647
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.56666666666668
valid_direction_mean3.579999999999996
valid_direction_median2.633333333333325
valid_direction_min0
No reset possible
5341678Mandana Samiei 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-25700:06:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible