Duckietown Challenges Home Challenges Submissions

Evaluator 343

ID343
evaluatormila-4841-30669
ownerRuixiang Zhang 🇨🇦
machinemila-4841
processmila-4841-30669
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success5 9382
# timeout1 9429
# failed1 9372
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
94291198Vincent Mai 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step4-viztimeoutyesmila-4841-306690:31:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
94241202Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step3-videossuccessyesmila-4841-306690:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
94231202Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyesmila-4841-306690:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3666666666666676


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -10.75414005917448, "good_angle": 0.11670871978383944, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 0.16666666666666674}, "ep001": {"nsteps": 22, "reward": -46.0180292061784, "good_angle": 0.00941573330888404, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 41, "reward": -24.872615833834903, "good_angle": 0.11448353244003842, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 0.20000000000000065}, "ep003": {"nsteps": 40, "reward": -25.4082356384024, "good_angle": 0.028194738352937343, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 52, "reward": -19.64057477019154, "good_angle": 0.03177397950217068, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}}
good_angle_max0.11670871978383944
good_angle_mean0.06011534067757399
good_angle_median0.03177397950217068
good_angle_min0.00941573330888404
reward_max-10.75414005917448
reward_mean-25.338719101556347
reward_median-24.872615833834903
reward_min-46.0180292061784
survival_time_max3.166666666666665
survival_time_mean1.6666666666666672
survival_time_min0.7333333333333333
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max0.20000000000000065
valid_direction_mean0.08000000000000015
valid_direction_median0.03333333333333344
valid_direction_min0
No reset possible
94201202Benjamin Ramtoula 🇨🇦My ROS solutionaido1_LF1_r3-v3step1-simulationsuccessnomila-4841-306690:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
94021201Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationsuccessnomila-4841-306690:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93821197Iban Harlouchet 🇨🇦ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessnomila-4841-306690:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
93721194Ruixiang Zhang 🇨🇦stay youngaido1_LF1_r3-v3step1-simulationfailednomila-4841-306690:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution_ddpg.py", line 140, in run
    solve(params, cis)
  File "solution_ddpg.py", line 82, in solve
    model.load("model", "models")
  File "/workspace/model.py", line 232, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for ActorCNN:
	Missing key(s) in state_dict: "bn1.running_var", "bn1.bias", "bn1.weight", "bn1.running_mean", "bn2.running_var", "bn2.bias", "bn2.weight", "bn2.running_mean", "bn3.running_var", "bn3.bias", "bn3.weight", "bn3.running_mean", "bn4.running_var", "bn4.bias", "bn4.weight", "bn4.running_mean".
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible