Duckietown Challenges Home Challenges Submissions

Evaluator 2299

ID2299
evaluatorreg01-2f0b95c6240e-1
ownerI don't have one 😀
machineChudeQian-Sager-Duckietown
processreg01-2f0b95c6240e-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 42373
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4237311440Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg01-2f0b95c6240e-10:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.354130674984826
survival_time_median14.950000000000076
deviation-center-line_median1.177777746116959
in-drivable-lane_median0.3750000000000018


other stats
agent_compute-ego_max0.015556668440500895
agent_compute-ego_mean0.01503100077311198
agent_compute-ego_median0.015026005109151204
agent_compute-ego_min0.014515324433644613
complete-iteration_max0.17528913577397665
complete-iteration_mean0.17279931763807935
complete-iteration_median0.17231208403905235
complete-iteration_min0.171283966700236
deviation-center-line_max1.7009601625748023
deviation-center-line_mean1.267380794229768
deviation-center-line_min1.0130075221103518
deviation-heading_max3.2370122381525372
deviation-heading_mean2.5493116868952184
deviation-heading_median2.4863963384120025
deviation-heading_min1.9874418326043295
driven_any_max5.721253936529227
driven_any_mean5.369384759949012
driven_any_median5.633995392629093
driven_any_min4.488294318008636
driven_lanedir_consec_max5.6317636893584115
driven_lanedir_consec_mean5.145582910549102
driven_lanedir_consec_min4.242306602868343
driven_lanedir_max5.6317636893584115
driven_lanedir_mean5.145582910549102
driven_lanedir_median5.354130674984826
driven_lanedir_min4.242306602868343
get_duckie_state_max1.5274683634440103e-06
get_duckie_state_mean1.4986594518025717e-06
get_duckie_state_median1.515944798787435e-06
get_duckie_state_min1.435279846191406e-06
get_robot_state_max0.011289684772491456
get_robot_state_mean0.010932121475537616
get_robot_state_median0.01087000807126363
get_robot_state_min0.010698784987131754
get_state_dump_max0.009679568608601887
get_state_dump_mean0.009298271735509235
get_state_dump_median0.009201064507166543
get_state_dump_min0.00911138931910197
get_ui_image_max0.029405678113301595
get_ui_image_mean0.02882026016712189
get_ui_image_median0.02896162509918213
get_ui_image_min0.027952112356821695
in-drivable-lane_max0.900000000000003
in-drivable-lane_mean0.4125000000000016
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.721253936529227, "get_ui_image": 0.028974165121714274, "step_physics": 0.0716927417119344, "survival_time": 14.950000000000076, "driven_lanedir": 5.6317636893584115, "get_state_dump": 0.009239420890808106, "sim_render-ego": 0.005259552001953125, "get_robot_state": 0.010849563280741374, "get_duckie_state": 1.5123685201009115e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014805681705474852, "deviation-heading": 2.2156851156451363, "complete-iteration": 0.171283966700236, "set_robot_commands": 0.003873664538065592, "deviation-center-line": 1.013560745098803, "driven_lanedir_consec": 5.6317636893584115, "sim_compute_sim_state": 0.02306375026702881, "sim_compute_performance-ego": 0.0034230804443359376}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.5979214300088165, "get_ui_image": 0.028949085076649984, "step_physics": 0.07267959197362264, "survival_time": 14.950000000000076, "driven_lanedir": 5.19002904272369, "get_state_dump": 0.00911138931910197, "sim_render-ego": 0.005182714462280274, "get_robot_state": 0.010698784987131754, "get_duckie_state": 1.435279846191406e-06, "in-drivable-lane": 0.7500000000000036, "agent_compute-ego": 0.015246328512827556, "deviation-heading": 3.2370122381525372, "complete-iteration": 0.17143639246622722, "set_robot_commands": 0.004037578105926514, "deviation-center-line": 1.341994747135115, "driven_lanedir_consec": 5.19002904272369, "sim_compute_sim_state": 0.022009321053822837, "sim_compute_performance-ego": 0.003417628606160482}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.488294318008636, "get_ui_image": 0.029405678113301595, "step_physics": 0.07341919660568237, "survival_time": 14.950000000000076, "driven_lanedir": 4.242306602868343, "get_state_dump": 0.009162708123524984, "sim_render-ego": 0.005439438025156657, "get_robot_state": 0.01089045286178589, "get_duckie_state": 1.5274683634440103e-06, "in-drivable-lane": 0.900000000000003, "agent_compute-ego": 0.015556668440500895, "deviation-heading": 1.9874418326043295, "complete-iteration": 0.17528913577397665, "set_robot_commands": 0.004020264943440755, "deviation-center-line": 1.7009601625748023, "driven_lanedir_consec": 4.242306602868343, "sim_compute_sim_state": 0.023750586509704588, "sim_compute_performance-ego": 0.0035367369651794433}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.67006935524937, "get_ui_image": 0.027952112356821695, "step_physics": 0.07085625092188517, "survival_time": 14.950000000000076, "driven_lanedir": 5.518232307245961, "get_state_dump": 0.009679568608601887, "sim_render-ego": 0.0051014868418375655, "get_robot_state": 0.011289684772491456, "get_duckie_state": 1.5195210774739585e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014515324433644613, "deviation-heading": 2.757107561178869, "complete-iteration": 0.17318777561187745, "set_robot_commands": 0.003985857168833415, "deviation-center-line": 1.0130075221103518, "driven_lanedir_consec": 5.518232307245961, "sim_compute_sim_state": 0.026239039103190104, "sim_compute_performance-ego": 0.0034650286038716634}}
set_robot_commands_max0.004037578105926514
set_robot_commands_mean0.003979341189066569
set_robot_commands_median0.004003061056137085
set_robot_commands_min0.003873664538065592
sim_compute_performance-ego_max0.0035367369651794433
sim_compute_performance-ego_mean0.0034606186548868816
sim_compute_performance-ego_median0.0034440545241038005
sim_compute_performance-ego_min0.003417628606160482
sim_compute_sim_state_max0.026239039103190104
sim_compute_sim_state_mean0.023765674233436583
sim_compute_sim_state_median0.0234071683883667
sim_compute_sim_state_min0.022009321053822837
sim_render-ego_max0.005439438025156657
sim_render-ego_mean0.005245797832806905
sim_render-ego_median0.005221133232116699
sim_render-ego_min0.0051014868418375655
simulation-passed1
step_physics_max0.07341919660568237
step_physics_mean0.07216194530328116
step_physics_median0.07218616684277852
step_physics_min0.07085625092188517
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible