Duckietown Challenges Home Challenges Submissions

Evaluator 5040

ID5040
evaluatornoname
ownerEric Hanley
machineeric-XPS-13-9310
processnoname_eric-XPS-13-9310
version6.2.19
first heard
last heard
statusinactive
# evaluating
# success1 62516
# timeout
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors8
Processor frequency (MHz)4.6 GHz
Free % of processors99%
RAM total (MB)15.4 GB
RAM free (MB)10.4 GB
Disk (MB)459.8 GB
Disk available (MB)400.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6251613812Eric Hanleytemplate-randomaido-hello-sim-validation370success Note that this job is not up to date; the challenge has been changed. noname0:01:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.020560633052479137
agent_compute-ego0_mean0.020560633052479137
agent_compute-ego0_median0.020560633052479137
agent_compute-ego0_min0.020560633052479137
complete-iteration_max0.1854480450803583
complete-iteration_mean0.1854480450803583
complete-iteration_median0.1854480450803583
complete-iteration_min0.1854480450803583
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.46033809610609455
driven_any_mean0.46033809610609455
driven_any_median0.46033809610609455
driven_any_min0.46033809610609455
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.01007644696669145
get_duckie_state_mean0.01007644696669145
get_duckie_state_median0.01007644696669145
get_duckie_state_min0.01007644696669145
get_robot_state_max0.008735131133686413
get_robot_state_mean0.008735131133686413
get_robot_state_median0.008735131133686413
get_robot_state_min0.008735131133686413
get_state_dump_max0.01121729612350464
get_state_dump_mean0.01121729612350464
get_state_dump_median0.01121729612350464
get_state_dump_min0.01121729612350464
get_ui_image_max0.0259324312210083
get_ui_image_mean0.0259324312210083
get_ui_image_median0.0259324312210083
get_ui_image_min0.0259324312210083
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.46033809610609455, "get_ui_image": 0.0259324312210083, "step_physics": 0.08047867905009877, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.01121729612350464, "get_robot_state": 0.008735131133686413, "sim_render-ego0": 0.008505517786199396, "get_duckie_state": 0.01007644696669145, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.020560633052479137, "complete-iteration": 0.1854480450803583, "set_robot_commands": 0.0038342367519031873, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.01097526333548806, "sim_compute_performance-ego0": 0.004966725002635609}}
set_robot_commands_max0.0038342367519031873
set_robot_commands_mean0.0038342367519031873
set_robot_commands_median0.0038342367519031873
set_robot_commands_min0.0038342367519031873
sim_compute_performance-ego0_max0.004966725002635609
sim_compute_performance-ego0_mean0.004966725002635609
sim_compute_performance-ego0_median0.004966725002635609
sim_compute_performance-ego0_min0.004966725002635609
sim_compute_sim_state_max0.01097526333548806
sim_compute_sim_state_mean0.01097526333548806
sim_compute_sim_state_median0.01097526333548806
sim_compute_sim_state_min0.01097526333548806
sim_render-ego0_max0.008505517786199396
sim_render-ego0_mean0.008505517786199396
sim_render-ego0_median0.008505517786199396
sim_render-ego0_min0.008505517786199396
simulation-passed1
step_physics_max0.08047867905009877
step_physics_mean0.08047867905009877
step_physics_median0.08047867905009877
step_physics_min0.08047867905009877
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible