Duckietown Challenges Home Challenges Submissions

Evaluator 2016

ID2016
evaluatorreg04-cdd7667d8062-1
ownerI don't have one 😀
machinearchimede
processreg04-cdd7667d8062-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34895
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348959373Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg04-cdd7667d8062-10:13:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6307094986095041
survival_time_median8.374999999999984
deviation-center-line_median0.22777608540000271
in-drivable-lane_median3.500000000000032


other stats
agent_compute-ego_max0.02861133927390689
agent_compute-ego_mean0.02702730850661202
agent_compute-ego_median0.027142441448043373
agent_compute-ego_min0.024936123026741877
complete-iteration_max0.2745595746121164
complete-iteration_mean0.2641432083366214
complete-iteration_median0.2643343042417836
complete-iteration_min0.2514849536948734
deviation-center-line_max0.4897421930144883
deviation-center-line_mean0.2809838401589796
deviation-center-line_min0.0907295495241662
deviation-heading_max1.411993874805973
deviation-heading_mean0.625707941128054
deviation-heading_median0.47031223390133103
deviation-heading_min0.3691216776849934
driven_any_max2.85430048120387
driven_any_mean1.8983933262337336
driven_any_median2.239684033671963
driven_any_min0.7299121144570085
driven_lanedir_consec_max1.7765945309447713
driven_lanedir_consec_mean0.9144119656488628
driven_lanedir_consec_min0.45190290746045303
driven_lanedir_max1.7765945309447713
driven_lanedir_mean0.9144119656488628
driven_lanedir_median0.6307094986095041
driven_lanedir_min0.45190290746045303
get_state_dump_max0.018509277275630405
get_state_dump_mean0.017461752627566236
get_state_dump_median0.017436444199183866
get_state_dump_min0.016758246554268733
get_ui_image_max0.051833274000782074
get_ui_image_mean0.04981044892017398
get_ui_image_median0.049840492652911766
get_ui_image_min0.04753721770593675
in-drivable-lane_max7.5000000000000115
in-drivable-lane_mean3.410000000000005
in-drivable-lane_min0.9499999999999966
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.240022122546936, "get_ui_image": 0.05007140835126241, "step_physics": 0.11038250440642948, "survival_time": 8.399999999999984, "driven_lanedir": 1.2140757282365449, "get_state_dump": 0.018509277275630405, "sim_render-ego": 0.00910666443052746, "in-drivable-lane": 3.6499999999999937, "agent_compute-ego": 0.02861133927390689, "deviation-heading": 0.39983224412744456, "complete-iteration": 0.27283629065468196, "set_robot_commands": 0.007078632002785092, "deviation-center-line": 0.42552031561630094, "driven_lanedir_consec": 1.2140757282365449, "sim_compute_sim_state": 0.02010482123919896, "sim_compute_performance-ego": 0.006461381912231445, "sim_compute_robot_state-ego": 0.01163904865582784, "sim_compute_robot_state-parked0": 0.010636715661911735}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.239345944796991, "get_ui_image": 0.05007903732939395, "step_physics": 0.1050631414630456, "survival_time": 8.349999999999984, "driven_lanedir": 1.213432903511722, "get_state_dump": 0.017611256616558144, "sim_render-ego": 0.008519072732525671, "in-drivable-lane": 3.649999999999992, "agent_compute-ego": 0.026218708403810055, "deviation-heading": 0.3939231926132936, "complete-iteration": 0.2620641214404991, "set_robot_commands": 0.006898113353523665, "deviation-center-line": 0.42440057577468504, "driven_lanedir_consec": 1.213432903511722, "sim_compute_sim_state": 0.020434897816823627, "sim_compute_performance-ego": 0.006114165939970644, "sim_compute_robot_state-ego": 0.010522162842893316, "sim_compute_robot_state-parked0": 0.010374293355884669}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7299121144570085, "get_ui_image": 0.051833274000782074, "step_physics": 0.11554324828972252, "survival_time": 2.9499999999999975, "driven_lanedir": 0.45190290746045303, "get_state_dump": 0.017460293689016568, "sim_render-ego": 0.009149026062528966, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.026498006562055167, "deviation-heading": 0.47031223390133103, "complete-iteration": 0.2745595746121164, "set_robot_commands": 0.007478907956915386, "deviation-center-line": 0.171710927160748, "driven_lanedir_consec": 0.45190290746045303, "sim_compute_sim_state": 0.017572140289565264, "sim_compute_performance-ego": 0.006384429285081767, "sim_compute_robot_state-ego": 0.011255914882078008, "sim_compute_robot_state-parked0": 0.011129742961818888}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.7299121144570085, "get_ui_image": 0.04753721770593675, "step_physics": 0.11145984520346432, "survival_time": 2.9499999999999975, "driven_lanedir": 0.45190290746045303, "get_state_dump": 0.018145213692875233, "sim_render-ego": 0.009351625280865168, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.02671830532914501, "deviation-heading": 0.47031223390133103, "complete-iteration": 0.2673879599167129, "set_robot_commands": 0.007595623953867767, "deviation-center-line": 0.171710927160748, "driven_lanedir_consec": 0.45190290746045303, "sim_compute_sim_state": 0.018103538933446853, "sim_compute_performance-ego": 0.006232807191751771, "sim_compute_robot_state-ego": 0.011324878466331352, "sim_compute_robot_state-parked0": 0.01067982689808991}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.7564668049573218, "get_ui_image": 0.04960957695456112, "step_physics": 0.10489062935698266, "survival_time": 10.20000000000001, "driven_lanedir": 0.6307094986095041, "get_state_dump": 0.017206391867469337, "sim_render-ego": 0.00869447343489703, "in-drivable-lane": 7.5000000000000115, "agent_compute-ego": 0.027767616159775677, "deviation-heading": 0.48023420087760293, "complete-iteration": 0.25752859606462364, "set_robot_commands": 0.0071107920478372015, "deviation-center-line": 0.0907295495241662, "driven_lanedir_consec": 0.6307094986095041, "sim_compute_sim_state": 0.01437544355205461, "sim_compute_performance-ego": 0.006097441794825536, "sim_compute_robot_state-ego": 0.010829951248916924, "sim_compute_robot_state-parked0": 0.010723449435888552}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.7564668049573218, "get_ui_image": 0.051319274247861375, "step_physics": 0.11037280279047348, "survival_time": 10.20000000000001, "driven_lanedir": 0.6307094986095041, "get_state_dump": 0.01695699551526238, "sim_render-ego": 0.008733134643704283, "in-drivable-lane": 7.5000000000000115, "agent_compute-ego": 0.0274086220591676, "deviation-heading": 0.48023420087760293, "complete-iteration": 0.26340683184418023, "set_robot_commands": 0.006719768047332764, "deviation-center-line": 0.0907295495241662, "driven_lanedir_consec": 0.6307094986095041, "sim_compute_sim_state": 0.014746554926329968, "sim_compute_performance-ego": 0.005996292712641698, "sim_compute_robot_state-ego": 0.010496596495310463, "sim_compute_robot_state-parked0": 0.010419904016980938}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.85430048120387, "get_ui_image": 0.0485960318578928, "step_physics": 0.10946180809165627, "survival_time": 10.550000000000017, "driven_lanedir": 1.7765945309447713, "get_state_dump": 0.017043110318658475, "sim_render-ego": 0.008661171836310653, "in-drivable-lane": 3.500000000000032, "agent_compute-ego": 0.02761131666282907, "deviation-heading": 1.411993874805973, "complete-iteration": 0.26526177663938694, "set_robot_commands": 0.006918556882306863, "deviation-center-line": 0.4897421930144883, "driven_lanedir_consec": 1.7765945309447713, "sim_compute_sim_state": 0.019542242113447867, "sim_compute_performance-ego": 0.00603102959727789, "sim_compute_robot_state-ego": 0.010740495971028838, "sim_compute_robot_state-parked0": 0.010422319032569632}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.85430048120387, "get_ui_image": 0.04891586529700112, "step_physics": 0.11372359330055272, "survival_time": 10.550000000000017, "driven_lanedir": 1.7765945309447713, "get_state_dump": 0.017412594709351165, "sim_render-ego": 0.008950691087551027, "in-drivable-lane": 3.500000000000032, "agent_compute-ego": 0.02762678675176973, "deviation-heading": 1.411993874805973, "complete-iteration": 0.2715068541431879, "set_robot_commands": 0.006924155764105195, "deviation-center-line": 0.4897421930144883, "driven_lanedir_consec": 1.7765945309447713, "sim_compute_sim_state": 0.01945024079056148, "sim_compute_performance-ego": 0.006364863065746723, "sim_compute_robot_state-ego": 0.011264365996229705, "sim_compute_robot_state-parked0": 0.010641581639294377}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.9116031968785048, "get_ui_image": 0.051492416196399264, "step_physics": 0.10361012154155308, "survival_time": 3.599999999999995, "driven_lanedir": 0.49909857535545177, "get_state_dump": 0.016758246554268733, "sim_render-ego": 0.008421583308113946, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.024936123026741877, "deviation-heading": 0.3691216776849934, "complete-iteration": 0.25539512435595196, "set_robot_commands": 0.006973389122221205, "deviation-center-line": 0.22777608540000271, "driven_lanedir_consec": 0.49909857535545177, "sim_compute_sim_state": 0.01628978384865655, "sim_compute_performance-ego": 0.0057841042677561445, "sim_compute_robot_state-ego": 0.010496159394582111, "sim_compute_robot_state-parked0": 0.01041251089837816}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9116031968785048, "get_ui_image": 0.048650387260648936, "step_physics": 0.09857570462756687, "survival_time": 3.599999999999995, "driven_lanedir": 0.49909857535545177, "get_state_dump": 0.017514146036571927, "sim_render-ego": 0.008722712596257528, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.026876260836919148, "deviation-heading": 0.3691216776849934, "complete-iteration": 0.2514849536948734, "set_robot_commands": 0.006913999716440837, "deviation-center-line": 0.22777608540000271, "driven_lanedir_consec": 0.49909857535545177, "sim_compute_sim_state": 0.015998237662845187, "sim_compute_performance-ego": 0.006257702906926473, "sim_compute_robot_state-ego": 0.010972115728590224, "sim_compute_robot_state-parked0": 0.010766257842381796}}
set_robot_commands_max0.007595623953867767
set_robot_commands_mean0.0070611938847335975
set_robot_commands_median0.0069487724431632
set_robot_commands_min0.006719768047332764
sim_compute_performance-ego_max0.006461381912231445
sim_compute_performance-ego_mean0.006172421867421009
sim_compute_performance-ego_median0.0061734865658612074
sim_compute_performance-ego_min0.0057841042677561445
sim_compute_robot_state-ego_max0.01163904865582784
sim_compute_robot_state-ego_mean0.010954168968178878
sim_compute_robot_state-ego_median0.010901033488753572
sim_compute_robot_state-ego_min0.010496159394582111
sim_compute_robot_state-parked0_max0.011129742961818888
sim_compute_robot_state-parked0_mean0.010620660174319865
sim_compute_robot_state-parked0_median0.010639148650603057
sim_compute_robot_state-parked0_min0.010374293355884669
sim_compute_sim_state_max0.020434897816823627
sim_compute_sim_state_mean0.017661790117293037
sim_compute_sim_state_median0.01783783961150606
sim_compute_sim_state_min0.01437544355205461
sim_render-ego_max0.009351625280865168
sim_render-ego_mean0.008831015541328171
sim_render-ego_median0.008727923619980905
sim_render-ego_min0.008421583308113946
simulation-passed1
step_physics_max0.11554324828972252
step_physics_mean0.10830833990714468
step_physics_median0.10991730544106489
step_physics_min0.09857570462756687
survival_time_max10.550000000000017
survival_time_mean7.135
survival_time_min2.9499999999999975
No reset possible