Duckietown Challenges Home Challenges Submissions

Evaluator 2017

ID2017
evaluatorreg03-68c9ae071294-1
ownerI don't have one 😀
machinearchimede
processreg03-68c9ae071294-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34892
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348929379Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg03-68c9ae071294-10:16:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5708975450509437
survival_time_median8.74999999999999
deviation-center-line_median0.26748585823113147
in-drivable-lane_median1.0250000000000132


other stats
agent_compute-ego_max0.027929161071777345
agent_compute-ego_mean0.027045815999263804
agent_compute-ego_median0.027120622479341883
agent_compute-ego_min0.02602441210142324
complete-iteration_max0.2629364996917488
complete-iteration_mean0.25694001187184284
complete-iteration_median0.25811928673578177
complete-iteration_min0.24570531912252935
deviation-center-line_max0.7857067921644263
deviation-center-line_mean0.32550339543296775
deviation-center-line_min0.1458985579959571
deviation-heading_max3.3984938578120976
deviation-heading_mean1.5138334560996358
deviation-heading_median1.3794695618936412
deviation-heading_min0.6534271626152738
driven_any_max2.697807841521587
driven_any_mean1.9809702989610305
driven_any_median2.099244010275325
driven_any_min0.6046438985145202
driven_lanedir_consec_max2.4644515497323813
driven_lanedir_consec_mean1.4924963037598176
driven_lanedir_consec_min0.5063672503908787
driven_lanedir_max2.4644515497323813
driven_lanedir_mean1.4924963037598176
driven_lanedir_median1.5708975450509437
driven_lanedir_min0.5063672503908787
get_state_dump_max0.017784824371337892
get_state_dump_mean0.017279466124566482
get_state_dump_median0.01732690811854357
get_state_dump_min0.01666887601216634
get_ui_image_max0.04960003564524096
get_ui_image_mean0.04735004123388326
get_ui_image_median0.04747958990766827
get_ui_image_min0.0452053238363827
in-drivable-lane_max11.950000000000074
in-drivable-lane_mean2.6050000000000115
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.446089866105439, "get_ui_image": 0.04773323440551758, "step_physics": 0.103364013671875, "survival_time": 6.249999999999986, "driven_lanedir": 1.2602178862806634, "get_state_dump": 0.017784824371337892, "sim_render-ego": 0.00871958351135254, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.027929161071777345, "deviation-heading": 1.4211162013481482, "complete-iteration": 0.2604972724914551, "set_robot_commands": 0.007014110565185547, "deviation-center-line": 0.22165402634082693, "driven_lanedir_consec": 1.2602178862806634, "sim_compute_sim_state": 0.019611684799194336, "sim_compute_performance-ego": 0.006007261276245117, "sim_compute_robot_state-ego": 0.011073238372802734, "sim_compute_robot_state-parked0": 0.01103007698059082}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.5054608581167326, "get_ui_image": 0.04960003564524096, "step_physics": 0.10965142323989276, "survival_time": 6.449999999999985, "driven_lanedir": 1.2832497514069696, "get_state_dump": 0.01666887601216634, "sim_render-ego": 0.008258991463239803, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.026169948799665586, "deviation-heading": 1.287885044566066, "complete-iteration": 0.2629364996917488, "set_robot_commands": 0.006814945575802825, "deviation-center-line": 0.2446687069771365, "driven_lanedir_consec": 1.2832497514069696, "sim_compute_sim_state": 0.0195040739783945, "sim_compute_performance-ego": 0.0056913601335629015, "sim_compute_robot_state-ego": 0.010250738424848216, "sim_compute_robot_state-parked0": 0.010116839593695116}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.1103268472434396, "get_ui_image": 0.047565405898624, "step_physics": 0.10380536980099148, "survival_time": 8.999999999999993, "driven_lanedir": 1.8872917698309537, "get_state_dump": 0.017247929837968613, "sim_render-ego": 0.00843394332461887, "in-drivable-lane": 1.100000000000013, "agent_compute-ego": 0.026362478733062744, "deviation-heading": 1.5762677049626357, "complete-iteration": 0.2564043336444431, "set_robot_commands": 0.006747889518737793, "deviation-center-line": 0.3340369783920691, "driven_lanedir_consec": 1.8872917698309537, "sim_compute_sim_state": 0.018702614307403564, "sim_compute_performance-ego": 0.0059683534834120006, "sim_compute_robot_state-ego": 0.011003949907090927, "sim_compute_robot_state-parked0": 0.010352516174316406}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.222424896464999, "get_ui_image": 0.04750666643846481, "step_physics": 0.10468724704681232, "survival_time": 9.349999999999998, "driven_lanedir": 1.929290601210381, "get_state_dump": 0.01774535204637497, "sim_render-ego": 0.008687859550516873, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.027097704576298516, "deviation-heading": 1.5098407432839145, "complete-iteration": 0.2598342398271204, "set_robot_commands": 0.007178975936563257, "deviation-center-line": 0.3604655180451421, "driven_lanedir_consec": 1.929290601210381, "sim_compute_sim_state": 0.01895311936975163, "sim_compute_performance-ego": 0.00611788576299494, "sim_compute_robot_state-ego": 0.010926868826310264, "sim_compute_robot_state-parked0": 0.01071344339911313}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.5279170695195226, "get_ui_image": 0.04765509208043416, "step_physics": 0.11307944138844808, "survival_time": 14.950000000000076, "driven_lanedir": 0.6678745171168438, "get_state_dump": 0.016984772682189942, "sim_render-ego": 0.008375316460927328, "in-drivable-lane": 11.950000000000074, "agent_compute-ego": 0.027595251401265463, "deviation-heading": 1.0851471971635498, "complete-iteration": 0.2620418349901835, "set_robot_commands": 0.0067315673828125, "deviation-center-line": 0.1458985579959571, "driven_lanedir_consec": 0.6678745171168438, "sim_compute_sim_state": 0.015032678445180258, "sim_compute_performance-ego": 0.005778352419535319, "sim_compute_robot_state-ego": 0.010447998046875, "sim_compute_robot_state-parked0": 0.010148751735687255}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.549392944386946, "get_ui_image": 0.047452513376871744, "step_physics": 0.10637903928756716, "survival_time": 14.950000000000076, "driven_lanedir": 1.1829379306495764, "get_state_dump": 0.016924602190653483, "sim_render-ego": 0.008566075960795085, "in-drivable-lane": 6.950000000000004, "agent_compute-ego": 0.027143540382385253, "deviation-heading": 3.3984938578120976, "complete-iteration": 0.25534756819407145, "set_robot_commands": 0.006673272450764974, "deviation-center-line": 0.7857067921644263, "driven_lanedir_consec": 1.1829379306495764, "sim_compute_sim_state": 0.015459974606831867, "sim_compute_performance-ego": 0.0057179641723632815, "sim_compute_robot_state-ego": 0.01052913506825765, "sim_compute_robot_state-parked0": 0.010288848876953124}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.0574775944299044, "get_ui_image": 0.046995244920253754, "step_physics": 0.10742899030447006, "survival_time": 7.99999999999998, "driven_lanedir": 1.8585453386949171, "get_state_dump": 0.017595505714416503, "sim_render-ego": 0.008602747321128845, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.027841745316982268, "deviation-heading": 1.337822922439134, "complete-iteration": 0.2610801234841347, "set_robot_commands": 0.006785421073436737, "deviation-center-line": 0.2509187408015722, "driven_lanedir_consec": 1.8585453386949171, "sim_compute_sim_state": 0.01888250410556793, "sim_compute_performance-ego": 0.005749431252479553, "sim_compute_robot_state-ego": 0.010706761479377746, "sim_compute_robot_state-parked0": 0.010273964703083038}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.0881611733072107, "get_ui_image": 0.0452053238363827, "step_physics": 0.10022407419541304, "survival_time": 8.499999999999986, "driven_lanedir": 1.884736442284611, "get_state_dump": 0.01756761214312385, "sim_render-ego": 0.008900695688584271, "in-drivable-lane": 1.150000000000004, "agent_compute-ego": 0.027319589783163633, "deviation-heading": 1.2431300546237356, "complete-iteration": 0.25502991676330566, "set_robot_commands": 0.007514245369855096, "deviation-center-line": 0.2696163767154585, "driven_lanedir_consec": 1.884736442284611, "sim_compute_sim_state": 0.019380955135121065, "sim_compute_performance-ego": 0.006169307933134191, "sim_compute_robot_state-ego": 0.011376089208266316, "sim_compute_robot_state-parked0": 0.011148559345918544}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.697807841521587, "get_ui_image": 0.04638446346994792, "step_physics": 0.09814880339152506, "survival_time": 10.450000000000014, "driven_lanedir": 2.4644515497323813, "get_state_dump": 0.017405886399118525, "sim_render-ego": 0.008681433052537544, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.026974327826614016, "deviation-heading": 1.6252036721818046, "complete-iteration": 0.2505230105094362, "set_robot_commands": 0.00691586590269536, "deviation-center-line": 0.3767129171502848, "driven_lanedir_consec": 2.4644515497323813, "sim_compute_sim_state": 0.01836516412251304, "sim_compute_performance-ego": 0.006006135894921408, "sim_compute_robot_state-ego": 0.010822111339660353, "sim_compute_robot_state-parked0": 0.010599828793101332}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.6046438985145202, "get_ui_image": 0.047402432267095, "step_physics": 0.0993350626717151, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5063672503908787, "get_state_dump": 0.016869299848314742, "sim_render-ego": 0.008705243258409098, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.02602441210142324, "deviation-heading": 0.6534271626152738, "complete-iteration": 0.24570531912252935, "set_robot_commands": 0.006609473429935079, "deviation-center-line": 0.2653553397468044, "driven_lanedir_consec": 0.5063672503908787, "sim_compute_sim_state": 0.014815709960292762, "sim_compute_performance-ego": 0.005751351235618054, "sim_compute_robot_state-ego": 0.009830515149613502, "sim_compute_robot_state-parked0": 0.010138169140882896}}
set_robot_commands_max0.007514245369855096
set_robot_commands_mean0.006898576720578917
set_robot_commands_median0.006800183324619781
set_robot_commands_min0.006609473429935079
sim_compute_performance-ego_max0.006169307933134191
sim_compute_performance-ego_mean0.005895740356426676
sim_compute_performance-ego_median0.00587335295147366
sim_compute_performance-ego_min0.0056913601335629015
sim_compute_robot_state-ego_max0.011376089208266316
sim_compute_robot_state-ego_mean0.010696740582310273
sim_compute_robot_state-ego_median0.01076443640951905
sim_compute_robot_state-ego_min0.009830515149613502
sim_compute_robot_state-parked0_max0.011148559345918544
sim_compute_robot_state-parked0_mean0.010481099874334165
sim_compute_robot_state-parked0_median0.010320682525634766
sim_compute_robot_state-parked0_min0.010116839593695116
sim_compute_sim_state_max0.019611684799194336
sim_compute_sim_state_mean0.017870847883025096
sim_compute_sim_state_median0.018792559206485746
sim_compute_sim_state_min0.014815709960292762
sim_render-ego_max0.008900695688584271
sim_render-ego_mean0.008593188959211026
sim_render-ego_median0.008642090186833195
sim_render-ego_min0.008258991463239803
simulation-passed1
step_physics_max0.11307944138844808
step_physics_mean0.10461034649987104
step_physics_median0.1042463084239019
step_physics_min0.09814880339152506
survival_time_max14.950000000000076
survival_time_mean9.145000000000008
survival_time_min3.5499999999999954
No reset possible