Duckietown Challenges Home Challenges Submissions

Evaluator 2015

ID2015
evaluatorreg02-99e0f784cfda-1
ownerI don't have one 😀
machinearchimede
processreg02-99e0f784cfda-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34894
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348949374Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg02-99e0f784cfda-10:21:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6914183769158742
survival_time_median13.02500000000005
deviation-center-line_median0.5890246485044419
in-drivable-lane_median5.275000000000054


other stats
agent_compute-ego_max0.02710170348485311
agent_compute-ego_mean0.02667960754950488
agent_compute-ego_median0.026775706325403093
agent_compute-ego_min0.02602336009343465
complete-iteration_max0.26809127887090045
complete-iteration_mean0.26100427987368285
complete-iteration_median0.2598437076467809
complete-iteration_min0.2514863520860672
deviation-center-line_max1.0582067094028451
deviation-center-line_mean0.6212956257774146
deviation-center-line_min0.28018327210947797
deviation-heading_max3.390483562593187
deviation-heading_mean2.22887694998116
deviation-heading_median2.236772239141655
deviation-heading_min1.1302350128861065
driven_any_max3.595528648142774
driven_any_mean2.832331566610347
driven_any_median2.899637562788241
driven_any_min1.787614512695526
driven_lanedir_consec_max2.4831349981625426
driven_lanedir_consec_mean1.724561831713635
driven_lanedir_consec_min1.204993384443504
driven_lanedir_max2.4831349981625426
driven_lanedir_mean1.7285746376540232
driven_lanedir_median1.7114824066178138
driven_lanedir_min1.204993384443504
get_state_dump_max0.017909513725029243
get_state_dump_mean0.017487263921809826
get_state_dump_median0.0175465951464442
get_state_dump_min0.01656311591466268
get_ui_image_max0.048823025226593014
get_ui_image_mean0.0473683695306671
get_ui_image_median0.04758223826776425
get_ui_image_min0.046085395655789216
in-drivable-lane_max7.550000000000058
in-drivable-lane_mean4.850000000000042
in-drivable-lane_min1.500000000000021
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 3.595528648142774, "get_ui_image": 0.0482058310508728, "step_physics": 0.11104571421941122, "survival_time": 14.950000000000076, "driven_lanedir": 1.7024267250740963, "get_state_dump": 0.01763265530268351, "sim_render-ego": 0.008672699133555095, "in-drivable-lane": 7.550000000000058, "agent_compute-ego": 0.026949480374654135, "deviation-heading": 2.5156151765839407, "complete-iteration": 0.26809127887090045, "set_robot_commands": 0.007079673608144124, "deviation-center-line": 0.4951959275441187, "driven_lanedir_consec": 1.7024267250740963, "sim_compute_sim_state": 0.020779226620992023, "sim_compute_performance-ego": 0.005932249228159586, "sim_compute_robot_state-ego": 0.010914569695790608, "sim_compute_robot_state-parked0": 0.01067193905512492}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.787614512695526, "get_ui_image": 0.047624904934952896, "step_physics": 0.10536240077600248, "survival_time": 8.199999999999982, "driven_lanedir": 1.3976023336211845, "get_state_dump": 0.01734962695982398, "sim_render-ego": 0.008565142387297095, "in-drivable-lane": 2.6499999999999932, "agent_compute-ego": 0.02668111644140104, "deviation-heading": 1.1905712810877611, "complete-iteration": 0.2600998587724639, "set_robot_commands": 0.00676974726886284, "deviation-center-line": 0.28018327210947797, "driven_lanedir_consec": 1.3976023336211845, "sim_compute_sim_state": 0.020195119264649185, "sim_compute_performance-ego": 0.006049020988185231, "sim_compute_robot_state-ego": 0.010709072031625888, "sim_compute_robot_state-parked0": 0.01058685343439986}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.933839067586919, "get_ui_image": 0.0475395716005756, "step_physics": 0.10419152052171768, "survival_time": 12.40000000000004, "driven_lanedir": 1.8175715448284409, "get_state_dump": 0.01756233073049976, "sim_render-ego": 0.00868475821710402, "in-drivable-lane": 4.30000000000004, "agent_compute-ego": 0.026731941969163956, "deviation-heading": 1.9579293016993693, "complete-iteration": 0.25839426248304304, "set_robot_commands": 0.006878397157115321, "deviation-center-line": 0.8398836118921132, "driven_lanedir_consec": 1.8175715448284409, "sim_compute_sim_state": 0.019170569796716014, "sim_compute_performance-ego": 0.006017007174030427, "sim_compute_robot_state-ego": 0.01112162874590966, "sim_compute_robot_state-parked0": 0.01029101014137268}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 3.3180381169387863, "get_ui_image": 0.048823025226593014, "step_physics": 0.1058462150891622, "survival_time": 14.950000000000076, "driven_lanedir": 1.6285606661984064, "get_state_dump": 0.01656311591466268, "sim_render-ego": 0.008567462762196859, "in-drivable-lane": 7.250000000000055, "agent_compute-ego": 0.02602336009343465, "deviation-heading": 2.864763841768543, "complete-iteration": 0.25958755652109783, "set_robot_commands": 0.0069693342844645186, "deviation-center-line": 0.7566244668783436, "driven_lanedir_consec": 1.6285606661984064, "sim_compute_sim_state": 0.01979291518529256, "sim_compute_performance-ego": 0.0058357890446980795, "sim_compute_robot_state-ego": 0.010494741598765057, "sim_compute_robot_state-parked0": 0.010465528964996338}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.822680358063506, "get_ui_image": 0.04773049913483225, "step_physics": 0.11482625741225022, "survival_time": 13.65000000000006, "driven_lanedir": 1.204993384443504, "get_state_dump": 0.01740547938224597, "sim_render-ego": 0.00839266584906386, "in-drivable-lane": 6.250000000000067, "agent_compute-ego": 0.02628396980928414, "deviation-heading": 3.390483562593187, "complete-iteration": 0.2642959177275717, "set_robot_commands": 0.006850012929448278, "deviation-center-line": 0.6707305762393934, "driven_lanedir_consec": 1.204993384443504, "sim_compute_sim_state": 0.01575915630047138, "sim_compute_performance-ego": 0.005889126669356238, "sim_compute_robot_state-ego": 0.01071159568898407, "sim_compute_robot_state-parked0": 0.01022068746797331}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.923479360594682, "get_ui_image": 0.04666689700550503, "step_physics": 0.10846459203296238, "survival_time": 14.40000000000007, "driven_lanedir": 1.2310413312909465, "get_state_dump": 0.017886972261799708, "sim_render-ego": 0.008803497585985396, "in-drivable-lane": 7.050000000000078, "agent_compute-ego": 0.02690954671965705, "deviation-heading": 3.106389575563632, "complete-iteration": 0.2593979487816493, "set_robot_commands": 0.006868641409609053, "deviation-center-line": 0.5329433255356693, "driven_lanedir_consec": 1.2310413312909465, "sim_compute_sim_state": 0.01631706953048706, "sim_compute_performance-ego": 0.006011783248848385, "sim_compute_robot_state-ego": 0.010809089574548934, "sim_compute_robot_state-parked0": 0.010445213152302636}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.902205917872316, "get_ui_image": 0.0464889931678772, "step_physics": 0.11009446541468304, "survival_time": 14.950000000000076, "driven_lanedir": 1.7205380881615313, "get_state_dump": 0.01771034876505534, "sim_render-ego": 0.008892563184102377, "in-drivable-lane": 6.850000000000078, "agent_compute-ego": 0.02710170348485311, "deviation-heading": 3.3238018949091246, "complete-iteration": 0.26586946566899616, "set_robot_commands": 0.007317895889282227, "deviation-center-line": 0.6451059714732147, "driven_lanedir_consec": 1.6804100287576518, "sim_compute_sim_state": 0.019871329466501872, "sim_compute_performance-ego": 0.006181039810180664, "sim_compute_robot_state-ego": 0.011180612246195477, "sim_compute_robot_state-parked0": 0.010817524592081703}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.277893730611515, "get_ui_image": 0.046085395655789216, "step_physics": 0.1108125605425992, "survival_time": 9.099999999999994, "driven_lanedir": 1.9310787840474728, "get_state_dump": 0.017909513725029243, "sim_render-ego": 0.008698678278661037, "in-drivable-lane": 1.7500000000000124, "agent_compute-ego": 0.02703791136270041, "deviation-heading": 1.2707417826769392, "complete-iteration": 0.2635452118548718, "set_robot_commands": 0.006743681299817431, "deviation-center-line": 0.4361990204699472, "driven_lanedir_consec": 1.9310787840474728, "sim_compute_sim_state": 0.01887081612597455, "sim_compute_performance-ego": 0.0060250300627488354, "sim_compute_robot_state-ego": 0.01082403057224148, "sim_compute_robot_state-parked0": 0.01032977968781859}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.897069207704166, "get_ui_image": 0.04684760769208272, "step_physics": 0.09978122015794118, "survival_time": 12.000000000000036, "driven_lanedir": 2.1687985207121065, "get_state_dump": 0.017321736613909403, "sim_render-ego": 0.0084981769323349, "in-drivable-lane": 3.3500000000000165, "agent_compute-ego": 0.026257574558258057, "deviation-heading": 1.5382380700429958, "complete-iteration": 0.2514863520860672, "set_robot_commands": 0.007015842199325562, "deviation-center-line": 0.4978833762290232, "driven_lanedir_consec": 2.1687985207121065, "sim_compute_sim_state": 0.018137827515602112, "sim_compute_performance-ego": 0.005967751145362854, "sim_compute_robot_state-ego": 0.010709428787231443, "sim_compute_robot_state-parked0": 0.01073957880338033}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 2.8649667458932826, "get_ui_image": 0.04767096983759027, "step_physics": 0.10471088739863613, "survival_time": 11.400000000000029, "driven_lanedir": 2.4831349981625426, "get_state_dump": 0.01753085956238864, "sim_render-ego": 0.008865431735390112, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.02681947068164223, "deviation-heading": 1.1302350128861065, "complete-iteration": 0.2592749459701672, "set_robot_commands": 0.007213205621953597, "deviation-center-line": 1.0582067094028451, "driven_lanedir_consec": 2.4831349981625426, "sim_compute_sim_state": 0.01812826436862611, "sim_compute_performance-ego": 0.006078688721907766, "sim_compute_robot_state-ego": 0.011144654792651795, "sim_compute_robot_state-parked0": 0.01089838513156824}}
set_robot_commands_max0.007317895889282227
set_robot_commands_mean0.006970643166802295
set_robot_commands_median0.00692386572078992
set_robot_commands_min0.006743681299817431
sim_compute_performance-ego_max0.006181039810180664
sim_compute_performance-ego_mean0.005998748609347807
sim_compute_performance-ego_median0.006014395211439406
sim_compute_performance-ego_min0.0058357890446980795
sim_compute_robot_state-ego_max0.011180612246195477
sim_compute_robot_state-ego_mean0.010861942373394442
sim_compute_robot_state-ego_median0.010816560073395206
sim_compute_robot_state-ego_min0.010494741598765057
sim_compute_robot_state-parked0_max0.01089838513156824
sim_compute_robot_state-parked0_mean0.010546650043101862
sim_compute_robot_state-parked0_median0.0105261911996981
sim_compute_robot_state-parked0_min0.01022068746797331
sim_compute_sim_state_max0.020779226620992023
sim_compute_sim_state_mean0.018702229417531288
sim_compute_sim_state_median0.01902069296134528
sim_compute_sim_state_min0.01575915630047138
sim_render-ego_max0.008892563184102377
sim_render-ego_mean0.008664107606569075
sim_render-ego_median0.008678728675329556
sim_render-ego_min0.00839266584906386
simulation-passed1
step_physics_max0.11482625741225022
step_physics_mean0.10751358335653656
step_physics_median0.10715540356106228
step_physics_min0.09978122015794118
survival_time_max14.950000000000076
survival_time_mean12.600000000000046
survival_time_min8.199999999999982
No reset possible