Duckietown Challenges Home Challenges Submissions

Evaluator 2005

ID2005
evaluatorreg07-09b15723f292-1
ownerI don't have one 😀
machinearchimede
processreg07-09b15723f292-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34884
# timeout1 34887
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348879382Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simtimeoutnoreg07-09b15723f292-11:05:27
I can see how the jo [...]
I can see how the job 34887 is timeout because passed 3927 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
348849388Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg07-09b15723f292-10:23:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6436239418394042
survival_time_median10.675000000000017
deviation-center-line_median0.3900788501428524
in-drivable-lane_median2.0999999999999925


other stats
agent_compute-ego_max0.06631002267201741
agent_compute-ego_mean0.04344278579187268
agent_compute-ego_median0.03345536828041076
agent_compute-ego_min0.02810693750477801
complete-iteration_max0.37317767858505246
complete-iteration_mean0.34334999193317217
complete-iteration_median0.34663493573768717
complete-iteration_min0.2920770596976232
deviation-center-line_max0.6869559943152134
deviation-center-line_mean0.39844168060017304
deviation-center-line_min0.1692817983275666
deviation-heading_max1.369319665560359
deviation-heading_mean0.933302885703239
deviation-heading_median0.8473509256010923
deviation-heading_min0.6742771920163947
driven_any_max2.0421048768821297
driven_any_mean1.383857774325744
driven_any_median1.4412955945304446
driven_any_min0.6444808610745287
driven_lanedir_consec_max1.9657386071104328
driven_lanedir_consec_mean0.8822820411729909
driven_lanedir_consec_min0.4146278967393662
driven_lanedir_max1.9657386071104328
driven_lanedir_mean0.8822820411729909
driven_lanedir_median0.6436239418394042
driven_lanedir_min0.4146278967393662
get_state_dump_max0.01721314468769112
get_state_dump_mean0.016630596804358976
get_state_dump_median0.01661759297053019
get_state_dump_min0.016231141592326918
get_ui_image_max0.07880345348999879
get_ui_image_mean0.06925631107237261
get_ui_image_median0.06869741251594141
get_ui_image_min0.06123886686382872
in-drivable-lane_max9.750000000000089
in-drivable-lane_mean3.450000000000023
in-drivable-lane_min0.30000000000000426
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.4414646389762482, "get_ui_image": 0.07880345348999879, "step_physics": 0.16009264460233885, "survival_time": 10.700000000000015, "driven_lanedir": 0.9397573843831812, "get_state_dump": 0.016837494395603645, "sim_render-ego": 0.009240427863932102, "in-drivable-lane": 3.5500000000000345, "agent_compute-ego": 0.02981071717271181, "deviation-heading": 0.7747214366547285, "complete-iteration": 0.3516213437107122, "set_robot_commands": 0.0066869192034284645, "deviation-center-line": 0.6869559943152134, "driven_lanedir_consec": 0.9397573843831812, "sim_compute_sim_state": 0.02257432336005095, "sim_compute_performance-ego": 0.005884705302871276, "sim_compute_robot_state-ego": 0.010705240418977826, "sim_compute_robot_state-parked0": 0.010786296051239298}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.441126550084641, "get_ui_image": 0.07152719564840827, "step_physics": 0.1624682240642852, "survival_time": 10.650000000000016, "driven_lanedir": 0.9394217616470544, "get_state_dump": 0.01641482478576087, "sim_render-ego": 0.00948301503356074, "in-drivable-lane": 3.5500000000000336, "agent_compute-ego": 0.02899876446791098, "deviation-heading": 0.7693038042305695, "complete-iteration": 0.34544608850434355, "set_robot_commands": 0.0066405562727663995, "deviation-center-line": 0.6858364881924462, "driven_lanedir_consec": 0.9394217616470544, "sim_compute_sim_state": 0.02286028414265091, "sim_compute_performance-ego": 0.006154880837095735, "sim_compute_robot_state-ego": 0.0105072858747742, "sim_compute_robot_state-parked0": 0.010199085647511373}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.6444808610745287, "get_ui_image": 0.06123886686382872, "step_physics": 0.12498782861112344, "survival_time": 4.94999999999999, "driven_lanedir": 0.4146278967393662, "get_state_dump": 0.01721314468769112, "sim_render-ego": 0.00899179776509603, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.02810693750477801, "deviation-heading": 0.8473509256010923, "complete-iteration": 0.2920770596976232, "set_robot_commands": 0.006714454805008089, "deviation-center-line": 0.3044473804175064, "driven_lanedir_consec": 0.4146278967393662, "sim_compute_sim_state": 0.01802258298854635, "sim_compute_performance-ego": 0.005715769950789634, "sim_compute_robot_state-ego": 0.010672186360214697, "sim_compute_robot_state-parked0": 0.010210347898078688}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.6444808610745287, "get_ui_image": 0.07343568464722296, "step_physics": 0.1545490472003667, "survival_time": 4.94999999999999, "driven_lanedir": 0.4146278967393662, "get_state_dump": 0.016845691083657622, "sim_render-ego": 0.008881901249741062, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.0286638688559484, "deviation-heading": 0.8473509256010923, "complete-iteration": 0.3359840831371269, "set_robot_commands": 0.0066141913635562165, "deviation-center-line": 0.3044473804175064, "driven_lanedir_consec": 0.4146278967393662, "sim_compute_sim_state": 0.018926398922698668, "sim_compute_performance-ego": 0.006797624356818922, "sim_compute_robot_state-ego": 0.010544577030220418, "sim_compute_robot_state-parked0": 0.010526515016652116}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.042104876882031, "get_ui_image": 0.06631990432739258, "step_physics": 0.1443779436747233, "survival_time": 14.950000000000076, "driven_lanedir": 0.6436239418394042, "get_state_dump": 0.016631507873535158, "sim_render-ego": 0.009461082617441814, "in-drivable-lane": 9.750000000000089, "agent_compute-ego": 0.030147011280059813, "deviation-heading": 1.0035540248957011, "complete-iteration": 0.315485626856486, "set_robot_commands": 0.006780343850453695, "deviation-center-line": 0.1692817983275666, "driven_lanedir_consec": 0.6436239418394042, "sim_compute_sim_state": 0.01482856035232544, "sim_compute_performance-ego": 0.00575864315032959, "sim_compute_robot_state-ego": 0.010714582602183024, "sim_compute_robot_state-parked0": 0.010273870627085367}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.042104876882031, "get_ui_image": 0.07272856076558432, "step_physics": 0.15754260460535685, "survival_time": 14.950000000000076, "driven_lanedir": 0.6436239418394042, "get_state_dump": 0.01660367806752523, "sim_render-ego": 0.00924976905186971, "in-drivable-lane": 9.750000000000089, "agent_compute-ego": 0.03676372528076172, "deviation-heading": 1.0035540248957011, "complete-iteration": 0.34163430372873943, "set_robot_commands": 0.006487011114756266, "deviation-center-line": 0.1692817983275666, "driven_lanedir_consec": 0.6436239418394042, "sim_compute_sim_state": 0.015612833499908448, "sim_compute_performance-ego": 0.005940790971120199, "sim_compute_robot_state-ego": 0.010433700879414877, "sim_compute_robot_state-parked0": 0.01008400519688924}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.0421048768821297, "get_ui_image": 0.06884689648946127, "step_physics": 0.15907616138458253, "survival_time": 14.950000000000076, "driven_lanedir": 1.9657386071104328, "get_state_dump": 0.016283499399820964, "sim_render-ego": 0.008854350248972576, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.06631002267201741, "deviation-heading": 1.369319665560359, "complete-iteration": 0.37317767858505246, "set_robot_commands": 0.0065012939771016435, "deviation-center-line": 0.44200413285911, "driven_lanedir_consec": 1.9657386071104328, "sim_compute_sim_state": 0.020268375873565673, "sim_compute_performance-ego": 0.006213261286417643, "sim_compute_robot_state-ego": 0.010555675824483236, "sim_compute_robot_state-parked0": 0.010063767433166504}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.0421048768821297, "get_ui_image": 0.06665141026178996, "step_physics": 0.15974766492843628, "survival_time": 14.950000000000076, "driven_lanedir": 1.9657386071104328, "get_state_dump": 0.016485542456309, "sim_render-ego": 0.00945967435836792, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.06599814494450887, "deviation-heading": 1.369319665560359, "complete-iteration": 0.372916107972463, "set_robot_commands": 0.006265014012654622, "deviation-center-line": 0.44200413285911, "driven_lanedir_consec": 1.9657386071104328, "sim_compute_sim_state": 0.02048304080963135, "sim_compute_performance-ego": 0.006169991493225098, "sim_compute_robot_state-ego": 0.010936892032623291, "sim_compute_robot_state-parked0": 0.010477471351623534}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.7493026622595864, "get_ui_image": 0.06446320968761779, "step_physics": 0.14835619926452637, "survival_time": 5.699999999999988, "driven_lanedir": 0.44783018716063294, "get_state_dump": 0.016231141592326918, "sim_render-ego": 0.008958835350839715, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.06033483931892797, "deviation-heading": 0.6742771920163947, "complete-iteration": 0.3478237829710308, "set_robot_commands": 0.0063741792712295265, "deviation-center-line": 0.3900788501428524, "driven_lanedir_consec": 0.44783018716063294, "sim_compute_sim_state": 0.016666496009157414, "sim_compute_performance-ego": 0.006101300841883609, "sim_compute_robot_state-ego": 0.010487462344922515, "sim_compute_robot_state-parked0": 0.009608829230592962}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.7493026622595864, "get_ui_image": 0.06854792854242157, "step_physics": 0.15429688545695522, "survival_time": 5.699999999999988, "driven_lanedir": 0.44783018716063294, "get_state_dump": 0.016759443701359265, "sim_render-ego": 0.008397844799777917, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.05929382642110189, "deviation-heading": 0.6742771920163947, "complete-iteration": 0.35733384416814434, "set_robot_commands": 0.006513457549245734, "deviation-center-line": 0.3900788501428524, "driven_lanedir_consec": 0.44783018716063294, "sim_compute_sim_state": 0.016901836060641103, "sim_compute_performance-ego": 0.0063071167259885555, "sim_compute_robot_state-ego": 0.0102662768280297, "sim_compute_robot_state-parked0": 0.009851522612989995}}
set_robot_commands_max0.006780343850453695
set_robot_commands_mean0.006557742142020066
set_robot_commands_median0.006563824456400975
set_robot_commands_min0.006265014012654622
sim_compute_performance-ego_max0.006797624356818922
sim_compute_performance-ego_mean0.006104408491654027
sim_compute_performance-ego_median0.006128090839489672
sim_compute_performance-ego_min0.005715769950789634
sim_compute_robot_state-ego_max0.010936892032623291
sim_compute_robot_state-ego_mean0.010582388019584376
sim_compute_robot_state-ego_median0.010550126427351827
sim_compute_robot_state-ego_min0.0102662768280297
sim_compute_robot_state-parked0_max0.010786296051239298
sim_compute_robot_state-parked0_mean0.010208171106582908
sim_compute_robot_state-parked0_median0.010204716772795028
sim_compute_robot_state-parked0_min0.009608829230592962
sim_compute_sim_state_max0.02286028414265091
sim_compute_sim_state_mean0.01871447320191763
sim_compute_sim_state_median0.018474490955622508
sim_compute_sim_state_min0.01482856035232544
sim_render-ego_max0.00948301503356074
sim_render-ego_mean0.009097869833959958
sim_render-ego_median0.009116112814514066
sim_render-ego_min0.008397844799777917
simulation-passed1
step_physics_max0.1624682240642852
step_physics_mean0.15254952037926947
step_physics_median0.15604582590286176
step_physics_min0.12498782861112344
survival_time_max14.950000000000076
survival_time_mean10.24500000000003
survival_time_min4.94999999999999
No reset possible