Duckietown Challenges Home Challenges Submissions

Evaluator 2301

ID2301
evaluatorreg02-1207a943d4bb-1
ownerI don't have one 😀
machineChudeQian-Sager-Duckietown
processreg02-1207a943d4bb-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success2 42389
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4241211446Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-1207a943d4bb-10:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.775385129358667
survival_time_median14.950000000000076
deviation-center-line_median0.5411180486726401
in-drivable-lane_median2.2000000000000313


other stats
agent_compute-ego_max0.01237980365753174
agent_compute-ego_mean0.012184991041819256
agent_compute-ego_median0.012201869487762453
agent_compute-ego_min0.011956421534220378
complete-iteration_max0.15204340855280557
complete-iteration_mean0.14864414850870766
complete-iteration_median0.14907366593678792
complete-iteration_min0.1443858536084493
deviation-center-line_max0.803008320509106
deviation-center-line_mean0.5262956931658999
deviation-center-line_min0.21993835480921303
deviation-heading_max3.081967968297965
deviation-heading_mean2.283791707234111
deviation-heading_median2.101392477563099
deviation-heading_min1.8504139055122797
driven_any_max3.545518665464815
driven_any_mean3.156629046881815
driven_any_median3.125500094126832
driven_any_min2.829997333808781
driven_lanedir_consec_max3.493811444406898
driven_lanedir_consec_mean2.46039077065668
driven_lanedir_consec_min0.7969813795024909
driven_lanedir_max3.493811444406898
driven_lanedir_mean2.4613066705412647
driven_lanedir_median2.7772169291278352
driven_lanedir_min0.7969813795024909
get_duckie_state_max1.0569890340169271e-06
get_duckie_state_mean1.014868418375651e-06
get_duckie_state_median1.0136763254801433e-06
get_duckie_state_min9.751319885253906e-07
get_robot_state_max0.009564629395802816
get_robot_state_mean0.009459152817726135
get_robot_state_median0.009436428944269815
get_robot_state_min0.009399123986562091
get_state_dump_max0.008642223676045736
get_state_dump_mean0.008307828108469646
get_state_dump_median0.00820077141125997
get_state_dump_min0.008187545935312906
get_ui_image_max0.02454920530319214
get_ui_image_mean0.023928681015968324
get_ui_image_median0.02375384291013082
get_ui_image_min0.023657832940419513
in-drivable-lane_max11.00000000000006
in-drivable-lane_mean3.8500000000000303
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2557818394025615, "get_ui_image": 0.023657832940419513, "step_physics": 0.06175198554992676, "survival_time": 14.950000000000076, "driven_lanedir": 3.1114664010471444, "get_state_dump": 0.008642223676045736, "sim_render-ego": 0.004561471144358317, "get_robot_state": 0.009564629395802816, "get_duckie_state": 1.0569890340169271e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.012266715367635092, "deviation-heading": 3.081967968297965, "complete-iteration": 0.14708354234695434, "set_robot_commands": 0.00369809627532959, "deviation-center-line": 0.803008320509106, "driven_lanedir_consec": 3.1114664010471444, "sim_compute_sim_state": 0.019799753030141195, "sim_compute_performance-ego": 0.0030510576566060385}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.545518665464815, "get_ui_image": 0.02380848566691081, "step_physics": 0.06032681465148926, "survival_time": 14.950000000000076, "driven_lanedir": 3.493811444406898, "get_state_dump": 0.008196798165639242, "sim_render-ego": 0.004550649325052897, "get_robot_state": 0.009399123986562091, "get_duckie_state": 1.0434786478678386e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01237980365753174, "deviation-heading": 2.1184187987714735, "complete-iteration": 0.1443858536084493, "set_robot_commands": 0.0036897929509480793, "deviation-center-line": 0.5600155775921044, "driven_lanedir_consec": 3.493811444406898, "sim_compute_sim_state": 0.01892857472101847, "sim_compute_performance-ego": 0.003024800618489583}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.829997333808781, "get_ui_image": 0.02454920530319214, "step_physics": 0.06620795726776123, "survival_time": 14.950000000000076, "driven_lanedir": 0.7969813795024909, "get_state_dump": 0.008204744656880697, "sim_render-ego": 0.0045977147420247395, "get_robot_state": 0.00944894552230835, "get_duckie_state": 9.751319885253906e-07, "in-drivable-lane": 11.00000000000006, "agent_compute-ego": 0.012137023607889812, "deviation-heading": 1.8504139055122797, "complete-iteration": 0.1510637895266215, "set_robot_commands": 0.003573463757832845, "deviation-center-line": 0.21993835480921303, "driven_lanedir_consec": 0.7969813795024909, "sim_compute_sim_state": 0.019273719787597655, "sim_compute_performance-ego": 0.0029891443252563475}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.995218348851102, "get_ui_image": 0.02369920015335083, "step_physics": 0.0655646014213562, "survival_time": 14.950000000000076, "driven_lanedir": 2.4429674572085265, "get_state_dump": 0.008187545935312906, "sim_render-ego": 0.004448328812917074, "get_robot_state": 0.009423912366231284, "get_duckie_state": 9.83874003092448e-07, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.011956421534220378, "deviation-heading": 2.084366156354725, "complete-iteration": 0.15204340855280557, "set_robot_commands": 0.003639846642812093, "deviation-center-line": 0.5222205197531758, "driven_lanedir_consec": 2.439303857670189, "sim_compute_sim_state": 0.022098116874694824, "sim_compute_performance-ego": 0.00294261376063029}}
set_robot_commands_max0.00369809627532959
set_robot_commands_mean0.003650299906730651
set_robot_commands_median0.003664819796880086
set_robot_commands_min0.003573463757832845
sim_compute_performance-ego_max0.0030510576566060385
sim_compute_performance-ego_mean0.0030019040902455646
sim_compute_performance-ego_median0.0030069724718729653
sim_compute_performance-ego_min0.00294261376063029
sim_compute_sim_state_max0.022098116874694824
sim_compute_sim_state_mean0.020025041103363037
sim_compute_sim_state_median0.019536736408869423
sim_compute_sim_state_min0.01892857472101847
sim_render-ego_max0.0045977147420247395
sim_render-ego_mean0.004539541006088257
sim_render-ego_median0.004556060234705607
sim_render-ego_min0.004448328812917074
simulation-passed1
step_physics_max0.06620795726776123
step_physics_mean0.06346283972263336
step_physics_median0.06365829348564148
step_physics_min0.06032681465148926
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4238911442Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-1207a943d4bb-10:08:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8062367438446416
survival_time_median14.950000000000076
deviation-center-line_median0.5056901181234303
in-drivable-lane_median2.0750000000000295


other stats
agent_compute-ego_max0.015075870354970296
agent_compute-ego_mean0.014226557413736978
agent_compute-ego_median0.014273823102315264
agent_compute-ego_min0.013282713095347086
complete-iteration_max0.18668183036472483
complete-iteration_mean0.17791808135267617
complete-iteration_median0.1805424165725708
complete-iteration_min0.16390566190083822
deviation-center-line_max0.7771089391098717
deviation-center-line_mean0.5542900234124849
deviation-center-line_min0.42867091829320697
deviation-heading_max4.403412123529586
deviation-heading_mean2.468528181622493
deviation-heading_median2.035771292111904
deviation-heading_min1.3991580187365775
driven_any_max3.653719872841653
driven_any_mean3.177838777685711
driven_any_median3.1649479087371466
driven_any_min2.7277394204268974
driven_lanedir_consec_max3.620407352407192
driven_lanedir_consec_mean2.6173781327196313
driven_lanedir_consec_min1.2366316907820492
driven_lanedir_max3.620407352407192
driven_lanedir_mean2.6173781327196313
driven_lanedir_median2.8062367438446416
driven_lanedir_min1.2366316907820492
get_duckie_state_max1.4432271321614584e-06
get_duckie_state_mean1.3811519180518997e-06
get_duckie_state_median1.3778866201207258e-06
get_duckie_state_min1.3256072998046874e-06
get_robot_state_max0.011192778746287027
get_robot_state_mean0.010912123503892318
get_robot_state_median0.010954940284507862
get_robot_state_min0.01054583470026652
get_state_dump_max0.009592993259429932
get_state_dump_mean0.009344027854394222
get_state_dump_median0.00935299519179524
get_state_dump_min0.009077127774556475
get_ui_image_max0.031120028495788574
get_ui_image_mean0.02966550316499627
get_ui_image_median0.030204177818436553
get_ui_image_min0.027133628527323404
in-drivable-lane_max6.650000000000007
in-drivable-lane_mean2.700000000000016
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.4039108082177645, "get_ui_image": 0.027133628527323404, "step_physics": 0.06967896143595377, "survival_time": 14.950000000000076, "driven_lanedir": 3.1792595399258854, "get_state_dump": 0.009077127774556475, "sim_render-ego": 0.005058014392852783, "get_robot_state": 0.01054583470026652, "get_duckie_state": 1.3256072998046874e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.013282713095347086, "deviation-heading": 2.396687588614215, "complete-iteration": 0.16390566190083822, "set_robot_commands": 0.004150252342224121, "deviation-center-line": 0.7771089391098717, "driven_lanedir_consec": 3.1792595399258854, "sim_compute_sim_state": 0.021557440757751463, "sim_compute_performance-ego": 0.003328265349070231}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.653719872841653, "get_ui_image": 0.031120028495788574, "step_physics": 0.07508191426595053, "survival_time": 14.950000000000076, "driven_lanedir": 3.620407352407192, "get_state_dump": 0.009491488933563231, "sim_render-ego": 0.005322813193003336, "get_robot_state": 0.011192778746287027, "get_duckie_state": 1.4432271321614584e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.014236471652984618, "deviation-heading": 1.674854995609593, "complete-iteration": 0.17637404203414916, "set_robot_commands": 0.004398648738861084, "deviation-center-line": 0.4322696191261103, "driven_lanedir_consec": 3.620407352407192, "sim_compute_sim_state": 0.021888591448465985, "sim_compute_performance-ego": 0.0035396575927734374}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7277394204268974, "get_ui_image": 0.030062207380930583, "step_physics": 0.08251612981160482, "survival_time": 14.950000000000076, "driven_lanedir": 1.2366316907820492, "get_state_dump": 0.009592993259429932, "sim_render-ego": 0.005494858423868815, "get_robot_state": 0.011123805046081544, "get_duckie_state": 1.3891855875651045e-06, "in-drivable-lane": 6.650000000000007, "agent_compute-ego": 0.015075870354970296, "deviation-heading": 4.403412123529586, "complete-iteration": 0.1847107911109924, "set_robot_commands": 0.004817626476287842, "deviation-center-line": 0.5791106171207505, "driven_lanedir_consec": 1.2366316907820492, "sim_compute_sim_state": 0.022273232936859132, "sim_compute_performance-ego": 0.0036474370956420896}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9259850092565287, "get_ui_image": 0.030346148255942524, "step_physics": 0.08350998854291612, "survival_time": 13.80000000000006, "driven_lanedir": 2.433213947763398, "get_state_dump": 0.009214501450027245, "sim_render-ego": 0.0052634702212568645, "get_robot_state": 0.01078607552293418, "get_duckie_state": 1.3665876526763474e-06, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.014311174551645914, "deviation-heading": 1.3991580187365775, "complete-iteration": 0.18668183036472483, "set_robot_commands": 0.004563470681508382, "deviation-center-line": 0.42867091829320697, "driven_lanedir_consec": 2.433213947763398, "sim_compute_sim_state": 0.025102299192677372, "sim_compute_performance-ego": 0.0034823460855345793}}
set_robot_commands_max0.004817626476287842
set_robot_commands_mean0.004482499559720357
set_robot_commands_median0.004481059710184733
set_robot_commands_min0.004150252342224121
sim_compute_performance-ego_max0.0036474370956420896
sim_compute_performance-ego_mean0.0034994265307550848
sim_compute_performance-ego_median0.003511001839154008
sim_compute_performance-ego_min0.003328265349070231
sim_compute_sim_state_max0.025102299192677372
sim_compute_sim_state_mean0.022705391083938486
sim_compute_sim_state_median0.022080912192662557
sim_compute_sim_state_min0.021557440757751463
sim_render-ego_max0.005494858423868815
sim_render-ego_mean0.005284789057745451
sim_render-ego_median0.0052931417071301005
sim_render-ego_min0.005058014392852783
simulation-passed1
step_physics_max0.08350998854291612
step_physics_mean0.07769674851410631
step_physics_median0.07879902203877767
step_physics_min0.06967896143595377
survival_time_max14.950000000000076
survival_time_mean14.662500000000074
survival_time_min13.80000000000006
No reset possible