Duckietown Challenges Home Challenges Submissions

Evaluator 1997

ID1997
evaluatorreg02-837a84a03856-1
ownerI don't have one 😀
machinearchimede
processreg02-837a84a03856-1
versiond-c:6.1.5;d-c-r:6.0.31
first heard
last heard
statusinactive
# evaluating
# success5 34843
# timeout
# failed1 34859
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348729395Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:22:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.880575452476275
survival_time_median12.125000000000036
deviation-center-line_median0.3877032931775954
in-drivable-lane_median4.4750000000000565


other stats
agent_compute-ego_max0.0690017827351888
agent_compute-ego_mean0.05716183742482609
agent_compute-ego_median0.05615939293794477
agent_compute-ego_min0.04650650802923709
complete-iteration_max0.39696057558059694
complete-iteration_mean0.3738703576219142
complete-iteration_median0.3749428521267771
complete-iteration_min0.35009213198315015
deviation-center-line_max0.5326836711783982
deviation-center-line_mean0.38395931880025697
deviation-center-line_min0.1915282457214657
deviation-heading_max2.9130630782179123
deviation-heading_mean1.1063758843817288
deviation-heading_median0.9639839388015304
deviation-heading_min0.3342886168111522
driven_any_max3.575629978452065
driven_any_mean2.6400738506744625
driven_any_median3.0443764020823494
driven_any_min0.7064194105249092
driven_lanedir_consec_max2.449093977697487
driven_lanedir_consec_mean1.5683186096189776
driven_lanedir_consec_min0.5374548919725046
driven_lanedir_max2.449093977697487
driven_lanedir_mean1.6143838090659604
driven_lanedir_median1.880575452476275
driven_lanedir_min0.5374548919725046
get_state_dump_max0.01668969744985754
get_state_dump_mean0.016295744745153922
get_state_dump_median0.016279425079172308
get_state_dump_min0.015844078063964845
get_ui_image_max0.07453865301413615
get_ui_image_mean0.06828387767630675
get_ui_image_median0.06821986215702001
get_ui_image_min0.061547990549694405
in-drivable-lane_max9.750000000000044
in-drivable-lane_mean4.455000000000036
in-drivable-lane_min0.3999999999999986
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 3.2289209284396168, "get_ui_image": 0.06662313402915487, "step_physics": 0.1490822169245506, "survival_time": 12.25000000000004, "driven_lanedir": 2.119568953821658, "get_state_dump": 0.01610092727505431, "sim_render-ego": 0.007403247210444237, "in-drivable-lane": 4.850000000000057, "agent_compute-ego": 0.04650650802923709, "deviation-heading": 1.162085244609144, "complete-iteration": 0.35013065824703293, "set_robot_commands": 0.0065648847696732505, "deviation-center-line": 0.523912389299622, "driven_lanedir_consec": 2.119568953821658, "sim_compute_sim_state": 0.030832538799363735, "sim_compute_performance-ego": 0.006351820303469288, "sim_compute_robot_state-ego": 0.010475652071894432, "sim_compute_robot_state-parked0": 0.009963377154603296}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.0505372672773408, "get_ui_image": 0.06919871205868929, "step_physics": 0.1591469723245372, "survival_time": 3.4499999999999957, "driven_lanedir": 0.8955855345456294, "get_state_dump": 0.016467491785685223, "sim_render-ego": 0.007063986598581508, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.05435192757758541, "deviation-heading": 0.3342886168111522, "complete-iteration": 0.3660631905431333, "set_robot_commands": 0.006323828213456748, "deviation-center-line": 0.2175390147060775, "driven_lanedir_consec": 0.8955855345456294, "sim_compute_sim_state": 0.02720520461814991, "sim_compute_performance-ego": 0.006016275157099185, "sim_compute_robot_state-ego": 0.010433062263157057, "sim_compute_robot_state-parked0": 0.009645741918812628}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7064194105249092, "get_ui_image": 0.06721258596940474, "step_physics": 0.1754224560477517, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5374548919725046, "get_state_dump": 0.016327701915394177, "sim_render-ego": 0.007589604637839578, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.05508104237643155, "deviation-heading": 0.47017561134692865, "complete-iteration": 0.3833559469743209, "set_robot_commands": 0.006850285963578658, "deviation-center-line": 0.1915282457214657, "driven_lanedir_consec": 0.5374548919725046, "sim_compute_sim_state": 0.028068577159534803, "sim_compute_performance-ego": 0.006434284556995739, "sim_compute_robot_state-ego": 0.010699276490644977, "sim_compute_robot_state-parked0": 0.009468273683027788}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.950171740411731, "get_ui_image": 0.07453865301413615, "step_physics": 0.176809235674436, "survival_time": 12.200000000000038, "driven_lanedir": 1.8981097842546548, "get_state_dump": 0.015850186347961426, "sim_render-ego": 0.007447913044788798, "in-drivable-lane": 5.550000000000054, "agent_compute-ego": 0.055415136892287456, "deviation-heading": 1.0349776032533151, "complete-iteration": 0.39274122675911327, "set_robot_commands": 0.006486530186700039, "deviation-center-line": 0.3400603542208056, "driven_lanedir_consec": 1.8981097842546548, "sim_compute_sim_state": 0.030003695214380986, "sim_compute_performance-ego": 0.005862208663440141, "sim_compute_robot_state-ego": 0.0102912431857625, "sim_compute_robot_state-parked0": 0.009836192990912766}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 3.575629978452065, "get_ui_image": 0.07222459395726522, "step_physics": 0.17823811531066894, "survival_time": 14.950000000000076, "driven_lanedir": 1.3061347930468217, "get_state_dump": 0.015844078063964845, "sim_render-ego": 0.007699068387349447, "in-drivable-lane": 8.350000000000044, "agent_compute-ego": 0.0690017827351888, "deviation-heading": 2.9130630782179123, "complete-iteration": 0.39503304958343505, "set_robot_commands": 0.006361897786458333, "deviation-center-line": 0.5326836711783982, "driven_lanedir_consec": 0.8454827985769959, "sim_compute_sim_state": 0.018932581742604572, "sim_compute_performance-ego": 0.0060891326268513995, "sim_compute_robot_state-ego": 0.010572954813639323, "sim_compute_robot_state-parked0": 0.009868907928466796}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 3.1385810637529676, "get_ui_image": 0.06724101225535074, "step_physics": 0.1635510532061259, "survival_time": 14.950000000000076, "driven_lanedir": 1.098730180256026, "get_state_dump": 0.016663453578948974, "sim_render-ego": 0.007774754365285238, "in-drivable-lane": 9.750000000000044, "agent_compute-ego": 0.05988023996353149, "deviation-heading": 1.6806264086415594, "complete-iteration": 0.3702717645963033, "set_robot_commands": 0.006520971457163493, "deviation-center-line": 0.3158606901670005, "driven_lanedir_consec": 1.098730180256026, "sim_compute_sim_state": 0.022304362456003823, "sim_compute_performance-ego": 0.005846169789632162, "sim_compute_robot_state-ego": 0.010357270240783692, "sim_compute_robot_state-parked0": 0.009934346675872802}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.84104816902282, "get_ui_image": 0.061547990549694405, "step_physics": 0.14948046613823285, "survival_time": 8.79999999999999, "driven_lanedir": 1.8630411206978952, "get_state_dump": 0.01668969744985754, "sim_render-ego": 0.007308930158615112, "in-drivable-lane": 2.950000000000003, "agent_compute-ego": 0.056049937551671807, "deviation-heading": 0.6525509366734251, "complete-iteration": 0.35009213198315015, "set_robot_commands": 0.006453106349164789, "deviation-center-line": 0.2957444543971955, "driven_lanedir_consec": 1.8630411206978952, "sim_compute_sim_state": 0.026273835789073597, "sim_compute_performance-ego": 0.005837559700012207, "sim_compute_robot_state-ego": 0.010104557329958136, "sim_compute_robot_state-parked0": 0.01013869589025324}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 3.2405300351258957, "get_ui_image": 0.07135739008585612, "step_physics": 0.17546314716339112, "survival_time": 14.950000000000076, "driven_lanedir": 1.9517911757242936, "get_state_dump": 0.01623114824295044, "sim_render-ego": 0.007978533903757731, "in-drivable-lane": 7.650000000000095, "agent_compute-ego": 0.06042585770289103, "deviation-heading": 0.8880234666607925, "complete-iteration": 0.39696057558059694, "set_robot_commands": 0.006523770491282145, "deviation-center-line": 0.48994534455207, "driven_lanedir_consec": 1.9517911757242936, "sim_compute_sim_state": 0.03215433597564697, "sim_compute_performance-ego": 0.006127634843190511, "sim_compute_robot_state-ego": 0.010779046217600504, "sim_compute_robot_state-parked0": 0.009722209771474205}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.181570904092802, "get_ui_image": 0.06331804570029764, "step_physics": 0.1526168374454274, "survival_time": 6.799999999999984, "driven_lanedir": 2.0243276786426305, "get_state_dump": 0.016122553278418147, "sim_render-ego": 0.007656286744510426, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.05863709309521843, "deviation-heading": 1.0020115224991888, "complete-iteration": 0.3544410922948052, "set_robot_commands": 0.006568417829625747, "deviation-center-line": 0.43534623213438506, "driven_lanedir_consec": 2.0243276786426305, "sim_compute_sim_state": 0.022584213930017808, "sim_compute_performance-ego": 0.006411454256843118, "sim_compute_robot_state-ego": 0.01018505061373991, "sim_compute_robot_state-parked0": 0.01013036510523628}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.4873290096444753, "get_ui_image": 0.06957665914321837, "step_physics": 0.16533087991579934, "survival_time": 12.050000000000036, "driven_lanedir": 2.449093977697487, "get_state_dump": 0.016660209513304144, "sim_render-ego": 0.007541919644937476, "in-drivable-lane": 4.1000000000000565, "agent_compute-ego": 0.05626884832421774, "deviation-heading": 0.9259563551038718, "complete-iteration": 0.3796139396572509, "set_robot_commands": 0.006293260210282575, "deviation-center-line": 0.4969727916255502, "driven_lanedir_consec": 2.449093977697487, "sim_compute_sim_state": 0.030471037037639696, "sim_compute_performance-ego": 0.006205779388237791, "sim_compute_robot_state-ego": 0.010683902566363705, "sim_compute_robot_state-parked0": 0.010384635806578325}}
set_robot_commands_max0.006850285963578658
set_robot_commands_mean0.0064946953257385785
set_robot_commands_median0.0065037508219317666
set_robot_commands_min0.006293260210282575
sim_compute_performance-ego_max0.006434284556995739
sim_compute_performance-ego_mean0.006118231928577154
sim_compute_performance-ego_median0.006108383735020956
sim_compute_performance-ego_min0.005837559700012207
sim_compute_robot_state-ego_max0.010779046217600504
sim_compute_robot_state-ego_mean0.010458201579354422
sim_compute_robot_state-ego_median0.010454357167525744
sim_compute_robot_state-ego_min0.010104557329958136
sim_compute_robot_state-parked0_max0.010384635806578325
sim_compute_robot_state-parked0_mean0.009909274692523812
sim_compute_robot_state-parked0_median0.0099016273021698
sim_compute_robot_state-parked0_min0.009468273683027788
sim_compute_sim_state_max0.03215433597564697
sim_compute_sim_state_mean0.02688303827224159
sim_compute_sim_state_median0.02763689088884236
sim_compute_sim_state_min0.018932581742604572
sim_render-ego_max0.007978533903757731
sim_render-ego_mean0.007546424469610955
sim_render-ego_median0.007565762141388527
sim_render-ego_min0.007063986598581508
simulation-passed1
step_physics_max0.17823811531066894
step_physics_mean0.1645141380150921
step_physics_median0.16444096656096263
step_physics_min0.1490822169245506
survival_time_max14.950000000000076
survival_time_mean10.315000000000031
survival_time_min2.7499999999999982
No reset possible
348679390Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:31:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4285388964542365
survival_time_median14.950000000000076
deviation-center-line_median0.39718863864318343
in-drivable-lane_median0.4250000000000061


other stats
agent_compute-ego_max0.06656590700149537
agent_compute-ego_mean0.059581222279224175
agent_compute-ego_median0.06176068345705668
agent_compute-ego_min0.02988130015295905
complete-iteration_max0.3802228442827861
complete-iteration_mean0.34867611684861133
complete-iteration_median0.35293302450918584
complete-iteration_min0.3167089594377054
deviation-center-line_max0.7273147133566706
deviation-center-line_mean0.4076896672188191
deviation-center-line_min0.17904141023165915
deviation-heading_max5.117012693972957
deviation-heading_mean2.420915090489912
deviation-heading_median2.218276307255249
deviation-heading_min0.9116113573367656
driven_any_max1.5315761301196082
driven_any_mean1.492277369562768
driven_any_median1.5315520661708324
driven_any_min1.1804097066828545
driven_lanedir_consec_max1.527297009725296
driven_lanedir_consec_mean1.3665330569035274
driven_lanedir_consec_min1.0432811967677544
driven_lanedir_max1.527297009725296
driven_lanedir_mean1.3665330569035274
driven_lanedir_median1.4285388964542365
driven_lanedir_min1.0432811967677544
get_state_dump_max0.017584822301206917
get_state_dump_mean0.016761056090323256
get_state_dump_median0.01674920121828715
get_state_dump_min0.016232309309211938
get_ui_image_max0.06988268613815307
get_ui_image_mean0.06213614645897584
get_ui_image_median0.06148269312875765
get_ui_image_min0.05603856086730957
in-drivable-lane_max2.1500000000000306
in-drivable-lane_mean0.7600000000000071
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.5003715943425129, "get_ui_image": 0.061268951441790606, "step_physics": 0.14121616128328685, "survival_time": 14.800000000000075, "driven_lanedir": 1.2297835379036637, "get_state_dump": 0.016232309309211938, "sim_render-ego": 0.007437991934853631, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.02988130015295905, "deviation-heading": 2.595106700765663, "complete-iteration": 0.3167089594377054, "set_robot_commands": 0.006482759037533322, "deviation-center-line": 0.3666252034938405, "driven_lanedir_consec": 1.2297835379036637, "sim_compute_sim_state": 0.026954108798826065, "sim_compute_performance-ego": 0.006105828929591823, "sim_compute_robot_state-ego": 0.010710061401934238, "sim_compute_robot_state-parked0": 0.010201066732406616}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.531530542102386, "get_ui_image": 0.06362340370814006, "step_physics": 0.14495698769887289, "survival_time": 14.950000000000076, "driven_lanedir": 1.1354524076810564, "get_state_dump": 0.016783119837443034, "sim_render-ego": 0.007737472852071126, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.06099430958429972, "deviation-heading": 5.117012693972957, "complete-iteration": 0.3541988150278727, "set_robot_commands": 0.006529866854349772, "deviation-center-line": 0.4978220458749003, "driven_lanedir_consec": 1.1354524076810564, "sim_compute_sim_state": 0.0265925931930542, "sim_compute_performance-ego": 0.0060271573066711425, "sim_compute_robot_state-ego": 0.010529556274414063, "sim_compute_robot_state-parked0": 0.010217878023783366}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.5315470561655318, "get_ui_image": 0.05603856086730957, "step_physics": 0.12580606857935586, "survival_time": 14.950000000000076, "driven_lanedir": 1.4926398694970249, "get_state_dump": 0.016715282599131267, "sim_render-ego": 0.007563183307647705, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06158220052719116, "deviation-heading": 2.7469598427590367, "complete-iteration": 0.3239618325233459, "set_robot_commands": 0.006513721148173015, "deviation-center-line": 0.314705668712008, "driven_lanedir_consec": 1.4926398694970249, "sim_compute_sim_state": 0.022067650159200033, "sim_compute_performance-ego": 0.006156504948933919, "sim_compute_robot_state-ego": 0.010894047419230142, "sim_compute_robot_state-parked0": 0.01041641394297282}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.5315668091541268, "get_ui_image": 0.056842668056488035, "step_physics": 0.128280299504598, "survival_time": 14.950000000000076, "driven_lanedir": 1.5138126128987504, "get_state_dump": 0.016834033330281575, "sim_render-ego": 0.007603163719177246, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06113145033518473, "deviation-heading": 1.7994824971382704, "complete-iteration": 0.32624093532562254, "set_robot_commands": 0.0064483896891276045, "deviation-center-line": 0.2504598869062754, "driven_lanedir_consec": 1.5138126128987504, "sim_compute_sim_state": 0.021816690762837727, "sim_compute_performance-ego": 0.006154092152913412, "sim_compute_robot_state-ego": 0.01057797114054362, "sim_compute_robot_state-parked0": 0.010325323740641277}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.5315570761761332, "get_ui_image": 0.06169643481572469, "step_physics": 0.15469312111536662, "survival_time": 14.950000000000076, "driven_lanedir": 1.4895631232014934, "get_state_dump": 0.016587366263071696, "sim_render-ego": 0.007587867577870687, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0655743662516276, "deviation-heading": 2.231499687095497, "complete-iteration": 0.3579709879557292, "set_robot_commands": 0.006386679808298747, "deviation-center-line": 0.42775207379252633, "driven_lanedir_consec": 1.4895631232014934, "sim_compute_sim_state": 0.01851315021514893, "sim_compute_performance-ego": 0.0059655133883158365, "sim_compute_robot_state-ego": 0.010664133230845134, "sim_compute_robot_state-parked0": 0.010098971525828044}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.5315594307576488, "get_ui_image": 0.06093860149383545, "step_physics": 0.14537855863571167, "survival_time": 14.950000000000076, "driven_lanedir": 1.5028525366055163, "get_state_dump": 0.01654028256734212, "sim_render-ego": 0.007454227606455485, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06656590700149537, "deviation-heading": 2.2050529274150015, "complete-iteration": 0.3482944424947103, "set_robot_commands": 0.006512877941131592, "deviation-center-line": 0.7273147133566706, "driven_lanedir_consec": 1.5028525366055163, "sim_compute_sim_state": 0.017798242568969728, "sim_compute_performance-ego": 0.006281015872955323, "sim_compute_robot_state-ego": 0.01041632095972697, "sim_compute_robot_state-parked0": 0.010203971068064373}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.5315761301196082, "get_ui_image": 0.06564010461171468, "step_physics": 0.1667122435569763, "survival_time": 14.950000000000076, "driven_lanedir": 1.527297009725296, "get_state_dump": 0.016974705855051675, "sim_render-ego": 0.007809810638427735, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06393048286437988, "deviation-heading": 0.9116113573367656, "complete-iteration": 0.3802228442827861, "set_robot_commands": 0.00649317741394043, "deviation-center-line": 0.17904141023165915, "driven_lanedir_consec": 1.527297009725296, "sim_compute_sim_state": 0.02553205966949463, "sim_compute_performance-ego": 0.006091202894846598, "sim_compute_robot_state-ego": 0.01079267422358195, "sim_compute_robot_state-parked0": 0.010046037832895914}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.5210912915788204, "get_ui_image": 0.06103632345745459, "step_physics": 0.14602878358629015, "survival_time": 14.850000000000076, "driven_lanedir": 1.3675146697069789, "get_state_dump": 0.017069871979530412, "sim_render-ego": 0.007476346661346127, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.061450199647383255, "deviation-heading": 1.99659258147444, "complete-iteration": 0.35166723399049904, "set_robot_commands": 0.006592950435599896, "deviation-center-line": 0.4847690078149853, "driven_lanedir_consec": 1.3675146697069789, "sim_compute_sim_state": 0.024169270036999223, "sim_compute_performance-ego": 0.006133659921511255, "sim_compute_robot_state-ego": 0.011121244141549774, "sim_compute_robot_state-parked0": 0.010386035097167146}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.5315640585480583, "get_ui_image": 0.06988268613815307, "step_physics": 0.1584207566579183, "survival_time": 14.950000000000076, "driven_lanedir": 1.3631336050477412, "get_state_dump": 0.016288766860961913, "sim_render-ego": 0.007461596330006918, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.0619391663869222, "deviation-heading": 2.7408134454356734, "complete-iteration": 0.370085912545522, "set_robot_commands": 0.006146820386250814, "deviation-center-line": 0.5561942614893488, "driven_lanedir_consec": 1.3631336050477412, "sim_compute_sim_state": 0.022654642264048255, "sim_compute_performance-ego": 0.006331199010213216, "sim_compute_robot_state-ego": 0.01078938086827596, "sim_compute_robot_state-parked0": 0.009962617556254069}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.1804097066828545, "get_ui_image": 0.06439372999914761, "step_physics": 0.14764875892935128, "survival_time": 11.60000000000003, "driven_lanedir": 1.0432811967677544, "get_state_dump": 0.017584822301206917, "sim_render-ego": 0.007908098656555703, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.06276284004079885, "deviation-heading": 1.865019171505815, "complete-iteration": 0.3574092049023201, "set_robot_commands": 0.00662327634877172, "deviation-center-line": 0.27221240051597645, "driven_lanedir_consec": 1.0432811967677544, "sim_compute_sim_state": 0.022235229097563643, "sim_compute_performance-ego": 0.006423727191727737, "sim_compute_robot_state-ego": 0.011020430203141838, "sim_compute_robot_state-parked0": 0.010602418718666866}}
set_robot_commands_max0.00662327634877172
set_robot_commands_mean0.006473051906317692
set_robot_commands_median0.0065030276775360114
set_robot_commands_min0.006146820386250814
sim_compute_performance-ego_max0.006423727191727737
sim_compute_performance-ego_mean0.006166990161768026
sim_compute_performance-ego_median0.006143876037212333
sim_compute_performance-ego_min0.0059655133883158365
sim_compute_robot_state-ego_max0.011121244141549774
sim_compute_robot_state-ego_mean0.010751581986324367
sim_compute_robot_state-ego_median0.0107497211351051
sim_compute_robot_state-ego_min0.01041632095972697
sim_compute_robot_state-parked0_max0.010602418718666866
sim_compute_robot_state-parked0_mean0.010246073423868048
sim_compute_robot_state-parked0_median0.010210924545923868
sim_compute_robot_state-parked0_min0.009962617556254069
sim_compute_sim_state_max0.026954108798826065
sim_compute_sim_state_mean0.022833363676614243
sim_compute_sim_state_median0.022444935680805952
sim_compute_sim_state_min0.017798242568969728
sim_render-ego_max0.007908098656555703
sim_render-ego_mean0.007603975928441235
sim_render-ego_median0.007575525442759196
sim_render-ego_min0.007437991934853631
simulation-passed1
step_physics_max0.1667122435569763
step_physics_mean0.1459141739547728
step_physics_median0.1457036711110009
step_physics_min0.12580606857935586
survival_time_max14.950000000000076
survival_time_mean14.590000000000073
survival_time_min11.60000000000003
No reset possible
348659389Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:26:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4690325420446482
survival_time_median14.950000000000076
deviation-center-line_median0.3520002192733875
in-drivable-lane_median0.25000000000000355


other stats
agent_compute-ego_max0.032008708426446625
agent_compute-ego_mean0.02893839014267956
agent_compute-ego_median0.028679182132085163
agent_compute-ego_min0.027564868132273355
complete-iteration_max0.28768951574961343
complete-iteration_mean0.2725302336311368
complete-iteration_median0.27289378841718037
complete-iteration_min0.2568190155029297
deviation-center-line_max0.5919955069947549
deviation-center-line_mean0.3823919654197381
deviation-center-line_min0.20499531393337456
deviation-heading_max4.14978842128652
deviation-heading_mean2.3909810832540748
deviation-heading_median2.1598177132890344
deviation-heading_min1.500722643988297
driven_any_max1.5315739277238616
driven_any_mean1.437771506849373
driven_any_median1.531551272970106
driven_any_min1.238051006539009
driven_lanedir_consec_max1.5203239380135598
driven_lanedir_consec_mean1.3589961425644652
driven_lanedir_consec_min1.0668881099130072
driven_lanedir_max1.5203239380135598
driven_lanedir_mean1.3589961425644652
driven_lanedir_median1.4690325420446482
driven_lanedir_min1.0668881099130072
get_state_dump_max0.020097626050313313
get_state_dump_mean0.018625595255831053
get_state_dump_median0.01851150155067444
get_state_dump_min0.017741398556242263
get_ui_image_max0.05154699007670085
get_ui_image_mean0.04994339679803471
get_ui_image_median0.050396607120831806
get_ui_image_min0.04666599464416504
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.38500000000000545
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.3326674400172525, "get_ui_image": 0.0506344735622406, "step_physics": 0.1078332897388574, "survival_time": 13.200000000000053, "driven_lanedir": 1.174700639026623, "get_state_dump": 0.01870291612365029, "sim_render-ego": 0.007917298512025312, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.032008708426446625, "deviation-heading": 1.583093384415414, "complete-iteration": 0.2761521836121877, "set_robot_commands": 0.0071296113910097065, "deviation-center-line": 0.27739704908165547, "driven_lanedir_consec": 1.174700639026623, "sim_compute_sim_state": 0.022498745809901844, "sim_compute_performance-ego": 0.006517118576801185, "sim_compute_robot_state-ego": 0.011511854150078514, "sim_compute_robot_state-parked0": 0.011183931068940596}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.238051006539009, "get_ui_image": 0.051520158233956545, "step_physics": 0.11169599603723596, "survival_time": 12.150000000000038, "driven_lanedir": 1.0668881099130072, "get_state_dump": 0.017741398556242263, "sim_render-ego": 0.007827341801835676, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.02827352358971113, "deviation-heading": 4.14978842128652, "complete-iteration": 0.2767050982502753, "set_robot_commands": 0.007166647616727853, "deviation-center-line": 0.5557295461739329, "driven_lanedir_consec": 1.0668881099130072, "sim_compute_sim_state": 0.023483706109317732, "sim_compute_performance-ego": 0.006302206604569046, "sim_compute_robot_state-ego": 0.011541204687989788, "sim_compute_robot_state-parked0": 0.01094407897917822}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.342877135987349, "get_ui_image": 0.05111880084860914, "step_physics": 0.10835899327644376, "survival_time": 13.150000000000052, "driven_lanedir": 1.208025361393348, "get_state_dump": 0.01797962188720703, "sim_render-ego": 0.007666605053745748, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.0278541044590591, "deviation-heading": 3.255037585131337, "complete-iteration": 0.26871943020548655, "set_robot_commands": 0.006902825243119504, "deviation-center-line": 0.39481962475172455, "driven_lanedir_consec": 1.208025361393348, "sim_compute_sim_state": 0.020329911445936776, "sim_compute_performance-ego": 0.006159016387997472, "sim_compute_robot_state-ego": 0.011221739729094416, "sim_compute_robot_state-parked0": 0.010910353279838997}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.5315540011186557, "get_ui_image": 0.04962161064147949, "step_physics": 0.10790305058161416, "survival_time": 14.950000000000076, "driven_lanedir": 1.4976991937946806, "get_state_dump": 0.018763447602589925, "sim_render-ego": 0.0077744666735331215, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02855379501978556, "deviation-heading": 2.7603439185488674, "complete-iteration": 0.2704594564437866, "set_robot_commands": 0.007264058589935302, "deviation-center-line": 0.2816634192942774, "driven_lanedir_consec": 1.4976991937946806, "sim_compute_sim_state": 0.02093558629353841, "sim_compute_performance-ego": 0.006519939104715983, "sim_compute_robot_state-ego": 0.01165815512339274, "sim_compute_robot_state-parked0": 0.01124198834101359}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.5315522795686276, "get_ui_image": 0.05015874067942301, "step_physics": 0.11406312863032024, "survival_time": 14.950000000000076, "driven_lanedir": 1.5163203955068931, "get_state_dump": 0.018452550570170086, "sim_render-ego": 0.007805161476135254, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02932654142379761, "deviation-heading": 1.652757854609413, "complete-iteration": 0.273755525747935, "set_robot_commands": 0.007279402414957683, "deviation-center-line": 0.35374324891298836, "driven_lanedir_consec": 1.5163203955068931, "sim_compute_sim_state": 0.016551617781321207, "sim_compute_performance-ego": 0.0063500483830769856, "sim_compute_robot_state-ego": 0.01259392499923706, "sim_compute_robot_state-parked0": 0.010960090160369872}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.531550266371584, "get_ui_image": 0.048099261124928794, "step_physics": 0.10669076442718506, "survival_time": 14.950000000000076, "driven_lanedir": 1.4876194924647788, "get_state_dump": 0.020097626050313313, "sim_render-ego": 0.008624866008758544, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030416465600331625, "deviation-heading": 2.70300850387882, "complete-iteration": 0.2720320510864258, "set_robot_commands": 0.00823510487874349, "deviation-center-line": 0.5519013986778475, "driven_lanedir_consec": 1.4876194924647788, "sim_compute_sim_state": 0.01747588316599528, "sim_compute_performance-ego": 0.007082115014394125, "sim_compute_robot_state-ego": 0.01278351068496704, "sim_compute_robot_state-parked0": 0.012285571098327636}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.5315697230512906, "get_ui_image": 0.05148264328638712, "step_physics": 0.12450688044230145, "survival_time": 14.950000000000076, "driven_lanedir": 1.5203239380135598, "get_state_dump": 0.017935740152994793, "sim_render-ego": 0.007743757565816243, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028813403447469077, "deviation-heading": 1.500722643988297, "complete-iteration": 0.28768951574961343, "set_robot_commands": 0.007082273165384928, "deviation-center-line": 0.20499531393337456, "driven_lanedir_consec": 1.5203239380135598, "sim_compute_sim_state": 0.021820626258850097, "sim_compute_performance-ego": 0.006142363548278808, "sim_compute_robot_state-ego": 0.011099929809570312, "sim_compute_robot_state-parked0": 0.010848570664723714}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.5315739277238616, "get_ui_image": 0.05154699007670085, "step_physics": 0.11879736264546711, "survival_time": 14.950000000000076, "driven_lanedir": 1.4504455916245174, "get_state_dump": 0.018038474718729654, "sim_render-ego": 0.007629876931508382, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.027564868132273355, "deviation-heading": 1.9854230941040072, "complete-iteration": 0.28056228399276734, "set_robot_commands": 0.006936812400817871, "deviation-center-line": 0.5919955069947549, "driven_lanedir_consec": 1.4504455916245174, "sim_compute_sim_state": 0.020976026852925617, "sim_compute_performance-ego": 0.0063660939534505205, "sim_compute_robot_state-ego": 0.011373483339945476, "sim_compute_robot_state-parked0": 0.011121381123860677}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.531564031177392, "get_ui_image": 0.04858529488245646, "step_physics": 0.10471123059590658, "survival_time": 14.950000000000076, "driven_lanedir": 1.5118334003059488, "get_state_dump": 0.018570452531178793, "sim_render-ego": 0.007714097499847412, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027767922083536786, "deviation-heading": 2.0869679034492443, "complete-iteration": 0.26240777571996055, "set_robot_commands": 0.007218206723531087, "deviation-center-line": 0.26141735674303895, "driven_lanedir_consec": 1.5118334003059488, "sim_compute_sim_state": 0.018396108150482177, "sim_compute_performance-ego": 0.0065152486165364586, "sim_compute_robot_state-ego": 0.011669687430063884, "sim_compute_robot_state-parked0": 0.011038978894551596}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.2747552569387075, "get_ui_image": 0.04666599464416504, "step_physics": 0.09584302234649658, "survival_time": 12.500000000000044, "driven_lanedir": 1.1561053036012932, "get_state_dump": 0.019973724365234376, "sim_render-ego": 0.008050347328186035, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.028804569244384765, "deviation-heading": 2.232667523128824, "complete-iteration": 0.2568190155029297, "set_robot_commands": 0.00793992805480957, "deviation-center-line": 0.3502571896337866, "driven_lanedir_consec": 1.1561053036012932, "sim_compute_sim_state": 0.018028844833374025, "sim_compute_performance-ego": 0.006889429092407227, "sim_compute_robot_state-ego": 0.012304670333862304, "sim_compute_robot_state-parked0": 0.01208973217010498}}
set_robot_commands_max0.00823510487874349
set_robot_commands_mean0.0073154870479037
set_robot_commands_median0.00719242717012947
set_robot_commands_min0.006902825243119504
sim_compute_performance-ego_max0.007082115014394125
sim_compute_performance-ego_mean0.006484357928222781
sim_compute_performance-ego_median0.006440671284993489
sim_compute_performance-ego_min0.006142363548278808
sim_compute_robot_state-ego_max0.01278351068496704
sim_compute_robot_state-ego_mean0.011775816028820153
sim_compute_robot_state-ego_median0.011599679905691263
sim_compute_robot_state-ego_min0.011099929809570312
sim_compute_robot_state-parked0_max0.012285571098327636
sim_compute_robot_state-parked0_mean0.011262467578090988
sim_compute_robot_state-parked0_median0.011080180009206136
sim_compute_robot_state-parked0_min0.010848570664723714
sim_compute_sim_state_max0.023483706109317732
sim_compute_sim_state_mean0.020049705670164317
sim_compute_sim_state_median0.02063274886973759
sim_compute_sim_state_min0.016551617781321207
sim_render-ego_max0.008624866008758544
sim_render-ego_mean0.007875381885139175
sim_render-ego_median0.007789814074834188
sim_render-ego_min0.007629876931508382
simulation-passed1
step_physics_max0.12450688044230145
step_physics_mean0.11004037187218282
step_physics_median0.10813102192902896
step_physics_min0.09584302234649658
survival_time_max14.950000000000076
survival_time_mean14.070000000000068
survival_time_min12.150000000000038
No reset possible
348599385Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednoreg02-837a84a03856-10:05:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 338 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
348509381Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:26:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7818630316675517
survival_time_median14.950000000000076
deviation-center-line_median0.5147320532493176
in-drivable-lane_median0.274999999999999


other stats
agent_compute-ego_max0.03064513762791951
agent_compute-ego_mean0.02994495066006978
agent_compute-ego_median0.029890539646148684
agent_compute-ego_min0.029308315912882486
complete-iteration_max0.27523993015289305
complete-iteration_mean0.2674500713348389
complete-iteration_median0.26690202514330547
complete-iteration_min0.25810633500417074
deviation-center-line_max0.975050176822996
deviation-center-line_mean0.5803174111668123
deviation-center-line_min0.36900586628315313
deviation-heading_max4.416672193125549
deviation-heading_mean2.067037222066511
deviation-heading_median1.6046591673020334
deviation-heading_min1.3959297033493852
driven_any_max2.9516256669451657
driven_any_mean2.8099053486207004
driven_any_median2.9005738002800494
driven_any_min2.48519771162393
driven_lanedir_consec_max2.9151433643895457
driven_lanedir_consec_mean2.604756748840289
driven_lanedir_consec_min1.8319231959608513
driven_lanedir_max2.9151433643895457
driven_lanedir_mean2.604756748840289
driven_lanedir_median2.7818630316675517
driven_lanedir_min1.8319231959608513
get_state_dump_max0.020525879859924316
get_state_dump_mean0.02033062148094177
get_state_dump_median0.02032272775967916
get_state_dump_min0.020076812108357742
get_ui_image_max0.04890772819519043
get_ui_image_mean0.047808689435323085
get_ui_image_median0.04767106533050537
get_ui_image_min0.04688831170399984
in-drivable-lane_max3.2000000000000286
in-drivable-lane_mean1.030000000000011
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.9376866376233446, "get_ui_image": 0.04771958907445272, "step_physics": 0.09554803212483724, "survival_time": 14.950000000000076, "driven_lanedir": 2.9151433643895457, "get_state_dump": 0.020394034385681152, "sim_render-ego": 0.008661990960439046, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03064513762791951, "deviation-heading": 1.4085582070117408, "complete-iteration": 0.26671422481536866, "set_robot_commands": 0.008229444821675619, "deviation-center-line": 0.4736333838805408, "driven_lanedir_consec": 2.9151433643895457, "sim_compute_sim_state": 0.022825303077697753, "sim_compute_performance-ego": 0.00721084992090861, "sim_compute_robot_state-ego": 0.012732108434041342, "sim_compute_robot_state-parked0": 0.012497706413269045}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.882126218720347, "get_ui_image": 0.047385371526082354, "step_physics": 0.09833722432454428, "survival_time": 14.950000000000076, "driven_lanedir": 2.520149385158827, "get_state_dump": 0.020339221954345704, "sim_render-ego": 0.008774648507436117, "in-drivable-lane": 2.1500000000000172, "agent_compute-ego": 0.030525429248809813, "deviation-heading": 1.5892080962511437, "complete-iteration": 0.2687581729888916, "set_robot_commands": 0.0081242036819458, "deviation-center-line": 0.5205983416091831, "driven_lanedir_consec": 2.520149385158827, "sim_compute_sim_state": 0.022756996154785155, "sim_compute_performance-ego": 0.007243348757425944, "sim_compute_robot_state-ego": 0.012677000363667808, "sim_compute_robot_state-parked0": 0.012344757715861002}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.899408671180197, "get_ui_image": 0.04824155728022257, "step_physics": 0.09678227504094442, "survival_time": 14.950000000000076, "driven_lanedir": 2.8578488814655323, "get_state_dump": 0.02027809540430705, "sim_render-ego": 0.008629459540049235, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030364599227905274, "deviation-heading": 2.129430832541444, "complete-iteration": 0.26608598709106446, "set_robot_commands": 0.007897857030232748, "deviation-center-line": 0.6226070713172359, "driven_lanedir_consec": 2.8578488814655323, "sim_compute_sim_state": 0.021622440814971923, "sim_compute_performance-ego": 0.007160047690073649, "sim_compute_robot_state-ego": 0.012585365772247314, "sim_compute_robot_state-parked0": 0.012272770404815676}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.901738929379902, "get_ui_image": 0.04828395048777263, "step_physics": 0.0967169713973999, "survival_time": 14.950000000000076, "driven_lanedir": 2.8804052152549784, "get_state_dump": 0.02019462744394938, "sim_render-ego": 0.00867157220840454, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030165232022603353, "deviation-heading": 1.617037281819777, "complete-iteration": 0.26708982547124227, "set_robot_commands": 0.0083467698097229, "deviation-center-line": 0.36900586628315313, "driven_lanedir_consec": 2.8804052152549784, "sim_compute_sim_state": 0.02159799257914225, "sim_compute_performance-ego": 0.007254465421040853, "sim_compute_robot_state-ego": 0.012958985169728597, "sim_compute_robot_state-parked0": 0.012646105289459229}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.506737554861815, "get_ui_image": 0.04809325456619263, "step_physics": 0.10049419164657591, "survival_time": 14.950000000000076, "driven_lanedir": 2.306788307222404, "get_state_dump": 0.020413699150085448, "sim_render-ego": 0.008754289944966635, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.029825902779897055, "deviation-heading": 3.2750806293184063, "complete-iteration": 0.26600557963053384, "set_robot_commands": 0.008097381591796874, "deviation-center-line": 0.975050176822996, "driven_lanedir_consec": 2.306788307222404, "sim_compute_sim_state": 0.017945894400278727, "sim_compute_performance-ego": 0.007037607034047445, "sim_compute_robot_state-ego": 0.012663788795471193, "sim_compute_robot_state-parked0": 0.012425964673360188}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.48519771162393, "get_ui_image": 0.04890772819519043, "step_physics": 0.10241759538650512, "survival_time": 14.950000000000076, "driven_lanedir": 1.8319231959608513, "get_state_dump": 0.020525879859924316, "sim_render-ego": 0.008769455750783285, "in-drivable-lane": 3.2000000000000286, "agent_compute-ego": 0.02995517651240031, "deviation-heading": 4.416672193125549, "complete-iteration": 0.2700718879699707, "set_robot_commands": 0.00829762617746989, "deviation-center-line": 0.7167644759247804, "driven_lanedir_consec": 1.8319231959608513, "sim_compute_sim_state": 0.018243906497955324, "sim_compute_performance-ego": 0.007241917451222738, "sim_compute_robot_state-ego": 0.013135852018992106, "sim_compute_robot_state-parked0": 0.012322533130645751}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.705697418714272, "get_ui_image": 0.04762254158655802, "step_physics": 0.10778385321299234, "survival_time": 14.950000000000076, "driven_lanedir": 2.2512951600339126, "get_state_dump": 0.020076812108357742, "sim_render-ego": 0.008551353613535564, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.029308315912882486, "deviation-heading": 1.3959297033493852, "complete-iteration": 0.27523993015289305, "set_robot_commands": 0.008101655642191568, "deviation-center-line": 0.488106172678609, "driven_lanedir_consec": 2.2512951600339126, "sim_compute_sim_state": 0.02155741771062215, "sim_compute_performance-ego": 0.007007506688435873, "sim_compute_robot_state-ego": 0.012627729574839274, "sim_compute_robot_state-parked0": 0.012355679670969646}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.9263669943697903, "get_ui_image": 0.04760794480641683, "step_physics": 0.10670273780822752, "survival_time": 14.950000000000076, "driven_lanedir": 2.901812828339277, "get_state_dump": 0.020298959414164226, "sim_render-ego": 0.008429614702860515, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02942230780919393, "deviation-heading": 1.59228105278429, "complete-iteration": 0.2737398370107015, "set_robot_commands": 0.0076062186559041345, "deviation-center-line": 0.6991496108717619, "driven_lanedir_consec": 2.901812828339277, "sim_compute_sim_state": 0.022041672865549724, "sim_compute_performance-ego": 0.006859465440114339, "sim_compute_robot_state-ego": 0.012309892177581787, "sim_compute_robot_state-parked0": 0.012208919525146484}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 2.902467682788238, "get_ui_image": 0.04688831170399984, "step_physics": 0.09428895711898803, "survival_time": 14.950000000000076, "driven_lanedir": 2.8763239687079905, "get_state_dump": 0.020306233565012613, "sim_render-ego": 0.008216783205668132, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02965731700261434, "deviation-heading": 1.7906466438067017, "complete-iteration": 0.25810633500417074, "set_robot_commands": 0.007484155495961507, "deviation-center-line": 0.5088657648894522, "driven_lanedir_consec": 2.8763239687079905, "sim_compute_sim_state": 0.02031167189280192, "sim_compute_performance-ego": 0.006749658584594726, "sim_compute_robot_state-ego": 0.011935978730519612, "sim_compute_robot_state-parked0": 0.012015324433644612}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 2.9516256669451657, "get_ui_image": 0.04733664512634277, "step_physics": 0.0951452660560608, "survival_time": 14.950000000000076, "driven_lanedir": 2.705877181869571, "get_state_dump": 0.02047865152359009, "sim_render-ego": 0.008657177289326986, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.02958008845647176, "deviation-heading": 1.4555275806566712, "complete-iteration": 0.26268893321355186, "set_robot_commands": 0.008002057870229085, "deviation-center-line": 0.42939324739041135, "driven_lanedir_consec": 2.705877181869571, "sim_compute_sim_state": 0.02069857120513916, "sim_compute_performance-ego": 0.007264680067698161, "sim_compute_robot_state-ego": 0.01303994099299113, "sim_compute_robot_state-parked0": 0.012232746283213298}}
set_robot_commands_max0.0083467698097229
set_robot_commands_mean0.008018737077713015
set_robot_commands_median0.008099518616994221
set_robot_commands_min0.007484155495961507
sim_compute_performance-ego_max0.007264680067698161
sim_compute_performance-ego_mean0.007102954705556235
sim_compute_performance-ego_median0.007185448805491129
sim_compute_performance-ego_min0.006749658584594726
sim_compute_robot_state-ego_max0.013135852018992106
sim_compute_robot_state-ego_mean0.012666664203008016
sim_compute_robot_state-ego_median0.012670394579569498
sim_compute_robot_state-ego_min0.011935978730519612
sim_compute_robot_state-parked0_max0.012646105289459229
sim_compute_robot_state-parked0_mean0.012332250754038493
sim_compute_robot_state-parked0_median0.012333645423253378
sim_compute_robot_state-parked0_min0.012015324433644612
sim_compute_sim_state_max0.022825303077697753
sim_compute_sim_state_mean0.020960186719894407
sim_compute_sim_state_median0.0215777051448822
sim_compute_sim_state_min0.017945894400278727
sim_render-ego_max0.008774648507436117
sim_render-ego_mean0.008611634572347005
sim_render-ego_median0.008659584124883015
sim_render-ego_min0.008216783205668132
simulation-passed1
step_physics_max0.10778385321299234
step_physics_mean0.09942171041170755
step_physics_median0.09755974968274432
step_physics_min0.09428895711898803
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
348439376Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:12:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23537674024806088
survival_time_median2.1750000000000003
deviation-center-line_median0.1228244762870688
in-drivable-lane_median0.3250000000000003


other stats
agent_compute-ego_max0.028517881234486897
agent_compute-ego_mean0.026693244068104284
agent_compute-ego_median0.02673503064762871
agent_compute-ego_min0.025129044757169837
complete-iteration_max0.2813890854517619
complete-iteration_mean0.2712466489598213
complete-iteration_median0.27449363792435616
complete-iteration_min0.25680752361522
deviation-center-line_max0.5409772312838965
deviation-center-line_mean0.20375503966284567
deviation-center-line_min0.07695085935458001
deviation-heading_max2.515304087094632
deviation-heading_mean1.0554251350837098
deviation-heading_median0.747473714583244
deviation-heading_min0.5542886632196296
driven_any_max3.021523015267352
driven_any_mean1.1230886239465825
driven_any_median0.33516446760085505
driven_any_min0.25179459113496316
driven_lanedir_consec_max1.9276016641007212
driven_lanedir_consec_mean0.7002649636627123
driven_lanedir_consec_min0.1369645768517782
driven_lanedir_max1.9276016641007212
driven_lanedir_mean0.7002649636627123
driven_lanedir_median0.23537674024806088
driven_lanedir_min0.1369645768517782
get_state_dump_max0.01945781707763672
get_state_dump_mean0.017494244927829954
get_state_dump_median0.017198612014033478
get_state_dump_min0.016476590458939715
get_ui_image_max0.051828680038452146
get_ui_image_mean0.05009447174652739
get_ui_image_median0.05075229958790105
get_ui_image_min0.0456544230966007
in-drivable-lane_max8.150000000000095
in-drivable-lane_mean1.8600000000000088
in-drivable-lane_min0.24999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.5292628404556836, "get_ui_image": 0.05102900179421029, "step_physics": 0.1196638723699058, "survival_time": 6.149999999999986, "driven_lanedir": 1.277097204925362, "get_state_dump": 0.016476590458939715, "sim_render-ego": 0.00721170456428838, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.026742328473222936, "deviation-heading": 0.9930545464032354, "complete-iteration": 0.2768406984282703, "set_robot_commands": 0.006613812795499476, "deviation-center-line": 0.18952132322217116, "driven_lanedir_consec": 1.277097204925362, "sim_compute_sim_state": 0.02218469759313072, "sim_compute_performance-ego": 0.005843286591816724, "sim_compute_robot_state-ego": 0.010632881304112876, "sim_compute_robot_state-parked0": 0.010234470289897143}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.30830218835815365, "get_ui_image": 0.04993866711128049, "step_physics": 0.11461591720581056, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2064651862938005, "get_state_dump": 0.017770598574382502, "sim_render-ego": 0.007061632668099753, "in-drivable-lane": 0.24999999999999975, "agent_compute-ego": 0.0255045251148503, "deviation-heading": 0.6804583124524273, "complete-iteration": 0.2689391171059957, "set_robot_commands": 0.006711314364177425, "deviation-center-line": 0.10002349506663266, "driven_lanedir_consec": 0.2064651862938005, "sim_compute_sim_state": 0.019937114017765697, "sim_compute_performance-ego": 0.00606899726681593, "sim_compute_robot_state-ego": 0.010830541936362662, "sim_compute_robot_state-parked0": 0.010287657016661109}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.2588235579690463, "get_ui_image": 0.0504755973815918, "step_physics": 0.11167090079363656, "survival_time": 1.7000000000000008, "driven_lanedir": 0.14275788411337764, "get_state_dump": 0.018027796464807847, "sim_render-ego": 0.007050423061146456, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.025129044757169837, "deviation-heading": 0.7317094000735982, "complete-iteration": 0.2642052033368279, "set_robot_commands": 0.006555276758530561, "deviation-center-line": 0.07695085935458001, "driven_lanedir_consec": 0.14275788411337764, "sim_compute_sim_state": 0.017718904158648324, "sim_compute_performance-ego": 0.00629730084363152, "sim_compute_robot_state-ego": 0.01069960874669692, "sim_compute_robot_state-parked0": 0.01036689561956069}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.25179459113496316, "get_ui_image": 0.049735592471228704, "step_physics": 0.12530314922332764, "survival_time": 1.800000000000001, "driven_lanedir": 0.1369645768517782, "get_state_dump": 0.016712956958346896, "sim_render-ego": 0.006655845377180312, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.0253601868947347, "deviation-heading": 0.7632380290928897, "complete-iteration": 0.27739353974660236, "set_robot_commands": 0.006743874814775255, "deviation-center-line": 0.07893906297610771, "driven_lanedir_consec": 0.1369645768517782, "sim_compute_sim_state": 0.02007971869574653, "sim_compute_performance-ego": 0.005953881475660536, "sim_compute_robot_state-ego": 0.010418143537309434, "sim_compute_robot_state-parked0": 0.010231600867377387}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 3.021523015267352, "get_ui_image": 0.051828680038452146, "step_physics": 0.1240417194366455, "survival_time": 14.950000000000076, "driven_lanedir": 1.391446177101757, "get_state_dump": 0.016826287905375163, "sim_render-ego": 0.007620360056559245, "in-drivable-lane": 8.150000000000095, "agent_compute-ego": 0.028517881234486897, "deviation-heading": 2.047935162281713, "complete-iteration": 0.2813890854517619, "set_robot_commands": 0.006968616644541422, "deviation-center-line": 0.45979439651881326, "driven_lanedir_consec": 1.391446177101757, "sim_compute_sim_state": 0.01819037596384684, "sim_compute_performance-ego": 0.006070867379506429, "sim_compute_robot_state-ego": 0.010718223253885904, "sim_compute_robot_state-parked0": 0.010393373171488444}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.73209953171248, "get_ui_image": 0.05173272371292114, "step_physics": 0.12191020011901856, "survival_time": 14.950000000000076, "driven_lanedir": 1.3702133319421854, "get_state_dump": 0.016794475714365643, "sim_render-ego": 0.007440553506215413, "in-drivable-lane": 6.599999999999992, "agent_compute-ego": 0.02811035712560018, "deviation-heading": 2.515304087094632, "complete-iteration": 0.27705395778020225, "set_robot_commands": 0.00690897544225057, "deviation-center-line": 0.5409772312838965, "driven_lanedir_consec": 1.3702133319421854, "sim_compute_sim_state": 0.01651137351989746, "sim_compute_performance-ego": 0.00616404930750529, "sim_compute_robot_state-ego": 0.010673293272654216, "sim_compute_robot_state-parked0": 0.01059648593266805}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.257923125912111, "get_ui_image": 0.05139635159419133, "step_physics": 0.12068613041082075, "survival_time": 8.449999999999985, "driven_lanedir": 1.9276016641007212, "get_state_dump": 0.017360293653589733, "sim_render-ego": 0.007420328241833568, "in-drivable-lane": 1.3000000000000025, "agent_compute-ego": 0.02672773282203449, "deviation-heading": 1.1218665506206742, "complete-iteration": 0.28019022236208946, "set_robot_commands": 0.006647575536423181, "deviation-center-line": 0.241628574462447, "driven_lanedir_consec": 1.9276016641007212, "sim_compute_sim_state": 0.022149143839728904, "sim_compute_performance-ego": 0.006072487351457043, "sim_compute_robot_state-ego": 0.01086007490665955, "sim_compute_robot_state-parked0": 0.010649390474579036}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.36202674684355646, "get_ui_image": 0.05118284536444623, "step_physics": 0.11836569723875626, "survival_time": 2.3, "driven_lanedir": 0.26428829420232125, "get_state_dump": 0.017036930374477222, "sim_render-ego": 0.007504644601241402, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.026310324668884277, "deviation-heading": 0.5542886632196296, "complete-iteration": 0.272146577420442, "set_robot_commands": 0.006804787594339122, "deviation-center-line": 0.1355223543261661, "driven_lanedir_consec": 0.26428829420232125, "sim_compute_sim_state": 0.01691840005957562, "sim_compute_performance-ego": 0.005879759788513184, "sim_compute_robot_state-ego": 0.011303124220474909, "sim_compute_robot_state-parked0": 0.010623501694720724}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.2547169565834856, "get_ui_image": 0.04797083490035113, "step_physics": 0.10354063791387222, "survival_time": 1.7000000000000008, "driven_lanedir": 0.14198508310694669, "get_state_dump": 0.018478702096378103, "sim_render-ego": 0.007381186765782973, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.027113598935744342, "deviation-heading": 0.5564616779783043, "complete-iteration": 0.25680752361522, "set_robot_commands": 0.007014646249658921, "deviation-center-line": 0.10406650116967105, "driven_lanedir_consec": 0.14198508310694669, "sim_compute_sim_state": 0.01658327439252068, "sim_compute_performance-ego": 0.006231602500466739, "sim_compute_robot_state-ego": 0.0114286366631003, "sim_compute_robot_state-parked0": 0.010834855191847858}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.2544136852289913, "get_ui_image": 0.0456544230966007, "step_physics": 0.10106318838456098, "survival_time": 1.7000000000000008, "driven_lanedir": 0.14383023398887218, "get_state_dump": 0.01945781707763672, "sim_render-ego": 0.007992330719442928, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.027416460654314828, "deviation-heading": 0.5899349216199958, "complete-iteration": 0.2575005643508014, "set_robot_commands": 0.007460517041823443, "deviation-center-line": 0.11012659824797148, "driven_lanedir_consec": 0.14383023398887218, "sim_compute_sim_state": 0.016708977082196402, "sim_compute_performance-ego": 0.006889848148121554, "sim_compute_robot_state-ego": 0.012613654136657717, "sim_compute_robot_state-parked0": 0.012000883326810948}}
set_robot_commands_max0.007460517041823443
set_robot_commands_mean0.006842939724201938
set_robot_commands_median0.006774331204557189
set_robot_commands_min0.006555276758530561
sim_compute_performance-ego_max0.006889848148121554
sim_compute_performance-ego_mean0.006147208065349495
sim_compute_performance-ego_median0.006071677365481736
sim_compute_performance-ego_min0.005843286591816724
sim_compute_robot_state-ego_max0.012613654136657717
sim_compute_robot_state-ego_mean0.01101781819779145
sim_compute_robot_state-ego_median0.010774382595124282
sim_compute_robot_state-ego_min0.010418143537309434
sim_compute_robot_state-parked0_max0.012000883326810948
sim_compute_robot_state-parked0_mean0.01062191135856114
sim_compute_robot_state-parked0_median0.010494929552078248
sim_compute_robot_state-parked0_min0.010231600867377387
sim_compute_sim_state_max0.02218469759313072
sim_compute_sim_state_mean0.01869819793230572
sim_compute_sim_state_median0.017954640061247584
sim_compute_sim_state_min0.01651137351989746
sim_render-ego_max0.007992330719442928
sim_render-ego_mean0.007333900956179043
sim_render-ego_median0.00740075750380827
sim_render-ego_min0.006655845377180312
simulation-passed1
step_physics_max0.12530314922332764
step_physics_mean0.11608614130963547
step_physics_median0.11901478480433104
step_physics_min0.10106318838456098
survival_time_max14.950000000000076
survival_time_mean5.5750000000000135
survival_time_min1.7000000000000008
No reset possible