Duckietown Challenges Home Challenges Submissions

Evaluator 4942

ID4942
evaluatorgpu-prod-01
ownerI don't have one 😀
machinegpu_cee35393e57c
processgpu-prod-01_cee35393e57c
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success222 60558
# timeout
# failed21 61779
# error38 60589
# aborted9 61172
# host-error32 60532
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors99%
RAM total (MB)
RAM free (MB)234.9 GB
Disk (MB)
Disk available (MB)432.0 GB
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
6200913503Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:10:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.600000000000058
in-drivable-lane_median0.7249999999999979
driven_lanedir_consec_median1.6354191260661937
deviation-center-line_median0.7406095438304618


other stats
agent_compute-ego0_max0.017265342530750093
agent_compute-ego0_mean0.016028716094057177
agent_compute-ego0_median0.015923579731120973
agent_compute-ego0_min0.015002362383236677
complete-iteration_max0.2622853256407238
complete-iteration_mean0.21864708684343265
complete-iteration_median0.21972331826910205
complete-iteration_min0.1728563851948026
deviation-center-line_max1.4595438666921048
deviation-center-line_mean0.8172091628406623
deviation-center-line_min0.3280736970096206
deviation-heading_max4.380580224967234
deviation-heading_mean2.3852648694451553
deviation-heading_median1.7417007279476675
deviation-heading_min1.6770777969180504
driven_any_max2.477368175686025
driven_any_mean1.589573469098898
driven_any_median1.6676209762566423
driven_any_min0.5456837481962815
driven_lanedir_consec_max2.1364192315692065
driven_lanedir_consec_mean1.428725295267799
driven_lanedir_consec_min0.3076436973696006
driven_lanedir_max2.1364192315692065
driven_lanedir_mean1.428725295267799
driven_lanedir_median1.6354191260661937
driven_lanedir_min0.3076436973696006
get_duckie_state_max0.024105883244448487
get_duckie_state_mean0.01718481202953958
get_duckie_state_median0.020212022209526004
get_duckie_state_min0.004209320454657832
get_robot_state_max0.003636435013783129
get_robot_state_mean0.0035917227223851594
get_robot_state_median0.0035974059357690253
get_robot_state_min0.003535644004219457
get_state_dump_max0.008409669564205146
get_state_dump_mean0.0073659757806494195
get_state_dump_median0.007823220425679869
get_state_dump_min0.005407792707032795
get_ui_image_max0.03964285169328962
get_ui_image_mean0.03373852037367644
get_ui_image_median0.0343168541142894
get_ui_image_min0.026677521572837343
in-drivable-lane_max1.6000000000000227
in-drivable-lane_mean0.7625000000000046
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.9663620989012711, "get_ui_image": 0.03254479507230363, "step_physics": 0.10789208367185772, "survival_time": 15.85000000000009, "driven_lanedir": 1.929918263159342, "get_state_dump": 0.008409669564205146, "get_robot_state": 0.003564764118794375, "sim_render-ego0": 0.003650414868720673, "get_duckie_state": 0.024105883244448487, "in-drivable-lane": 0.0, "deviation-heading": 1.7733354654904023, "agent_compute-ego0": 0.015002362383236677, "complete-iteration": 0.20751879725066372, "set_robot_commands": 0.002115053950615649, "deviation-center-line": 0.7631872151089687, "driven_lanedir_consec": 1.929918263159342, "sim_compute_sim_state": 0.008290547994697618, "sim_compute_performance-ego0": 0.0018623744916615996}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5456837481962815, "get_ui_image": 0.03964285169328962, "step_physics": 0.1552615937732515, "survival_time": 5.1999999999999895, "driven_lanedir": 0.3076436973696006, "get_state_dump": 0.007913628078642345, "get_robot_state": 0.003630047752743675, "sim_render-ego0": 0.003754499980381557, "get_duckie_state": 0.02039148693992978, "in-drivable-lane": 1.4499999999999955, "deviation-heading": 1.7100659904049331, "agent_compute-ego0": 0.017265342530750093, "complete-iteration": 0.2622853256407238, "set_robot_commands": 0.0021855127243768603, "deviation-center-line": 0.3280736970096206, "driven_lanedir_consec": 0.3076436973696006, "sim_compute_sim_state": 0.010239744186401369, "sim_compute_performance-ego0": 0.0019088268280029296}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.3688798536120137, "get_ui_image": 0.03608891315627517, "step_physics": 0.1270914590149595, "survival_time": 11.350000000000026, "driven_lanedir": 1.340919988973045, "get_state_dump": 0.007732812772717392, "get_robot_state": 0.003535644004219457, "sim_render-ego0": 0.003679076830546061, "get_duckie_state": 0.020032557479122227, "in-drivable-lane": 0.0, "deviation-heading": 1.6770777969180504, "agent_compute-ego0": 0.015740887114876194, "complete-iteration": 0.2319278392875404, "set_robot_commands": 0.0021179266143263433, "deviation-center-line": 0.7180318725519551, "driven_lanedir_consec": 1.340919988973045, "sim_compute_sim_state": 0.013972665134229158, "sim_compute_performance-ego0": 0.001856907417899684}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.477368175686025, "get_ui_image": 0.026677521572837343, "step_physics": 0.102905959720853, "survival_time": 19.700000000000145, "driven_lanedir": 2.1364192315692065, "get_state_dump": 0.005407792707032795, "get_robot_state": 0.003636435013783129, "sim_render-ego0": 0.0037454544743405114, "get_duckie_state": 0.004209320454657832, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 4.380580224967234, "agent_compute-ego0": 0.016106272347365752, "complete-iteration": 0.1728563851948026, "set_robot_commands": 0.002189682103410552, "deviation-center-line": 1.4595438666921048, "driven_lanedir_consec": 2.1364192315692065, "sim_compute_sim_state": 0.005961158607579484, "sim_compute_performance-ego0": 0.001931897296181208}}
set_robot_commands_max0.002189682103410552
set_robot_commands_mean0.002152043848182351
set_robot_commands_median0.0021517196693516018
set_robot_commands_min0.002115053950615649
sim_compute_performance-ego0_max0.001931897296181208
sim_compute_performance-ego0_mean0.0018900015084363552
sim_compute_performance-ego0_median0.0018856006598322649
sim_compute_performance-ego0_min0.001856907417899684
sim_compute_sim_state_max0.013972665134229158
sim_compute_sim_state_mean0.009616028980726906
sim_compute_sim_state_median0.009265146090549492
sim_compute_sim_state_min0.005961158607579484
sim_render-ego0_max0.003754499980381557
sim_render-ego0_mean0.003707361538497201
sim_render-ego0_median0.003712265652443286
sim_render-ego0_min0.003650414868720673
simulation-passed1
step_physics_max0.1552615937732515
step_physics_mean0.12328777404523042
step_physics_median0.1174917713434086
step_physics_min0.102905959720853
survival_time_max19.700000000000145
survival_time_mean13.025000000000064
survival_time_min5.1999999999999895
No reset possible
6200813502Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:31:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.5154171500272975
survival_time_median59.99999999999873
deviation-center-line_median3.9849332571852343
in-drivable-lane_median7.724999999999959


other stats
agent_compute-ego0_max0.016316557865516813
agent_compute-ego0_mean0.015372170363229076
agent_compute-ego0_median0.015223663018009842
agent_compute-ego0_min0.014724797551379811
complete-iteration_max0.20226744549359807
complete-iteration_mean0.18386488783647767
complete-iteration_median0.18557438669713697
complete-iteration_min0.1620433324580387
deviation-center-line_max5.860488767397566
deviation-center-line_mean3.738205282656387
deviation-center-line_min1.1224658488575143
deviation-heading_max11.772947505810144
deviation-heading_mean7.510461499071707
deviation-heading_median8.026698403478255
deviation-heading_min2.2155016835201757
driven_any_max7.921058370790536
driven_any_mean6.749318262136725
driven_any_median7.920946921730898
driven_any_min3.2343208342945715
driven_lanedir_consec_max7.374458844482353
driven_lanedir_consec_mean5.589153188826368
driven_lanedir_consec_min1.9513196107685251
driven_lanedir_max7.374458844482353
driven_lanedir_mean5.589153188826368
driven_lanedir_median6.5154171500272975
driven_lanedir_min1.9513196107685251
get_duckie_state_max1.366986124640599e-06
get_duckie_state_mean1.2950086334388452e-06
get_duckie_state_median1.2948941943892688e-06
get_duckie_state_min1.223260020336243e-06
get_robot_state_max0.0036615801294280726
get_robot_state_mean0.0035948810510286144
get_robot_state_median0.0036274224654506896
get_robot_state_min0.003463099143785005
get_state_dump_max0.004697752832671586
get_state_dump_mean0.004505273521144046
get_state_dump_median0.004552477340215886
get_state_dump_min0.0042183865714728284
get_ui_image_max0.03565413926066606
get_ui_image_mean0.030788744581360515
get_ui_image_median0.030685539772725742
get_ui_image_min0.026129759519324513
in-drivable-lane_max12.099999999999753
in-drivable-lane_mean7.5749999999998785
in-drivable-lane_min2.7499999999998437
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.2343208342945715, "get_ui_image": 0.02854475694544175, "step_physics": 0.10399504315619376, "survival_time": 25.450000000000227, "driven_lanedir": 1.9513196107685251, "get_state_dump": 0.00446626672557756, "get_robot_state": 0.003609653547698376, "sim_render-ego0": 0.003728892288955988, "get_duckie_state": 1.315509571748621e-06, "in-drivable-lane": 9.90000000000014, "deviation-heading": 2.2155016835201757, "agent_compute-ego0": 0.016316557865516813, "complete-iteration": 0.17474972687515558, "set_robot_commands": 0.002210266917359595, "deviation-center-line": 1.1224658488575143, "driven_lanedir_consec": 1.9513196107685251, "sim_compute_sim_state": 0.009892766148436304, "sim_compute_performance-ego0": 0.001907786201028263}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920969508390437, "get_ui_image": 0.03565413926066606, "step_physics": 0.12431967506599267, "survival_time": 59.99999999999873, "driven_lanedir": 6.880100207825185, "get_state_dump": 0.0042183865714728284, "get_robot_state": 0.003463099143785005, "sim_render-ego0": 0.003583674823910271, "get_duckie_state": 1.2742788170299163e-06, "in-drivable-lane": 5.549999999999777, "deviation-heading": 11.772947505810144, "agent_compute-ego0": 0.014724797551379811, "complete-iteration": 0.20226744549359807, "set_robot_commands": 0.0020755435108245164, "deviation-center-line": 4.267285478876854, "driven_lanedir_consec": 6.880100207825185, "sim_compute_sim_state": 0.012302940830799265, "sim_compute_performance-ego0": 0.0018509321665386672}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921058370790536, "get_ui_image": 0.032826322600009734, "step_physics": 0.1180107230250782, "survival_time": 59.99999999999873, "driven_lanedir": 7.374458844482353, "get_state_dump": 0.004697752832671586, "get_robot_state": 0.003645191383203003, "sim_render-ego0": 0.003790103624901307, "get_duckie_state": 1.366986124640599e-06, "in-drivable-lane": 2.7499999999998437, "deviation-heading": 8.689972459466388, "agent_compute-ego0": 0.01562600886196419, "complete-iteration": 0.1963990465191183, "set_robot_commands": 0.00223141447094259, "deviation-center-line": 3.7025810354936146, "driven_lanedir_consec": 7.374458844482353, "sim_compute_sim_state": 0.01350603611840495, "sim_compute_performance-ego0": 0.001986715418413021}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.9209243350713585, "get_ui_image": 0.026129759519324513, "step_physics": 0.09842880262522574, "survival_time": 59.99999999999873, "driven_lanedir": 6.15073409222941, "get_state_dump": 0.004638687954854211, "get_robot_state": 0.0036615801294280726, "sim_render-ego0": 0.0037899023289485936, "get_duckie_state": 1.223260020336243e-06, "in-drivable-lane": 12.099999999999753, "deviation-heading": 7.363424347490121, "agent_compute-ego0": 0.014821317174055494, "complete-iteration": 0.1620433324580387, "set_robot_commands": 0.002286979697526841, "deviation-center-line": 5.860488767397566, "driven_lanedir_consec": 6.15073409222941, "sim_compute_sim_state": 0.006228040001175981, "sim_compute_performance-ego0": 0.0019787441780922516}}
set_robot_commands_max0.002286979697526841
set_robot_commands_mean0.0022010511491633855
set_robot_commands_median0.0022208406941510925
set_robot_commands_min0.0020755435108245164
sim_compute_performance-ego0_max0.001986715418413021
sim_compute_performance-ego0_mean0.001931044491018051
sim_compute_performance-ego0_median0.0019432651895602573
sim_compute_performance-ego0_min0.0018509321665386672
sim_compute_sim_state_max0.01350603611840495
sim_compute_sim_state_mean0.010482445774704124
sim_compute_sim_state_median0.011097853489617783
sim_compute_sim_state_min0.006228040001175981
sim_render-ego0_max0.003790103624901307
sim_render-ego0_mean0.00372314326667904
sim_render-ego0_median0.0037593973089522902
sim_render-ego0_min0.003583674823910271
simulation-passed1
step_physics_max0.12431967506599267
step_physics_mean0.1111885609681226
step_physics_median0.11100288309063595
step_physics_min0.09842880262522574
survival_time_max59.99999999999873
survival_time_mean51.3624999999991
survival_time_min25.450000000000227
No reset possible
6200613500Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:29:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.979395131209206
survival_time_median59.99999999999873
deviation-center-line_median2.985534170967501
in-drivable-lane_median8.225000000000048


other stats
agent_compute-ego0_max0.01210665261303937
agent_compute-ego0_mean0.011913872765624218
agent_compute-ego0_median0.011870900161260372
agent_compute-ego0_min0.01180703812693676
complete-iteration_max0.2191400859091017
complete-iteration_mean0.1870899573554383
complete-iteration_median0.1863497671338541
complete-iteration_min0.15652020924494328
deviation-center-line_max3.3546564881788936
deviation-center-line_mean2.636490743735327
deviation-center-line_min1.220238144827412
deviation-heading_max15.21343980096925
deviation-heading_mean11.355049957963212
deviation-heading_median11.336016423319712
deviation-heading_min7.534727184244176
driven_any_max11.672956478369192
driven_any_mean10.019714089923257
driven_any_median11.66820687707749
driven_any_min5.069486127168861
driven_lanedir_consec_max11.426932473168426
driven_lanedir_consec_mean8.106766663189273
driven_lanedir_consec_min3.0413439171702574
driven_lanedir_max11.426932473168426
driven_lanedir_mean8.106766663189273
driven_lanedir_median8.979395131209206
driven_lanedir_min3.0413439171702574
get_duckie_state_max1.590781741672092e-06
get_duckie_state_mean1.551127199968276e-06
get_duckie_state_median1.549125214004199e-06
get_duckie_state_min1.5154766301926128e-06
get_robot_state_max0.003589573152654872
get_robot_state_mean0.003522776470953542
get_robot_state_median0.00351105800377737
get_robot_state_min0.0034794167236045555
get_state_dump_max0.004451699102053932
get_state_dump_mean0.0043852101943316945
get_state_dump_median0.004382414482463853
get_state_dump_min0.004324312710345139
get_ui_image_max0.03566265106201172
get_ui_image_mean0.030449094968870417
get_ui_image_median0.03036681063268504
get_ui_image_min0.02540010754809987
in-drivable-lane_max13.949999999999328
in-drivable-lane_mean7.599999999999856
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.663479624869977, "get_ui_image": 0.02854498240671785, "step_physics": 0.10175482875401531, "survival_time": 59.99999999999873, "driven_lanedir": 11.426932473168426, "get_state_dump": 0.004451699102053932, "get_robot_state": 0.0035402234845316283, "sim_render-ego0": 0.003638882124850792, "get_duckie_state": 1.5154766301926128e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.755320358560748, "agent_compute-ego0": 0.01180703812693676, "complete-iteration": 0.1671100452877302, "set_robot_commands": 0.0021552112477705144, "deviation-center-line": 2.6746439825436688, "driven_lanedir_consec": 11.426932473168426, "sim_compute_sim_state": 0.009258942044247796, "sim_compute_performance-ego0": 0.0018867666179393351}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.069486127168861, "get_ui_image": 0.03566265106201172, "step_physics": 0.14510143597920735, "survival_time": 26.950000000000248, "driven_lanedir": 3.0413439171702574, "get_state_dump": 0.0043519823639481155, "get_robot_state": 0.0034794167236045555, "sim_render-ego0": 0.003585168167396828, "get_duckie_state": 1.590781741672092e-06, "in-drivable-lane": 9.000000000000105, "deviation-heading": 7.534727184244176, "agent_compute-ego0": 0.01210665261303937, "complete-iteration": 0.2191400859091017, "set_robot_commands": 0.002046537399291992, "deviation-center-line": 1.220238144827412, "driven_lanedir_consec": 3.0413439171702574, "sim_compute_sim_state": 0.010881023936801487, "sim_compute_performance-ego0": 0.0018518761352256492}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.672934129285002, "get_ui_image": 0.03218863885865223, "step_physics": 0.1325796720487291, "survival_time": 59.99999999999873, "driven_lanedir": 9.512559979682395, "get_state_dump": 0.004412846600979591, "get_robot_state": 0.003589573152654872, "sim_render-ego0": 0.003699869637088315, "get_duckie_state": 1.5678850439168531e-06, "in-drivable-lane": 7.449999999999992, "deviation-heading": 15.21343980096925, "agent_compute-ego0": 0.011824405957618224, "complete-iteration": 0.20558948897997803, "set_robot_commands": 0.0022122790473982456, "deviation-center-line": 3.3546564881788936, "driven_lanedir_consec": 9.512559979682395, "sim_compute_sim_state": 0.013064348131889706, "sim_compute_performance-ego0": 0.0019453649814678768}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672956478369192, "get_ui_image": 0.02540010754809987, "step_physics": 0.0978208878554472, "survival_time": 59.99999999999873, "driven_lanedir": 8.446230282736014, "get_state_dump": 0.004324312710345139, "get_robot_state": 0.0034818925230231113, "sim_render-ego0": 0.0035743800726262456, "get_duckie_state": 1.5303653840915448e-06, "in-drivable-lane": 13.949999999999328, "deviation-heading": 12.916712488078677, "agent_compute-ego0": 0.01191739436490252, "complete-iteration": 0.15652020924494328, "set_robot_commands": 0.0020468094068998898, "deviation-center-line": 3.2964243593913336, "driven_lanedir_consec": 8.446230282736014, "sim_compute_sim_state": 0.006039635525654992, "sim_compute_performance-ego0": 0.001843210461733244}}
set_robot_commands_max0.0022122790473982456
set_robot_commands_mean0.00211520927534016
set_robot_commands_median0.002101010327335202
set_robot_commands_min0.002046537399291992
sim_compute_performance-ego0_max0.0019453649814678768
sim_compute_performance-ego0_mean0.0018818045490915263
sim_compute_performance-ego0_median0.001869321376582492
sim_compute_performance-ego0_min0.001843210461733244
sim_compute_sim_state_max0.013064348131889706
sim_compute_sim_state_mean0.009810987409648496
sim_compute_sim_state_median0.01006998299052464
sim_compute_sim_state_min0.006039635525654992
sim_render-ego0_max0.003699869637088315
sim_render-ego0_mean0.0036245750004905448
sim_render-ego0_median0.0036120251461238097
sim_render-ego0_min0.0035743800726262456
simulation-passed1
step_physics_max0.14510143597920735
step_physics_mean0.11931420615934972
step_physics_median0.1171672504013722
step_physics_min0.0978208878554472
survival_time_max59.99999999999873
survival_time_mean51.73749999999911
survival_time_min26.950000000000248
No reset possible
6200513499Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.575882219363143
survival_time_median16.075000000000095
deviation-center-line_median0.5776497124899834
in-drivable-lane_median6.649999999999849


other stats
agent_compute-ego0_max0.012553191035048766
agent_compute-ego0_mean0.012247387825470536
agent_compute-ego0_median0.01233572654044577
agent_compute-ego0_min0.011764907185941831
complete-iteration_max0.20403613684312352
complete-iteration_mean0.17891463608351243
complete-iteration_median0.17913800648741546
complete-iteration_min0.15334639451609536
deviation-center-line_max1.4800393207394251
deviation-center-line_mean0.7144135427720131
deviation-center-line_min0.22231542536866017
deviation-heading_max6.324427999824156
deviation-heading_mean3.5349975512569474
deviation-heading_median3.203051743260735
deviation-heading_min1.409458718682166
driven_any_max7.662184820674957
driven_any_mean3.72199152038741
driven_any_median2.941769413429652
driven_any_min1.3422424340153782
driven_lanedir_consec_max6.199840644909035
driven_lanedir_consec_mean2.4907001590926736
driven_lanedir_consec_min0.611195552735373
driven_lanedir_max6.199840644909035
driven_lanedir_mean2.4907001590926736
driven_lanedir_median1.575882219363143
driven_lanedir_min0.611195552735373
get_duckie_state_max1.1644265757485867e-06
get_duckie_state_mean1.1307254020808527e-06
get_duckie_state_median1.1401716094508603e-06
get_duckie_state_min1.0781318136731034e-06
get_robot_state_max0.003657092527479451
get_robot_state_mean0.003566503858592948
get_robot_state_median0.003557484553045565
get_robot_state_min0.003493953800801211
get_state_dump_max0.004581767049702731
get_state_dump_mean0.00451871498616456
get_state_dump_median0.004513023204599291
get_state_dump_min0.004467046485756928
get_ui_image_max0.03548587343227938
get_ui_image_mean0.03040849960857712
get_ui_image_median0.03008614612094925
get_ui_image_min0.025975832760130588
in-drivable-lane_max7.0500000000000815
in-drivable-lane_mean6.124999999999941
in-drivable-lane_min4.149999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.662184820674957, "get_ui_image": 0.027951117188995588, "step_physics": 0.09602600942474442, "survival_time": 40.24999999999985, "driven_lanedir": 6.199840644909035, "get_state_dump": 0.004505208644914272, "get_robot_state": 0.003657092527479451, "sim_render-ego0": 0.003747693066561488, "get_duckie_state": 1.1444683406252424e-06, "in-drivable-lane": 6.649999999999622, "deviation-heading": 6.324427999824156, "agent_compute-ego0": 0.012209851747706866, "complete-iteration": 0.1620456773057469, "set_robot_commands": 0.0022188617337134575, "deviation-center-line": 1.4800393207394251, "driven_lanedir_consec": 6.199840644909035, "sim_compute_sim_state": 0.00969143422602424, "sim_compute_performance-ego0": 0.0019639570718959307}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3422424340153782, "get_ui_image": 0.03548587343227938, "step_physics": 0.13081479222519593, "survival_time": 7.89999999999998, "driven_lanedir": 0.611195552735373, "get_state_dump": 0.004467046485756928, "get_robot_state": 0.003493953800801211, "sim_render-ego0": 0.003621192848157583, "get_duckie_state": 1.0781318136731034e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 1.409458718682166, "agent_compute-ego0": 0.012553191035048766, "complete-iteration": 0.20403613684312352, "set_robot_commands": 0.002073132017123624, "deviation-center-line": 0.22231542536866017, "driven_lanedir_consec": 0.611195552735373, "sim_compute_sim_state": 0.009607217596761836, "sim_compute_performance-ego0": 0.00184706172103402}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.230356464176344, "get_ui_image": 0.032221175052902916, "step_physics": 0.12559509480541403, "survival_time": 17.550000000000114, "driven_lanedir": 1.8710002434286068, "get_state_dump": 0.004581767049702731, "get_robot_state": 0.003558556464585391, "sim_render-ego0": 0.0037115480412136426, "get_duckie_state": 1.1358748782764785e-06, "in-drivable-lane": 6.650000000000078, "deviation-heading": 3.653253984986983, "agent_compute-ego0": 0.012461601333184675, "complete-iteration": 0.196230335669084, "set_robot_commands": 0.002140712331641804, "deviation-center-line": 0.6727425569638787, "driven_lanedir_consec": 1.8710002434286068, "sim_compute_sim_state": 0.009958109395070507, "sim_compute_performance-ego0": 0.0019277198748155072}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6531823626829603, "get_ui_image": 0.025975832760130588, "step_physics": 0.09433650970458984, "survival_time": 14.600000000000072, "driven_lanedir": 1.2807641952976792, "get_state_dump": 0.00452083776428431, "get_robot_state": 0.0035564126415057393, "sim_render-ego0": 0.003646779792707528, "get_duckie_state": 1.1644265757485867e-06, "in-drivable-lane": 7.0500000000000815, "deviation-heading": 2.7528495015344867, "agent_compute-ego0": 0.011764907185941831, "complete-iteration": 0.15334639451609536, "set_robot_commands": 0.002135392342004353, "deviation-center-line": 0.4825568680160881, "driven_lanedir_consec": 1.2807641952976792, "sim_compute_sim_state": 0.005452352985993994, "sim_compute_performance-ego0": 0.001885343330305184}}
set_robot_commands_max0.0022188617337134575
set_robot_commands_mean0.0021420246061208095
set_robot_commands_median0.002138052336823078
set_robot_commands_min0.002073132017123624
sim_compute_performance-ego0_max0.0019639570718959307
sim_compute_performance-ego0_mean0.0019060204995126604
sim_compute_performance-ego0_median0.0019065316025603455
sim_compute_performance-ego0_min0.00184706172103402
sim_compute_sim_state_max0.009958109395070507
sim_compute_sim_state_mean0.008677278550962645
sim_compute_sim_state_median0.009649325911393038
sim_compute_sim_state_min0.005452352985993994
sim_render-ego0_max0.003747693066561488
sim_render-ego0_mean0.00368180343716006
sim_render-ego0_median0.003679163916960585
sim_render-ego0_min0.003621192848157583
simulation-passed1
step_physics_max0.13081479222519593
step_physics_mean0.11169310153998606
step_physics_median0.11081055211507924
step_physics_min0.09433650970458984
survival_time_max40.24999999999985
survival_time_mean20.075000000000003
survival_time_min7.89999999999998
No reset possible
6200313497Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7319003120577856
survival_time_median9.475
deviation-center-line_median0.26418949341282927
in-drivable-lane_median5.1500000000000075


other stats
agent_compute-ego0_max0.013013662421951115
agent_compute-ego0_mean0.01243682128236686
agent_compute-ego0_median0.012353872595597958
agent_compute-ego0_min0.01202587751632041
complete-iteration_max0.19310616400720892
complete-iteration_mean0.1730219417201238
complete-iteration_median0.17572464710786703
complete-iteration_min0.1475323086575523
deviation-center-line_max0.3978947895429484
deviation-center-line_mean0.26819477773281974
deviation-center-line_min0.14650533456267198
deviation-heading_max2.268755282979776
deviation-heading_mean1.3785932033102632
deviation-heading_median1.1832034513021843
deviation-heading_min0.8792106276569074
driven_any_max4.022860204905593
driven_any_mean2.09557064101353
driven_any_median1.6455420544863886
driven_any_min1.068338250175752
driven_lanedir_consec_max0.7778342594017307
driven_lanedir_consec_mean0.7192354403234972
driven_lanedir_consec_min0.6353068777766868
driven_lanedir_max0.7778342594017307
driven_lanedir_mean0.7192354403234972
driven_lanedir_median0.7319003120577856
driven_lanedir_min0.6353068777766868
get_duckie_state_max1.3504319518577051e-06
get_duckie_state_mean1.2113857644434863e-06
get_duckie_state_median1.1872994230832013e-06
get_duckie_state_min1.1205122597498376e-06
get_robot_state_max0.0037474061580414463
get_robot_state_mean0.003653411056363494
get_robot_state_median0.0036367575531871914
get_robot_state_min0.0035927229610381445
get_state_dump_max0.004776119275857474
get_state_dump_mean0.004678613719902479
get_state_dump_median0.004665218510034248
get_state_dump_min0.004607898583683943
get_ui_image_max0.03608358099058649
get_ui_image_mean0.030705704344377815
get_ui_image_median0.030429922326230294
get_ui_image_min0.025879391734464186
in-drivable-lane_max16.600000000000158
in-drivable-lane_mean7.38750000000004
in-drivable-lane_min2.6499999999999906
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.616186473007498, "get_ui_image": 0.02836840457104622, "step_physics": 0.10598844416598056, "survival_time": 9.349999999999998, "driven_lanedir": 0.7778342594017307, "get_state_dump": 0.004711776337725051, "get_robot_state": 0.0037474061580414463, "sim_render-ego0": 0.003818459967349438, "get_duckie_state": 1.2035065508903342e-06, "in-drivable-lane": 4.800000000000006, "deviation-heading": 1.3163201456801348, "agent_compute-ego0": 0.01202587751632041, "complete-iteration": 0.17206921222362112, "set_robot_commands": 0.002257681907491481, "deviation-center-line": 0.3978947895429484, "driven_lanedir_consec": 0.7778342594017307, "sim_compute_sim_state": 0.009051850501527178, "sim_compute_performance-ego0": 0.0020170541519814347}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.022860204905593, "get_ui_image": 0.03608358099058649, "step_physics": 0.11681313712932773, "survival_time": 21.600000000000172, "driven_lanedir": 0.7750120065700425, "get_state_dump": 0.004618660682343446, "get_robot_state": 0.0035927229610381445, "sim_render-ego0": 0.0038214258453862495, "get_duckie_state": 1.1205122597498376e-06, "in-drivable-lane": 16.600000000000158, "deviation-heading": 2.268755282979776, "agent_compute-ego0": 0.013013662421951115, "complete-iteration": 0.19310616400720892, "set_robot_commands": 0.0021741307635230224, "deviation-center-line": 0.3684902604532129, "driven_lanedir_consec": 0.7750120065700425, "sim_compute_sim_state": 0.010949554949930027, "sim_compute_performance-ego0": 0.0019604548571016166}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.068338250175752, "get_ui_image": 0.03249144008141438, "step_physics": 0.10970884607038424, "survival_time": 6.499999999999985, "driven_lanedir": 0.6353068777766868, "get_state_dump": 0.004776119275857474, "get_robot_state": 0.0036735625667426424, "sim_render-ego0": 0.00377458106470472, "get_duckie_state": 1.3504319518577051e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.8792106276569074, "agent_compute-ego0": 0.01238885362639682, "complete-iteration": 0.17938008199211294, "set_robot_commands": 0.002174956197957046, "deviation-center-line": 0.14650533456267198, "driven_lanedir_consec": 0.6353068777766868, "sim_compute_sim_state": 0.008347944448922427, "sim_compute_performance-ego0": 0.001963815616287348}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.674897635965279, "get_ui_image": 0.025879391734464186, "step_physics": 0.0879985693205206, "survival_time": 9.6, "driven_lanedir": 0.6887886175455287, "get_state_dump": 0.004607898583683943, "get_robot_state": 0.00359995253963174, "sim_render-ego0": 0.0037517757613424194, "get_duckie_state": 1.1710922952760686e-06, "in-drivable-lane": 5.500000000000008, "deviation-heading": 1.0500867569242345, "agent_compute-ego0": 0.012318891564799097, "complete-iteration": 0.1475323086575523, "set_robot_commands": 0.0021679154331819997, "deviation-center-line": 0.15988872637244556, "driven_lanedir_consec": 0.6887886175455287, "sim_compute_sim_state": 0.005173315038335138, "sim_compute_performance-ego0": 0.0019541527940819302}}
set_robot_commands_max0.002257681907491481
set_robot_commands_mean0.0021936710755383875
set_robot_commands_median0.0021745434807400343
set_robot_commands_min0.0021679154331819997
sim_compute_performance-ego0_max0.0020170541519814347
sim_compute_performance-ego0_mean0.001973869354863082
sim_compute_performance-ego0_median0.001962135236694482
sim_compute_performance-ego0_min0.0019541527940819302
sim_compute_sim_state_max0.010949554949930027
sim_compute_sim_state_mean0.008380666234678692
sim_compute_sim_state_median0.008699897475224802
sim_compute_sim_state_min0.005173315038335138
sim_render-ego0_max0.0038214258453862495
sim_render-ego0_mean0.003791560659695707
sim_render-ego0_median0.003796520516027079
sim_render-ego0_min0.0037517757613424194
simulation-passed1
step_physics_max0.11681313712932773
step_physics_mean0.10512724917155328
step_physics_median0.1078486451181824
step_physics_min0.0879985693205206
survival_time_max21.600000000000172
survival_time_mean11.762500000000038
survival_time_min6.499999999999985
No reset possible
6200213495Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:08:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.97499999999998
in-drivable-lane_median0.549999999999998
driven_lanedir_consec_median1.805485459749374
deviation-center-line_median0.4688120005000399


other stats
agent_compute-ego0_max0.016410768032073975
agent_compute-ego0_mean0.015450287145228548
agent_compute-ego0_median0.015292079872880244
agent_compute-ego0_min0.014806220803079726
complete-iteration_max0.3016421766842113
complete-iteration_mean0.25985968128391973
complete-iteration_median0.2684875019504127
complete-iteration_min0.2008215445506422
deviation-center-line_max1.7974085280762626
deviation-center-line_mean0.7558830883105646
deviation-center-line_min0.28849982416591585
deviation-heading_max4.464934603235515
deviation-heading_mean2.6106100089471744
deviation-heading_median2.2857573253724985
deviation-heading_min1.405990781808186
driven_any_max5.864311686080665
driven_any_mean2.7595978536047925
driven_any_median2.0141707261853377
driven_any_min1.1457382759678305
driven_lanedir_consec_max4.47356880470438
driven_lanedir_consec_mean2.251654515258804
driven_lanedir_consec_min0.9220783368320876
driven_lanedir_max4.47356880470438
driven_lanedir_mean2.251654515258804
driven_lanedir_median1.805485459749374
driven_lanedir_min0.9220783368320876
get_duckie_state_max0.023885864421633856
get_duckie_state_mean0.016988619574154283
get_duckie_state_median0.02001716730349204
get_duckie_state_min0.0040342792679991905
get_robot_state_max0.0036092045727898095
get_robot_state_mean0.0035255342812944295
get_robot_state_median0.0035088045221652476
get_robot_state_min0.003475323508057413
get_state_dump_max0.008289843249174715
get_state_dump_mean0.007211607914512526
get_state_dump_median0.0076372508733880285
get_state_dump_min0.005282086662099331
get_ui_image_max0.039175432429594155
get_ui_image_mean0.03327708704128657
get_ui_image_median0.03375275698176191
get_ui_image_min0.026427401772028285
in-drivable-lane_max3.7000000000000384
in-drivable-lane_mean1.2000000000000086
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0354674759974003, "get_ui_image": 0.03210047417623134, "step_physics": 0.16820737774386726, "survival_time": 8.09999999999998, "driven_lanedir": 1.9263820565382448, "get_state_dump": 0.008289843249174715, "get_robot_state": 0.0035274789377224224, "sim_render-ego0": 0.0035231961794426107, "get_duckie_state": 0.023885864421633856, "in-drivable-lane": 0.0, "deviation-heading": 2.316986916702739, "agent_compute-ego0": 0.015053830995150138, "complete-iteration": 0.2666245501465593, "set_robot_commands": 0.002259582098276337, "deviation-center-line": 0.35903964985172004, "driven_lanedir_consec": 1.9263820565382448, "sim_compute_sim_state": 0.007847987801019399, "sim_compute_performance-ego0": 0.001843853230856679}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.864311686080665, "get_ui_image": 0.039175432429594155, "step_physics": 0.19449141726774327, "survival_time": 21.200000000000166, "driven_lanedir": 4.47356880470438, "get_state_dump": 0.007659109339994543, "get_robot_state": 0.0036092045727898095, "sim_render-ego0": 0.003649566874784582, "get_duckie_state": 0.02022654140696806, "in-drivable-lane": 3.7000000000000384, "deviation-heading": 4.464934603235515, "agent_compute-ego0": 0.015530328750610351, "complete-iteration": 0.3016421766842113, "set_robot_commands": 0.0022092202130485983, "deviation-center-line": 1.7974085280762626, "driven_lanedir_consec": 4.47356880470438, "sim_compute_sim_state": 0.013111447726978975, "sim_compute_performance-ego0": 0.001896027957691866}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1457382759678305, "get_ui_image": 0.03540503978729248, "step_physics": 0.1672430361310641, "survival_time": 4.749999999999991, "driven_lanedir": 0.9220783368320876, "get_state_dump": 0.007615392406781514, "get_robot_state": 0.0034901301066080728, "sim_render-ego0": 0.003566299875577291, "get_duckie_state": 0.01980779320001602, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.405990781808186, "agent_compute-ego0": 0.016410768032073975, "complete-iteration": 0.2703504537542661, "set_robot_commands": 0.002140683432420095, "deviation-center-line": 0.28849982416591585, "driven_lanedir_consec": 0.9220783368320876, "sim_compute_sim_state": 0.012754100064436594, "sim_compute_performance-ego0": 0.0018372709552447}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.992873976373275, "get_ui_image": 0.026427401772028285, "step_physics": 0.13355523272405698, "survival_time": 7.84999999999998, "driven_lanedir": 1.6845888629605033, "get_state_dump": 0.005282086662099331, "get_robot_state": 0.003475323508057413, "sim_render-ego0": 0.003515092632438563, "get_duckie_state": 0.0040342792679991905, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 2.254527734042258, "agent_compute-ego0": 0.014806220803079726, "complete-iteration": 0.2008215445506422, "set_robot_commands": 0.002138930031015903, "deviation-center-line": 0.5785843511483598, "driven_lanedir_consec": 1.6845888629605033, "sim_compute_sim_state": 0.005667024020907245, "sim_compute_performance-ego0": 0.0018409083161172988}}
set_robot_commands_max0.002259582098276337
set_robot_commands_mean0.0021871039436902333
set_robot_commands_median0.0021749518227343464
set_robot_commands_min0.002138930031015903
sim_compute_performance-ego0_max0.001896027957691866
sim_compute_performance-ego0_mean0.001854515114977636
sim_compute_performance-ego0_median0.0018423807734869889
sim_compute_performance-ego0_min0.0018372709552447
sim_compute_sim_state_max0.013111447726978975
sim_compute_sim_state_mean0.009845139903335551
sim_compute_sim_state_median0.010301043932727997
sim_compute_sim_state_min0.005667024020907245
sim_render-ego0_max0.003649566874784582
sim_render-ego0_mean0.0035635388905607616
sim_render-ego0_median0.003544748027509951
sim_render-ego0_min0.003515092632438563
simulation-passed1
step_physics_max0.19449141726774327
step_physics_mean0.1658742659666829
step_physics_median0.16772520693746568
step_physics_min0.13355523272405698
survival_time_max21.200000000000166
survival_time_mean10.47500000000003
survival_time_min4.749999999999991
No reset possible
6200113493Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:08:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.724999999999984
in-drivable-lane_median0.3999999999999986
driven_lanedir_consec_median2.032239986259677
deviation-center-line_median0.3340016785242004


other stats
agent_compute-ego0_max0.0161830244994745
agent_compute-ego0_mean0.015447666230644612
agent_compute-ego0_median0.0153710522747767
agent_compute-ego0_min0.014865535873550552
complete-iteration_max0.30357875838512327
complete-iteration_mean0.2613427043747478
complete-iteration_median0.2733946341771383
complete-iteration_min0.19500279075959148
deviation-center-line_max1.3778160461617917
deviation-center-line_mean0.5792893674106204
deviation-center-line_min0.27133806643228964
deviation-heading_max4.114251904858203
deviation-heading_mean1.971464824296553
deviation-heading_median1.5278855828874685
deviation-heading_min0.7158362265530703
driven_any_max5.7911637275968575
driven_any_mean2.9320130963213824
driven_any_median2.106755106084341
driven_any_min1.7233784455199916
driven_lanedir_consec_max4.615674226254079
driven_lanedir_consec_mean2.525181281855314
driven_lanedir_consec_min1.4205709286478223
driven_lanedir_max4.615674226254079
driven_lanedir_mean2.525181281855314
driven_lanedir_median2.032239986259677
driven_lanedir_min1.4205709286478223
get_duckie_state_max0.023633072111341687
get_duckie_state_mean0.01693285430513796
get_duckie_state_median0.020016386823401663
get_duckie_state_min0.004065571462406832
get_robot_state_max0.003585622804920848
get_robot_state_mean0.003508954836124522
get_robot_state_median0.00349257918874163
get_robot_state_min0.0034650381620939786
get_state_dump_max0.008131965001424154
get_state_dump_mean0.007093737400419233
get_state_dump_median0.007647516494451107
get_state_dump_min0.004947951611350565
get_ui_image_max0.038731234102714354
get_ui_image_mean0.03290456241982771
get_ui_image_median0.03342966806661856
get_ui_image_min0.026027679443359375
in-drivable-lane_max2.300000000000015
in-drivable-lane_mean0.775000000000003
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0564185010154303, "get_ui_image": 0.03164101353398076, "step_physics": 0.16514762242635092, "survival_time": 6.699999999999984, "driven_lanedir": 1.9903065036649852, "get_state_dump": 0.008131965001424154, "get_robot_state": 0.0034843374181676794, "sim_render-ego0": 0.003502457230179398, "get_duckie_state": 0.023633072111341687, "in-drivable-lane": 0.0, "deviation-heading": 1.4505292912563903, "agent_compute-ego0": 0.01536621164392542, "complete-iteration": 0.26254130292821815, "set_robot_commands": 0.0020216164765534577, "deviation-center-line": 0.27133806643228964, "driven_lanedir_consec": 1.9903065036649852, "sim_compute_sim_state": 0.007733608175207067, "sim_compute_performance-ego0": 0.0018033469164813007}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.7911637275968575, "get_ui_image": 0.038731234102714354, "step_physics": 0.19570328767706707, "survival_time": 16.350000000000097, "driven_lanedir": 4.615674226254079, "get_state_dump": 0.007763815362279008, "get_robot_state": 0.003585622804920848, "sim_render-ego0": 0.0037778121669118, "get_duckie_state": 0.02042023365090533, "in-drivable-lane": 2.300000000000015, "deviation-heading": 4.114251904858203, "agent_compute-ego0": 0.0161830244994745, "complete-iteration": 0.30357875838512327, "set_robot_commands": 0.0022515378347257287, "deviation-center-line": 1.3778160461617917, "driven_lanedir_consec": 4.615674226254079, "sim_compute_sim_state": 0.01311181013177081, "sim_compute_performance-ego0": 0.00196103061117777}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.7233784455199916, "get_ui_image": 0.03521832259925636, "step_physics": 0.1834019068125132, "survival_time": 5.4999999999999885, "driven_lanedir": 1.4205709286478223, "get_state_dump": 0.007531217626623205, "get_robot_state": 0.0034650381620939786, "sim_render-ego0": 0.003555916451119088, "get_duckie_state": 0.019612539995898, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7158362265530703, "agent_compute-ego0": 0.014865535873550552, "complete-iteration": 0.2842479654260584, "set_robot_commands": 0.0020157431696986292, "deviation-center-line": 0.3828720257156408, "driven_lanedir_consec": 1.4205709286478223, "sim_compute_sim_state": 0.012690668707495335, "sim_compute_performance-ego0": 0.0018148207449698232}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.1570917111532513, "get_ui_image": 0.026027679443359375, "step_physics": 0.12655713277704575, "survival_time": 6.749999999999984, "driven_lanedir": 2.0741734688543687, "get_state_dump": 0.004947951611350565, "get_robot_state": 0.0035008209593155805, "sim_render-ego0": 0.004012144663754632, "get_duckie_state": 0.004065571462406832, "in-drivable-lane": 0.0, "deviation-heading": 1.6052418745185464, "agent_compute-ego0": 0.01537589290562798, "complete-iteration": 0.19500279075959148, "set_robot_commands": 0.002552335753160365, "deviation-center-line": 0.2851313313327599, "driven_lanedir_consec": 2.0741734688543687, "sim_compute_sim_state": 0.0058164929642396815, "sim_compute_performance-ego0": 0.00207139814601225}}
set_robot_commands_max0.002552335753160365
set_robot_commands_mean0.002210308308534545
set_robot_commands_median0.002136577155639593
set_robot_commands_min0.0020157431696986292
sim_compute_performance-ego0_max0.00207139814601225
sim_compute_performance-ego0_mean0.001912649104660286
sim_compute_performance-ego0_median0.0018879256780737967
sim_compute_performance-ego0_min0.0018033469164813007
sim_compute_sim_state_max0.01311181013177081
sim_compute_sim_state_mean0.009838144994678224
sim_compute_sim_state_median0.0102121384413512
sim_compute_sim_state_min0.0058164929642396815
sim_render-ego0_max0.004012144663754632
sim_render-ego0_mean0.003712082627991229
sim_render-ego0_median0.003666864309015444
sim_render-ego0_min0.003502457230179398
simulation-passed1
step_physics_max0.19570328767706707
step_physics_mean0.16770248742324426
step_physics_median0.17427476461943206
step_physics_min0.12655713277704575
survival_time_max16.350000000000097
survival_time_mean8.825000000000014
survival_time_min5.4999999999999885
No reset possible
6199713492Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median19.879687423762743
survival_time_median59.99999999999873
deviation-center-line_median3.694857799053665
in-drivable-lane_median2.8249999999999194


other stats
agent_compute-ego0_max0.015824524389516304
agent_compute-ego0_mean0.01571446240295677
agent_compute-ego0_median0.015691440865757265
agent_compute-ego0_min0.015650443490796244
complete-iteration_max0.27134722813678525
complete-iteration_mean0.23879556771023489
complete-iteration_median0.242229487675612
complete-iteration_min0.19937606735293015
deviation-center-line_max4.25950053848739
deviation-center-line_mean3.7512900821986808
deviation-center-line_min3.355944192200005
deviation-heading_max17.63807419888253
deviation-heading_mean15.348712995254122
deviation-heading_median15.009755334243495
deviation-heading_min13.737267113646968
driven_any_max22.3416244084959
driven_any_mean22.232143394951823
driven_any_median22.233735161952136
driven_any_min22.119478847407123
driven_lanedir_consec_max20.80251903140721
driven_lanedir_consec_mean19.82011286285461
driven_lanedir_consec_min18.71855757248574
driven_lanedir_max20.80251903140721
driven_lanedir_mean19.82011286285461
driven_lanedir_median19.879687423762743
driven_lanedir_min18.71855757248574
get_duckie_state_max1.168072372550869e-06
get_duckie_state_mean1.1436548161566208e-06
get_duckie_state_median1.1383941231123311e-06
get_duckie_state_min1.129758645850951e-06
get_robot_state_max0.0035761198731485157
get_robot_state_mean0.00355049990098939
get_robot_state_median0.003556771441165057
get_robot_state_min0.0035123368484789286
get_state_dump_max0.004545759102585512
get_state_dump_mean0.0044941150774864425
get_state_dump_median0.004487988057481955
get_state_dump_min0.004454725092396351
get_ui_image_max0.03633148485575985
get_ui_image_mean0.031093877122165957
get_ui_image_median0.0307276895103804
get_ui_image_min0.02658864461214318
in-drivable-lane_max5.749999999999832
in-drivable-lane_mean3.1624999999999095
in-drivable-lane_min1.249999999999968
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 22.150012862800622, "get_ui_image": 0.028559004635139867, "step_physics": 0.1576421737273865, "survival_time": 59.99999999999873, "driven_lanedir": 20.80251903140721, "get_state_dump": 0.004469373442548994, "get_robot_state": 0.0035680694246570037, "sim_render-ego0": 0.003696515895643401, "get_duckie_state": 1.168072372550869e-06, "in-drivable-lane": 1.249999999999968, "deviation-heading": 13.737267113646968, "agent_compute-ego0": 0.015731128625925336, "complete-iteration": 0.22735665680268324, "set_robot_commands": 0.0022130228895430363, "deviation-center-line": 3.805849198870732, "driven_lanedir_consec": 20.80251903140721, "sim_compute_sim_state": 0.00946362528773172, "sim_compute_performance-ego0": 0.0019360154395695035}, "LF-norm-zigzag-000-ego0": {"driven_any": 22.317457461103647, "get_ui_image": 0.03633148485575985, "step_physics": 0.1900950766522918, "survival_time": 59.99999999999873, "driven_lanedir": 19.662394170160074, "get_state_dump": 0.004454725092396351, "get_robot_state": 0.0035123368484789286, "sim_render-ego0": 0.0036411932564893433, "get_duckie_state": 1.137103764441091e-06, "in-drivable-lane": 2.7499999999999414, "deviation-heading": 17.63807419888253, "agent_compute-ego0": 0.015651753105589195, "complete-iteration": 0.27134722813678525, "set_robot_commands": 0.002139463710546692, "deviation-center-line": 4.25950053848739, "driven_lanedir_consec": 19.662394170160074, "sim_compute_sim_state": 0.013565403535701553, "sim_compute_performance-ego0": 0.0018832032428395245}, "LF-norm-techtrack-000-ego0": {"driven_any": 22.119478847407123, "get_ui_image": 0.03289637438562093, "step_physics": 0.1800978783266828, "survival_time": 59.99999999999873, "driven_lanedir": 18.71855757248574, "get_state_dump": 0.004545759102585512, "get_robot_state": 0.0035454734576731103, "sim_render-ego0": 0.0036422229627089938, "get_duckie_state": 1.129758645850951e-06, "in-drivable-lane": 5.749999999999832, "deviation-heading": 15.227508847040705, "agent_compute-ego0": 0.015650443490796244, "complete-iteration": 0.25710231854854076, "set_robot_commands": 0.002113976149038907, "deviation-center-line": 3.355944192200005, "driven_lanedir_consec": 18.71855757248574, "sim_compute_sim_state": 0.012652304448454109, "sim_compute_performance-ego0": 0.0018848828927960424}, "LF-norm-small_loop-000-ego0": {"driven_any": 22.3416244084959, "get_ui_image": 0.02658864461214318, "step_physics": 0.13489057717970468, "survival_time": 59.99999999999873, "driven_lanedir": 20.09698067736542, "get_state_dump": 0.004506602672414915, "get_robot_state": 0.0035761198731485157, "sim_render-ego0": 0.003626477807685795, "get_duckie_state": 1.1396844817835722e-06, "in-drivable-lane": 2.8999999999998973, "deviation-heading": 14.792001821446288, "agent_compute-ego0": 0.015824524389516304, "complete-iteration": 0.19937606735293015, "set_robot_commands": 0.0021912329004368713, "deviation-center-line": 3.5838663992365976, "driven_lanedir_consec": 20.09698067736542, "sim_compute_sim_state": 0.0061985511366870385, "sim_compute_performance-ego0": 0.0019000332917301585}}
set_robot_commands_max0.0022130228895430363
set_robot_commands_mean0.0021644239123913764
set_robot_commands_median0.0021653483054917817
set_robot_commands_min0.002113976149038907
sim_compute_performance-ego0_max0.0019360154395695035
sim_compute_performance-ego0_mean0.0019010337167338072
sim_compute_performance-ego0_median0.0018924580922631004
sim_compute_performance-ego0_min0.0018832032428395245
sim_compute_sim_state_max0.013565403535701553
sim_compute_sim_state_mean0.010469971102143604
sim_compute_sim_state_median0.011057964868092914
sim_compute_sim_state_min0.0061985511366870385
sim_render-ego0_max0.003696515895643401
sim_render-ego0_mean0.003651602480631883
sim_render-ego0_median0.003641708109599168
sim_render-ego0_min0.003626477807685795
simulation-passed1
step_physics_max0.1900950766522918
step_physics_mean0.16568142647151646
step_physics_median0.16887002602703466
step_physics_min0.13489057717970468
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6199613491Sophie CHAUDONNERETsim-exercise-3aido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:08:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.375000000000057
in-drivable-lane_median0.7999999999999972
driven_lanedir_consec_median1.2942586268412908
deviation-center-line_median0.42226072572762735


other stats
agent_compute-ego0_max0.016486786879025973
agent_compute-ego0_mean0.01609790708232886
agent_compute-ego0_median0.01626988193572862
agent_compute-ego0_min0.015365077578832232
complete-iteration_max0.2711484065422645
complete-iteration_mean0.21860120655251747
complete-iteration_median0.2199074595398682
complete-iteration_min0.1634415005880689
deviation-center-line_max1.7134166579586598
deviation-center-line_mean0.7276147466459362
deviation-center-line_min0.35252087716983066
deviation-heading_max2.6379656419815314
deviation-heading_mean1.8351687045172975
deviation-heading_median1.8886915955824932
deviation-heading_min0.9253259849226716
driven_any_max2.039385268483291
driven_any_mean1.463457645990216
driven_any_median1.6377046559191524
driven_any_min0.5390360036392688
driven_lanedir_consec_max2.0279948904390266
driven_lanedir_consec_mean1.286316443096154
driven_lanedir_consec_min0.5287536282630074
driven_lanedir_max2.0279948904390266
driven_lanedir_mean1.286316443096154
driven_lanedir_median1.2942586268412908
driven_lanedir_min0.5287536282630074
get_duckie_state_max0.023652343402155263
get_duckie_state_mean0.016901695807322335
get_duckie_state_median0.019967592359415292
get_duckie_state_min0.004019255108303494
get_robot_state_max0.0035639267701369068
get_robot_state_mean0.0034995993462912643
get_robot_state_median0.0034822096095138283
get_robot_state_min0.003470051396000493
get_state_dump_max0.008107966565071269
get_state_dump_mean0.00708984006552078
get_state_dump_median0.007615911014693029
get_state_dump_min0.00501957166762579
get_ui_image_max0.03948220152121324
get_ui_image_mean0.03325125916817495
get_ui_image_median0.03375538057511743
get_ui_image_min0.026012074001251707
in-drivable-lane_max2.6000000000000085
in-drivable-lane_mean1.0500000000000007
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.039385268483291, "get_ui_image": 0.03195809086043059, "step_physics": 0.101941237696036, "survival_time": 16.400000000000098, "driven_lanedir": 2.0279948904390266, "get_state_dump": 0.008107966565071269, "get_robot_state": 0.0034877268376683752, "sim_render-ego0": 0.0036580323448297102, "get_duckie_state": 0.023652343402155263, "in-drivable-lane": 0.0, "deviation-heading": 1.2630638078699854, "agent_compute-ego0": 0.016382894979784193, "complete-iteration": 0.20146304133452905, "set_robot_commands": 0.0022060675461603877, "deviation-center-line": 0.4550664402768728, "driven_lanedir_consec": 2.0279948904390266, "sim_compute_sim_state": 0.008108669501307526, "sim_compute_performance-ego0": 0.001884187970842634}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5390360036392688, "get_ui_image": 0.03948220152121324, "step_physics": 0.16603903357799238, "survival_time": 5.14999999999999, "driven_lanedir": 0.5287536282630074, "get_state_dump": 0.0076778622773977425, "get_robot_state": 0.0035639267701369068, "sim_render-ego0": 0.003636422065588144, "get_duckie_state": 0.020252308020224936, "in-drivable-lane": 0.0, "deviation-heading": 0.9253259849226716, "agent_compute-ego0": 0.016486786879025973, "complete-iteration": 0.2711484065422645, "set_robot_commands": 0.0020956993103027344, "deviation-center-line": 0.35252087716983066, "driven_lanedir_consec": 0.5287536282630074, "sim_compute_sim_state": 0.009950665327218862, "sim_compute_performance-ego0": 0.001881727805504432}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.329020285430261, "get_ui_image": 0.03555267028980427, "step_physics": 0.1346523654353511, "survival_time": 11.050000000000022, "driven_lanedir": 0.9026444101878974, "get_state_dump": 0.007553959751988316, "get_robot_state": 0.003470051396000493, "sim_render-ego0": 0.0035946916889499974, "get_duckie_state": 0.019682876698605647, "in-drivable-lane": 2.6000000000000085, "deviation-heading": 2.6379656419815314, "agent_compute-ego0": 0.016156868891673046, "complete-iteration": 0.23835187774520736, "set_robot_commands": 0.002050596314507562, "deviation-center-line": 0.3894550111783819, "driven_lanedir_consec": 0.9026444101878974, "sim_compute_sim_state": 0.01373388316180255, "sim_compute_performance-ego0": 0.001828240918683576}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.9463890264080437, "get_ui_image": 0.026012074001251707, "step_physics": 0.09626544846428764, "survival_time": 15.700000000000088, "driven_lanedir": 1.685872843494684, "get_state_dump": 0.00501957166762579, "get_robot_state": 0.003476692381359282, "sim_render-ego0": 0.0035314764295305526, "get_duckie_state": 0.004019255108303494, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 2.514319383295001, "agent_compute-ego0": 0.015365077578832232, "complete-iteration": 0.1634415005880689, "set_robot_commands": 0.0020238906618148564, "deviation-center-line": 1.7134166579586598, "driven_lanedir_consec": 1.685872843494684, "sim_compute_sim_state": 0.005831368007357158, "sim_compute_performance-ego0": 0.0018219501253158327}}
set_robot_commands_max0.0022060675461603877
set_robot_commands_mean0.002094063458196385
set_robot_commands_median0.0020731478124051484
set_robot_commands_min0.0020238906618148564
sim_compute_performance-ego0_max0.001884187970842634
sim_compute_performance-ego0_mean0.0018540267050866188
sim_compute_performance-ego0_median0.001854984362094004
sim_compute_performance-ego0_min0.0018219501253158327
sim_compute_sim_state_max0.01373388316180255
sim_compute_sim_state_mean0.009406146499421524
sim_compute_sim_state_median0.009029667414263197
sim_compute_sim_state_min0.005831368007357158
sim_render-ego0_max0.0036580323448297102
sim_render-ego0_mean0.0036051556322246017
sim_render-ego0_median0.0036155568772690706
sim_render-ego0_min0.0035314764295305526
simulation-passed1
step_physics_max0.16603903357799238
step_physics_mean0.1247245212934168
step_physics_median0.11829680156569355
step_physics_min0.09626544846428764
survival_time_max16.400000000000098
survival_time_mean12.075000000000047
survival_time_min5.14999999999999
No reset possible
6199513490Sophie CHAUDONNERETsim-exercise-3aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.4858051694915435
survival_time_median59.99999999999873
deviation-center-line_median4.235385172607889
in-drivable-lane_median9.424999999999724


other stats
agent_compute-ego0_max0.01602949329855837
agent_compute-ego0_mean0.015773625893954136
agent_compute-ego0_median0.01579670624173154
agent_compute-ego0_min0.015471597793795089
complete-iteration_max0.20559478322234775
complete-iteration_mean0.1793334193273349
complete-iteration_median0.17691805062941168
complete-iteration_min0.1579027928281684
deviation-center-line_max5.4882632215147495
deviation-center-line_mean4.34626372007472
deviation-center-line_min3.4260213135683557
deviation-heading_max9.891933027681205
deviation-heading_mean7.491341509083323
deviation-heading_median7.422859948866741
deviation-heading_min5.227713110918605
driven_any_max7.921118772611221
driven_any_mean7.919392762983948
driven_any_median7.920943572264083
driven_any_min7.914565134796407
driven_lanedir_consec_max7.337558864411624
driven_lanedir_consec_mean6.446551082666827
driven_lanedir_consec_min5.477035127272594
driven_lanedir_max7.337558864411624
driven_lanedir_mean6.446551082666827
driven_lanedir_median6.4858051694915435
driven_lanedir_min5.477035127272594
get_duckie_state_max1.4045057844659074e-06
get_duckie_state_mean1.3122451394721928e-06
get_duckie_state_median1.302567449437887e-06
get_duckie_state_min1.2393398745470896e-06
get_robot_state_max0.00368620553282675
get_robot_state_mean0.003609494603146721
get_robot_state_median0.0035897373259811973
get_robot_state_min0.003572298227797738
get_state_dump_max0.004623924465004749
get_state_dump_mean0.0045060007697239595
get_state_dump_median0.004533791720718269
get_state_dump_min0.0043324951724545546
get_ui_image_max0.036231752637026216
get_ui_image_mean0.030739395594616713
get_ui_image_median0.03029985541010975
get_ui_image_min0.026126118921221145
in-drivable-lane_max17.69999999999946
in-drivable-lane_mean9.94999999999968
in-drivable-lane_min3.2499999999998153
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914565134796407, "get_ui_image": 0.028007290940995418, "step_physics": 0.0889162632150515, "survival_time": 59.99999999999873, "driven_lanedir": 6.481810019962147, "get_state_dump": 0.0043324951724545546, "get_robot_state": 0.0035906818685285456, "sim_render-ego0": 0.003649239734646482, "get_duckie_state": 1.2393398745470896e-06, "in-drivable-lane": 9.89999999999966, "deviation-heading": 6.730273003634963, "agent_compute-ego0": 0.01581073680785574, "complete-iteration": 0.1579027928281684, "set_robot_commands": 0.0022750484457023934, "deviation-center-line": 4.398433927338791, "driven_lanedir_consec": 6.481810019962147, "sim_compute_sim_state": 0.009343229265236834, "sim_compute_performance-ego0": 0.001900693558336396}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921009400984264, "get_ui_image": 0.036231752637026216, "step_physics": 0.12454955405140795, "survival_time": 59.99999999999873, "driven_lanedir": 6.489800319020939, "get_state_dump": 0.0045388866523024835, "get_robot_state": 0.003588792783433849, "sim_render-ego0": 0.003758628203608809, "get_duckie_state": 1.4045057844659074e-06, "in-drivable-lane": 8.949999999999786, "deviation-heading": 9.891933027681205, "agent_compute-ego0": 0.01602949329855837, "complete-iteration": 0.20559478322234775, "set_robot_commands": 0.002209535149313032, "deviation-center-line": 4.072336417876986, "driven_lanedir_consec": 6.489800319020939, "sim_compute_sim_state": 0.012664888820282922, "sim_compute_performance-ego0": 0.0019446517108977583}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921118772611221, "get_ui_image": 0.03259241987922408, "step_physics": 0.1129656397829842, "survival_time": 59.99999999999873, "driven_lanedir": 7.337558864411624, "get_state_dump": 0.004528696789134055, "get_robot_state": 0.003572298227797738, "sim_render-ego0": 0.003722550569227792, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 3.2499999999998153, "deviation-heading": 8.11544689409852, "agent_compute-ego0": 0.015782675675607344, "complete-iteration": 0.1907492898882279, "set_robot_commands": 0.0022235625391697307, "deviation-center-line": 3.4260213135683557, "driven_lanedir_consec": 7.337558864411624, "sim_compute_sim_state": 0.013361883997222369, "sim_compute_performance-ego0": 0.001922385877216984}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.9208777435439, "get_ui_image": 0.026126118921221145, "step_physics": 0.09893792495441676, "survival_time": 59.99999999999873, "driven_lanedir": 5.477035127272594, "get_state_dump": 0.004623924465004749, "get_robot_state": 0.00368620553282675, "sim_render-ego0": 0.003748956469076063, "get_duckie_state": 1.2953215892070737e-06, "in-drivable-lane": 17.69999999999946, "deviation-heading": 5.227713110918605, "agent_compute-ego0": 0.015471597793795089, "complete-iteration": 0.1630868113705955, "set_robot_commands": 0.0022542315855510627, "deviation-center-line": 5.4882632215147495, "driven_lanedir_consec": 5.477035127272594, "sim_compute_sim_state": 0.006196498672332891, "sim_compute_performance-ego0": 0.0019654100086170865}}
set_robot_commands_max0.0022750484457023934
set_robot_commands_mean0.0022405944299340548
set_robot_commands_median0.0022388970623603965
set_robot_commands_min0.002209535149313032
sim_compute_performance-ego0_max0.0019654100086170865
sim_compute_performance-ego0_mean0.0019332852887670564
sim_compute_performance-ego0_median0.0019335187940573712
sim_compute_performance-ego0_min0.001900693558336396
sim_compute_sim_state_max0.013361883997222369
sim_compute_sim_state_mean0.010391625188768754
sim_compute_sim_state_median0.01100405904275988
sim_compute_sim_state_min0.006196498672332891
sim_render-ego0_max0.003758628203608809
sim_render-ego0_mean0.0037198437441397863
sim_render-ego0_median0.003735753519151928
sim_render-ego0_min0.003649239734646482
simulation-passed1
step_physics_max0.12454955405140795
step_physics_mean0.10634234550096512
step_physics_median0.10595178236870048
step_physics_min0.0889162632150515
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6199413489Faisal Mubaidien 🇯🇴baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.748050610032039
survival_time_median59.99999999999873
deviation-center-line_median3.657566150411524
in-drivable-lane_median7.074999999999813


other stats
agent_compute-ego0_max0.012106323718627625
agent_compute-ego0_mean0.011939049809302616
agent_compute-ego0_median0.011937472643602103
agent_compute-ego0_min0.011774930231378636
complete-iteration_max0.1942614369547238
complete-iteration_mean0.16875605961365267
complete-iteration_median0.16635876700443392
complete-iteration_min0.14804526749101904
deviation-center-line_max4.367523962457368
deviation-center-line_mean3.7697864827200274
deviation-center-line_min3.3964896675996927
deviation-heading_max10.690181983532662
deviation-heading_mean8.85405389931029
deviation-heading_median9.117856683967076
deviation-heading_min6.490320245774349
driven_any_max7.921089859440449
driven_any_mean7.9193960436551025
driven_any_median7.920965638276382
driven_any_min7.914563038627198
driven_lanedir_consec_max7.463188259405643
driven_lanedir_consec_mean6.187336053611949
driven_lanedir_consec_min3.7900547349780727
driven_lanedir_max7.463188259405643
driven_lanedir_mean6.450386312163181
driven_lanedir_median6.748050610032039
driven_lanedir_min4.842255769183002
get_duckie_state_max1.209165333311921e-06
get_duckie_state_mean1.1195846640200144e-06
get_duckie_state_median1.125986828196555e-06
get_duckie_state_min1.017199666375026e-06
get_robot_state_max0.0035309168222444837
get_robot_state_mean0.0034985768110130746
get_robot_state_median0.003499475446569235
get_robot_state_min0.0034644395286693463
get_state_dump_max0.004282360966259197
get_state_dump_mean0.004260289430816803
get_state_dump_median0.00426815788910649
get_state_dump_min0.004222480978795035
get_ui_image_max0.03572088137554388
get_ui_image_mean0.030311902099406096
get_ui_image_median0.030044372234614463
get_ui_image_min0.025437982552851568
in-drivable-lane_max21.69999999999889
in-drivable-lane_mean9.299999999999637
in-drivable-lane_min1.3500000000000192
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914563038627198, "get_ui_image": 0.027959619533211664, "step_physics": 0.08931063851349359, "survival_time": 59.99999999999873, "driven_lanedir": 7.063295238848532, "get_state_dump": 0.004222480978795035, "get_robot_state": 0.0035309168222444837, "sim_render-ego0": 0.003606036541166155, "get_duckie_state": 1.017199666375026e-06, "in-drivable-lane": 5.099999999999824, "deviation-heading": 7.56646000672108, "agent_compute-ego0": 0.01188934554069068, "complete-iteration": 0.15403748273253937, "set_robot_commands": 0.0021466319507405123, "deviation-center-line": 3.651915410500738, "driven_lanedir_consec": 7.063295238848532, "sim_compute_sim_state": 0.009430509522792997, "sim_compute_performance-ego0": 0.0018667855131735312}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921028095455251, "get_ui_image": 0.03572088137554388, "step_physics": 0.11884361738765568, "survival_time": 59.99999999999873, "driven_lanedir": 6.432805981215546, "get_state_dump": 0.004274346052260324, "get_robot_state": 0.0035156123743366936, "sim_render-ego0": 0.0035933856662365917, "get_duckie_state": 1.1343245303799569e-06, "in-drivable-lane": 9.049999999999802, "deviation-heading": 10.669253361213077, "agent_compute-ego0": 0.011774930231378636, "complete-iteration": 0.1942614369547238, "set_robot_commands": 0.0021309352337966652, "deviation-center-line": 3.663216890322311, "driven_lanedir_consec": 6.432805981215546, "sim_compute_sim_state": 0.012463052108027754, "sim_compute_performance-ego0": 0.0018688028400684776}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921089859440449, "get_ui_image": 0.032129124936017266, "step_physics": 0.1060019285851573, "survival_time": 59.99999999999873, "driven_lanedir": 7.463188259405643, "get_state_dump": 0.004282360966259197, "get_robot_state": 0.0034833385188017757, "sim_render-ego0": 0.003565946883901172, "get_duckie_state": 1.209165333311921e-06, "in-drivable-lane": 1.3500000000000192, "deviation-heading": 10.690181983532662, "agent_compute-ego0": 0.012106323718627625, "complete-iteration": 0.17868005127632847, "set_robot_commands": 0.0020857301977254467, "deviation-center-line": 3.3964896675996927, "driven_lanedir_consec": 7.463188259405643, "sim_compute_sim_state": 0.013118959088607392, "sim_compute_performance-ego0": 0.0018319327269465996}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920903181097512, "get_ui_image": 0.025437982552851568, "step_physics": 0.0894615064552682, "survival_time": 59.99999999999873, "driven_lanedir": 4.842255769183002, "get_state_dump": 0.0042619697259526565, "get_robot_state": 0.0034644395286693463, "sim_render-ego0": 0.0035144520441161703, "get_duckie_state": 1.1176491260131532e-06, "in-drivable-lane": 21.69999999999889, "deviation-heading": 6.490320245774349, "agent_compute-ego0": 0.011985599746513526, "complete-iteration": 0.14804526749101904, "set_robot_commands": 0.002027368466125539, "deviation-center-line": 4.367523962457368, "driven_lanedir_consec": 3.7900547349780727, "sim_compute_sim_state": 0.006001700568854263, "sim_compute_performance-ego0": 0.0018171281441363763}}
set_robot_commands_max0.0021466319507405123
set_robot_commands_mean0.002097666462097041
set_robot_commands_median0.002108332715761056
set_robot_commands_min0.002027368466125539
sim_compute_performance-ego0_max0.0018688028400684776
sim_compute_performance-ego0_mean0.0018461623060812464
sim_compute_performance-ego0_median0.0018493591200600657
sim_compute_performance-ego0_min0.0018171281441363763
sim_compute_sim_state_max0.013118959088607392
sim_compute_sim_state_mean0.010253555322070602
sim_compute_sim_state_median0.010946780815410374
sim_compute_sim_state_min0.006001700568854263
sim_render-ego0_max0.003606036541166155
sim_render-ego0_mean0.003569955283855022
sim_render-ego0_median0.0035796662750688817
sim_render-ego0_min0.0035144520441161703
simulation-passed1
step_physics_max0.11884361738765568
step_physics_mean0.10090442273539368
step_physics_median0.09773171752021276
step_physics_min0.08931063851349359
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6199313488Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.37500000000002
in-drivable-lane_median2.749999999999996
driven_lanedir_consec_median3.268233901961299
deviation-center-line_median0.4426817080939134


other stats
agent_compute-ego0_max0.016166872053004024
agent_compute-ego0_mean0.015926422495278404
agent_compute-ego0_median0.01593324030514866
agent_compute-ego0_min0.01567233731781227
complete-iteration_max0.2928415407305178
complete-iteration_mean0.2543215719373062
complete-iteration_median0.26298096515116043
complete-iteration_min0.19848281671638623
deviation-center-line_max0.8816989629186834
deviation-center-line_mean0.482454951728703
deviation-center-line_min0.1627574278083022
deviation-heading_max2.891066181843624
deviation-heading_mean1.678107673993016
deviation-heading_median1.6004585045711812
deviation-heading_min0.6204475049860773
driven_any_max6.210896670763409
driven_any_mean4.099398879864166
driven_any_median4.526386803904542
driven_any_min1.1339252408841731
driven_lanedir_consec_max4.710477910034417
driven_lanedir_consec_mean3.0910421353506
driven_lanedir_consec_min1.1172228274453848
driven_lanedir_max4.710477910034417
driven_lanedir_mean3.0910421353506
driven_lanedir_median3.268233901961299
driven_lanedir_min1.1172228274453848
get_duckie_state_max0.02577394965692615
get_duckie_state_mean0.017606660794192416
get_duckie_state_median0.020262975913736176
get_duckie_state_min0.004126741692371166
get_robot_state_max0.003760637120997652
get_robot_state_mean0.003605061759803848
get_robot_state_median0.0035579033532803796
get_robot_state_min0.0035438032116569818
get_state_dump_max0.008476162633151874
get_state_dump_mean0.007303779973488304
get_state_dump_median0.007770781409500637
get_state_dump_min0.005197394441800067
get_ui_image_max0.03944839861081994
get_ui_image_mean0.033761847526938525
get_ui_image_median0.034405813528088976
get_ui_image_min0.026787364440756217
in-drivable-lane_max3.3500000000000227
in-drivable-lane_mean2.212500000000004
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.8985048774075324, "get_ui_image": 0.03280744315884637, "step_physics": 0.14527235132582644, "survival_time": 6.999999999999983, "driven_lanedir": 1.857370069389351, "get_state_dump": 0.008476162633151874, "get_robot_state": 0.003760637120997652, "sim_render-ego0": 0.00399065355882577, "get_duckie_state": 0.02577394965692615, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.8808731574506794, "agent_compute-ego0": 0.015775944324249915, "complete-iteration": 0.24821385086005465, "set_robot_commands": 0.002482972246535281, "deviation-center-line": 0.21218178652900355, "driven_lanedir_consec": 1.857370069389351, "sim_compute_sim_state": 0.007632801718745671, "sim_compute_performance-ego0": 0.0021524699867194424}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.15426873040155, "get_ui_image": 0.03944839861081994, "step_physics": 0.18537556002105493, "survival_time": 13.75000000000006, "driven_lanedir": 4.710477910034417, "get_state_dump": 0.007650808147762133, "get_robot_state": 0.0035562351130057073, "sim_render-ego0": 0.0037053365638290625, "get_duckie_state": 0.020088899826657944, "in-drivable-lane": 3.3500000000000227, "deviation-heading": 2.320043851691683, "agent_compute-ego0": 0.01567233731781227, "complete-iteration": 0.2928415407305178, "set_robot_commands": 0.0021652320156926694, "deviation-center-line": 0.6731816296588231, "driven_lanedir_consec": 4.710477910034417, "sim_compute_sim_state": 0.013203231320864912, "sim_compute_performance-ego0": 0.0018983275994010592}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1339252408841731, "get_ui_image": 0.03600418389733158, "step_physics": 0.17322490820244177, "survival_time": 3.2999999999999963, "driven_lanedir": 1.1172228274453848, "get_state_dump": 0.00789075467123914, "get_robot_state": 0.003559571593555052, "sim_render-ego0": 0.003804822466266689, "get_duckie_state": 0.020437052000814408, "in-drivable-lane": 0.0, "deviation-heading": 0.6204475049860773, "agent_compute-ego0": 0.016166872053004024, "complete-iteration": 0.2777480794422662, "set_robot_commands": 0.002255169313345382, "deviation-center-line": 0.1627574278083022, "driven_lanedir_consec": 1.1172228274453848, "sim_compute_sim_state": 0.012356622895198082, "sim_compute_performance-ego0": 0.0019605515608147007}, "LFP-norm-small_loop-000-ego0": {"driven_any": 6.210896670763409, "get_ui_image": 0.026787364440756217, "step_physics": 0.1290097295606094, "survival_time": 14.100000000000064, "driven_lanedir": 4.679097734533247, "get_state_dump": 0.005197394441800067, "get_robot_state": 0.0035438032116569818, "sim_render-ego0": 0.003605999289468826, "get_duckie_state": 0.004126741692371166, "in-drivable-lane": 2.7500000000000018, "deviation-heading": 2.891066181843624, "agent_compute-ego0": 0.016090536286047407, "complete-iteration": 0.19848281671638623, "set_robot_commands": 0.0022488887234205913, "deviation-center-line": 0.8816989629186834, "driven_lanedir_consec": 4.679097734533247, "sim_compute_sim_state": 0.005905794170635749, "sim_compute_performance-ego0": 0.001886386332158065}}
set_robot_commands_max0.002482972246535281
set_robot_commands_mean0.002288065574748481
set_robot_commands_median0.002252029018382987
set_robot_commands_min0.0021652320156926694
sim_compute_performance-ego0_max0.0021524699867194424
sim_compute_performance-ego0_mean0.001974433869773317
sim_compute_performance-ego0_median0.00192943958010788
sim_compute_performance-ego0_min0.001886386332158065
sim_compute_sim_state_max0.013203231320864912
sim_compute_sim_state_mean0.009774612526361104
sim_compute_sim_state_median0.009994712306971876
sim_compute_sim_state_min0.005905794170635749
sim_render-ego0_max0.00399065355882577
sim_render-ego0_mean0.003776702969597587
sim_render-ego0_median0.003755079515047875
sim_render-ego0_min0.003605999289468826
simulation-passed1
step_physics_max0.18537556002105493
step_physics_mean0.15822063727748314
step_physics_median0.15924862976413412
step_physics_min0.1290097295606094
survival_time_max14.100000000000064
survival_time_mean9.537500000000026
survival_time_min3.2999999999999963
No reset possible
6199213487Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:29:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median16.72116967707168
survival_time_median45.849999999999525
deviation-center-line_median2.515788852014752
in-drivable-lane_median8.874999999999911


other stats
agent_compute-ego0_max0.016117200764093075
agent_compute-ego0_mean0.015479218238483411
agent_compute-ego0_median0.015388585711767142
agent_compute-ego0_min0.015022500766306296
complete-iteration_max0.25686633318885976
complete-iteration_mean0.21486991689113177
complete-iteration_median0.21120066594964892
complete-iteration_min0.18021200247636932
deviation-center-line_max3.920781982469066
deviation-center-line_mean2.5107924009336804
deviation-center-line_min1.0908099172361534
deviation-heading_max12.6112212034759
deviation-heading_mean7.855264362281044
deviation-heading_median8.047330643948573
deviation-heading_min2.7151749577511333
driven_any_max28.761730813373553
driven_any_mean20.332464009354887
driven_any_median21.669353948985098
driven_any_min9.2294173260758
driven_lanedir_consec_max23.310554517542016
driven_lanedir_consec_mean16.247005046100963
driven_lanedir_consec_min8.23512631271848
driven_lanedir_max23.310554517542016
driven_lanedir_mean16.247005046100963
driven_lanedir_median16.72116967707168
driven_lanedir_min8.23512631271848
get_duckie_state_max1.25819896281907e-06
get_duckie_state_mean1.2099108280499709e-06
get_duckie_state_median1.1967601524823507e-06
get_duckie_state_min1.1879240444161116e-06
get_robot_state_max0.0035856944499629557
get_robot_state_mean0.00353266384239533
get_robot_state_median0.0035244278953200257
get_robot_state_min0.003496105128978313
get_state_dump_max0.004466549805768831
get_state_dump_mean0.00440583214285935
get_state_dump_median0.004397854250590515
get_state_dump_min0.00436107026448754
get_ui_image_max0.03561121974757669
get_ui_image_mean0.030410933308928734
get_ui_image_median0.03016994699960219
get_ui_image_min0.025692619488933893
in-drivable-lane_max9.849999999999817
in-drivable-lane_mean7.537499999999919
in-drivable-lane_min2.550000000000036
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.2294173260758, "get_ui_image": 0.028051953504581263, "step_physics": 0.12578624368894217, "survival_time": 20.15000000000015, "driven_lanedir": 8.23512631271848, "get_state_dump": 0.0044249774205802695, "get_robot_state": 0.0035856944499629557, "sim_render-ego0": 0.003621811913971854, "get_duckie_state": 1.1991746354811262e-06, "in-drivable-lane": 2.550000000000036, "deviation-heading": 2.7151749577511333, "agent_compute-ego0": 0.015632801126725604, "complete-iteration": 0.19403449438586093, "set_robot_commands": 0.0021104145758222823, "deviation-center-line": 1.0908099172361534, "driven_lanedir_consec": 8.23512631271848, "sim_compute_sim_state": 0.008854259358774317, "sim_compute_performance-ego0": 0.001890972109124212}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.563091066727132, "get_ui_image": 0.03561121974757669, "step_physics": 0.1762286155646687, "survival_time": 59.99999999999873, "driven_lanedir": 23.310554517542016, "get_state_dump": 0.0043707310806007605, "get_robot_state": 0.003500488973676315, "sim_render-ego0": 0.0035732268890075938, "get_duckie_state": 1.25819896281907e-06, "in-drivable-lane": 8.59999999999972, "deviation-heading": 12.6112212034759, "agent_compute-ego0": 0.016117200764093075, "complete-iteration": 0.25686633318885976, "set_robot_commands": 0.002042550826251358, "deviation-center-line": 3.920781982469066, "driven_lanedir_consec": 23.310554517542016, "sim_compute_sim_state": 0.013484973693072649, "sim_compute_performance-ego0": 0.0018640392328876936}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.761730813373553, "get_ui_image": 0.032287940494623114, "step_physics": 0.15269098551843088, "survival_time": 59.99999999999873, "driven_lanedir": 23.072672277218636, "get_state_dump": 0.00436107026448754, "get_robot_state": 0.003496105128978313, "sim_render-ego0": 0.003627962712741315, "get_duckie_state": 1.1879240444161116e-06, "in-drivable-lane": 9.849999999999817, "deviation-heading": 11.179027599058736, "agent_compute-ego0": 0.015022500766306296, "complete-iteration": 0.2283668375134369, "set_robot_commands": 0.0020858119866135317, "deviation-center-line": 3.2007774101920488, "driven_lanedir_consec": 23.072672277218636, "sim_compute_sim_state": 0.012824888134082092, "sim_compute_performance-ego0": 0.001895023920851683}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.775616831243058, "get_ui_image": 0.025692619488933893, "step_physics": 0.11760236897806484, "survival_time": 31.700000000000315, "driven_lanedir": 10.36966707692472, "get_state_dump": 0.004466549805768831, "get_robot_state": 0.0035483668169637365, "sim_render-ego0": 0.003604892670638918, "get_duckie_state": 1.1943456694835752e-06, "in-drivable-lane": 9.150000000000102, "deviation-heading": 4.915633688838411, "agent_compute-ego0": 0.01514437029680868, "complete-iteration": 0.18021200247636932, "set_robot_commands": 0.0021161695164958324, "deviation-center-line": 1.8308002938374544, "driven_lanedir_consec": 10.36966707692472, "sim_compute_sim_state": 0.006088820029431441, "sim_compute_performance-ego0": 0.001873802575539416}}
set_robot_commands_max0.0021161695164958324
set_robot_commands_mean0.002088736726295751
set_robot_commands_median0.002098113281217907
set_robot_commands_min0.002042550826251358
sim_compute_performance-ego0_max0.001895023920851683
sim_compute_performance-ego0_mean0.001880959459600751
sim_compute_performance-ego0_median0.001882387342331814
sim_compute_performance-ego0_min0.0018640392328876936
sim_compute_sim_state_max0.013484973693072649
sim_compute_sim_state_mean0.010313235303840124
sim_compute_sim_state_median0.010839573746428206
sim_compute_sim_state_min0.006088820029431441
sim_render-ego0_max0.003627962712741315
sim_render-ego0_mean0.00360697354658992
sim_render-ego0_median0.003613352292305386
sim_render-ego0_min0.0035732268890075938
simulation-passed1
step_physics_max0.1762286155646687
step_physics_mean0.14307705343752666
step_physics_median0.13923861460368653
step_physics_min0.11760236897806484
survival_time_max59.99999999999873
survival_time_mean42.96249999999948
survival_time_min20.15000000000015
No reset possible
6199113485Sophie CHAUDONNERETsim-exercise-3aido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6199013485Sophie CHAUDONNERETsim-exercise-3aido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6198913485Sophie CHAUDONNERETsim-exercise-3aido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6198813484Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.474999999999989
in-drivable-lane_median2.224999999999992
driven_lanedir_consec_median1.123804227240233
deviation-center-line_median0.2235132167269232


other stats
agent_compute-ego0_max0.01690885295038638
agent_compute-ego0_mean0.016135381985396713
agent_compute-ego0_median0.016033624019166425
agent_compute-ego0_min0.015565426952867624
complete-iteration_max0.341897612032683
complete-iteration_mean0.26389049925848884
complete-iteration_median0.25518695299165794
complete-iteration_min0.2032904790179564
deviation-center-line_max0.35763995260615455
deviation-center-line_mean0.22943735091710943
deviation-center-line_min0.1130830176084368
deviation-heading_max1.399661962528873
deviation-heading_mean1.0027032746168585
deviation-heading_median0.982973699726958
deviation-heading_min0.6452037364846448
driven_any_max3.486859336630767
driven_any_mean2.063072248491948
driven_any_median2.115684647832614
driven_any_min0.534060361671797
driven_lanedir_consec_max1.9945703333498117
driven_lanedir_consec_mean1.1373917447857296
driven_lanedir_consec_min0.3073881913126413
driven_lanedir_max1.9945703333498117
driven_lanedir_mean1.1373917447857296
driven_lanedir_median1.123804227240233
driven_lanedir_min0.3073881913126413
get_duckie_state_max0.024375502268473303
get_duckie_state_mean0.01723804740760162
get_duckie_state_median0.02027619827973899
get_duckie_state_min0.004024290802455185
get_robot_state_max0.0036421806915946623
get_robot_state_mean0.0035685941607304776
get_robot_state_median0.0035634664766281
get_robot_state_min0.003505262998071047
get_state_dump_max0.00849046508471171
get_state_dump_mean0.0073470865481363645
get_state_dump_median0.007860896255159453
get_state_dump_min0.005176088597514842
get_ui_image_max0.0405211707820063
get_ui_image_mean0.03407508768764763
get_ui_image_median0.03434144714510584
get_ui_image_min0.02709628567837253
in-drivable-lane_max3.6499999999999906
in-drivable-lane_mean2.0874999999999937
in-drivable-lane_min0.2500000000000001
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.365655244147135, "get_ui_image": 0.03297784924507141, "step_physics": 0.15391658544540404, "survival_time": 5.949999999999987, "driven_lanedir": 1.8499760021660367, "get_state_dump": 0.00849046508471171, "get_robot_state": 0.0036025663216908772, "sim_render-ego0": 0.003725997606913249, "get_duckie_state": 0.024375502268473303, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.019616173996324, "agent_compute-ego0": 0.016245911518732708, "complete-iteration": 0.25518625378608706, "set_robot_commands": 0.0022149960199991862, "deviation-center-line": 0.2520474305257845, "driven_lanedir_consec": 1.8499760021660367, "sim_compute_sim_state": 0.00764039158821106, "sim_compute_performance-ego0": 0.001908189058303833}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.534060361671797, "get_ui_image": 0.0405211707820063, "step_physics": 0.23545643039371655, "survival_time": 2.25, "driven_lanedir": 0.3976324523144292, "get_state_dump": 0.008071671361508577, "get_robot_state": 0.0036421806915946623, "sim_render-ego0": 0.003868268883746603, "get_duckie_state": 0.0205629649369613, "in-drivable-lane": 0.2500000000000001, "deviation-heading": 0.6452037364846448, "agent_compute-ego0": 0.01690885295038638, "complete-iteration": 0.341897612032683, "set_robot_commands": 0.0021952287010524583, "deviation-center-line": 0.1949790029280619, "driven_lanedir_consec": 0.3976324523144292, "sim_compute_sim_state": 0.008625004602515179, "sim_compute_performance-ego0": 0.001955042714657991}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.486859336630767, "get_ui_image": 0.03570504504514028, "step_physics": 0.1529719930097281, "survival_time": 8.249999999999982, "driven_lanedir": 1.9945703333498117, "get_state_dump": 0.007650121148810329, "get_robot_state": 0.0035243666315653236, "sim_render-ego0": 0.003631667918469533, "get_duckie_state": 0.01998943162251668, "in-drivable-lane": 2.84999999999999, "deviation-heading": 1.399661962528873, "agent_compute-ego0": 0.015565426952867624, "complete-iteration": 0.25518765219722883, "set_robot_commands": 0.002119953373828566, "deviation-center-line": 0.35763995260615455, "driven_lanedir_consec": 1.9945703333498117, "sim_compute_sim_state": 0.012092268610575113, "sim_compute_performance-ego0": 0.0018509669476244825}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.8657140515180937, "get_ui_image": 0.02709628567837253, "step_physics": 0.1345616331194887, "survival_time": 4.99999999999999, "driven_lanedir": 0.3073881913126413, "get_state_dump": 0.005176088597514842, "get_robot_state": 0.003505262998071047, "sim_render-ego0": 0.003590057391931515, "get_duckie_state": 0.004024290802455185, "in-drivable-lane": 3.6499999999999906, "deviation-heading": 0.9463312254575922, "agent_compute-ego0": 0.015821336519600143, "complete-iteration": 0.2032904790179564, "set_robot_commands": 0.002082987587050636, "deviation-center-line": 0.1130830176084368, "driven_lanedir_consec": 0.3073881913126413, "sim_compute_sim_state": 0.005517083819549863, "sim_compute_performance-ego0": 0.001836809781518313}}
set_robot_commands_max0.0022149960199991862
set_robot_commands_mean0.002153291420482712
set_robot_commands_median0.002157591037440512
set_robot_commands_min0.002082987587050636
sim_compute_performance-ego0_max0.001955042714657991
sim_compute_performance-ego0_mean0.0018877521255261547
sim_compute_performance-ego0_median0.0018795780029641576
sim_compute_performance-ego0_min0.001836809781518313
sim_compute_sim_state_max0.012092268610575113
sim_compute_sim_state_mean0.008468687155212803
sim_compute_sim_state_median0.00813269809536312
sim_compute_sim_state_min0.005517083819549863
sim_render-ego0_max0.003868268883746603
sim_render-ego0_mean0.003703997950265225
sim_render-ego0_median0.003678832762691391
sim_render-ego0_min0.003590057391931515
simulation-passed1
step_physics_max0.23545643039371655
step_physics_mean0.16922666049208435
step_physics_median0.1534442892275661
step_physics_min0.1345616331194887
survival_time_max8.249999999999982
survival_time_mean5.36249999999999
survival_time_min2.25
No reset possible
6198713484Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.574999999999992
in-drivable-lane_median1.149999999999996
driven_lanedir_consec_median1.1604078402650615
deviation-center-line_median0.19154773547270643


other stats
agent_compute-ego0_max0.016818209489186605
agent_compute-ego0_mean0.016369111971825986
agent_compute-ego0_median0.01648974504048442
agent_compute-ego0_min0.015678748317148494
complete-iteration_max0.34272919309900163
complete-iteration_mean0.2620694177385419
complete-iteration_median0.25556411256595535
complete-iteration_min0.1944202527232554
deviation-center-line_max0.28900569663366904
deviation-center-line_mean0.20413071054343385
deviation-center-line_min0.1444216745946533
deviation-heading_max0.7906326233891195
deviation-heading_mean0.7053384487209715
deviation-heading_median0.7207257370585161
deviation-heading_min0.5892696973777342
driven_any_max2.3643731139693607
driven_any_mean1.5993741601724398
driven_any_median1.74087809460741
driven_any_min0.5513673375055786
driven_lanedir_consec_max1.763827819691024
driven_lanedir_consec_mean1.1264977472334856
driven_lanedir_consec_min0.42134748871279504
driven_lanedir_max1.763827819691024
driven_lanedir_mean1.1264977472334856
driven_lanedir_median1.1604078402650615
driven_lanedir_min0.42134748871279504
get_duckie_state_max0.026470848492213657
get_duckie_state_mean0.018106984454583093
get_duckie_state_median0.02087018724451674
get_duckie_state_min0.004216714837085241
get_robot_state_max0.0037653665153347714
get_robot_state_mean0.0036727045287361783
get_robot_state_median0.0036572737051240095
get_robot_state_min0.003610904189361923
get_state_dump_max0.00870396409715925
get_state_dump_mean0.007503943576697128
get_state_dump_median0.008033570668376084
get_state_dump_min0.005244668872877099
get_ui_image_max0.039586757091765706
get_ui_image_mean0.0337187673065765
get_ui_image_median0.034116006363816814
get_ui_image_min0.027056299406906653
in-drivable-lane_max2.4499999999999953
in-drivable-lane_mean1.249999999999997
in-drivable-lane_min0.2500000000000001
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.9130221838315205, "get_ui_image": 0.0323212414371724, "step_physics": 0.13974115313315877, "survival_time": 4.849999999999991, "driven_lanedir": 1.763827819691024, "get_state_dump": 0.00870396409715925, "get_robot_state": 0.0037653665153347714, "sim_render-ego0": 0.004021968160356794, "get_duckie_state": 0.026470848492213657, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 0.72934892131136, "agent_compute-ego0": 0.01662554302994086, "complete-iteration": 0.24436115245429835, "set_robot_commands": 0.002677800704021843, "deviation-center-line": 0.17567810054675587, "driven_lanedir_consec": 1.763827819691024, "sim_compute_sim_state": 0.007831043126631757, "sim_compute_performance-ego0": 0.0021137826296747948}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5513673375055786, "get_ui_image": 0.039586757091765706, "step_physics": 0.23684711659208257, "survival_time": 2.3, "driven_lanedir": 0.42134748871279504, "get_state_dump": 0.008111669662150931, "get_robot_state": 0.003668952495493787, "sim_render-ego0": 0.003910937207810422, "get_duckie_state": 0.02098530404111172, "in-drivable-lane": 0.2500000000000001, "deviation-heading": 0.5892696973777342, "agent_compute-ego0": 0.016353947051027988, "complete-iteration": 0.34272919309900163, "set_robot_commands": 0.002387356250844103, "deviation-center-line": 0.207417370398657, "driven_lanedir_consec": 0.42134748871279504, "sim_compute_sim_state": 0.008740090309305395, "sim_compute_performance-ego0": 0.002042166730190845}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.3643731139693607, "get_ui_image": 0.035910771290461226, "step_physics": 0.1605720857779185, "survival_time": 5.949999999999987, "driven_lanedir": 1.6504440884016798, "get_state_dump": 0.007955471674601236, "get_robot_state": 0.003645594914754232, "sim_render-ego0": 0.003862476348876953, "get_duckie_state": 0.020755070447921752, "in-drivable-lane": 1.399999999999995, "deviation-heading": 0.7121025528056721, "agent_compute-ego0": 0.016818209489186605, "complete-iteration": 0.2667670726776123, "set_robot_commands": 0.002391227086385091, "deviation-center-line": 0.28900569663366904, "driven_lanedir_consec": 1.6504440884016798, "sim_compute_sim_state": 0.012761227289835612, "sim_compute_performance-ego0": 0.0020036240418752032}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.5687340053832997, "get_ui_image": 0.027056299406906653, "step_physics": 0.1240846316019694, "survival_time": 4.299999999999993, "driven_lanedir": 0.6703715921284437, "get_state_dump": 0.005244668872877099, "get_robot_state": 0.003610904189361923, "sim_render-ego0": 0.004101846409940171, "get_duckie_state": 0.004216714837085241, "in-drivable-lane": 2.4499999999999953, "deviation-heading": 0.7906326233891195, "agent_compute-ego0": 0.015678748317148494, "complete-iteration": 0.1944202527232554, "set_robot_commands": 0.0025425012084259384, "deviation-center-line": 0.1444216745946533, "driven_lanedir_consec": 0.6703715921284437, "sim_compute_sim_state": 0.005685565115391523, "sim_compute_performance-ego0": 0.002113810900984139}}
set_robot_commands_max0.002677800704021843
set_robot_commands_mean0.002499721312419244
set_robot_commands_median0.002466864147405515
set_robot_commands_min0.002387356250844103
sim_compute_performance-ego0_max0.002113810900984139
sim_compute_performance-ego0_mean0.0020683460756812455
sim_compute_performance-ego0_median0.00207797467993282
sim_compute_performance-ego0_min0.0020036240418752032
sim_compute_sim_state_max0.012761227289835612
sim_compute_sim_state_mean0.008754481460291072
sim_compute_sim_state_median0.008285566717968575
sim_compute_sim_state_min0.005685565115391523
sim_render-ego0_max0.004101846409940171
sim_render-ego0_mean0.003974307031746085
sim_render-ego0_median0.003966452684083608
sim_render-ego0_min0.003862476348876953
simulation-passed1
step_physics_max0.23684711659208257
step_physics_mean0.1653112467762823
step_physics_median0.15015661945553865
step_physics_min0.1240846316019694
survival_time_max5.949999999999987
survival_time_mean4.3499999999999925
survival_time_min2.3
No reset possible
6198513482Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.524999999999988
in-drivable-lane_median2.8999999999999915
driven_lanedir_consec_median1.455665663779841
deviation-center-line_median0.1975480869981429


other stats
agent_compute-ego0_max0.01598602243371912
agent_compute-ego0_mean0.015452814570600038
agent_compute-ego0_median0.015660601436096967
agent_compute-ego0_min0.014504032976487105
complete-iteration_max0.2753409497878131
complete-iteration_mean0.2462245980765404
complete-iteration_median0.25760105448285375
complete-iteration_min0.19435533355264104
deviation-center-line_max1.0747723571508976
deviation-center-line_mean0.3927518512962645
deviation-center-line_min0.1011388740378748
deviation-heading_max5.171837047472428
deviation-heading_mean1.7944311872687446
deviation-heading_median0.7615630900419716
deviation-heading_min0.4827615215186079
driven_any_max12.659671304513925
driven_any_mean4.531524561801966
driven_any_median2.167065116193894
driven_any_min1.1322967103061536
driven_lanedir_consec_max5.684756922876946
driven_lanedir_consec_mean2.2217390194277726
driven_lanedir_consec_min0.29086782727446403
driven_lanedir_max5.688945775999554
driven_lanedir_mean2.2227862327084247
driven_lanedir_median1.455665663779841
driven_lanedir_min0.29086782727446403
get_duckie_state_max0.02387527986006303
get_duckie_state_mean0.01707098684114155
get_duckie_state_median0.020158213819216723
get_duckie_state_min0.004092239866069719
get_robot_state_max0.003598631609667529
get_robot_state_mean0.0035373224301561805
get_robot_state_median0.003527372008184428
get_robot_state_min0.003495914094588336
get_state_dump_max0.008234394483329835
get_state_dump_mean0.007219178990193524
get_state_dump_median0.007748708417950071
get_state_dump_min0.005144904641544118
get_ui_image_max0.03879348093324953
get_ui_image_mean0.03299825502027907
get_ui_image_median0.033457195506724095
get_ui_image_min0.02628514813441856
in-drivable-lane_max13.800000000000107
in-drivable-lane_mean4.900000000000023
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.479311916137505, "get_ui_image": 0.03169796486531407, "step_physics": 0.14674677139471384, "survival_time": 5.999999999999987, "driven_lanedir": 1.8051996012667808, "get_state_dump": 0.008234394483329835, "get_robot_state": 0.003511923403779338, "sim_render-ego0": 0.0036648817298826106, "get_duckie_state": 0.02387527986006303, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 0.6313132226886237, "agent_compute-ego0": 0.015689838031106743, "complete-iteration": 0.2451731449316356, "set_robot_commands": 0.0022501334671146613, "deviation-center-line": 0.19445249248408095, "driven_lanedir_consec": 1.8051996012667808, "sim_compute_sim_state": 0.007537686135158066, "sim_compute_performance-ego0": 0.0018876032395796344}, "LFP-norm-zigzag-000-ego0": {"driven_any": 12.659671304513925, "get_ui_image": 0.03879348093324953, "step_physics": 0.16254386644105653, "survival_time": 27.70000000000026, "driven_lanedir": 5.688945775999554, "get_state_dump": 0.00793642739991884, "get_robot_state": 0.003598631609667529, "sim_render-ego0": 0.003778326189195788, "get_duckie_state": 0.02051658157829766, "in-drivable-lane": 13.800000000000107, "deviation-heading": 5.171837047472428, "agent_compute-ego0": 0.01598602243371912, "complete-iteration": 0.2700289640340719, "set_robot_commands": 0.0022117735029340865, "deviation-center-line": 1.0747723571508976, "driven_lanedir_consec": 5.684756922876946, "sim_compute_sim_state": 0.012628576777002833, "sim_compute_performance-ego0": 0.001948917663849152}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1322967103061536, "get_ui_image": 0.03521642614813412, "step_physics": 0.17503994703292847, "survival_time": 3.349999999999996, "driven_lanedir": 1.1061317262929014, "get_state_dump": 0.007560989435981302, "get_robot_state": 0.003495914094588336, "sim_render-ego0": 0.0035886519095476937, "get_duckie_state": 0.019799846060135785, "in-drivable-lane": 0.0, "deviation-heading": 0.4827615215186079, "agent_compute-ego0": 0.014504032976487105, "complete-iteration": 0.2753409497878131, "set_robot_commands": 0.0020308704937205594, "deviation-center-line": 0.20064368151220485, "driven_lanedir_consec": 1.1061317262929014, "sim_compute_sim_state": 0.012204405139474309, "sim_compute_performance-ego0": 0.001824196647195255}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.854818316250283, "get_ui_image": 0.02628514813441856, "step_physics": 0.1265156946930231, "survival_time": 5.04999999999999, "driven_lanedir": 0.29086782727446403, "get_state_dump": 0.005144904641544118, "get_robot_state": 0.003542820612589518, "sim_render-ego0": 0.003593926336251054, "get_duckie_state": 0.004092239866069719, "in-drivable-lane": 3.7499999999999902, "deviation-heading": 0.8918129573953196, "agent_compute-ego0": 0.01563136484108719, "complete-iteration": 0.19435533355264104, "set_robot_commands": 0.0021035507613537357, "deviation-center-line": 0.1011388740378748, "driven_lanedir_consec": 0.29086782727446403, "sim_compute_sim_state": 0.0055121206769756246, "sim_compute_performance-ego0": 0.0018571895711562213}}
set_robot_commands_max0.0022501334671146613
set_robot_commands_mean0.002149082056280761
set_robot_commands_median0.002157662132143911
set_robot_commands_min0.0020308704937205594
sim_compute_performance-ego0_max0.001948917663849152
sim_compute_performance-ego0_mean0.0018794767804450655
sim_compute_performance-ego0_median0.0018723964053679275
sim_compute_performance-ego0_min0.001824196647195255
sim_compute_sim_state_max0.012628576777002833
sim_compute_sim_state_mean0.009470697182152708
sim_compute_sim_state_median0.009871045637316188
sim_compute_sim_state_min0.0055121206769756246
sim_render-ego0_max0.003778326189195788
sim_render-ego0_mean0.0036564465412192862
sim_render-ego0_median0.003629404033066832
sim_render-ego0_min0.0035886519095476937
simulation-passed1
step_physics_max0.17503994703292847
step_physics_mean0.15271156989043047
step_physics_median0.1546453189178852
step_physics_min0.1265156946930231
survival_time_max27.70000000000026
survival_time_mean10.525000000000055
survival_time_min3.349999999999996
No reset possible
6198413481Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:15:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5099331715634143
survival_time_median14.275000000000077
deviation-center-line_median0.3032602068181385
in-drivable-lane_median9.875000000000064


other stats
agent_compute-ego0_max0.016607284545898438
agent_compute-ego0_mean0.01583931448058398
agent_compute-ego0_median0.01580494419158294
agent_compute-ego0_min0.0151400849932716
complete-iteration_max0.2729722233045669
complete-iteration_mean0.21917630794445003
complete-iteration_median0.2109405003437641
complete-iteration_min0.181852007785705
deviation-center-line_max0.5656036925390935
deviation-center-line_mean0.31653440046137316
deviation-center-line_min0.09401349567012224
deviation-heading_max3.3084327042629873
deviation-heading_mean1.66926363691669
deviation-heading_median1.2870728141084204
deviation-heading_min0.7944762151869315
driven_any_max28.4239277551141
driven_any_mean10.604939855615022
driven_any_median6.285342004068266
driven_any_min1.4251476592094567
driven_lanedir_consec_max2.5854324926140917
driven_lanedir_consec_mean1.5589347438591616
driven_lanedir_consec_min0.6304401396957258
driven_lanedir_max2.5854324926140917
driven_lanedir_mean1.569958062373647
driven_lanedir_median1.529670999755822
driven_lanedir_min0.6350577573688532
get_duckie_state_max1.7560761550377154e-06
get_duckie_state_mean1.6359605803295547e-06
get_duckie_state_median1.6336633090607898e-06
get_duckie_state_min1.5204395481589237e-06
get_robot_state_max0.003604430165784112
get_robot_state_mean0.0035727964095714822
get_robot_state_median0.003586266868069406
get_robot_state_min0.0035142217363630024
get_state_dump_max0.004636255380149199
get_state_dump_mean0.004559059595021751
get_state_dump_median0.004577050464652799
get_state_dump_min0.004445882070632208
get_ui_image_max0.036803100790296285
get_ui_image_mean0.03115627529654682
get_ui_image_median0.030826053673553344
get_ui_image_min0.026169893048784316
in-drivable-lane_max53.79999999999869
in-drivable-lane_mean18.949999999999704
in-drivable-lane_min2.249999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.890505017715257, "get_ui_image": 0.02883184860492575, "step_physics": 0.125915579960264, "survival_time": 7.199999999999982, "driven_lanedir": 1.7077516636442645, "get_state_dump": 0.004581722719915982, "get_robot_state": 0.003604430165784112, "sim_render-ego0": 0.003710281437840955, "get_duckie_state": 1.7560761550377154e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 0.8167119520314491, "agent_compute-ego0": 0.016607284545898438, "complete-iteration": 0.1969790047612683, "set_robot_commands": 0.0022112155782765355, "deviation-center-line": 0.28157989856698973, "driven_lanedir_consec": 1.7077516636442645, "sim_compute_sim_state": 0.009489264981500031, "sim_compute_performance-ego0": 0.0019454429889547416}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4251476592094567, "get_ui_image": 0.036803100790296285, "step_physics": 0.1958841567947751, "survival_time": 4.149999999999993, "driven_lanedir": 0.6350577573688532, "get_state_dump": 0.004445882070632208, "get_robot_state": 0.0035142217363630024, "sim_render-ego0": 0.0037697298186165945, "get_duckie_state": 1.5610740298316592e-06, "in-drivable-lane": 2.249999999999993, "deviation-heading": 0.7944762151869315, "agent_compute-ego0": 0.0151400849932716, "complete-iteration": 0.2729722233045669, "set_robot_commands": 0.0021027695564996628, "deviation-center-line": 0.09401349567012224, "driven_lanedir_consec": 0.6304401396957258, "sim_compute_sim_state": 0.009358655838739304, "sim_compute_performance-ego0": 0.0018802966390337264}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.680178990421275, "get_ui_image": 0.03282025874218094, "step_physics": 0.14665313246094178, "survival_time": 21.35000000000017, "driven_lanedir": 1.3515903358673795, "get_state_dump": 0.004636255380149199, "get_robot_state": 0.0035910344569482534, "sim_render-ego0": 0.003759591378898264, "get_duckie_state": 1.7062525882899204e-06, "in-drivable-lane": 16.650000000000137, "deviation-heading": 3.3084327042629873, "agent_compute-ego0": 0.01620098474983857, "complete-iteration": 0.22490199592625984, "set_robot_commands": 0.00212370012408105, "deviation-center-line": 0.32494051506928723, "driven_lanedir_consec": 1.312114679482564, "sim_compute_sim_state": 0.013112065948058513, "sim_compute_performance-ego0": 0.0019292458195552648}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.4239277551141, "get_ui_image": 0.026169893048784316, "step_physics": 0.11796914091912238, "survival_time": 59.99999999999873, "driven_lanedir": 2.5854324926140917, "get_state_dump": 0.004572378209389616, "get_robot_state": 0.003581499279190559, "sim_render-ego0": 0.003721476990813319, "get_duckie_state": 1.5204395481589237e-06, "in-drivable-lane": 53.79999999999869, "deviation-heading": 1.757433676185392, "agent_compute-ego0": 0.015408903633327309, "complete-iteration": 0.181852007785705, "set_robot_commands": 0.002236998746238283, "deviation-center-line": 0.5656036925390935, "driven_lanedir_consec": 2.5854324926140917, "sim_compute_sim_state": 0.006162343275338585, "sim_compute_performance-ego0": 0.0019524706888953216}}
set_robot_commands_max0.002236998746238283
set_robot_commands_mean0.002168671001273883
set_robot_commands_median0.0021674578511787926
set_robot_commands_min0.0021027695564996628
sim_compute_performance-ego0_max0.0019524706888953216
sim_compute_performance-ego0_mean0.0019268640341097635
sim_compute_performance-ego0_median0.001937344404255003
sim_compute_performance-ego0_min0.0018802966390337264
sim_compute_sim_state_max0.013112065948058513
sim_compute_sim_state_mean0.00953058251090911
sim_compute_sim_state_median0.00942396041011967
sim_compute_sim_state_min0.006162343275338585
sim_render-ego0_max0.0037697298186165945
sim_render-ego0_mean0.003740269906542283
sim_render-ego0_median0.003740534184855791
sim_render-ego0_min0.003710281437840955
simulation-passed1
step_physics_max0.1958841567947751
step_physics_mean0.1466055025337758
step_physics_median0.1362843562106029
step_physics_min0.11796914091912238
survival_time_max59.99999999999873
survival_time_mean23.174999999999716
survival_time_min4.149999999999993
No reset possible
6198113478Raphael Jeanmobile-segmentationaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.950000000000106
in-drivable-lane_median5.075000000000015
driven_lanedir_consec_median3.2456865978222376
deviation-center-line_median0.6477128414931161


other stats
agent_compute-ego0_max0.016282357033409366
agent_compute-ego0_mean0.015849357228094035
agent_compute-ego0_median0.015924019369896188
agent_compute-ego0_min0.015267033139174394
complete-iteration_max0.283292284626475
complete-iteration_mean0.2458840978339901
complete-iteration_median0.2545467827295345
complete-iteration_min0.1911505412504163
deviation-center-line_max0.9733716617373944
deviation-center-line_mean0.646344284976349
deviation-center-line_min0.31657979518176926
deviation-heading_max2.9048814591634673
deviation-heading_mean1.7564915557740115
deviation-heading_median1.541521124918526
deviation-heading_min1.0380425140955276
driven_any_max6.662750003725019
driven_any_mean4.384021183373781
driven_any_median4.1227138458197015
driven_any_min2.627907038130702
driven_lanedir_consec_max4.332458856416124
driven_lanedir_consec_mean3.1194623113932103
driven_lanedir_consec_min1.654017193512242
driven_lanedir_max4.332458856416124
driven_lanedir_mean3.1194623113932103
driven_lanedir_median3.2456865978222376
driven_lanedir_min1.654017193512242
get_duckie_state_max0.02422918825803681
get_duckie_state_mean0.017214205189689597
get_duckie_state_median0.020210674283778065
get_duckie_state_min0.004206283933165446
get_robot_state_max0.003624159476660579
get_robot_state_mean0.0035888180858186956
get_robot_state_median0.0035961687408721894
get_robot_state_min0.003538775384869824
get_state_dump_max0.008462347278526114
get_state_dump_mean0.007340848314871563
get_state_dump_median0.007755774949911446
get_state_dump_min0.005389496081137243
get_ui_image_max0.03870919340613478
get_ui_image_mean0.03311140426695855
get_ui_image_median0.033696827730569645
get_ui_image_min0.026342768200560113
in-drivable-lane_max13.750000000000115
in-drivable-lane_mean6.075000000000037
in-drivable-lane_min0.3999999999999986
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 4.435420311664515, "get_ui_image": 0.03213667094922668, "step_physics": 0.13752870955622154, "survival_time": 13.80000000000006, "driven_lanedir": 4.251696372245229, "get_state_dump": 0.008462347278526114, "get_robot_state": 0.003610020510126107, "sim_render-ego0": 0.003637078867061904, "get_duckie_state": 0.02422918825803681, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.5719799301412976, "agent_compute-ego0": 0.016282357033409366, "complete-iteration": 0.23811769055115187, "set_robot_commands": 0.0021354489378120063, "deviation-center-line": 0.7079565798446381, "driven_lanedir_consec": 4.251696372245229, "sim_compute_sim_state": 0.008103448991741084, "sim_compute_performance-ego0": 0.001903927283166548}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.662750003725019, "get_ui_image": 0.03870919340613478, "step_physics": 0.17635105404685292, "survival_time": 24.00000000000021, "driven_lanedir": 4.332458856416124, "get_state_dump": 0.007785498228489485, "get_robot_state": 0.003582316971618272, "sim_render-ego0": 0.003682722420801492, "get_duckie_state": 0.02038103230529912, "in-drivable-lane": 9.200000000000037, "deviation-heading": 2.9048814591634673, "agent_compute-ego0": 0.01591194246018503, "complete-iteration": 0.283292284626475, "set_robot_commands": 0.0021569188568051787, "deviation-center-line": 0.9733716617373944, "driven_lanedir_consec": 4.332458856416124, "sim_compute_sim_state": 0.012727162446400727, "sim_compute_performance-ego0": 0.001913505879360524}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.810007379974888, "get_ui_image": 0.03525698451191261, "step_physics": 0.16876902769576232, "survival_time": 20.10000000000015, "driven_lanedir": 1.654017193512242, "get_state_dump": 0.007726051671333408, "get_robot_state": 0.003538775384869824, "sim_render-ego0": 0.0036012913393915144, "get_duckie_state": 0.02004031626225701, "in-drivable-lane": 13.750000000000115, "deviation-heading": 1.0380425140955276, "agent_compute-ego0": 0.015267033139174394, "complete-iteration": 0.2709758749079172, "set_robot_commands": 0.0020494348653788603, "deviation-center-line": 0.31657979518176926, "driven_lanedir_consec": 1.654017193512242, "sim_compute_sim_state": 0.012795425822066312, "sim_compute_performance-ego0": 0.0018480291437570273}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.627907038130702, "get_ui_image": 0.026342768200560113, "step_physics": 0.12187602340830545, "survival_time": 8.599999999999987, "driven_lanedir": 2.239676823399246, "get_state_dump": 0.005389496081137243, "get_robot_state": 0.003624159476660579, "sim_render-ego0": 0.0037054808842653486, "get_duckie_state": 0.004206283933165446, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.5110623196957544, "agent_compute-ego0": 0.015936096279607345, "complete-iteration": 0.1911505412504163, "set_robot_commands": 0.0022143532085969956, "deviation-center-line": 0.5874691031415941, "driven_lanedir_consec": 2.239676823399246, "sim_compute_sim_state": 0.005820861441551605, "sim_compute_performance-ego0": 0.0019456031005506572}}
set_robot_commands_max0.0022143532085969956
set_robot_commands_mean0.00213903896714826
set_robot_commands_median0.0021461838973085923
set_robot_commands_min0.0020494348653788603
sim_compute_performance-ego0_max0.0019456031005506572
sim_compute_performance-ego0_mean0.001902766351708689
sim_compute_performance-ego0_median0.001908716581263536
sim_compute_performance-ego0_min0.0018480291437570273
sim_compute_sim_state_max0.012795425822066312
sim_compute_sim_state_mean0.009861724675439932
sim_compute_sim_state_median0.010415305719070908
sim_compute_sim_state_min0.005820861441551605
sim_render-ego0_max0.0037054808842653486
sim_render-ego0_mean0.003656643377880065
sim_render-ego0_median0.003659900643931698
sim_render-ego0_min0.0036012913393915144
simulation-passed1
step_physics_max0.17635105404685292
step_physics_mean0.15113120367678556
step_physics_median0.15314886862599192
step_physics_min0.12187602340830545
survival_time_max24.00000000000021
survival_time_mean16.6250000000001
survival_time_min8.599999999999987
No reset possible
6198013477Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:33:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median20.478663774243515
survival_time_median59.99999999999873
deviation-center-line_median2.3884325555138632
in-drivable-lane_median0.4250000000000016


other stats
agent_compute-ego0_max0.016453182813033318
agent_compute-ego0_mean0.015420283913563218
agent_compute-ego0_median0.015325849101902742
agent_compute-ego0_min0.014576254637414071
complete-iteration_max0.24914856228186916
complete-iteration_mean0.20317543259960752
complete-iteration_median0.1964654277306016
complete-iteration_min0.1706223126553576
deviation-center-line_max2.967777663872265
deviation-center-line_mean2.334821927528451
deviation-center-line_min1.5946449352138137
deviation-heading_max6.206781208438274
deviation-heading_mean5.404639275103314
deviation-heading_median5.39624092263108
deviation-heading_min4.619294046712824
driven_any_max20.818580191775663
driven_any_mean18.645638933667
driven_any_median20.796249209804976
driven_any_min12.171477123282376
driven_lanedir_consec_max20.703736071671585
driven_lanedir_consec_mean18.13196010637084
driven_lanedir_consec_min10.866776805324736
driven_lanedir_max20.703736071671585
driven_lanedir_mean18.13196010637084
driven_lanedir_median20.478663774243515
driven_lanedir_min10.866776805324736
get_duckie_state_max1.1085173569551416e-06
get_duckie_state_mean1.0829117977705943e-06
get_duckie_state_median1.08628348446607e-06
get_duckie_state_min1.0505628651950958e-06
get_robot_state_max0.003633099729869884
get_robot_state_mean0.0035402565508502104
get_robot_state_median0.0035182883070156213
get_robot_state_min0.003491349859499713
get_state_dump_max0.004517796633146287
get_state_dump_mean0.0044185330082398295
get_state_dump_median0.004398110208662225
get_state_dump_min0.004360114982488582
get_ui_image_max0.03600056657513368
get_ui_image_mean0.030959828697295497
get_ui_image_median0.030835723698288076
get_ui_image_min0.026167300817472153
in-drivable-lane_max3.799999999999948
in-drivable-lane_mean1.162499999999988
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 20.818580191775663, "get_ui_image": 0.028900660047126155, "step_physics": 0.10870515396950346, "survival_time": 59.99999999999873, "driven_lanedir": 20.703736071671585, "get_state_dump": 0.004517796633146287, "get_robot_state": 0.003633099729869884, "sim_render-ego0": 0.003695104640290501, "get_duckie_state": 1.1019663052396117e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.619294046712824, "agent_compute-ego0": 0.01598293894435047, "complete-iteration": 0.1790409082179264, "set_robot_commands": 0.0022213175135984906, "deviation-center-line": 2.453668486337301, "driven_lanedir_consec": 20.703736071671585, "sim_compute_sim_state": 0.009386669289162514, "sim_compute_performance-ego0": 0.0019175833607593443}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.171477123282376, "get_ui_image": 0.03600056657513368, "step_physics": 0.16753801459578305, "survival_time": 36.00000000000009, "driven_lanedir": 10.866776805324736, "get_state_dump": 0.004360114982488582, "get_robot_state": 0.003541254633508013, "sim_render-ego0": 0.003637062858443981, "get_duckie_state": 1.0505628651950958e-06, "in-drivable-lane": 3.799999999999948, "deviation-heading": 4.859766743101799, "agent_compute-ego0": 0.016453182813033318, "complete-iteration": 0.24914856228186916, "set_robot_commands": 0.0021641413150316467, "deviation-center-line": 1.5946449352138137, "driven_lanedir_consec": 10.866776805324736, "sim_compute_sim_state": 0.01348006576506341, "sim_compute_performance-ego0": 0.0018992877039598528}, "LF-norm-techtrack-000-ego0": {"driven_any": 20.79448141117048, "get_ui_image": 0.03277078734945, "step_physics": 0.138348476575078, "survival_time": 59.99999999999873, "driven_lanedir": 20.497138477133728, "get_state_dump": 0.004363177717972754, "get_robot_state": 0.0034953219805232295, "sim_render-ego0": 0.003591987115953685, "get_duckie_state": 1.1085173569551416e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 5.932715102160359, "agent_compute-ego0": 0.014576254637414071, "complete-iteration": 0.2138899472432768, "set_robot_commands": 0.0021264275146662247, "deviation-center-line": 2.323196624690425, "driven_lanedir_consec": 20.497138477133728, "sim_compute_sim_state": 0.01268121741594224, "sim_compute_performance-ego0": 0.0018604609690339837}, "LF-norm-small_loop-000-ego0": {"driven_any": 20.798017008439473, "get_ui_image": 0.026167300817472153, "step_physics": 0.1081433943368116, "survival_time": 59.99999999999873, "driven_lanedir": 20.460189071353305, "get_state_dump": 0.004433042699351696, "get_robot_state": 0.003491349859499713, "sim_render-ego0": 0.0035879482933127015, "get_duckie_state": 1.0706006636925284e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 6.206781208438274, "agent_compute-ego0": 0.014668759259455011, "complete-iteration": 0.1706223126553576, "set_robot_commands": 0.0021525296839349575, "deviation-center-line": 2.967777663872265, "driven_lanedir_consec": 20.460189071353305, "sim_compute_sim_state": 0.006046792648912568, "sim_compute_performance-ego0": 0.0018563945525691072}}
set_robot_commands_max0.0022213175135984906
set_robot_commands_mean0.0021661040068078298
set_robot_commands_median0.002158335499483302
set_robot_commands_min0.0021264275146662247
sim_compute_performance-ego0_max0.0019175833607593443
sim_compute_performance-ego0_mean0.001883431646580572
sim_compute_performance-ego0_median0.001879874336496918
sim_compute_performance-ego0_min0.0018563945525691072
sim_compute_sim_state_max0.01348006576506341
sim_compute_sim_state_mean0.010398686279770183
sim_compute_sim_state_median0.011033943352552375
sim_compute_sim_state_min0.006046792648912568
sim_render-ego0_max0.003695104640290501
sim_render-ego0_mean0.003628025727000217
sim_render-ego0_median0.003614524987198833
sim_render-ego0_min0.0035879482933127015
simulation-passed1
step_physics_max0.16753801459578305
step_physics_mean0.13068375986929404
step_physics_median0.12352681527229072
step_physics_min0.1081433943368116
survival_time_max59.99999999999873
survival_time_mean53.99999999999907
survival_time_min36.00000000000009
No reset possible
6197913476Faisal Mubaidien 🇯🇴template-rosaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6197813476Faisal Mubaidien 🇯🇴template-rosaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6197513475Faisal Mubaidien 🇯🇴baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:02:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [2c029ca87737781ed3bb9c0c1ced00b814f321878d2e5800ab18582f6db26b6d,
│                 4be99921695045fd2f81da45cb15785b53eed1f36419d412a282741adb7310b6]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:6d0af9441525e1ed05be582f41e00fc178083c86797d28cd1a255c7025d0fd50
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13475
│                │ │ │ submitter_name: Faisal Mubaidien
│                │ │ │ SUBMISSION_CONTAINER: docker.io/jblade/aido-submissions:2020_12_22_15_47_05@sha256:b0ac341713a50a10ccc682bee4ef40e21e54a4d9c57d30e02cbef28c22c50651
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_cee35393e57c}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_22_15_59_19-3117/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:c0096866077db3574e425d40603d8f5fc8ebbd164da7c0578df94ff4ede58d95
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13475
│                │ │ │ submitter_name: Faisal Mubaidien
│                │ │ │ SUBMISSION_CONTAINER: docker.io/jblade/aido-submissions:2020_12_22_15_47_05@sha256:b0ac341713a50a10ccc682bee4ef40e21e54a4d9c57d30e02cbef28c22c50651
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_cee35393e57c}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_22_15_59_19-3117/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/jblade/aido-submissions@sha256:b0ac341713a50a10ccc682bee4ef40e21e54a4d9c57d30e02cbef28c22c50651
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 13475
│                │ │ │ submitter_name: Faisal Mubaidien
│                │ │ │ SUBMISSION_CONTAINER: docker.io/jblade/aido-submissions:2020_12_22_15_47_05@sha256:b0ac341713a50a10ccc682bee4ef40e21e54a4d9c57d30e02cbef28c22c50651
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: gpu-prod-01_cee35393e57c}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission13475/LFv-sim-gpu-prod-01_cee35393e57c-job61975-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_22_15_59_19-3117/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[2]
│                │ evaluator: 2c029ca87737781ed3bb9c0c1ced00b814f321878d2e5800ab18582f6db26b6d
│                │ simulator: 4be99921695045fd2f81da45cb15785b53eed1f36419d412a282741adb7310b6
│         names: dict[2]
│                │ 2c029ca87737781ed3bb9c0c1ced00b814f321878d2e5800ab18582f6db26b6d: gpu-prod-01_cee35393e57c-job61975-207335_evaluator_1
│                │ 4be99921695045fd2f81da45cb15785b53eed1f36419d412a282741adb7310b6: gpu-prod-01_cee35393e57c-job61975-207335_simulator_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |2c029ca87737781ed3bb9c0c1ced00b814f321878d2e5800ab18582f6db26b6d
│         |4be99921695045fd2f81da45cb15785b53eed1f36419d412a282741adb7310b6
│         |
│  names: dict[2]
│         │ 2c029ca87737781ed3bb9c0c1ced00b814f321878d2e5800ab18582f6db26b6d: gpu-prod-01_cee35393e57c-job61975-207335_evaluator_1
│         │ 4be99921695045fd2f81da45cb15785b53eed1f36419d412a282741adb7310b6: gpu-prod-01_cee35393e57c-job61975-207335_simulator_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6197413475Faisal Mubaidien 🇯🇴baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6197213472Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:12:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.949999999999983
in-drivable-lane_median0.6999999999999975
driven_lanedir_consec_median1.7814333131036195
deviation-center-line_median0.4138568889251446


other stats
agent_compute-ego0_max0.01585355069902208
agent_compute-ego0_mean0.015220226649156482
agent_compute-ego0_median0.015348081677629376
agent_compute-ego0_min0.014331192542345095
complete-iteration_max0.3220537017892908
complete-iteration_mean0.260165647107844
complete-iteration_median0.2623438970474688
complete-iteration_min0.1939210925471475
deviation-center-line_max4.993711428455254
deviation-center-line_mean1.5090965865018275
deviation-center-line_min0.2149611397017665
deviation-heading_max9.328563203854204
deviation-heading_mean3.225220362705291
deviation-heading_median1.2590405513888654
deviation-heading_min1.0542371441892284
driven_any_max20.82350139820477
driven_any_mean6.373082258537829
driven_any_median2.062756828345323
driven_any_min0.5433139792558981
driven_lanedir_consec_max15.69245940606145
driven_lanedir_consec_mean4.940823065876567
driven_lanedir_consec_min0.5079662312375814
driven_lanedir_max15.69245940606145
driven_lanedir_mean4.940823065876567
driven_lanedir_median1.7814333131036195
driven_lanedir_min0.5079662312375814
get_duckie_state_max0.02366338326380803
get_duckie_state_mean0.016930143974067953
get_duckie_state_median0.019993381973093416
get_duckie_state_min0.004070428686276959
get_robot_state_max0.003614928987291124
get_robot_state_mean0.0035299285762818897
get_robot_state_median0.0035029443717368523
get_robot_state_min0.00349889657436273
get_state_dump_max0.00819007402811295
get_state_dump_mean0.007206361744977294
get_state_dump_median0.007774604727005589
get_state_dump_min0.005086163497785049
get_ui_image_max0.03912467426723904
get_ui_image_mean0.03330670070420061
get_ui_image_median0.03378786958871152
get_ui_image_min0.026526389372140344
in-drivable-lane_max13.59999999999976
in-drivable-lane_mean3.7499999999999383
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.3414921249140015, "get_ui_image": 0.03205044605793097, "step_physics": 0.1395142689729348, "survival_time": 7.7499999999999805, "driven_lanedir": 2.0434065821386778, "get_state_dump": 0.00819007402811295, "get_robot_state": 0.00349889657436273, "sim_render-ego0": 0.003519935485644218, "get_duckie_state": 0.02366338326380803, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 1.3320705189330888, "agent_compute-ego0": 0.014331192542345095, "complete-iteration": 0.23642305227426383, "set_robot_commands": 0.0020644787030342296, "deviation-center-line": 0.5236199269377351, "driven_lanedir_consec": 2.0434065821386778, "sim_compute_sim_state": 0.007688209032401061, "sim_compute_performance-ego0": 0.0018233030270307492}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5433139792558981, "get_ui_image": 0.03912467426723904, "step_physics": 0.21798072037873445, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5079662312375814, "get_state_dump": 0.007958275300485117, "get_robot_state": 0.003614928987291124, "sim_render-ego0": 0.003748213803326642, "get_duckie_state": 0.020217476067719637, "in-drivable-lane": 0.0, "deviation-heading": 1.0542371441892284, "agent_compute-ego0": 0.01585355069902208, "complete-iteration": 0.3220537017892908, "set_robot_commands": 0.0023124129683883103, "deviation-center-line": 0.2149611397017665, "driven_lanedir_consec": 0.5079662312375814, "sim_compute_sim_state": 0.009161189750388815, "sim_compute_performance-ego0": 0.0019925435384114585}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.784021531776644, "get_ui_image": 0.03552529311949207, "step_physics": 0.1864446651551031, "survival_time": 6.149999999999986, "driven_lanedir": 1.5194600440685613, "get_state_dump": 0.00759093415352606, "get_robot_state": 0.003499382926571754, "sim_render-ego0": 0.0036020913431721348, "get_duckie_state": 0.01976928787846719, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 1.1860105838446418, "agent_compute-ego0": 0.01495033694851783, "complete-iteration": 0.2882647418206738, "set_robot_commands": 0.002057461969314083, "deviation-center-line": 0.30409385091255414, "driven_lanedir_consec": 1.5194600440685613, "sim_compute_sim_state": 0.01292062767090336, "sim_compute_performance-ego0": 0.001826124806557932}, "LFP-norm-small_loop-000-ego0": {"driven_any": 20.82350139820477, "get_ui_image": 0.026526389372140344, "step_physics": 0.12512635807510616, "survival_time": 59.99999999999873, "driven_lanedir": 15.69245940606145, "get_state_dump": 0.005086163497785049, "get_robot_state": 0.003506505816901951, "sim_render-ego0": 0.0035720842267750303, "get_duckie_state": 0.004070428686276959, "in-drivable-lane": 13.59999999999976, "deviation-heading": 9.328563203854204, "agent_compute-ego0": 0.015745826406740923, "complete-iteration": 0.1939210925471475, "set_robot_commands": 0.002138102679923611, "deviation-center-line": 4.993711428455254, "driven_lanedir_consec": 15.69245940606145, "sim_compute_sim_state": 0.006208182572325898, "sim_compute_performance-ego0": 0.0018620608152696036}}
set_robot_commands_max0.0023124129683883103
set_robot_commands_mean0.0021431140801650584
set_robot_commands_median0.002101290691478921
set_robot_commands_min0.002057461969314083
sim_compute_performance-ego0_max0.0019925435384114585
sim_compute_performance-ego0_mean0.001876008046817436
sim_compute_performance-ego0_median0.001844092810913768
sim_compute_performance-ego0_min0.0018233030270307492
sim_compute_sim_state_max0.01292062767090336
sim_compute_sim_state_mean0.008994552256504784
sim_compute_sim_state_median0.008424699391394938
sim_compute_sim_state_min0.006208182572325898
sim_render-ego0_max0.003748213803326642
sim_render-ego0_mean0.003610581214729506
sim_render-ego0_median0.0035870877849735828
sim_render-ego0_min0.003519935485644218
simulation-passed1
step_physics_max0.21798072037873445
step_physics_mean0.16726650314546965
step_physics_median0.16297946706401897
step_physics_min0.12512635807510616
survival_time_max59.99999999999873
survival_time_mean19.137499999999676
survival_time_min2.6499999999999986
No reset possible
6197013471Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.02404573136815
survival_time_median45.32499999999951
deviation-center-line_median2.8699866879186295
in-drivable-lane_median5.924999999999994


other stats
agent_compute-ego0_max0.015787941625141553
agent_compute-ego0_mean0.01544475067294577
agent_compute-ego0_median0.015538254347967169
agent_compute-ego0_min0.014914552370707192
complete-iteration_max0.2543731592950367
complete-iteration_mean0.20946723736450248
complete-iteration_median0.20227357993049755
complete-iteration_min0.17894863030197816
deviation-center-line_max5.940622411994401
deviation-center-line_mean3.2065526331775533
deviation-center-line_min1.1456147448785534
deviation-heading_max9.26717211454492
deviation-heading_mean6.052357226838228
deviation-heading_median5.2927150600286215
deviation-heading_min4.35682667275075
driven_any_max20.839969937012576
driven_any_mean14.722458675737975
driven_any_median15.557156806317572
driven_any_min6.935551153304191
driven_lanedir_consec_max20.67722266830486
driven_lanedir_consec_mean12.300306519730723
driven_lanedir_consec_min4.475911947881732
driven_lanedir_max20.67722266830486
driven_lanedir_mean12.300808366176208
driven_lanedir_median12.025049424259116
driven_lanedir_min4.475911947881732
get_duckie_state_max1.162581801026186e-06
get_duckie_state_mean1.1241739035929443e-06
get_duckie_state_median1.1238031442913782e-06
get_duckie_state_min1.0865075247628348e-06
get_robot_state_max0.00365169141612184
get_robot_state_mean0.003565558672921969
get_robot_state_median0.0035486072367740488
get_robot_state_min0.003513328802017938
get_state_dump_max0.0045379742694635575
get_state_dump_mean0.0044347154982720864
get_state_dump_median0.004420721870591285
get_state_dump_min0.00435944398244222
get_ui_image_max0.035624031793503534
get_ui_image_mean0.03043537016197756
get_ui_image_median0.030244735754300513
get_ui_image_min0.02562797734580568
in-drivable-lane_max13.650000000000178
in-drivable-lane_mean6.375000000000041
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 20.816194890009147, "get_ui_image": 0.02813249404583247, "step_physics": 0.1118468759855958, "survival_time": 59.99999999999873, "driven_lanedir": 20.67722266830486, "get_state_dump": 0.0045379742694635575, "get_robot_state": 0.00365169141612184, "sim_render-ego0": 0.0036711490323005566, "get_duckie_state": 1.103554438988831e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.390132416987151, "agent_compute-ego0": 0.015388941784683214, "complete-iteration": 0.18073429473730843, "set_robot_commands": 0.0022186605658360463, "deviation-center-line": 4.497352045396556, "driven_lanedir_consec": 20.67722266830486, "sim_compute_sim_state": 0.00927979344630817, "sim_compute_performance-ego0": 0.00192966965414106}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.935551153304191, "get_ui_image": 0.035624031793503534, "step_physics": 0.17687467961084274, "survival_time": 20.950000000000163, "driven_lanedir": 4.475911947881732, "get_state_dump": 0.00435944398244222, "get_robot_state": 0.003513328802017938, "sim_render-ego0": 0.003664106982094901, "get_duckie_state": 1.0865075247628348e-06, "in-drivable-lane": 6.90000000000006, "deviation-heading": 4.35682667275075, "agent_compute-ego0": 0.014914552370707192, "complete-iteration": 0.2543731592950367, "set_robot_commands": 0.002114911306472052, "deviation-center-line": 1.1456147448785534, "driven_lanedir_consec": 4.475911947881732, "sim_compute_sim_state": 0.011339898904164631, "sim_compute_performance-ego0": 0.0018970290819803873}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.298118722625995, "get_ui_image": 0.032356977462768555, "step_physics": 0.14745816190390323, "survival_time": 30.6500000000003, "driven_lanedir": 5.2585914340863, "get_state_dump": 0.004461976138310634, "get_robot_state": 0.0035367811929907784, "sim_render-ego0": 0.003618882222750288, "get_duckie_state": 1.162581801026186e-06, "in-drivable-lane": 13.650000000000178, "deviation-heading": 5.195297703070092, "agent_compute-ego0": 0.015787941625141553, "complete-iteration": 0.22381286512368664, "set_robot_commands": 0.002086504662852334, "deviation-center-line": 1.2426213304407032, "driven_lanedir_consec": 5.256584048304368, "sim_compute_sim_state": 0.012549377031357358, "sim_compute_performance-ego0": 0.001884254648165128}, "LF-norm-small_loop-000-ego0": {"driven_any": 20.839969937012576, "get_ui_image": 0.02562797734580568, "step_physics": 0.11601547734326469, "survival_time": 59.99999999999873, "driven_lanedir": 18.79150741443193, "get_state_dump": 0.004379467602871935, "get_robot_state": 0.0035604332805573196, "sim_render-ego0": 0.003575530278494118, "get_duckie_state": 1.1440518495939256e-06, "in-drivable-lane": 4.949999999999927, "deviation-heading": 9.26717211454492, "agent_compute-ego0": 0.015687566911251123, "complete-iteration": 0.17894863030197816, "set_robot_commands": 0.0021072122874009817, "deviation-center-line": 5.940622411994401, "driven_lanedir_consec": 18.79150741443193, "sim_compute_sim_state": 0.006058999441942506, "sim_compute_performance-ego0": 0.0018654997203868197}}
set_robot_commands_max0.0022186605658360463
set_robot_commands_mean0.0021318222056403535
set_robot_commands_median0.002111061796936517
set_robot_commands_min0.002086504662852334
sim_compute_performance-ego0_max0.00192966965414106
sim_compute_performance-ego0_mean0.0018941132761683488
sim_compute_performance-ego0_median0.0018906418650727575
sim_compute_performance-ego0_min0.0018654997203868197
sim_compute_sim_state_max0.012549377031357358
sim_compute_sim_state_mean0.009807017205943168
sim_compute_sim_state_median0.0103098461752364
sim_compute_sim_state_min0.006058999441942506
sim_render-ego0_max0.0036711490323005566
sim_render-ego0_mean0.003632417128909966
sim_render-ego0_median0.0036414946024225943
sim_render-ego0_min0.003575530278494118
simulation-passed1
step_physics_max0.17687467961084274
step_physics_mean0.13804879871090162
step_physics_median0.13173681962358397
step_physics_min0.1118468759855958
survival_time_max59.99999999999873
survival_time_mean42.89999999999948
survival_time_min20.950000000000163
No reset possible
6196913471Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simabortedyesgpu-prod-010:30:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.440059114213575
survival_time_median59.99999999999873
deviation-center-line_median3.9809409201136927
in-drivable-lane_median3.5499999999999634


other stats
agent_compute-ego0_max0.016763626983223312
agent_compute-ego0_mean0.016143468182083204
agent_compute-ego0_median0.016239950070135463
agent_compute-ego0_min0.01533034560483858
complete-iteration_max0.27342515074929524
complete-iteration_mean0.21807416101724553
complete-iteration_median0.2078572833270058
complete-iteration_min0.18315692666567537
deviation-center-line_max5.902748665917321
deviation-center-line_mean3.60903968867048
deviation-center-line_min0.5715282485372143
deviation-heading_max9.14261677244902
deviation-heading_mean5.981581934242817
deviation-heading_median6.518904180010537
deviation-heading_min1.7459026045011714
driven_any_max20.837906995417303
driven_any_mean16.266214761670916
driven_any_median20.80427117541651
driven_any_min2.6184097004333435
driven_lanedir_consec_max20.326090260359955
driven_lanedir_consec_mean12.815373237432771
driven_lanedir_consec_min2.055284460943977
driven_lanedir_max20.326090260359955
driven_lanedir_mean13.98470790007134
driven_lanedir_median16.778728439490713
driven_lanedir_min2.055284460943977
get_duckie_state_max1.9309721223321387e-06
get_duckie_state_mean1.8688352352269608e-06
get_duckie_state_median1.8635733880157024e-06
get_duckie_state_min1.817222042544299e-06
get_robot_state_max0.003687821458916581
get_robot_state_mean0.003593719218182272
get_robot_state_median0.003569291493577028
get_robot_state_min0.003548472426658453
get_state_dump_max0.004623720389817974
get_state_dump_mean0.004558509161719174
get_state_dump_median0.0045727458623525605
get_state_dump_min0.0044648245323536005
get_ui_image_max0.036454744117204535
get_ui_image_mean0.03082375885558817
get_ui_image_median0.030304240942199863
get_ui_image_min0.026231809420748417
in-drivable-lane_max15.849999999999683
in-drivable-lane_mean5.999999999999907
in-drivable-lane_min1.050000000000015
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 20.818548870846115, "get_ui_image": 0.027988756030525, "step_physics": 0.11419180092664682, "survival_time": 59.99999999999873, "driven_lanedir": 20.326090260359955, "get_state_dump": 0.004544646416377466, "get_robot_state": 0.003687821458916581, "sim_render-ego0": 0.0037574519920507937, "get_duckie_state": 1.817222042544299e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 5.046165848884329, "agent_compute-ego0": 0.01533034560483858, "complete-iteration": 0.18315692666567537, "set_robot_commands": 0.002301314589780733, "deviation-center-line": 4.660061571651612, "driven_lanedir_consec": 20.326090260359955, "sim_compute_sim_state": 0.009298586229996122, "sim_compute_performance-ego0": 0.0019781720529090953}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.6184097004333435, "get_ui_image": 0.036454744117204535, "step_physics": 0.194587298603945, "survival_time": 8.549999999999986, "driven_lanedir": 2.055284460943977, "get_state_dump": 0.0044648245323536005, "get_robot_state": 0.003548472426658453, "sim_render-ego0": 0.0037245514780976058, "get_duckie_state": 1.8297239791515264e-06, "in-drivable-lane": 2.0500000000000016, "deviation-heading": 1.7459026045011714, "agent_compute-ego0": 0.01619079362514407, "complete-iteration": 0.27342515074929524, "set_robot_commands": 0.002125970152921455, "deviation-center-line": 0.5715282485372143, "driven_lanedir_consec": 2.055284460943977, "sim_compute_sim_state": 0.010344691054765568, "sim_compute_performance-ego0": 0.0019092143968094228}, "LF-norm-techtrack-000-ego0": {"driven_any": 20.789993479986908, "get_ui_image": 0.03261972585387472, "step_physics": 0.14732014249504655, "survival_time": 59.99999999999873, "driven_lanedir": 14.79725415531129, "get_state_dump": 0.004600845308327655, "get_robot_state": 0.0035597587207473387, "sim_render-ego0": 0.003713397558880885, "get_duckie_state": 1.9309721223321387e-06, "in-drivable-lane": 15.849999999999683, "deviation-heading": 7.991642511136744, "agent_compute-ego0": 0.016763626983223312, "complete-iteration": 0.2258525793995091, "set_robot_commands": 0.002203311253149841, "deviation-center-line": 3.301820268575774, "driven_lanedir_consec": 10.11991550475702, "sim_compute_sim_state": 0.013065956315827508, "sim_compute_performance-ego0": 0.001930175673256905}, "LF-norm-small_loop-000-ego0": {"driven_any": 20.837906995417303, "get_ui_image": 0.026231809420748417, "step_physics": 0.1249376953293342, "survival_time": 59.99999999999873, "driven_lanedir": 18.760202723670133, "get_state_dump": 0.004623720389817974, "get_robot_state": 0.0035788242664067174, "sim_render-ego0": 0.003723958251279757, "get_duckie_state": 1.8974227968798787e-06, "in-drivable-lane": 5.049999999999925, "deviation-heading": 9.14261677244902, "agent_compute-ego0": 0.01628910651512686, "complete-iteration": 0.18986198725450248, "set_robot_commands": 0.0022433713314237444, "deviation-center-line": 5.902748665917321, "driven_lanedir_consec": 18.760202723670133, "sim_compute_sim_state": 0.006214699082132382, "sim_compute_performance-ego0": 0.0019433877549500983}}
set_robot_commands_max0.002301314589780733
set_robot_commands_mean0.0022184918318189435
set_robot_commands_median0.0022233412922867926
set_robot_commands_min0.002125970152921455
sim_compute_performance-ego0_max0.0019781720529090953
sim_compute_performance-ego0_mean0.0019402374694813805
sim_compute_performance-ego0_median0.001936781714103502
sim_compute_performance-ego0_min0.0019092143968094228
sim_compute_sim_state_max0.013065956315827508
sim_compute_sim_state_mean0.009730983170680396
sim_compute_sim_state_median0.009821638642380844
sim_compute_sim_state_min0.006214699082132382
sim_render-ego0_max0.0037574519920507937
sim_render-ego0_mean0.00372983982007726
sim_render-ego0_median0.0037242548646886807
sim_render-ego0_min0.003713397558880885
simulation-passed1
step_physics_max0.194587298603945
step_physics_mean0.14525923433874313
step_physics_median0.13612891891219037
step_physics_min0.11419180092664682
survival_time_max59.99999999999873
survival_time_mean47.13749999999904
survival_time_min8.549999999999986
No reset possible
6196813470Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:14:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.900000000000029
in-drivable-lane_median1.8500000000000072
driven_lanedir_consec_median3.429225370422672
deviation-center-line_median0.5258945512191177


other stats
agent_compute-ego0_max0.017318749773329582
agent_compute-ego0_mean0.016059736884392065
agent_compute-ego0_median0.015680696563911228
agent_compute-ego0_min0.015558804636416228
complete-iteration_max0.2985501870670925
complete-iteration_mean0.2510257808411938
complete-iteration_median0.2566806485687477
complete-iteration_min0.19219163916018733
deviation-center-line_max2.340272244453222
deviation-center-line_mean0.8790109039596147
deviation-center-line_min0.12398226894700191
deviation-heading_max8.26600181030178
deviation-heading_mean3.072970880765032
deviation-heading_median1.7616839417642056
deviation-heading_min0.5025138292299354
driven_any_max22.91978105270112
driven_any_mean8.162660798844756
driven_any_median4.274460560742228
driven_any_min1.181941021193451
driven_lanedir_consec_max13.240220665478246
driven_lanedir_consec_mean5.31581678891035
driven_lanedir_consec_min1.1645957493178107
driven_lanedir_max13.240220665478246
driven_lanedir_mean5.31581678891035
driven_lanedir_median3.429225370422672
driven_lanedir_min1.1645957493178107
get_duckie_state_max0.02386830578679624
get_duckie_state_mean0.017148298278412005
get_duckie_state_median0.020320400430071085
get_duckie_state_min0.004084086466709611
get_robot_state_max0.003677192930619203
get_robot_state_mean0.0035701499177578696
get_robot_state_median0.0035362231213817274
get_robot_state_min0.00353096049764882
get_state_dump_max0.008285725635030996
get_state_dump_mean0.007307081785874144
get_state_dump_median0.007891611849748272
get_state_dump_min0.005159377808969036
get_ui_image_max0.03892967304998068
get_ui_image_mean0.033231403324470304
get_ui_image_median0.03365896715634111
get_ui_image_min0.02667800593521833
in-drivable-lane_max18.94999999999987
in-drivable-lane_mean5.662499999999971
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.2805758622401924, "get_ui_image": 0.032036839360776156, "step_physics": 0.13808049533678138, "survival_time": 5.699999999999988, "driven_lanedir": 1.9243644125516823, "get_state_dump": 0.008285725635030996, "get_robot_state": 0.00353096049764882, "sim_render-ego0": 0.0035374620686406673, "get_duckie_state": 0.02386830578679624, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 0.8388041709805552, "agent_compute-ego0": 0.015558804636416228, "complete-iteration": 0.23641518095265265, "set_robot_commands": 0.002137105361275051, "deviation-center-line": 0.20154070904827215, "driven_lanedir_consec": 1.9243644125516823, "sim_compute_sim_state": 0.007480042913685674, "sim_compute_performance-ego0": 0.0018224550330120583}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.268345259244264, "get_ui_image": 0.03892967304998068, "step_physics": 0.1906091374980266, "survival_time": 14.100000000000064, "driven_lanedir": 4.934086328293661, "get_state_dump": 0.007865491267227874, "get_robot_state": 0.003677192930619203, "sim_render-ego0": 0.003748758942836586, "get_duckie_state": 0.020578516666965013, "in-drivable-lane": 2.350000000000019, "deviation-heading": 2.684563712547856, "agent_compute-ego0": 0.015672873271227725, "complete-iteration": 0.2985501870670925, "set_robot_commands": 0.0022479518984737327, "deviation-center-line": 0.8502483933899632, "driven_lanedir_consec": 4.934086328293661, "sim_compute_sim_state": 0.013202045494591813, "sim_compute_performance-ego0": 0.0019340843699424933}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.181941021193451, "get_ui_image": 0.03528109495190607, "step_physics": 0.17298870155776758, "survival_time": 3.399999999999996, "driven_lanedir": 1.1645957493178107, "get_state_dump": 0.007917732432268667, "get_robot_state": 0.003534983897554702, "sim_render-ego0": 0.003629304360652315, "get_duckie_state": 0.020062284193177155, "in-drivable-lane": 0.0, "deviation-heading": 0.5025138292299354, "agent_compute-ego0": 0.017318749773329582, "complete-iteration": 0.27694611618484277, "set_robot_commands": 0.002089154893073483, "deviation-center-line": 0.12398226894700191, "driven_lanedir_consec": 1.1645957493178107, "sim_compute_sim_state": 0.012198441270468891, "sim_compute_performance-ego0": 0.0018450246340986612}, "LFP-norm-small_loop-000-ego0": {"driven_any": 22.91978105270112, "get_ui_image": 0.02667800593521833, "step_physics": 0.12327471211582967, "survival_time": 49.04999999999935, "driven_lanedir": 13.240220665478246, "get_state_dump": 0.005159377808969036, "get_robot_state": 0.0035374623452087525, "sim_render-ego0": 0.003600913492579567, "get_duckie_state": 0.004084086466709611, "in-drivable-lane": 18.94999999999987, "deviation-heading": 8.26600181030178, "agent_compute-ego0": 0.01568851985659473, "complete-iteration": 0.19219163916018733, "set_robot_commands": 0.0021604840964260996, "deviation-center-line": 2.340272244453222, "driven_lanedir_consec": 13.240220665478246, "sim_compute_sim_state": 0.006065280520017666, "sim_compute_performance-ego0": 0.0018640712905075788}}
set_robot_commands_max0.0022479518984737327
set_robot_commands_mean0.002158674062312091
set_robot_commands_median0.0021487947288505753
set_robot_commands_min0.002089154893073483
sim_compute_performance-ego0_max0.0019340843699424933
sim_compute_performance-ego0_mean0.001866408831890198
sim_compute_performance-ego0_median0.00185454796230312
sim_compute_performance-ego0_min0.0018224550330120583
sim_compute_sim_state_max0.013202045494591813
sim_compute_sim_state_mean0.009736452549691013
sim_compute_sim_state_median0.009839242092077285
sim_compute_sim_state_min0.006065280520017666
sim_render-ego0_max0.003748758942836586
sim_render-ego0_mean0.003629109716177284
sim_render-ego0_median0.003615108926615941
sim_render-ego0_min0.0035374620686406673
simulation-passed1
step_physics_max0.1906091374980266
step_physics_mean0.1562382616271013
step_physics_median0.15553459844727446
step_physics_min0.12327471211582967
survival_time_max49.04999999999935
survival_time_mean18.062499999999847
survival_time_min3.399999999999996
No reset possible
6196613468Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.16448323164753
survival_time_median51.19999999999923
deviation-center-line_median2.1068732896966127
in-drivable-lane_median10.47499999999976


other stats
agent_compute-ego0_max0.01250952854313755
agent_compute-ego0_mean0.012301865170913912
agent_compute-ego0_median0.012369597341894516
agent_compute-ego0_min0.011958737456729072
complete-iteration_max0.22122368050256835
complete-iteration_mean0.18541431323098148
complete-iteration_median0.1824322229285293
complete-iteration_min0.15556912656429903
deviation-center-line_max3.5976320958572745
deviation-center-line_mean2.3767999947702148
deviation-center-line_min1.6958213038303591
deviation-heading_max15.78819892245479
deviation-heading_mean10.74309203744538
deviation-heading_median9.159095324078944
deviation-heading_min8.865978579168848
driven_any_max11.672909932253598
driven_any_mean9.674865524509812
driven_any_median9.877962429148544
driven_any_min7.270627307488564
driven_lanedir_consec_max11.148724290539889
driven_lanedir_consec_mean7.473832164794507
driven_lanedir_consec_min4.41763790534308
driven_lanedir_max11.148724290539889
driven_lanedir_mean7.473832164794507
driven_lanedir_median7.16448323164753
driven_lanedir_min4.41763790534308
get_duckie_state_max1.6860712587443831e-06
get_duckie_state_mean1.6254163170693169e-06
get_duckie_state_median1.6524408902939648e-06
get_duckie_state_min1.5107122289449547e-06
get_robot_state_max0.003520596572776246
get_robot_state_mean0.003496798577372339
get_robot_state_median0.0034909951495228535
get_robot_state_min0.003484607437667402
get_state_dump_max0.0043987399416902185
get_state_dump_mean0.004376518864591915
get_state_dump_median0.004384958564800152
get_state_dump_min0.004337418387077134
get_ui_image_max0.035633133214081854
get_ui_image_mean0.030222024144321305
get_ui_image_median0.029901698641300004
get_ui_image_min0.02545156608060336
in-drivable-lane_max15.199999999999726
in-drivable-lane_mean9.412499999999795
in-drivable-lane_min1.4999999999999432
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.663499605233431, "get_ui_image": 0.027743020323690627, "step_physics": 0.0913317185655224, "survival_time": 59.99999999999873, "driven_lanedir": 11.148724290539889, "get_state_dump": 0.004337418387077134, "get_robot_state": 0.003484607437667402, "sim_render-ego0": 0.0035796336190686636, "get_duckie_state": 1.5107122289449547e-06, "in-drivable-lane": 1.4999999999999432, "deviation-heading": 8.865978579168848, "agent_compute-ego0": 0.011958737456729072, "complete-iteration": 0.15556912656429903, "set_robot_commands": 0.002041300766474003, "deviation-center-line": 2.338017052461001, "driven_lanedir_consec": 11.148724290539889, "sim_compute_sim_state": 0.009177861860848584, "sim_compute_performance-ego0": 0.0018384371272332463}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.672909932253598, "get_ui_image": 0.035633133214081854, "step_physics": 0.1439975372063528, "survival_time": 59.99999999999873, "driven_lanedir": 9.461103089582716, "get_state_dump": 0.004395480358431877, "get_robot_state": 0.003485408849660602, "sim_render-ego0": 0.003749443232070199, "get_duckie_state": 1.6191023573291789e-06, "in-drivable-lane": 7.899999999999776, "deviation-heading": 15.78819892245479, "agent_compute-ego0": 0.01248403155337166, "complete-iteration": 0.22122368050256835, "set_robot_commands": 0.0021808955393464837, "deviation-center-line": 3.5976320958572745, "driven_lanedir_consec": 9.461103089582716, "sim_compute_sim_state": 0.013310768919920148, "sim_compute_performance-ego0": 0.0019077750467241651}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.270627307488564, "get_ui_image": 0.03206037695890938, "step_physics": 0.13329239421420627, "survival_time": 38.19999999999997, "driven_lanedir": 4.41763790534308, "get_state_dump": 0.004374436771168428, "get_robot_state": 0.003520596572776246, "sim_render-ego0": 0.0036248054379731222, "get_duckie_state": 1.6860712587443831e-06, "in-drivable-lane": 13.049999999999743, "deviation-heading": 9.23543691839572, "agent_compute-ego0": 0.012255163130417367, "complete-iteration": 0.20620421739964703, "set_robot_commands": 0.002101043314715616, "deviation-center-line": 1.8757295269322247, "driven_lanedir_consec": 4.41763790534308, "sim_compute_sim_state": 0.01301864362230488, "sim_compute_performance-ego0": 0.001876928603727054}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.092425253063658, "get_ui_image": 0.02545156608060336, "step_physics": 0.09906425099771632, "survival_time": 42.39999999999973, "driven_lanedir": 4.867863373712344, "get_state_dump": 0.0043987399416902185, "get_robot_state": 0.003496581449385105, "sim_render-ego0": 0.003585330167844523, "get_duckie_state": 1.685779423258751e-06, "in-drivable-lane": 15.199999999999726, "deviation-heading": 9.08275372976217, "agent_compute-ego0": 0.01250952854313755, "complete-iteration": 0.15866022845741154, "set_robot_commands": 0.0021208256518180854, "deviation-center-line": 1.6958213038303591, "driven_lanedir_consec": 4.867863373712344, "sim_compute_sim_state": 0.006111216910174654, "sim_compute_performance-ego0": 0.0018440966611756593}}
set_robot_commands_max0.0021808955393464837
set_robot_commands_mean0.002111016318088547
set_robot_commands_median0.0021109344832668507
set_robot_commands_min0.002041300766474003
sim_compute_performance-ego0_max0.0019077750467241651
sim_compute_performance-ego0_mean0.0018668093597150313
sim_compute_performance-ego0_median0.0018605126324513568
sim_compute_performance-ego0_min0.0018384371272332463
sim_compute_sim_state_max0.013310768919920148
sim_compute_sim_state_mean0.010404622828312069
sim_compute_sim_state_median0.011098252741576732
sim_compute_sim_state_min0.006111216910174654
sim_render-ego0_max0.003749443232070199
sim_render-ego0_mean0.0036348031142391262
sim_render-ego0_median0.0036050678029088223
sim_render-ego0_min0.0035796336190686636
simulation-passed1
step_physics_max0.1439975372063528
step_physics_mean0.11692147524594944
step_physics_median0.1161783226059613
step_physics_min0.0913317185655224
survival_time_max59.99999999999873
survival_time_mean50.14999999999929
survival_time_min38.19999999999997
No reset possible
6196513467Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.883123640539294
survival_time_median59.99999999999873
deviation-center-line_median3.4239150380181176
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012199811593976049
agent_compute-ego0_mean0.011921314722691648
agent_compute-ego0_median0.012010526994582911
agent_compute-ego0_min0.011464393307624708
complete-iteration_max0.2171509766161789
complete-iteration_mean0.1820203283744291
complete-iteration_median0.17780671062120093
complete-iteration_min0.15531691563913566
deviation-center-line_max3.8961810944534023
deviation-center-line_mean3.3356119193968135
deviation-center-line_min2.598436507097617
deviation-heading_max13.456197809429952
deviation-heading_mean11.794334506603782
deviation-heading_median11.935408954156756
deviation-heading_min9.850322308671666
driven_any_max11.256130198582683
driven_any_mean11.253803509638496
driven_any_median11.256075379150564
driven_any_min11.246933081670164
driven_lanedir_consec_max11.00014526231658
driven_lanedir_consec_mean10.90204156364919
driven_lanedir_consec_min10.841773711201595
driven_lanedir_max11.00014526231658
driven_lanedir_mean10.90204156364919
driven_lanedir_median10.883123640539294
driven_lanedir_min10.841773711201595
get_duckie_state_max1.2155178683087986e-06
get_duckie_state_mean1.1086662444941309e-06
get_duckie_state_median1.0841990589202197e-06
get_duckie_state_min1.0507489918272858e-06
get_robot_state_max0.003527985921410299
get_robot_state_mean0.0035077520056032915
get_robot_state_median0.0035087170946310206
get_robot_state_min0.003485587911740826
get_state_dump_max0.00437166073439421
get_state_dump_mean0.004338806415973952
get_state_dump_median0.00435975926007756
get_state_dump_min0.00426404640934648
get_ui_image_max0.035772891763247223
get_ui_image_mean0.03042792876892344
get_ui_image_median0.03010260215111319
get_ui_image_min0.02573361901022016
in-drivable-lane_max0.4999999999999716
in-drivable-lane_mean0.1249999999999929
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.246933081670164, "get_ui_image": 0.0278463885746431, "step_physics": 0.09172662648432062, "survival_time": 59.99999999999873, "driven_lanedir": 10.909459615134804, "get_state_dump": 0.00426404640934648, "get_robot_state": 0.003485587911740826, "sim_render-ego0": 0.003544130690588145, "get_duckie_state": 1.0813205664997594e-06, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 9.850322308671666, "agent_compute-ego0": 0.011464393307624708, "complete-iteration": 0.15531691563913566, "set_robot_commands": 0.002065051108176861, "deviation-center-line": 2.598436507097617, "driven_lanedir_consec": 10.909459615134804, "sim_compute_sim_state": 0.009013105292403628, "sim_compute_performance-ego0": 0.0018379080801780377}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.256072855879964, "get_ui_image": 0.035772891763247223, "step_physics": 0.14038994806593005, "survival_time": 59.99999999999873, "driven_lanedir": 10.856787665943784, "get_state_dump": 0.004354065403553171, "get_robot_state": 0.0035244086501401827, "sim_render-ego0": 0.003634311872953975, "get_duckie_state": 1.0507489918272858e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.456197809429952, "agent_compute-ego0": 0.012199811593976049, "complete-iteration": 0.2171509766161789, "set_robot_commands": 0.002131452766882192, "deviation-center-line": 3.8961810944534023, "driven_lanedir_consec": 10.856787665943784, "sim_compute_sim_state": 0.013200716611050649, "sim_compute_performance-ego0": 0.0018721627355316696}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.256130198582683, "get_ui_image": 0.03235881572758328, "step_physics": 0.1243750794940348, "survival_time": 59.99999999999873, "driven_lanedir": 10.841773711201595, "get_state_dump": 0.004365453116601949, "get_robot_state": 0.003527985921410299, "sim_render-ego0": 0.0036849110053044174, "get_duckie_state": 1.2155178683087986e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.177915733150542, "agent_compute-ego0": 0.012106532756732366, "complete-iteration": 0.19746425070433096, "set_robot_commands": 0.002262982003992543, "deviation-center-line": 3.498039792690536, "driven_lanedir_consec": 10.841773711201595, "sim_compute_sim_state": 0.012807035724090398, "sim_compute_performance-ego0": 0.0019041779237821835}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.256077902421165, "get_ui_image": 0.02573361901022016, "step_physics": 0.09877348720382197, "survival_time": 59.99999999999873, "driven_lanedir": 11.00014526231658, "get_state_dump": 0.00437166073439421, "get_robot_state": 0.003493025539121858, "sim_render-ego0": 0.003664540609253336, "get_duckie_state": 1.0870775513406795e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.69290217516297, "agent_compute-ego0": 0.011914521232433462, "complete-iteration": 0.1581491705380709, "set_robot_commands": 0.002155846501270202, "deviation-center-line": 3.3497902833456994, "driven_lanedir_consec": 11.00014526231658, "sim_compute_sim_state": 0.006073559452155349, "sim_compute_performance-ego0": 0.0018959863299037095}}
set_robot_commands_max0.002262982003992543
set_robot_commands_mean0.0021538330950804496
set_robot_commands_median0.002143649634076197
set_robot_commands_min0.002065051108176861
sim_compute_performance-ego0_max0.0019041779237821835
sim_compute_performance-ego0_mean0.0018775587673489
sim_compute_performance-ego0_median0.0018840745327176895
sim_compute_performance-ego0_min0.0018379080801780377
sim_compute_sim_state_max0.013200716611050649
sim_compute_sim_state_mean0.010273604269925006
sim_compute_sim_state_median0.010910070508247011
sim_compute_sim_state_min0.006073559452155349
sim_render-ego0_max0.0036849110053044174
sim_render-ego0_mean0.0036319735445249687
sim_render-ego0_median0.003649426241103656
sim_render-ego0_min0.003544130690588145
simulation-passed1
step_physics_max0.14038994806593005
step_physics_mean0.11381628531202688
step_physics_median0.11157428334892838
step_physics_min0.09172662648432062
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6196313466Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.384323448446067
survival_time_median29.77500000000008
deviation-center-line_median1.1940550397157346
in-drivable-lane_median8.749999999999769


other stats
agent_compute-ego0_max0.012001696551380812
agent_compute-ego0_mean0.011751887305335896
agent_compute-ego0_median0.011737648868129592
agent_compute-ego0_min0.011530554933703583
complete-iteration_max0.21611707569112248
complete-iteration_mean0.18629508467278297
complete-iteration_median0.18410718049413477
complete-iteration_min0.1608489020117398
deviation-center-line_max1.5255857621250049
deviation-center-line_mean1.2284394988139584
deviation-center-line_min1.0000621536993597
deviation-heading_max9.0038594127363
deviation-heading_mean6.253716146002416
deviation-heading_median5.600870146140984
deviation-heading_min4.809264878991394
driven_any_max8.754518521235298
driven_any_mean6.249222009540183
driven_any_median6.0238139112671565
driven_any_min4.194741694391125
driven_lanedir_consec_max6.318993630440075
driven_lanedir_consec_mean3.987628688310508
driven_lanedir_consec_min2.862874225909823
driven_lanedir_max6.318993630440075
driven_lanedir_mean3.9878964837904007
driven_lanedir_median3.3848590394058524
driven_lanedir_min2.862874225909823
get_duckie_state_max1.7960489643693536e-06
get_duckie_state_mean1.745838305600489e-06
get_duckie_state_median1.7384852558402422e-06
get_duckie_state_min1.710333746352118e-06
get_robot_state_max0.003495569886832402
get_robot_state_mean0.003472937897778889
get_robot_state_median0.003475725658119204
get_robot_state_min0.003444730388044746
get_state_dump_max0.004311427120913826
get_state_dump_mean0.004305990720867585
get_state_dump_median0.004305634737995772
get_state_dump_min0.0043012662865649694
get_ui_image_max0.03567049717211157
get_ui_image_mean0.030360225981833723
get_ui_image_median0.0300488945146405
get_ui_image_min0.025672617725942325
in-drivable-lane_max16.54999999999979
in-drivable-lane_mean9.974999999999852
in-drivable-lane_min5.850000000000083
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.754518521235298, "get_ui_image": 0.0277852331285988, "step_physics": 0.096904546230823, "survival_time": 42.8499999999997, "driven_lanedir": 6.318993630440075, "get_state_dump": 0.0043093257850700326, "get_robot_state": 0.0034809826693056904, "sim_render-ego0": 0.0035947883601510997, "get_duckie_state": 1.710333746352118e-06, "in-drivable-lane": 10.849999999999454, "deviation-heading": 6.389797008758355, "agent_compute-ego0": 0.011530554933703583, "complete-iteration": 0.16092400423018804, "set_robot_commands": 0.00206698265386906, "deviation-center-line": 1.377306422101296, "driven_lanedir_consec": 6.318993630440075, "sim_compute_sim_state": 0.009323759234590686, "sim_compute_performance-ego0": 0.0018537247375452711}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.716613136794491, "get_ui_image": 0.03567049717211157, "step_physics": 0.14120808031439466, "survival_time": 37.84999999999999, "driven_lanedir": 3.891771666989955, "get_state_dump": 0.004301943690921512, "get_robot_state": 0.003470468646932718, "sim_render-ego0": 0.0036335696016578374, "get_duckie_state": 1.7362408398952836e-06, "in-drivable-lane": 16.54999999999979, "deviation-heading": 9.0038594127363, "agent_compute-ego0": 0.012001696551380812, "complete-iteration": 0.21611707569112248, "set_robot_commands": 0.0020068887041237863, "deviation-center-line": 1.5255857621250049, "driven_lanedir_consec": 3.890700485070384, "sim_compute_sim_state": 0.011912043302229024, "sim_compute_performance-ego0": 0.0018383198488985328}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.194741694391125, "get_ui_image": 0.0323125559006822, "step_physics": 0.13718920013915872, "survival_time": 21.050000000000164, "driven_lanedir": 2.862874225909823, "get_state_dump": 0.004311427120913826, "get_robot_state": 0.003444730388044746, "sim_render-ego0": 0.00363872119035766, "get_duckie_state": 1.7960489643693536e-06, "in-drivable-lane": 5.850000000000083, "deviation-heading": 4.809264878991394, "agent_compute-ego0": 0.011629743033675786, "complete-iteration": 0.20729035675808152, "set_robot_commands": 0.0020513466749146085, "deviation-center-line": 1.0000621536993597, "driven_lanedir_consec": 2.862874225909823, "sim_compute_sim_state": 0.010793229979926376, "sim_compute_performance-ego0": 0.0018487535946742051}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.331014685739821, "get_ui_image": 0.025672617725942325, "step_physics": 0.10199708938598633, "survival_time": 21.700000000000173, "driven_lanedir": 2.8779464118217497, "get_state_dump": 0.0043012662865649694, "get_robot_state": 0.003495569886832402, "sim_render-ego0": 0.003604953042392073, "get_duckie_state": 1.740729671785201e-06, "in-drivable-lane": 6.650000000000085, "deviation-heading": 4.811943283523615, "agent_compute-ego0": 0.0118455547025834, "complete-iteration": 0.1608489020117398, "set_robot_commands": 0.0020330807258342872, "deviation-center-line": 1.010803657330173, "driven_lanedir_consec": 2.8779464118217497, "sim_compute_sim_state": 0.00597191240595675, "sim_compute_performance-ego0": 0.001852964532786402}}
set_robot_commands_max0.00206698265386906
set_robot_commands_mean0.0020395746896854352
set_robot_commands_median0.002042213700374448
set_robot_commands_min0.0020068887041237863
sim_compute_performance-ego0_max0.0018537247375452711
sim_compute_performance-ego0_mean0.0018484406784761028
sim_compute_performance-ego0_median0.001850859063730304
sim_compute_performance-ego0_min0.0018383198488985328
sim_compute_sim_state_max0.011912043302229024
sim_compute_sim_state_mean0.00950023623067571
sim_compute_sim_state_median0.010058494607258533
sim_compute_sim_state_min0.00597191240595675
sim_render-ego0_max0.00363872119035766
sim_render-ego0_mean0.003618008048639667
sim_render-ego0_median0.0036192613220249552
sim_render-ego0_min0.0035947883601510997
simulation-passed1
step_physics_max0.14120808031439466
step_physics_mean0.11932472901759068
step_physics_median0.11959314476257252
step_physics_min0.096904546230823
survival_time_max42.8499999999997
survival_time_mean30.862500000000004
survival_time_min21.050000000000164
No reset possible
6196113463Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.729633679406019
survival_time_median59.99999999999873
deviation-center-line_median4.2938512738423675
in-drivable-lane_median7.374999999999819


other stats
agent_compute-ego0_max0.01654804457633521
agent_compute-ego0_mean0.015757566883998746
agent_compute-ego0_median0.015679642818651033
agent_compute-ego0_min0.015122937322357711
complete-iteration_max0.1992016892746823
complete-iteration_mean0.17950200840992098
complete-iteration_median0.1781646637594968
complete-iteration_min0.16247701684600804
deviation-center-line_max6.898030976914843
deviation-center-line_mean4.727210768446778
deviation-center-line_min3.4231095491875343
deviation-heading_max11.002901877856653
deviation-heading_mean9.422104532824834
deviation-heading_median9.311212737072749
deviation-heading_min8.063090779297188
driven_any_max7.921116216861415
driven_any_mean7.919408482130082
driven_any_median7.920995426941683
driven_any_min7.914526857775549
driven_lanedir_consec_max7.726688452220938
driven_lanedir_consec_mean6.795391755814069
driven_lanedir_consec_min5.995611212223296
driven_lanedir_max7.726688452220938
driven_lanedir_mean6.795391755814069
driven_lanedir_median6.729633679406019
driven_lanedir_min5.995611212223296
get_duckie_state_max1.1599331870861196e-06
get_duckie_state_mean1.108318840236489e-06
get_duckie_state_median1.1029588888328735e-06
get_duckie_state_min1.0674243961940897e-06
get_robot_state_max0.0036339372719058783
get_robot_state_mean0.003544537749119742
get_robot_state_median0.0035289082300851587
get_robot_state_min0.0034863972644027723
get_state_dump_max0.0045369270937726655
get_state_dump_mean0.004440730060764792
get_state_dump_median0.004439223815162017
get_state_dump_min0.00434754551896247
get_ui_image_max0.03604265216188963
get_ui_image_mean0.03062836549164949
get_ui_image_median0.03028154680869859
get_ui_image_min0.025907716187311153
in-drivable-lane_max11.799999999999716
in-drivable-lane_mean6.6374999999998385
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914526857775549, "get_ui_image": 0.02800818625139654, "step_physics": 0.09380179301189642, "survival_time": 59.99999999999873, "driven_lanedir": 5.995611212223296, "get_state_dump": 0.00434754551896247, "get_robot_state": 0.0035637745154489587, "sim_render-ego0": 0.0036586267962046806, "get_duckie_state": 1.0972019039919534e-06, "in-drivable-lane": 11.799999999999716, "deviation-heading": 9.083474653550493, "agent_compute-ego0": 0.01564377789493405, "complete-iteration": 0.16247701684600804, "set_robot_commands": 0.002123949033433849, "deviation-center-line": 4.411008333208726, "driven_lanedir_consec": 5.995611212223296, "sim_compute_sim_state": 0.009377350318838814, "sim_compute_performance-ego0": 0.0018775572288443304}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921036770570813, "get_ui_image": 0.03604265216188963, "step_physics": 0.12010654541574647, "survival_time": 59.99999999999873, "driven_lanedir": 6.525850163822902, "get_state_dump": 0.0044700442305413216, "get_robot_state": 0.0034940419447213587, "sim_render-ego0": 0.003591181138075956, "get_duckie_state": 1.108715873673794e-06, "in-drivable-lane": 8.49999999999984, "deviation-heading": 11.002901877856653, "agent_compute-ego0": 0.015122937322357711, "complete-iteration": 0.1992016892746823, "set_robot_commands": 0.002169084588653539, "deviation-center-line": 4.176694214476008, "driven_lanedir_consec": 6.525850163822902, "sim_compute_sim_state": 0.012287946863039446, "sim_compute_performance-ego0": 0.0018432626716302497}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921116216861415, "get_ui_image": 0.03255490736600064, "step_physics": 0.11427974581817704, "survival_time": 59.99999999999873, "driven_lanedir": 7.726688452220938, "get_state_dump": 0.0045369270937726655, "get_robot_state": 0.0036339372719058783, "sim_render-ego0": 0.0037582454633752474, "get_duckie_state": 1.1599331870861196e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.538950820595002, "agent_compute-ego0": 0.01654804457633521, "complete-iteration": 0.19291784801054357, "set_robot_commands": 0.0022451933178675365, "deviation-center-line": 3.4231095491875343, "driven_lanedir_consec": 7.726688452220938, "sim_compute_sim_state": 0.013323012438543036, "sim_compute_performance-ego0": 0.0019605534956119736}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920954083312552, "get_ui_image": 0.025907716187311153, "step_physics": 0.1002502036432144, "survival_time": 59.99999999999873, "driven_lanedir": 6.933417194989137, "get_state_dump": 0.004408403399782713, "get_robot_state": 0.0034863972644027723, "sim_render-ego0": 0.0035719375229199463, "get_duckie_state": 1.0674243961940897e-06, "in-drivable-lane": 6.2499999999997975, "deviation-heading": 8.063090779297188, "agent_compute-ego0": 0.015715507742368014, "complete-iteration": 0.16341147950845, "set_robot_commands": 0.002110983112471785, "deviation-center-line": 6.898030976914843, "driven_lanedir_consec": 6.933417194989137, "sim_compute_sim_state": 0.006046537951962537, "sim_compute_performance-ego0": 0.0018403546002187104}}
set_robot_commands_max0.0022451933178675365
set_robot_commands_mean0.0021623025131066774
set_robot_commands_median0.0021465168110436942
set_robot_commands_min0.002110983112471785
sim_compute_performance-ego0_max0.0019605534956119736
sim_compute_performance-ego0_mean0.001880431999076316
sim_compute_performance-ego0_median0.00186040995023729
sim_compute_performance-ego0_min0.0018403546002187104
sim_compute_sim_state_max0.013323012438543036
sim_compute_sim_state_mean0.01025871189309596
sim_compute_sim_state_median0.010832648590939131
sim_compute_sim_state_min0.006046537951962537
sim_render-ego0_max0.0037582454633752474
sim_render-ego0_mean0.0036449977301439575
sim_render-ego0_median0.0036249039671403184
sim_render-ego0_min0.0035719375229199463
simulation-passed1
step_physics_max0.12010654541574647
step_physics_mean0.1071095719722586
step_physics_median0.10726497473069573
step_physics_min0.09380179301189642
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6195913462Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:11:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8486792385543862
survival_time_median8.42499999999999
deviation-center-line_median0.32792432694082435
in-drivable-lane_median3.449999999999999


other stats
agent_compute-ego0_max0.012923407972904671
agent_compute-ego0_mean0.012630711087836711
agent_compute-ego0_median0.012602999064072131
agent_compute-ego0_min0.012393438250297909
complete-iteration_max0.2685481498115941
complete-iteration_mean0.20750312047248043
complete-iteration_median0.201712919588395
complete-iteration_min0.15803849290153762
deviation-center-line_max1.358199682009899
deviation-center-line_mean0.5251282687516696
deviation-center-line_min0.08646473911513089
deviation-heading_max10.513233547255608
deviation-heading_mean3.5231522902024723
deviation-heading_median1.380828381075044
deviation-heading_min0.8177188514041935
driven_any_max11.672972930325992
driven_any_mean3.724354705779554
driven_any_median1.4400459809164918
driven_any_min0.34435393095924066
driven_lanedir_consec_max2.180697293282704
driven_lanedir_consec_mean1.0137152174184574
driven_lanedir_consec_min0.17680509928235333
driven_lanedir_max2.180697293282704
driven_lanedir_mean1.0137152174184574
driven_lanedir_median0.8486792385543862
driven_lanedir_min0.17680509928235333
get_duckie_state_max1.317039530544995e-06
get_duckie_state_mean1.2387746773906845e-06
get_duckie_state_median1.2292573148892169e-06
get_duckie_state_min1.1795445492393093e-06
get_robot_state_max0.003635969601179424
get_robot_state_mean0.003591913802293901
get_robot_state_median0.0035832991507433855
get_robot_state_min0.003565087306509407
get_state_dump_max0.004708386304085715
get_state_dump_mean0.004583119429017872
get_state_dump_median0.004595463213167693
get_state_dump_min0.004433164985650386
get_ui_image_max0.03627743637352659
get_ui_image_mean0.0307221224200798
get_ui_image_median0.03052155708313794
get_ui_image_min0.025567939140516752
in-drivable-lane_max43.89999999999888
in-drivable-lane_mean13.03749999999972
in-drivable-lane_min1.3499999999999974
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.2639490311928814, "get_ui_image": 0.028485602454135298, "step_physics": 0.13122261354797765, "survival_time": 7.549999999999981, "driven_lanedir": 0.5274215635627506, "get_state_dump": 0.00462783324091058, "get_robot_state": 0.003635969601179424, "sim_render-ego0": 0.003755111443369012, "get_duckie_state": 1.2171895880448192e-06, "in-drivable-lane": 4.249999999999985, "deviation-heading": 1.1565120935180129, "agent_compute-ego0": 0.012401047505830464, "complete-iteration": 0.1966668963432312, "set_robot_commands": 0.002183570673591212, "deviation-center-line": 0.26099450639631333, "driven_lanedir_consec": 0.5274215635627506, "sim_compute_sim_state": 0.008306749557193956, "sim_compute_performance-ego0": 0.001965656092292384}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.34435393095924066, "get_ui_image": 0.03627743637352659, "step_physics": 0.19354122563412315, "survival_time": 2.799999999999998, "driven_lanedir": 0.17680509928235333, "get_state_dump": 0.004708386304085715, "get_robot_state": 0.003589805803800884, "sim_render-ego0": 0.0037265284019604066, "get_duckie_state": 1.1795445492393093e-06, "in-drivable-lane": 1.3499999999999974, "deviation-heading": 0.8177188514041935, "agent_compute-ego0": 0.012923407972904671, "complete-iteration": 0.2685481498115941, "set_robot_commands": 0.002405346485606411, "deviation-center-line": 0.08646473911513089, "driven_lanedir_consec": 0.17680509928235333, "sim_compute_sim_state": 0.009399305310165673, "sim_compute_performance-ego0": 0.0018983138234991777}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6161429306401025, "get_ui_image": 0.03255751171214058, "step_physics": 0.13632617787243848, "survival_time": 9.299999999999995, "driven_lanedir": 1.1699369135460218, "get_state_dump": 0.004563093185424805, "get_robot_state": 0.0035767924976858865, "sim_render-ego0": 0.0037794470149565503, "get_duckie_state": 1.317039530544995e-06, "in-drivable-lane": 2.650000000000013, "deviation-heading": 1.6051446686320752, "agent_compute-ego0": 0.0128049506223138, "complete-iteration": 0.20675894283355875, "set_robot_commands": 0.002178209988191166, "deviation-center-line": 0.39485414748533537, "driven_lanedir_consec": 1.1699369135460218, "sim_compute_sim_state": 0.0089306385121881, "sim_compute_performance-ego0": 0.0019603145313772928}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672972930325992, "get_ui_image": 0.025567939140516752, "step_physics": 0.09833881321001012, "survival_time": 59.99999999999873, "driven_lanedir": 2.180697293282704, "get_state_dump": 0.004433164985650386, "get_robot_state": 0.003565087306509407, "sim_render-ego0": 0.003684533625022259, "get_duckie_state": 1.241325041733614e-06, "in-drivable-lane": 43.89999999999888, "deviation-heading": 10.513233547255608, "agent_compute-ego0": 0.012393438250297909, "complete-iteration": 0.15803849290153762, "set_robot_commands": 0.00213973508290109, "deviation-center-line": 1.358199682009899, "driven_lanedir_consec": 2.180697293282704, "sim_compute_sim_state": 0.005906924518518503, "sim_compute_performance-ego0": 0.0019282889703628324}}
set_robot_commands_max0.002405346485606411
set_robot_commands_mean0.0022267155575724697
set_robot_commands_median0.002180890330891189
set_robot_commands_min0.00213973508290109
sim_compute_performance-ego0_max0.001965656092292384
sim_compute_performance-ego0_mean0.0019381433543829217
sim_compute_performance-ego0_median0.0019443017508700624
sim_compute_performance-ego0_min0.0018983138234991777
sim_compute_sim_state_max0.009399305310165673
sim_compute_sim_state_mean0.008135904474516557
sim_compute_sim_state_median0.008618694034691027
sim_compute_sim_state_min0.005906924518518503
sim_render-ego0_max0.0037794470149565503
sim_render-ego0_mean0.0037364051213270577
sim_render-ego0_median0.0037408199226647097
sim_render-ego0_min0.003684533625022259
simulation-passed1
step_physics_max0.19354122563412315
step_physics_mean0.13985720756613734
step_physics_median0.13377439571020805
step_physics_min0.09833881321001012
survival_time_max59.99999999999873
survival_time_mean19.91249999999968
survival_time_min2.799999999999998
No reset possible
6195813460Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:36:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.124533757753921
survival_time_median59.99999999999873
deviation-center-line_median3.881962369145616
in-drivable-lane_median4.149999999999886


other stats
agent_compute-ego0_max0.017136155119744267
agent_compute-ego0_mean0.01615048521861347
agent_compute-ego0_median0.01585119620250921
agent_compute-ego0_min0.015763393349691197
complete-iteration_max0.2149576449969925
complete-iteration_mean0.18663814150225017
complete-iteration_median0.18314307545940645
complete-iteration_min0.16530877009319525
deviation-center-line_max4.3229522832662095
deviation-center-line_mean3.679325719391643
deviation-center-line_min2.6304258560091305
deviation-heading_max11.211125967395882
deviation-heading_mean8.308213071693421
deviation-heading_median8.231149047679274
deviation-heading_min5.559428224019259
driven_any_max7.921073741470936
driven_any_mean7.919373358467594
driven_any_median7.9209167479998195
driven_any_min7.914586196399799
driven_lanedir_consec_max7.524417674880174
driven_lanedir_consec_mean6.040448840348397
driven_lanedir_consec_min2.3883101710055668
driven_lanedir_max7.524417674880174
driven_lanedir_mean6.14756288334134
driven_lanedir_median7.124533757753921
driven_lanedir_min2.8167663429773415
get_duckie_state_max1.2639559476599903e-06
get_duckie_state_mean1.2075275703830386e-06
get_duckie_state_median1.19189437878916e-06
get_duckie_state_min1.1823655762938435e-06
get_robot_state_max0.0036468902892812303
get_robot_state_mean0.003586221148231246
get_robot_state_median0.0035810810044643584
get_robot_state_min0.0035358322947150363
get_state_dump_max0.004541309151820199
get_state_dump_mean0.00453217703535793
get_state_dump_median0.0045345842987174895
get_state_dump_min0.004518230392176543
get_ui_image_max0.03645303227522292
get_ui_image_mean0.03098288925363063
get_ui_image_median0.03065408814658134
get_ui_image_min0.026170348446136908
in-drivable-lane_max36.74999999999874
in-drivable-lane_mean11.749999999999616
in-drivable-lane_min1.9499999999999496
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914586196399799, "get_ui_image": 0.028456061606998744, "step_physics": 0.0950720206982488, "survival_time": 59.99999999999873, "driven_lanedir": 7.524417674880174, "get_state_dump": 0.0045361185351775945, "get_robot_state": 0.0036468902892812303, "sim_render-ego0": 0.0037353342518421334, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 1.9499999999999496, "deviation-heading": 7.069579482719833, "agent_compute-ego0": 0.015928669237872145, "complete-iteration": 0.16530877009319525, "set_robot_commands": 0.002208689269574854, "deviation-center-line": 3.794509472082512, "driven_lanedir_consec": 7.524417674880174, "sim_compute_sim_state": 0.009718091362818988, "sim_compute_performance-ego0": 0.0019253713701487976}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920983437261113, "get_ui_image": 0.03645303227522292, "step_physics": 0.1341616603158892, "survival_time": 59.99999999999873, "driven_lanedir": 7.195879597911455, "get_state_dump": 0.004518230392176543, "get_robot_state": 0.0035358322947150363, "sim_render-ego0": 0.003686865600916269, "get_duckie_state": 1.2639559476599903e-06, "in-drivable-lane": 3.39999999999994, "deviation-heading": 11.211125967395882, "agent_compute-ego0": 0.015763393349691197, "complete-iteration": 0.2149576449969925, "set_robot_commands": 0.0021528367892987127, "deviation-center-line": 4.3229522832662095, "driven_lanedir_consec": 7.195879597911455, "sim_compute_sim_state": 0.01273521416193242, "sim_compute_performance-ego0": 0.001871305143307091}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921073741470936, "get_ui_image": 0.03285211468616393, "step_physics": 0.1185108448047622, "survival_time": 59.99999999999873, "driven_lanedir": 7.053187917596388, "get_state_dump": 0.004541309151820199, "get_robot_state": 0.0035467177604656236, "sim_render-ego0": 0.003700546380582201, "get_duckie_state": 1.189909211602636e-06, "in-drivable-lane": 4.899999999999832, "deviation-heading": 9.392718612638715, "agent_compute-ego0": 0.017136155119744267, "complete-iteration": 0.1979972023848789, "set_robot_commands": 0.00213222201916697, "deviation-center-line": 3.96941526620872, "driven_lanedir_consec": 7.053187917596388, "sim_compute_sim_state": 0.013598246340152128, "sim_compute_performance-ego0": 0.0018999318496869268}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920850058738526, "get_ui_image": 0.026170348446136908, "step_physics": 0.10387765517540518, "survival_time": 59.99999999999873, "driven_lanedir": 2.8167663429773415, "get_state_dump": 0.004533050062257384, "get_robot_state": 0.003615444248463093, "sim_render-ego0": 0.00373073422243752, "get_duckie_state": 1.1938795459756845e-06, "in-drivable-lane": 36.74999999999874, "deviation-heading": 5.559428224019259, "agent_compute-ego0": 0.015773723167146276, "complete-iteration": 0.16828894853393403, "set_robot_commands": 0.002232382835496177, "deviation-center-line": 2.6304258560091305, "driven_lanedir_consec": 2.3883101710055668, "sim_compute_sim_state": 0.006352481794397003, "sim_compute_performance-ego0": 0.0019251134969312685}}
set_robot_commands_max0.002232382835496177
set_robot_commands_mean0.0021815327283841784
set_robot_commands_median0.0021807630294367834
set_robot_commands_min0.00213222201916697
sim_compute_performance-ego0_max0.0019253713701487976
sim_compute_performance-ego0_mean0.001905430465018521
sim_compute_performance-ego0_median0.0019125226733090975
sim_compute_performance-ego0_min0.001871305143307091
sim_compute_sim_state_max0.013598246340152128
sim_compute_sim_state_mean0.010601008414825136
sim_compute_sim_state_median0.011226652762375704
sim_compute_sim_state_min0.006352481794397003
sim_render-ego0_max0.0037353342518421334
sim_render-ego0_mean0.0037133701139445306
sim_render-ego0_median0.003715640301509861
sim_render-ego0_min0.003686865600916269
simulation-passed1
step_physics_max0.1341616603158892
step_physics_mean0.11290554524857636
step_physics_median0.11119424999008368
step_physics_min0.0950720206982488
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6195713458Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6195613458Charlie Gauthier 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6195413456Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:23:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.72280449572305
survival_time_median31.92500000000008
deviation-center-line_median1.519022854973058
in-drivable-lane_median5.5999999999999215


other stats
agent_compute-ego0_max0.01238601370508891
agent_compute-ego0_mean0.012003354879655074
agent_compute-ego0_median0.011907108620808664
agent_compute-ego0_min0.01181318857191405
complete-iteration_max0.22813930965605236
complete-iteration_mean0.1968273376559563
complete-iteration_median0.20111123588588448
complete-iteration_min0.156947569196004
deviation-center-line_max2.6297318780982115
deviation-center-line_mean1.4991284523282045
deviation-center-line_min0.32873622126849034
deviation-heading_max10.993398471970226
deviation-heading_mean7.156097082274824
deviation-heading_median7.77998199190208
deviation-heading_min2.0710258733249094
driven_any_max11.66331521914197
driven_any_mean7.101848735100653
driven_any_median6.0427198765594845
driven_any_min4.658639968141669
driven_lanedir_consec_max10.75246328079237
driven_lanedir_consec_mean5.437017105088723
driven_lanedir_consec_min1.5499961481164204
driven_lanedir_max10.75246328079237
driven_lanedir_mean5.437017105088723
driven_lanedir_median4.72280449572305
driven_lanedir_min1.5499961481164204
get_duckie_state_max1.1466114396551049e-06
get_duckie_state_mean1.1345046458186162e-06
get_duckie_state_median1.1334971804443825e-06
get_duckie_state_min1.124412782730595e-06
get_robot_state_max0.0035980055473130708
get_robot_state_mean0.003530680417305544
get_robot_state_median0.0035114122554087603
get_robot_state_min0.003501891611091583
get_state_dump_max0.0045330915522515825
get_state_dump_mean0.00441435181593536
get_state_dump_median0.004393465325597315
get_state_dump_min0.004337385060295226
get_ui_image_max0.03586367718757145
get_ui_image_mean0.03057572005999305
get_ui_image_median0.030478073882651925
get_ui_image_min0.025483055287096875
in-drivable-lane_max16.20000000000023
in-drivable-lane_mean7.525000000000021
in-drivable-lane_min2.70000000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.66331521914197, "get_ui_image": 0.028663438722354783, "step_physics": 0.1097719583979852, "survival_time": 59.99999999999873, "driven_lanedir": 10.75246328079237, "get_state_dump": 0.0045330915522515825, "get_robot_state": 0.0035980055473130708, "sim_render-ego0": 0.003733519014966776, "get_duckie_state": 1.13214084647478e-06, "in-drivable-lane": 2.70000000000001, "deviation-heading": 10.993398471970226, "agent_compute-ego0": 0.01181318857191405, "complete-iteration": 0.17581066461923617, "set_robot_commands": 0.002190423349258207, "deviation-center-line": 2.6297318780982115, "driven_lanedir_consec": 10.75246328079237, "sim_compute_sim_state": 0.009486164081900644, "sim_compute_performance-ego0": 0.0019445347845504725}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.717227376448534, "get_ui_image": 0.03586367718757145, "step_physics": 0.15414479422190833, "survival_time": 25.150000000000222, "driven_lanedir": 3.662311348460764, "get_state_dump": 0.004337385060295226, "get_robot_state": 0.0035076169740586053, "sim_render-ego0": 0.003601754941637554, "get_duckie_state": 1.134853514413985e-06, "in-drivable-lane": 4.70000000000005, "deviation-heading": 6.121264791430511, "agent_compute-ego0": 0.011837371284999544, "complete-iteration": 0.22813930965605236, "set_robot_commands": 0.0020395853216685945, "deviation-center-line": 1.268208755271665, "driven_lanedir_consec": 3.662311348460764, "sim_compute_sim_state": 0.010876247334101844, "sim_compute_performance-ego0": 0.0018569226302797832}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.368212376670436, "get_ui_image": 0.032292709042949064, "step_physics": 0.15370176684471867, "survival_time": 38.69999999999994, "driven_lanedir": 5.783297642985336, "get_state_dump": 0.004360436470277848, "get_robot_state": 0.003515207536758915, "sim_render-ego0": 0.003590643790460402, "get_duckie_state": 1.124412782730595e-06, "in-drivable-lane": 6.499999999999794, "deviation-heading": 9.43869919237365, "agent_compute-ego0": 0.011976845956617788, "complete-iteration": 0.22641180715253276, "set_robot_commands": 0.002027326399280179, "deviation-center-line": 1.769836954674451, "driven_lanedir_consec": 5.783297642985336, "sim_compute_sim_state": 0.013029437834216702, "sim_compute_performance-ego0": 0.0018448958858366935}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.658639968141669, "get_ui_image": 0.025483055287096875, "step_physics": 0.09719517096936942, "survival_time": 24.850000000000215, "driven_lanedir": 1.5499961481164204, "get_state_dump": 0.004426494180916782, "get_robot_state": 0.003501891611091583, "sim_render-ego0": 0.00362700678737288, "get_duckie_state": 1.1466114396551049e-06, "in-drivable-lane": 16.20000000000023, "deviation-heading": 2.0710258733249094, "agent_compute-ego0": 0.01238601370508891, "complete-iteration": 0.156947569196004, "set_robot_commands": 0.0020307010436153793, "deviation-center-line": 0.32873622126849034, "driven_lanedir_consec": 1.5499961481164204, "sim_compute_sim_state": 0.006386160371772735, "sim_compute_performance-ego0": 0.0018378601495520656}}
set_robot_commands_max0.002190423349258207
set_robot_commands_mean0.00207200902845559
set_robot_commands_median0.002035143182641987
set_robot_commands_min0.002027326399280179
sim_compute_performance-ego0_max0.0019445347845504725
sim_compute_performance-ego0_mean0.0018710533625547537
sim_compute_performance-ego0_median0.0018509092580582384
sim_compute_performance-ego0_min0.0018378601495520656
sim_compute_sim_state_max0.013029437834216702
sim_compute_sim_state_mean0.009944502405497982
sim_compute_sim_state_median0.010181205708001243
sim_compute_sim_state_min0.006386160371772735
sim_render-ego0_max0.003733519014966776
sim_render-ego0_mean0.003638231133609403
sim_render-ego0_median0.003614380864505217
sim_render-ego0_min0.003590643790460402
simulation-passed1
step_physics_max0.15414479422190833
step_physics_mean0.1287034226084954
step_physics_median0.13173686262135192
step_physics_min0.09719517096936942
survival_time_max59.99999999999873
survival_time_mean37.17499999999978
survival_time_min24.850000000000215
No reset possible
6195313455Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:05:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median1.585234471253694
deviation-center-line_median0.3021876370193082


other stats
agent_compute-ego0_max0.01663747316674341
agent_compute-ego0_mean0.01597983357531612
agent_compute-ego0_median0.016008734298964676
agent_compute-ego0_min0.01526439253659172
complete-iteration_max0.3065561161765569
complete-iteration_mean0.24978374779466467
complete-iteration_median0.25208218126551
complete-iteration_min0.18841451247108176
deviation-center-line_max0.39981578853211264
deviation-center-line_mean0.29009659482978567
deviation-center-line_min0.15619531674841355
deviation-heading_max2.3856628733461687
deviation-heading_mean1.6007010741258767
deviation-heading_median1.575783656425494
deviation-heading_min0.8655741103063506
driven_any_max2.227011203935092
driven_any_mean1.526670433702811
driven_any_median1.656780330166637
driven_any_min0.5661098705428779
driven_lanedir_consec_max2.197816387668939
driven_lanedir_consec_mean1.4793224002106515
driven_lanedir_consec_min0.5490042706662799
driven_lanedir_max2.197816387668939
driven_lanedir_mean1.4793224002106515
driven_lanedir_median1.585234471253694
driven_lanedir_min0.5490042706662799
get_duckie_state_max0.023724108766027763
get_duckie_state_mean0.0170070474455721
get_duckie_state_median0.020107172166388604
get_duckie_state_min0.00408973668348343
get_robot_state_max0.0036603921576391298
get_robot_state_mean0.0035928640315248815
get_robot_state_median0.0035747499419800767
get_robot_state_min0.003561564084500243
get_state_dump_max0.008375904654378945
get_state_dump_mean0.0073055256664429635
get_state_dump_median0.007839611857105551
get_state_dump_min0.005166974297181807
get_ui_image_max0.03909623170200782
get_ui_image_mean0.03328495941337585
get_ui_image_median0.03380070866068301
get_ui_image_min0.026442188630129565
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1589317720749737, "get_ui_image": 0.03199128646635066, "step_physics": 0.13796215003493142, "survival_time": 8.79999999999999, "driven_lanedir": 2.075678184181281, "get_state_dump": 0.008375904654378945, "get_robot_state": 0.003561564084500243, "sim_render-ego0": 0.003662417837455448, "get_duckie_state": 0.023724108766027763, "in-drivable-lane": 0.0, "deviation-heading": 2.3856628733461687, "agent_compute-ego0": 0.016035349355579095, "complete-iteration": 0.2371947657590532, "set_robot_commands": 0.0021639557208045055, "deviation-center-line": 0.39625960178639225, "driven_lanedir_consec": 2.075678184181281, "sim_compute_sim_state": 0.007744607278856181, "sim_compute_performance-ego0": 0.0018841937436895855}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5661098705428779, "get_ui_image": 0.03909623170200782, "step_physics": 0.20132691950737672, "survival_time": 3.899999999999994, "driven_lanedir": 0.5490042706662799, "get_state_dump": 0.007931069482730913, "get_robot_state": 0.0036603921576391298, "sim_render-ego0": 0.0036990612368040447, "get_duckie_state": 0.020285280444954017, "in-drivable-lane": 0.0, "deviation-heading": 0.8655741103063506, "agent_compute-ego0": 0.01663747316674341, "complete-iteration": 0.3065561161765569, "set_robot_commands": 0.0021864130527158325, "deviation-center-line": 0.15619531674841355, "driven_lanedir_consec": 0.5490042706662799, "sim_compute_sim_state": 0.00973465171041368, "sim_compute_performance-ego0": 0.001908063888549805}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1546288882583002, "get_ui_image": 0.03561013085501535, "step_physics": 0.16326072783697218, "survival_time": 5.1999999999999895, "driven_lanedir": 1.094790758326107, "get_state_dump": 0.007748154231480189, "get_robot_state": 0.0035863036201113745, "sim_render-ego0": 0.003635429200671968, "get_duckie_state": 0.019929063887823197, "in-drivable-lane": 0.0, "deviation-heading": 1.810359999531561, "agent_compute-ego0": 0.01598211924235026, "complete-iteration": 0.26696959677196686, "set_robot_commands": 0.0021014872051420665, "deviation-center-line": 0.20811567225222408, "driven_lanedir_consec": 1.094790758326107, "sim_compute_sim_state": 0.01315921601795015, "sim_compute_performance-ego0": 0.0018680572509765625}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.227011203935092, "get_ui_image": 0.026442188630129565, "step_physics": 0.1205478913006298, "survival_time": 9.299999999999995, "driven_lanedir": 2.197816387668939, "get_state_dump": 0.005166974297181807, "get_robot_state": 0.003563196263848779, "sim_render-ego0": 0.0035515137534728024, "get_duckie_state": 0.00408973668348343, "in-drivable-lane": 0.0, "deviation-heading": 1.341207313319427, "agent_compute-ego0": 0.01526439253659172, "complete-iteration": 0.18841451247108176, "set_robot_commands": 0.002084858277264763, "deviation-center-line": 0.39981578853211264, "driven_lanedir_consec": 2.197816387668939, "sim_compute_sim_state": 0.0057673798525397155, "sim_compute_performance-ego0": 0.0018520010983880191}}
set_robot_commands_max0.0021864130527158325
set_robot_commands_mean0.0021341785639817923
set_robot_commands_median0.002132721462973286
set_robot_commands_min0.002084858277264763
sim_compute_performance-ego0_max0.001908063888549805
sim_compute_performance-ego0_mean0.001878078995400993
sim_compute_performance-ego0_median0.001876125497333074
sim_compute_performance-ego0_min0.0018520010983880191
sim_compute_sim_state_max0.01315921601795015
sim_compute_sim_state_mean0.00910146371493993
sim_compute_sim_state_median0.00873962949463493
sim_compute_sim_state_min0.0057673798525397155
sim_render-ego0_max0.0036990612368040447
sim_render-ego0_mean0.003637105507101066
sim_render-ego0_median0.003648923519063708
sim_render-ego0_min0.0035515137534728024
simulation-passed1
step_physics_max0.20132691950737672
step_physics_mean0.15577442216997756
step_physics_median0.1506114389359518
step_physics_min0.1205478913006298
survival_time_max9.299999999999995
survival_time_mean6.799999999999993
survival_time_min3.899999999999994
No reset possible
6195213453Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:07:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999984
in-drivable-lane_median0.0
driven_lanedir_consec_median1.694479506406792
deviation-center-line_median0.16798696634837174


other stats
agent_compute-ego0_max0.017197563098027155
agent_compute-ego0_mean0.01623365323091712
agent_compute-ego0_median0.016233432322907318
agent_compute-ego0_min0.01527018517982669
complete-iteration_max0.3024666676154503
complete-iteration_mean0.24270140053818656
complete-iteration_median0.24189267506181528
complete-iteration_min0.18455358441366537
deviation-center-line_max0.20849286764396976
deviation-center-line_mean0.17058951154196464
deviation-center-line_min0.13789124582714526
deviation-heading_max1.3879189041805828
deviation-heading_mean0.9414588851561024
deviation-heading_median0.8133519375089211
deviation-heading_min0.7512127614259841
driven_any_max2.3433822339902157
driven_any_mean1.5759571450714258
driven_any_median1.705229003800416
driven_any_min0.5499883386946551
driven_lanedir_consec_max2.318312084986776
driven_lanedir_consec_mean1.5608406397007726
driven_lanedir_consec_min0.53609146100273
driven_lanedir_max2.318312084986776
driven_lanedir_mean1.5608406397007726
driven_lanedir_median1.694479506406792
driven_lanedir_min0.53609146100273
get_duckie_state_max0.023910705636187295
get_duckie_state_mean0.01701741062328133
get_duckie_state_median0.02003943130069585
get_duckie_state_min0.0040800742555463145
get_robot_state_max0.0036558340757321087
get_robot_state_mean0.0035478301187939014
get_robot_state_median0.003528993881518066
get_robot_state_min0.0034774986364073672
get_state_dump_max0.008286702923658417
get_state_dump_mean0.007182905345297973
get_state_dump_median0.007722091151547919
get_state_dump_min0.005000736154437636
get_ui_image_max0.0389332679601816
get_ui_image_mean0.03306823494736914
get_ui_image_median0.03348870049975736
get_ui_image_min0.02636227082978025
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0723672446846053, "get_ui_image": 0.03189388280961572, "step_physics": 0.12490720138317202, "survival_time": 8.14999999999998, "driven_lanedir": 2.059813816657207, "get_state_dump": 0.008286702923658417, "get_robot_state": 0.0035368727474677855, "sim_render-ego0": 0.0035586080900052697, "get_duckie_state": 0.023910705636187295, "in-drivable-lane": 0.0, "deviation-heading": 0.831495983756991, "agent_compute-ego0": 0.01527018517982669, "complete-iteration": 0.22313570540125777, "set_robot_commands": 0.0020500319760020187, "deviation-center-line": 0.17508992596056838, "driven_lanedir_consec": 2.059813816657207, "sim_compute_sim_state": 0.007817031406774753, "sim_compute_performance-ego0": 0.001826949235869617}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5499883386946551, "get_ui_image": 0.0389332679601816, "step_physics": 0.19606316395294973, "survival_time": 3.8499999999999943, "driven_lanedir": 0.53609146100273, "get_state_dump": 0.007884450447865022, "get_robot_state": 0.0036558340757321087, "sim_render-ego0": 0.003952870002159705, "get_duckie_state": 0.020444555160326835, "in-drivable-lane": 0.0, "deviation-heading": 0.7952078912608513, "agent_compute-ego0": 0.017197563098027155, "complete-iteration": 0.3024666676154503, "set_robot_commands": 0.002383858729631473, "deviation-center-line": 0.13789124582714526, "driven_lanedir_consec": 0.53609146100273, "sim_compute_sim_state": 0.00981124547811655, "sim_compute_performance-ego0": 0.0020512036788157928}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.3380907629162269, "get_ui_image": 0.03508351818989899, "step_physics": 0.15804831052230575, "survival_time": 5.849999999999987, "driven_lanedir": 1.3291451961563767, "get_state_dump": 0.007559731855230816, "get_robot_state": 0.0034774986364073672, "sim_render-ego0": 0.003562298871703067, "get_duckie_state": 0.019634307441064865, "in-drivable-lane": 0.0, "deviation-heading": 0.7512127614259841, "agent_compute-ego0": 0.01651517415450791, "complete-iteration": 0.2606496447223728, "set_robot_commands": 0.0020242383924581235, "deviation-center-line": 0.16088400673617506, "driven_lanedir_consec": 1.3291451961563767, "sim_compute_sim_state": 0.012866292969655182, "sim_compute_performance-ego0": 0.001801927210920948}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.3433822339902157, "get_ui_image": 0.02636227082978025, "step_physics": 0.1163907233607826, "survival_time": 10.400000000000013, "driven_lanedir": 2.318312084986776, "get_state_dump": 0.005000736154437636, "get_robot_state": 0.0035211150155683452, "sim_render-ego0": 0.0035354007374156604, "get_duckie_state": 0.0040800742555463145, "in-drivable-lane": 0.0, "deviation-heading": 1.3879189041805828, "agent_compute-ego0": 0.015951690491306725, "complete-iteration": 0.18455358441366537, "set_robot_commands": 0.0020467824342718533, "deviation-center-line": 0.20849286764396976, "driven_lanedir_consec": 2.318312084986776, "sim_compute_sim_state": 0.005738551536815588, "sim_compute_performance-ego0": 0.0018498760661440031}}
set_robot_commands_max0.002383858729631473
set_robot_commands_mean0.002126227883090867
set_robot_commands_median0.002048407205136936
set_robot_commands_min0.0020242383924581235
sim_compute_performance-ego0_max0.0020512036788157928
sim_compute_performance-ego0_mean0.0018824890479375903
sim_compute_performance-ego0_median0.0018384126510068103
sim_compute_performance-ego0_min0.001801927210920948
sim_compute_sim_state_max0.012866292969655182
sim_compute_sim_state_mean0.00905828034784052
sim_compute_sim_state_median0.008814138442445652
sim_compute_sim_state_min0.005738551536815588
sim_render-ego0_max0.003952870002159705
sim_render-ego0_mean0.003652294425320926
sim_render-ego0_median0.0035604534808541684
sim_render-ego0_min0.0035354007374156604
simulation-passed1
step_physics_max0.19606316395294973
step_physics_mean0.14885234980480253
step_physics_median0.14147775595273887
step_physics_min0.1163907233607826
survival_time_max10.400000000000013
survival_time_mean7.062499999999994
survival_time_min3.8499999999999943
No reset possible
6195013452Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:36:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.686251620868374
survival_time_median59.99999999999873
deviation-center-line_median2.23597368319421
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.016966237712164507
agent_compute-ego0_mean0.01577887383229925
agent_compute-ego0_median0.015657887073678836
agent_compute-ego0_min0.014833483469674828
complete-iteration_max0.2300546330079548
complete-iteration_mean0.19730844207846257
complete-iteration_median0.1933972377959735
complete-iteration_min0.1723846597139484
deviation-center-line_max2.322374588799706
deviation-center-line_mean2.1658672765440556
deviation-center-line_min1.8691471509880964
deviation-heading_max9.172101530712144
deviation-heading_mean8.515036688778249
deviation-heading_median8.618555275212824
deviation-heading_min7.650934673975205
driven_any_max17.401029045876335
driven_any_mean16.26773283084595
driven_any_median15.988047641683917
driven_any_min15.69380699413964
driven_lanedir_consec_max16.597477667465736
driven_lanedir_consec_mean15.869683743281696
driven_lanedir_consec_min15.5087540639243
driven_lanedir_max16.597477667465736
driven_lanedir_mean15.869683743281696
driven_lanedir_median15.686251620868374
driven_lanedir_min15.5087540639243
get_duckie_state_max1.3564647385520203e-06
get_duckie_state_mean1.2581989628190702e-06
get_duckie_state_median1.2509531025882566e-06
get_duckie_state_min1.1744249075477467e-06
get_robot_state_max0.0036011593824223018
get_robot_state_mean0.0035592440165250526
get_robot_state_median0.003572012264464519
get_robot_state_min0.0034917921547488705
get_state_dump_max0.00471451796659522
get_state_dump_mean0.00451849154091993
get_state_dump_median0.004483986853759156
get_state_dump_min0.00439147448956619
get_ui_image_max0.03592608493134739
get_ui_image_mean0.03064735634539348
get_ui_image_median0.030300079734001825
get_ui_image_min0.026063180982222864
in-drivable-lane_max2.700000000000003
in-drivable-lane_mean0.6750000000000007
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 17.401029045876335, "get_ui_image": 0.028331893965366183, "step_physics": 0.10340088670398671, "survival_time": 59.99999999999873, "driven_lanedir": 16.597477667465736, "get_state_dump": 0.004431257438500855, "get_robot_state": 0.0035947310140388993, "sim_render-ego0": 0.003680657983124008, "get_duckie_state": 1.206783132688092e-06, "in-drivable-lane": 2.700000000000003, "deviation-heading": 8.160249141807537, "agent_compute-ego0": 0.015611319418850788, "complete-iteration": 0.1723846597139484, "set_robot_commands": 0.002155981889672323, "deviation-center-line": 2.322374588799706, "driven_lanedir_consec": 16.597477667465736, "sim_compute_sim_state": 0.009190616162988566, "sim_compute_performance-ego0": 0.0019010834451718295}, "LF-norm-zigzag-000-ego0": {"driven_any": 16.106815363798717, "get_ui_image": 0.03592608493134739, "step_physics": 0.14794765185753966, "survival_time": 59.99999999999873, "driven_lanedir": 15.818700792781272, "get_state_dump": 0.004536716269017457, "get_robot_state": 0.0035492935148901386, "sim_render-ego0": 0.0037027878328525056, "get_duckie_state": 1.2951230724884212e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.07686140861811, "agent_compute-ego0": 0.016966237712164507, "complete-iteration": 0.2300546330079548, "set_robot_commands": 0.002119258281888811, "deviation-center-line": 2.2093602961877323, "driven_lanedir_consec": 15.818700792781272, "sim_compute_sim_state": 0.013316460394243912, "sim_compute_performance-ego0": 0.0019042247737277851}, "LF-norm-techtrack-000-ego0": {"driven_any": 15.869279919569118, "get_ui_image": 0.03226826550263747, "step_physics": 0.1328358666088857, "survival_time": 59.99999999999873, "driven_lanedir": 15.553802448955476, "get_state_dump": 0.00439147448956619, "get_robot_state": 0.0034917921547488705, "sim_render-ego0": 0.0036471054814042497, "get_duckie_state": 1.1744249075477467e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.172101530712144, "agent_compute-ego0": 0.014833483469674828, "complete-iteration": 0.20806385654890963, "set_robot_commands": 0.002081496828700184, "deviation-center-line": 2.262587070200688, "driven_lanedir_consec": 15.553802448955476, "sim_compute_sim_state": 0.012551018836397016, "sim_compute_performance-ego0": 0.0018839713040239904}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.69380699413964, "get_ui_image": 0.026063180982222864, "step_physics": 0.1144119700623194, "survival_time": 59.99999999999873, "driven_lanedir": 15.5087540639243, "get_state_dump": 0.00471451796659522, "get_robot_state": 0.0036011593824223018, "sim_render-ego0": 0.003752456914376061, "get_duckie_state": 1.3564647385520203e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.650934673975205, "agent_compute-ego0": 0.015704454728506883, "complete-iteration": 0.17873061904303736, "set_robot_commands": 0.002273492868695033, "deviation-center-line": 1.8691471509880964, "driven_lanedir_consec": 15.5087540639243, "sim_compute_sim_state": 0.006166549447573393, "sim_compute_performance-ego0": 0.00195407807876625}}
set_robot_commands_max0.002273492868695033
set_robot_commands_mean0.0021575574672390877
set_robot_commands_median0.0021376200857805673
set_robot_commands_min0.002081496828700184
sim_compute_performance-ego0_max0.00195407807876625
sim_compute_performance-ego0_mean0.0019108394004224635
sim_compute_performance-ego0_median0.0019026541094498072
sim_compute_performance-ego0_min0.0018839713040239904
sim_compute_sim_state_max0.013316460394243912
sim_compute_sim_state_mean0.010306161210300722
sim_compute_sim_state_median0.010870817499692792
sim_compute_sim_state_min0.006166549447573393
sim_render-ego0_max0.003752456914376061
sim_render-ego0_mean0.003695752052939206
sim_render-ego0_median0.0036917229079882568
sim_render-ego0_min0.0036471054814042497
simulation-passed1
step_physics_max0.14794765185753966
step_physics_mean0.12464909380818288
step_physics_median0.12362391833560256
step_physics_min0.10340088670398671
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6194913450Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simabortedyesgpu-prod-010:02:13
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6194813449Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.34029460989644
survival_time_median59.99999999999873
deviation-center-line_median2.537694916219664
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego0_max0.011923367931483488
agent_compute-ego0_mean0.011639855620275108
agent_compute-ego0_median0.011651408733094115
agent_compute-ego0_min0.011333237083428706
complete-iteration_max0.20253081514891275
complete-iteration_mean0.17785093064366317
complete-iteration_median0.17805681498620435
complete-iteration_min0.15275927745333123
deviation-center-line_max3.3997831722270835
deviation-center-line_mean2.352508069785389
deviation-center-line_min0.9348592744751446
deviation-heading_max9.923472217679338
deviation-heading_mean7.59907455590904
deviation-heading_median7.768583149689856
deviation-heading_min4.9356597065771135
driven_any_max11.673088276282506
driven_any_mean9.846150241893978
driven_any_median11.668273748707378
driven_any_min4.374965193878651
driven_lanedir_consec_max11.565304553149058
driven_lanedir_consec_mean9.498132926134211
driven_lanedir_consec_min3.7466379315949103
driven_lanedir_max11.565304553149058
driven_lanedir_mean9.498132926134211
driven_lanedir_median11.34029460989644
driven_lanedir_min3.7466379315949103
get_duckie_state_max1.8390588815960657e-06
get_duckie_state_mean1.7549482156200336e-06
get_duckie_state_median1.7543138298373464e-06
get_duckie_state_min1.6721063212093764e-06
get_robot_state_max0.003591588097349194
get_robot_state_mean0.003580011203264317
get_robot_state_median0.003580543222673529
get_robot_state_min0.003567370270361016
get_state_dump_max0.004632122609934937
get_state_dump_mean0.004532969788699475
get_state_dump_median0.004567555695652966
get_state_dump_min0.004364645153557034
get_ui_image_max0.03567312673719199
get_ui_image_mean0.03039408388869053
get_ui_image_median0.030076948927403688
get_ui_image_min0.025749310962762763
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean0.9625000000000136
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.66355713664712, "get_ui_image": 0.027800962192430584, "step_physics": 0.0887869631221749, "survival_time": 59.99999999999873, "driven_lanedir": 11.565304553149058, "get_state_dump": 0.004364645153557034, "get_robot_state": 0.0035761508417566255, "sim_render-ego0": 0.003606663258446941, "get_duckie_state": 1.6721063212093764e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.897894354022344, "agent_compute-ego0": 0.011333237083428706, "complete-iteration": 0.15275927745333123, "set_robot_commands": 0.002126226814263667, "deviation-center-line": 2.367243789345501, "driven_lanedir_consec": 11.565304553149058, "sim_compute_sim_state": 0.0092204242423611, "sim_compute_performance-ego0": 0.001869180617384073}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.374965193878651, "get_ui_image": 0.03567312673719199, "step_physics": 0.12815495696403326, "survival_time": 23.4000000000002, "driven_lanedir": 3.7466379315949103, "get_state_dump": 0.00456262499030465, "get_robot_state": 0.003567370270361016, "sim_render-ego0": 0.003699075438574687, "get_duckie_state": 1.733491161484708e-06, "in-drivable-lane": 2.8500000000000405, "deviation-heading": 4.9356597065771135, "agent_compute-ego0": 0.011886882883653456, "complete-iteration": 0.20253081514891275, "set_robot_commands": 0.0021960343887556847, "deviation-center-line": 0.9348592744751446, "driven_lanedir_consec": 3.7466379315949103, "sim_compute_sim_state": 0.01080423326634649, "sim_compute_performance-ego0": 0.001908839638553449}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.673088276282506, "get_ui_image": 0.03235293566237679, "step_physics": 0.12260621810932144, "survival_time": 59.99999999999873, "driven_lanedir": 11.23277449450641, "get_state_dump": 0.004632122609934937, "get_robot_state": 0.0035849356035904324, "sim_render-ego0": 0.003709622961992427, "get_duckie_state": 1.8390588815960657e-06, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 9.923472217679338, "agent_compute-ego0": 0.011923367931483488, "complete-iteration": 0.19560134361228976, "set_robot_commands": 0.0021821680315130456, "deviation-center-line": 2.7081460430938264, "driven_lanedir_consec": 11.23277449450641, "sim_compute_sim_state": 0.01259961136175532, "sim_compute_performance-ego0": 0.0019310745569589632}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672990360767637, "get_ui_image": 0.025749310962762763, "step_physics": 0.10120698256258363, "survival_time": 59.99999999999873, "driven_lanedir": 11.447814725286472, "get_state_dump": 0.004572486401001281, "get_robot_state": 0.003591588097349194, "sim_render-ego0": 0.003638915674176244, "get_duckie_state": 1.7751364981899848e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.639271945357368, "agent_compute-ego0": 0.011415934582534776, "complete-iteration": 0.1605122863601189, "set_robot_commands": 0.0022321660552394084, "deviation-center-line": 3.3997831722270835, "driven_lanedir_consec": 11.447814725286472, "sim_compute_sim_state": 0.006124768427865491, "sim_compute_performance-ego0": 0.001902897689463594}}
set_robot_commands_max0.0022321660552394084
set_robot_commands_mean0.0021841488224429513
set_robot_commands_median0.002189101210134366
set_robot_commands_min0.002126226814263667
sim_compute_performance-ego0_max0.0019310745569589632
sim_compute_performance-ego0_mean0.0019029981255900196
sim_compute_performance-ego0_median0.0019058686640085216
sim_compute_performance-ego0_min0.001869180617384073
sim_compute_sim_state_max0.01259961136175532
sim_compute_sim_state_mean0.0096872593245821
sim_compute_sim_state_median0.010012328754353796
sim_compute_sim_state_min0.006124768427865491
sim_render-ego0_max0.003709622961992427
sim_render-ego0_mean0.003663569333297574
sim_render-ego0_median0.0036689955563754656
sim_render-ego0_min0.003606663258446941
simulation-passed1
step_physics_max0.12815495696403326
step_physics_mean0.1101887801895283
step_physics_median0.11190660033595254
step_physics_min0.0887869631221749
survival_time_max59.99999999999873
survival_time_mean50.8499999999991
survival_time_min23.4000000000002
No reset possible
6194513446Fernanda Custodio Pereira do Carmo 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4549057673552314
survival_time_median24.724999999999945
deviation-center-line_median0.4243365335053274
in-drivable-lane_median19.02499999999995


other stats
agent_compute-ego0_max0.012874677777290344
agent_compute-ego0_mean0.01248968527313904
agent_compute-ego0_median0.012427826730266302
agent_compute-ego0_min0.012228409854733214
complete-iteration_max0.30575483043988544
complete-iteration_mean0.23109397698384643
complete-iteration_median0.21424948349621992
complete-iteration_min0.1901221105030605
deviation-center-line_max1.0059844117784245
deviation-center-line_mean0.47933893333184624
deviation-center-line_min0.06269825453830574
deviation-heading_max13.791638177456166
deviation-heading_mean6.249773278176546
deviation-heading_median5.171142791937621
deviation-heading_min0.8651693513747781
driven_any_max12.07928299066842
driven_any_mean5.4859253125264
driven_any_median4.799481162803363
driven_any_min0.2654559338304552
driven_lanedir_consec_max0.633530553064575
driven_lanedir_consec_mean0.41085590814331174
driven_lanedir_consec_min0.10008154479820908
driven_lanedir_max0.6979106914541351
driven_lanedir_mean0.4668650868499202
driven_lanedir_median0.5347340555736683
driven_lanedir_min0.10008154479820908
get_duckie_state_max1.6993405867596065e-06
get_duckie_state_mean1.6489963970335082e-06
get_duckie_state_median1.6684950648758525e-06
get_duckie_state_min1.5596548716227214e-06
get_robot_state_max0.003689004221526312
get_robot_state_mean0.003604669233824834
get_robot_state_median0.003579108640044725
get_robot_state_min0.0035714554336835755
get_state_dump_max0.004608194438778624
get_state_dump_mean0.00457782237262241
get_state_dump_median0.004573147561681873
get_state_dump_min0.00455679992834727
get_ui_image_max0.03605152666568756
get_ui_image_mean0.030736455087080103
get_ui_image_median0.030446410410116757
get_ui_image_min0.02600147286239935
in-drivable-lane_max48.39999999999897
in-drivable-lane_mean21.912499999999717
in-drivable-lane_min1.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.07928299066842, "get_ui_image": 0.028025464154004455, "step_physics": 0.13298078143130135, "survival_time": 59.99999999999873, "driven_lanedir": 0.6954807789181505, "get_state_dump": 0.004580298629430411, "get_robot_state": 0.003689004221526312, "sim_render-ego0": 0.003750133673217672, "get_duckie_state": 1.6647612026192366e-06, "in-drivable-lane": 48.39999999999897, "deviation-heading": 13.791638177456166, "agent_compute-ego0": 0.012471652646346651, "complete-iteration": 0.1991684992644908, "set_robot_commands": 0.0022357206956035987, "deviation-center-line": 1.0059844117784245, "driven_lanedir_consec": 0.5786979457713597, "sim_compute_sim_state": 0.009403078879643045, "sim_compute_performance-ego0": 0.0019540741084318773}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2654559338304552, "get_ui_image": 0.03605152666568756, "step_physics": 0.2318266530831655, "survival_time": 2.3499999999999996, "driven_lanedir": 0.10008154479820908, "get_state_dump": 0.00455679992834727, "get_robot_state": 0.003576750556627909, "sim_render-ego0": 0.0037918488184611, "get_duckie_state": 1.5596548716227214e-06, "in-drivable-lane": 1.1999999999999993, "deviation-heading": 0.8651693513747781, "agent_compute-ego0": 0.012874677777290344, "complete-iteration": 0.30575483043988544, "set_robot_commands": 0.00222635269165039, "deviation-center-line": 0.06269825453830574, "driven_lanedir_consec": 0.10008154479820908, "sim_compute_sim_state": 0.008866270383199057, "sim_compute_performance-ego0": 0.001908948024113973}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.834016909709796, "get_ui_image": 0.03286735666622906, "step_physics": 0.15897265350293813, "survival_time": 39.69999999999988, "driven_lanedir": 0.6979106914541351, "get_state_dump": 0.004565996493933336, "get_robot_state": 0.0035714554336835755, "sim_render-ego0": 0.003728347754328506, "get_duckie_state": 1.6722289271324686e-06, "in-drivable-lane": 32.04999999999989, "deviation-heading": 7.332861570417455, "agent_compute-ego0": 0.012384000814185952, "complete-iteration": 0.22933046772794904, "set_robot_commands": 0.0021387136207436618, "deviation-center-line": 0.6149907390754777, "driven_lanedir_consec": 0.633530553064575, "sim_compute_sim_state": 0.009108221006093537, "sim_compute_performance-ego0": 0.0019201959454038609}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7649454158969295, "get_ui_image": 0.02600147286239935, "step_physics": 0.13009654989047925, "survival_time": 9.750000000000004, "driven_lanedir": 0.373987332229186, "get_state_dump": 0.004608194438778624, "get_robot_state": 0.0035814667234615404, "sim_render-ego0": 0.0036705294433905153, "get_duckie_state": 1.6993405867596065e-06, "in-drivable-lane": 6.000000000000009, "deviation-heading": 3.0094240134577865, "agent_compute-ego0": 0.012228409854733214, "complete-iteration": 0.1901221105030605, "set_robot_commands": 0.0021260100968030033, "deviation-center-line": 0.233682327935177, "driven_lanedir_consec": 0.33111358893910325, "sim_compute_sim_state": 0.005847752094268799, "sim_compute_performance-ego0": 0.0018875404280059192}}
set_robot_commands_max0.0022357206956035987
set_robot_commands_mean0.002181699276200164
set_robot_commands_median0.002182533156197026
set_robot_commands_min0.0021260100968030033
sim_compute_performance-ego0_max0.0019540741084318773
sim_compute_performance-ego0_mean0.0019176896264889072
sim_compute_performance-ego0_median0.0019145719847589169
sim_compute_performance-ego0_min0.0018875404280059192
sim_compute_sim_state_max0.009403078879643045
sim_compute_sim_state_mean0.008306330590801108
sim_compute_sim_state_median0.008987245694646297
sim_compute_sim_state_min0.005847752094268799
sim_render-ego0_max0.0037918488184611
sim_render-ego0_mean0.003735214922349448
sim_render-ego0_median0.003739240713773089
sim_render-ego0_min0.0036705294433905153
simulation-passed1
step_physics_max0.2318266530831655
step_physics_mean0.16346915947697105
step_physics_median0.14597671746711974
step_physics_min0.13009654989047925
survival_time_max59.99999999999873
survival_time_mean27.94999999999965
survival_time_min2.3499999999999996
No reset possible
6194313445Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.269992004605369
survival_time_median59.99999999999873
deviation-center-line_median2.8781666944545146
in-drivable-lane_median0.8999999999999488


other stats
agent_compute-ego0_max0.0121902567275027
agent_compute-ego0_mean0.011902688082925236
agent_compute-ego0_median0.01190244605598799
agent_compute-ego0_min0.011615603492222262
complete-iteration_max0.20816538080256036
complete-iteration_mean0.18122837461715555
complete-iteration_median0.17794047336991284
complete-iteration_min0.1608671709262362
deviation-center-line_max3.373967980113233
deviation-center-line_mean2.5450441172688385
deviation-center-line_min1.0498751000530917
deviation-heading_max9.817276753365018
deviation-heading_mean7.598176340622848
deviation-heading_median7.975872315486436
deviation-heading_min4.623683978153499
driven_any_max11.673078763774315
driven_any_mean9.848587349595928
driven_any_median11.668267555171626
driven_any_min4.384735524266142
driven_lanedir_consec_max11.542462137836855
driven_lanedir_consec_mean9.466714159849856
driven_lanedir_consec_min3.784410492351841
driven_lanedir_max11.542462137836855
driven_lanedir_mean9.467287149455808
driven_lanedir_median11.269992004605369
driven_lanedir_min3.786702450775638
get_duckie_state_max1.793400036306008e-06
get_duckie_state_mean1.6981955362062769e-06
get_duckie_state_median1.682726965657281e-06
get_duckie_state_min1.633928177204538e-06
get_robot_state_max0.003677122400364808
get_robot_state_mean0.0035878116177197297
get_robot_state_median0.003583085030739155
get_robot_state_min0.0035079540090358005
get_state_dump_max0.004642953682104614
get_state_dump_mean0.004521623203084409
get_state_dump_median0.004535829219657275
get_state_dump_min0.004371880690918477
get_ui_image_max0.035607552528381346
get_ui_image_mean0.030682977684133757
get_ui_image_median0.030526249236012375
get_ui_image_min0.02607185973612891
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean1.1749999999999847
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.66354792001036, "get_ui_image": 0.028267828054372515, "step_physics": 0.09503724970090996, "survival_time": 59.99999999999873, "driven_lanedir": 11.542462137836855, "get_state_dump": 0.004642953682104614, "get_robot_state": 0.003610778708541324, "sim_render-ego0": 0.0037413552639188616, "get_duckie_state": 1.65523240012392e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.733419471938121, "agent_compute-ego0": 0.011837674219542797, "complete-iteration": 0.1608671709262362, "set_robot_commands": 0.002144940191264157, "deviation-center-line": 2.787331543898525, "driven_lanedir_consec": 11.542462137836855, "sim_compute_sim_state": 0.00955553158038264, "sim_compute_performance-ego0": 0.0019526584857111667}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.384735524266142, "get_ui_image": 0.035607552528381346, "step_physics": 0.13378248062539608, "survival_time": 23.4500000000002, "driven_lanedir": 3.786702450775638, "get_state_dump": 0.00449966217609162, "get_robot_state": 0.0035079540090358005, "sim_render-ego0": 0.00362505963508119, "get_duckie_state": 1.633928177204538e-06, "in-drivable-lane": 2.900000000000041, "deviation-heading": 4.623683978153499, "agent_compute-ego0": 0.0121902567275027, "complete-iteration": 0.20816538080256036, "set_robot_commands": 0.002059015314629737, "deviation-center-line": 1.0498751000530917, "driven_lanedir_consec": 3.784410492351841, "sim_compute_sim_state": 0.01095894955574198, "sim_compute_performance-ego0": 0.001858781246428794}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.673078763774315, "get_ui_image": 0.03278467041765224, "step_physics": 0.12097566510914366, "survival_time": 59.99999999999873, "driven_lanedir": 11.09280186356945, "get_state_dump": 0.004371880690918477, "get_robot_state": 0.0035553913529369854, "sim_render-ego0": 0.003628523720988227, "get_duckie_state": 1.710221531190642e-06, "in-drivable-lane": 1.7999999999998977, "deviation-heading": 9.218325159034752, "agent_compute-ego0": 0.011615603492222262, "complete-iteration": 0.19378804167938868, "set_robot_commands": 0.002109965515771972, "deviation-center-line": 2.969001845010504, "driven_lanedir_consec": 11.09280186356945, "sim_compute_sim_state": 0.012770141590445564, "sim_compute_performance-ego0": 0.0019030348645161829}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672987190332892, "get_ui_image": 0.02607185973612891, "step_physics": 0.10156251528578732, "survival_time": 59.99999999999873, "driven_lanedir": 11.447182145641282, "get_state_dump": 0.004571996263222929, "get_robot_state": 0.003677122400364808, "sim_render-ego0": 0.003697584511139907, "get_duckie_state": 1.793400036306008e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.817276753365018, "agent_compute-ego0": 0.011967217892433183, "complete-iteration": 0.162092905060437, "set_robot_commands": 0.002250041890203903, "deviation-center-line": 3.373967980113233, "driven_lanedir_consec": 11.447182145641282, "sim_compute_sim_state": 0.006273950764182009, "sim_compute_performance-ego0": 0.001943474903789587}}
set_robot_commands_max0.002250041890203903
set_robot_commands_mean0.002140990727967442
set_robot_commands_median0.0021274528535180645
set_robot_commands_min0.002059015314629737
sim_compute_performance-ego0_max0.0019526584857111667
sim_compute_performance-ego0_mean0.0019144873751114329
sim_compute_performance-ego0_median0.001923254884152885
sim_compute_performance-ego0_min0.001858781246428794
sim_compute_sim_state_max0.012770141590445564
sim_compute_sim_state_mean0.009889643372688047
sim_compute_sim_state_median0.01025724056806231
sim_compute_sim_state_min0.006273950764182009
sim_render-ego0_max0.0037413552639188616
sim_render-ego0_mean0.003673130782782046
sim_render-ego0_median0.003663054116064067
sim_render-ego0_min0.00362505963508119
simulation-passed1
step_physics_max0.13378248062539608
step_physics_mean0.11283947768030923
step_physics_median0.1112690901974655
step_physics_min0.09503724970090996
survival_time_max59.99999999999873
survival_time_mean50.862499999999095
survival_time_min23.4500000000002
No reset possible
6194113442Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median24.727743614853537
survival_time_median59.99999999999873
deviation-center-line_median2.6399790990115655
in-drivable-lane_median0.07500000000000107


other stats
agent_compute-ego0_max0.01627656839769349
agent_compute-ego0_mean0.01576728159740108
agent_compute-ego0_median0.015664018659567853
agent_compute-ego0_min0.015464520672775128
complete-iteration_max0.2713290569089434
complete-iteration_mean0.23256742909587888
complete-iteration_median0.2353802525332131
complete-iteration_min0.188180154408146
deviation-center-line_max3.477378560910265
deviation-center-line_mean2.782337235283757
deviation-center-line_min2.372012182201632
deviation-heading_max12.217037123679749
deviation-heading_mean11.148369346729206
deviation-heading_median10.986552842120652
deviation-heading_min10.403334578995771
driven_any_max25.842622181647315
driven_any_mean25.470198552749252
driven_any_median25.382090990891022
driven_any_min25.273990047567644
driven_lanedir_consec_max25.229691227876593
driven_lanedir_consec_mean24.750197921859943
driven_lanedir_consec_min24.315613229856098
driven_lanedir_max25.229691227876593
driven_lanedir_mean24.750197921859943
driven_lanedir_median24.727743614853537
driven_lanedir_min24.315613229856098
get_duckie_state_max2.1275036737980393e-06
get_duckie_state_mean1.969484365750709e-06
get_duckie_state_median1.9851671865242505e-06
get_duckie_state_min1.7800994161562957e-06
get_robot_state_max0.003690895291788195
get_robot_state_mean0.0035946450562997223
get_robot_state_median0.0035858547359977934
get_robot_state_min0.003515975461415109
get_state_dump_max0.004606816492708002
get_state_dump_mean0.0044830906500328
get_state_dump_median0.004470761372187453
get_state_dump_min0.00438402336304829
get_ui_image_max0.03566729337547741
get_ui_image_mean0.0304988669813126
get_ui_image_median0.03034071749592701
get_ui_image_min0.02564673955791896
in-drivable-lane_max0.350000000000005
in-drivable-lane_mean0.12500000000000178
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 25.30596879878782, "get_ui_image": 0.028089612250919643, "step_physics": 0.1448967625556838, "survival_time": 59.99999999999873, "driven_lanedir": 24.731532422511066, "get_state_dump": 0.004507067598569998, "get_robot_state": 0.003634542152347613, "sim_render-ego0": 0.003732711051921861, "get_duckie_state": 1.7800994161562957e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.833374433780383, "agent_compute-ego0": 0.015464520672775128, "complete-iteration": 0.2140998772836347, "set_robot_commands": 0.0022969099008272728, "deviation-center-line": 2.38959128378638, "driven_lanedir_consec": 24.731532422511066, "sim_compute_sim_state": 0.009424323940356506, "sim_compute_performance-ego0": 0.0019704618620733534}, "LF-norm-zigzag-000-ego0": {"driven_any": 25.45821318299422, "get_ui_image": 0.03566729337547741, "step_physics": 0.1909863432678553, "survival_time": 59.99999999999873, "driven_lanedir": 24.723954807196016, "get_state_dump": 0.00438402336304829, "get_robot_state": 0.003515975461415109, "sim_render-ego0": 0.0036271879019884145, "get_duckie_state": 2.088197363504859e-06, "in-drivable-lane": 0.15000000000000213, "deviation-heading": 11.139731250460915, "agent_compute-ego0": 0.01552171373645233, "complete-iteration": 0.2713290569089434, "set_robot_commands": 0.0021684193591293348, "deviation-center-line": 2.890366914236751, "driven_lanedir_consec": 24.723954807196016, "sim_compute_sim_state": 0.013500139973344255, "sim_compute_performance-ego0": 0.001880601681241584}, "LF-norm-techtrack-000-ego0": {"driven_any": 25.273990047567644, "get_ui_image": 0.032591822740934376, "step_physics": 0.17937099288444933, "survival_time": 59.99999999999873, "driven_lanedir": 24.315613229856098, "get_state_dump": 0.004606816492708002, "get_robot_state": 0.003690895291788195, "sim_render-ego0": 0.003768017448850913, "get_duckie_state": 1.882137009543642e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 12.217037123679749, "agent_compute-ego0": 0.015806323582683374, "complete-iteration": 0.2566606277827915, "set_robot_commands": 0.0022699628444039555, "deviation-center-line": 3.477378560910265, "driven_lanedir_consec": 24.315613229856098, "sim_compute_sim_state": 0.012486448295904536, "sim_compute_performance-ego0": 0.0019871479863429646}, "LF-norm-small_loop-000-ego0": {"driven_any": 25.842622181647315, "get_ui_image": 0.02564673955791896, "step_physics": 0.1245963843438548, "survival_time": 59.99999999999873, "driven_lanedir": 25.229691227876593, "get_state_dump": 0.0044344551458049076, "get_robot_state": 0.003537167319647974, "sim_render-ego0": 0.003586032408460987, "get_duckie_state": 2.1275036737980393e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.403334578995771, "agent_compute-ego0": 0.01627656839769349, "complete-iteration": 0.188180154408146, "set_robot_commands": 0.0021285758625954813, "deviation-center-line": 2.372012182201632, "driven_lanedir_consec": 25.229691227876593, "sim_compute_sim_state": 0.0060148237150575, "sim_compute_performance-ego0": 0.001880498452547885}}
set_robot_commands_max0.0022969099008272728
set_robot_commands_mean0.002215966991739011
set_robot_commands_median0.002219191101766645
set_robot_commands_min0.0021285758625954813
sim_compute_performance-ego0_max0.0019871479863429646
sim_compute_performance-ego0_mean0.0019296774955514468
sim_compute_performance-ego0_median0.001925531771657469
sim_compute_performance-ego0_min0.001880498452547885
sim_compute_sim_state_max0.013500139973344255
sim_compute_sim_state_mean0.0103564339811657
sim_compute_sim_state_median0.01095538611813052
sim_compute_sim_state_min0.0060148237150575
sim_render-ego0_max0.003768017448850913
sim_render-ego0_mean0.003678487202805544
sim_render-ego0_median0.0036799494769551378
sim_render-ego0_min0.003586032408460987
simulation-passed1
step_physics_max0.1909863432678553
step_physics_mean0.1599626207629608
step_physics_median0.16213387772006654
step_physics_min0.1245963843438548
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6194013441Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:05:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.199999999999986
in-drivable-lane_median0.274999999999999
driven_lanedir_consec_median1.7827735284707884
deviation-center-line_median0.17362179347557005


other stats
agent_compute-ego0_max0.017670680065544283
agent_compute-ego0_mean0.016430511604243483
agent_compute-ego0_median0.016315440251089903
agent_compute-ego0_min0.015420485849249852
complete-iteration_max0.35188164029802593
complete-iteration_mean0.2817995281638069
complete-iteration_median0.2855108945875627
complete-iteration_min0.20429468318207625
deviation-center-line_max0.4637150439603034
deviation-center-line_mean0.23429311497942729
deviation-center-line_min0.12621382900626568
deviation-heading_max1.4676749900326884
deviation-heading_mean0.9698353718753308
deviation-heading_median1.0146651263313555
deviation-heading_min0.3823362448059238
driven_any_max2.606336016667396
driven_any_mean1.863642745124856
driven_any_median2.1585518422647647
driven_any_min0.5311312793024986
driven_lanedir_consec_max2.2762867401696623
driven_lanedir_consec_mean1.591905771257247
driven_lanedir_consec_min0.5257892879177497
driven_lanedir_max2.2762867401696623
driven_lanedir_mean1.591905771257247
driven_lanedir_median1.7827735284707884
driven_lanedir_min0.5257892879177497
get_duckie_state_max0.02465584813332071
get_duckie_state_mean0.01750441210782286
get_duckie_state_median0.020605683607433804
get_duckie_state_min0.004150433083103128
get_robot_state_max0.003734968146499322
get_robot_state_mean0.003635171734652567
get_robot_state_median0.0036164273584406766
get_robot_state_min0.0035728640752295923
get_state_dump_max0.008579166568055446
get_state_dump_mean0.007471491845118708
get_state_dump_median0.008028339998126965
get_state_dump_min0.005250120816165453
get_ui_image_max0.04014471112465372
get_ui_image_mean0.033756100988967946
get_ui_image_median0.03408099133141187
get_ui_image_min0.026717710168394325
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.7124999999999975
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.5671180075408913, "get_ui_image": 0.032523948319104254, "step_physics": 0.17196788593214385, "survival_time": 7.299999999999982, "driven_lanedir": 1.837139611654389, "get_state_dump": 0.008579166568055446, "get_robot_state": 0.0036375117139751407, "sim_render-ego0": 0.003764086029156535, "get_duckie_state": 0.02465584813332071, "in-drivable-lane": 2.299999999999992, "deviation-heading": 1.2174811088192394, "agent_compute-ego0": 0.016673628164797415, "complete-iteration": 0.2738761772103861, "set_robot_commands": 0.002281143551781064, "deviation-center-line": 0.2013971852467682, "driven_lanedir_consec": 1.837139611654389, "sim_compute_sim_state": 0.007716191869203737, "sim_compute_performance-ego0": 0.0019845492174836244}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5311312793024986, "get_ui_image": 0.04014471112465372, "step_physics": 0.24392737661089217, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5257892879177497, "get_state_dump": 0.008137269895903918, "get_robot_state": 0.003734968146499322, "sim_render-ego0": 0.0038607169170768894, "get_duckie_state": 0.02088500042350925, "in-drivable-lane": 0.0, "deviation-heading": 0.3823362448059238, "agent_compute-ego0": 0.017670680065544283, "complete-iteration": 0.35188164029802593, "set_robot_commands": 0.0023831980569022043, "deviation-center-line": 0.12621382900626568, "driven_lanedir_consec": 0.5257892879177497, "sim_compute_sim_state": 0.008984006181055186, "sim_compute_performance-ego0": 0.002056598663330078}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.7499856769886386, "get_ui_image": 0.03563803434371948, "step_physics": 0.1928330659866333, "survival_time": 5.14999999999999, "driven_lanedir": 1.7284074452871878, "get_state_dump": 0.007919410100350013, "get_robot_state": 0.003595343002906213, "sim_render-ego0": 0.0038236585947183464, "get_duckie_state": 0.02032636679135836, "in-drivable-lane": 0.0, "deviation-heading": 0.8118491438434715, "agent_compute-ego0": 0.01595725233738239, "complete-iteration": 0.29714561196473926, "set_robot_commands": 0.0022467787449176493, "deviation-center-line": 0.14584640170437188, "driven_lanedir_consec": 1.7284074452871878, "sim_compute_sim_state": 0.012758346704336314, "sim_compute_performance-ego0": 0.0019543377252725456}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.606336016667396, "get_ui_image": 0.026717710168394325, "step_physics": 0.135580985513452, "survival_time": 7.249999999999982, "driven_lanedir": 2.2762867401696623, "get_state_dump": 0.005250120816165453, "get_robot_state": 0.0035728640752295923, "sim_render-ego0": 0.003658854798094867, "get_duckie_state": 0.004150433083103128, "in-drivable-lane": 0.549999999999998, "deviation-heading": 1.4676749900326884, "agent_compute-ego0": 0.015420485849249852, "complete-iteration": 0.20429468318207625, "set_robot_commands": 0.002218112553635689, "deviation-center-line": 0.4637150439603034, "driven_lanedir_consec": 2.2762867401696623, "sim_compute_sim_state": 0.005721142847244054, "sim_compute_performance-ego0": 0.0019135622129048389}}
set_robot_commands_max0.0023831980569022043
set_robot_commands_mean0.0022823082268091516
set_robot_commands_median0.0022639611483493563
set_robot_commands_min0.002218112553635689
sim_compute_performance-ego0_max0.002056598663330078
sim_compute_performance-ego0_mean0.0019772619547477714
sim_compute_performance-ego0_median0.001969443471378085
sim_compute_performance-ego0_min0.0019135622129048389
sim_compute_sim_state_max0.012758346704336314
sim_compute_sim_state_mean0.008794921900459822
sim_compute_sim_state_median0.00835009902512946
sim_compute_sim_state_min0.005721142847244054
sim_render-ego0_max0.0038607169170768894
sim_render-ego0_mean0.00377682908476166
sim_render-ego0_median0.003793872311937441
sim_render-ego0_min0.003658854798094867
simulation-passed1
step_physics_max0.24392737661089217
step_physics_mean0.18607732851078032
step_physics_median0.18240047595938855
step_physics_min0.135580985513452
survival_time_max7.299999999999982
survival_time_mean5.524999999999988
survival_time_min2.3999999999999995
No reset possible
6193813441Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.874999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median1.5984637301090765
deviation-center-line_median0.17192954663072418


other stats
agent_compute-ego0_max0.01845363208225795
agent_compute-ego0_mean0.015676176925264743
agent_compute-ego0_median0.014843100550396195
agent_compute-ego0_min0.014564874518008633
complete-iteration_max0.338880003715048
complete-iteration_mean0.2816600174012901
complete-iteration_median0.2880728950917395
complete-iteration_min0.21161427570663335
deviation-center-line_max0.4980934677849318
deviation-center-line_mean0.24436137894540397
deviation-center-line_min0.13549295473523565
deviation-heading_max1.3920304874288565
deviation-heading_mean0.98414550942308
deviation-heading_median0.9515712076320876
deviation-heading_min0.6414091349992892
driven_any_max2.3685251007861132
driven_any_mean1.543151720802934
driven_any_median1.6323335037784636
driven_any_min0.5394147748686953
driven_lanedir_consec_max2.279635763398966
driven_lanedir_consec_mean1.5012739941322706
driven_lanedir_consec_min0.528532752911964
driven_lanedir_max2.279635763398966
driven_lanedir_mean1.5012739941322706
driven_lanedir_median1.5984637301090765
driven_lanedir_min0.528532752911964
get_duckie_state_max0.023787846330736506
get_duckie_state_mean0.01717008354953527
get_duckie_state_median0.02039617175147647
get_duckie_state_min0.004100144364451634
get_robot_state_max0.003682014893512337
get_robot_state_mean0.003573205994553107
get_robot_state_median0.003539803702099394
get_robot_state_min0.003531201680501302
get_state_dump_max0.00826988063874792
get_state_dump_mean0.007277605862450196
get_state_dump_median0.007851781682903264
get_state_dump_min0.00513697944524634
get_ui_image_max0.03973646066626724
get_ui_image_mean0.034018966397418
get_ui_image_median0.034598240813270946
get_ui_image_min0.027142923296862888
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0846099486391787, "get_ui_image": 0.03283460609248427, "step_physics": 0.18134612529004207, "survival_time": 6.0499999999999865, "driven_lanedir": 2.0448040823026, "get_state_dump": 0.00826988063874792, "get_robot_state": 0.003539624761362545, "sim_render-ego0": 0.003545591088592029, "get_duckie_state": 0.023787846330736506, "in-drivable-lane": 0.0, "deviation-heading": 1.260300989373689, "agent_compute-ego0": 0.014694161102419992, "complete-iteration": 0.27983747935685954, "set_robot_commands": 0.0021596130777577884, "deviation-center-line": 0.2076336255414721, "driven_lanedir_consec": 2.0448040823026, "sim_compute_sim_state": 0.00775055220869721, "sim_compute_performance-ego0": 0.0018308651251871075}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5394147748686953, "get_ui_image": 0.03973646066626724, "step_physics": 0.23072011130196707, "survival_time": 2.3999999999999995, "driven_lanedir": 0.528532752911964, "get_state_dump": 0.008017126394777882, "get_robot_state": 0.003682014893512337, "sim_render-ego0": 0.0038660837679493185, "get_duckie_state": 0.020942722048078264, "in-drivable-lane": 0.0, "deviation-heading": 0.6414091349992892, "agent_compute-ego0": 0.01845363208225795, "complete-iteration": 0.338880003715048, "set_robot_commands": 0.002340939580177774, "deviation-center-line": 0.13549295473523565, "driven_lanedir_consec": 0.528532752911964, "sim_compute_sim_state": 0.00897063041219906, "sim_compute_performance-ego0": 0.002056165617339465}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1800570589177486, "get_ui_image": 0.03636187553405762, "step_physics": 0.1938055229187012, "survival_time": 3.699999999999995, "driven_lanedir": 1.1521233779155529, "get_state_dump": 0.007686436971028646, "get_robot_state": 0.003531201680501302, "sim_render-ego0": 0.003612680435180664, "get_duckie_state": 0.01984962145487467, "in-drivable-lane": 0.0, "deviation-heading": 0.6428414258904859, "agent_compute-ego0": 0.014992039998372396, "complete-iteration": 0.29630831082661946, "set_robot_commands": 0.0020966593424479167, "deviation-center-line": 0.13622546771997626, "driven_lanedir_consec": 1.1521233779155529, "sim_compute_sim_state": 0.0124211851755778, "sim_compute_performance-ego0": 0.0018727906545003255}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.3685251007861132, "get_ui_image": 0.027142923296862888, "step_physics": 0.1438195286816313, "survival_time": 6.499999999999985, "driven_lanedir": 2.279635763398966, "get_state_dump": 0.00513697944524634, "get_robot_state": 0.003539982642836243, "sim_render-ego0": 0.0035609780377104084, "get_duckie_state": 0.004100144364451634, "in-drivable-lane": 0.0, "deviation-heading": 1.3920304874288565, "agent_compute-ego0": 0.014564874518008633, "complete-iteration": 0.21161427570663335, "set_robot_commands": 0.002162864190021544, "deviation-center-line": 0.4980934677849318, "driven_lanedir_consec": 2.279635763398966, "sim_compute_sim_state": 0.005661711438011577, "sim_compute_performance-ego0": 0.0018474072900437216}}
set_robot_commands_max0.002340939580177774
set_robot_commands_mean0.002190019047601256
set_robot_commands_median0.0021612386338896662
set_robot_commands_min0.0020966593424479167
sim_compute_performance-ego0_max0.002056165617339465
sim_compute_performance-ego0_mean0.0019018071717676552
sim_compute_performance-ego0_median0.0018600989722720232
sim_compute_performance-ego0_min0.0018308651251871075
sim_compute_sim_state_max0.0124211851755778
sim_compute_sim_state_mean0.008701019808621412
sim_compute_sim_state_median0.008360591310448135
sim_compute_sim_state_min0.005661711438011577
sim_render-ego0_max0.0038660837679493185
sim_render-ego0_mean0.003646333332358105
sim_render-ego0_median0.0035868292364455365
sim_render-ego0_min0.003545591088592029
simulation-passed1
step_physics_max0.23072011130196707
step_physics_mean0.1874228220480854
step_physics_median0.1875758241043716
step_physics_min0.1438195286816313
survival_time_max6.499999999999985
survival_time_mean4.662499999999992
survival_time_min2.3999999999999995
No reset possible
6193513437Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:39:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.879673988791524
survival_time_median59.99999999999873
deviation-center-line_median2.6788561159115645
in-drivable-lane_median0.02499999999999991


other stats
agent_compute-ego0_max0.016908906877884558
agent_compute-ego0_mean0.016264157876881034
agent_compute-ego0_median0.01648053410249785
agent_compute-ego0_min0.015186656424643893
complete-iteration_max0.27163526735933097
complete-iteration_mean0.2351223075518898
complete-iteration_median0.2390530809176951
complete-iteration_min0.190747801012838
deviation-center-line_max3.217941488978158
deviation-center-line_mean2.773317467956511
deviation-center-line_min2.5176161510247583
deviation-heading_max11.509567425488806
deviation-heading_mean10.324330753307454
deviation-heading_median10.34111737363052
deviation-heading_min9.105520840479963
driven_any_max26.9624087829597
driven_any_mean26.519683256880924
driven_any_median26.431467707053464
driven_any_min26.25338883045705
driven_lanedir_consec_max26.41961758301415
driven_lanedir_consec_mean25.735764012517446
driven_lanedir_consec_min24.7640904894726
driven_lanedir_max26.41961758301415
driven_lanedir_mean25.735764012517446
driven_lanedir_median25.879673988791524
driven_lanedir_min24.7640904894726
get_duckie_state_max1.2998874737360793e-06
get_duckie_state_mean1.238992470289448e-06
get_duckie_state_median1.24509685938801e-06
get_duckie_state_min1.1658886886456923e-06
get_robot_state_max0.003618558777262031
get_robot_state_mean0.0035468968225458477
get_robot_state_median0.0035273126519589897
get_robot_state_min0.0035144032090033816
get_state_dump_max0.0045832303243314694
get_state_dump_mean0.004471856886699336
get_state_dump_median0.004458874488849624
get_state_dump_min0.004386448244766629
get_ui_image_max0.03560979757380426
get_ui_image_mean0.03070386894338831
get_ui_image_median0.030615954474545237
get_ui_image_min0.02597376925065853
in-drivable-lane_max1.849999999999988
in-drivable-lane_mean0.474999999999997
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 26.393185242482613, "get_ui_image": 0.02848928774723304, "step_physics": 0.14781809508254587, "survival_time": 59.99999999999873, "driven_lanedir": 25.82554860157695, "get_state_dump": 0.0045832303243314694, "get_robot_state": 0.003618558777262031, "sim_render-ego0": 0.0036440006799245256, "get_duckie_state": 1.266139631565167e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.63325547995575, "agent_compute-ego0": 0.01623819928482907, "complete-iteration": 0.2181004290775296, "set_robot_commands": 0.002183245183228454, "deviation-center-line": 2.780798973143427, "driven_lanedir_consec": 25.82554860157695, "sim_compute_sim_state": 0.009533449970216774, "sim_compute_performance-ego0": 0.0019127284358879807}, "LF-norm-zigzag-000-ego0": {"driven_any": 26.46975017162432, "get_ui_image": 0.03560979757380426, "step_physics": 0.18983564567407105, "survival_time": 59.99999999999873, "driven_lanedir": 25.933799376006093, "get_state_dump": 0.004386448244766629, "get_robot_state": 0.0035144032090033816, "sim_render-ego0": 0.00359336521901457, "get_duckie_state": 1.224054087210853e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.048979267305294, "agent_compute-ego0": 0.016722868920166625, "complete-iteration": 0.27163526735933097, "set_robot_commands": 0.002177753019690216, "deviation-center-line": 2.5769132586797014, "driven_lanedir_consec": 25.933799376006093, "sim_compute_sim_state": 0.013847782252531663, "sim_compute_performance-ego0": 0.0018696503079404048}, "LF-norm-techtrack-000-ego0": {"driven_any": 26.25338883045705, "get_ui_image": 0.03274262120185744, "step_physics": 0.18361968859149255, "survival_time": 59.99999999999873, "driven_lanedir": 24.7640904894726, "get_state_dump": 0.004520506386355893, "get_robot_state": 0.003530594034059955, "sim_render-ego0": 0.003633165240387039, "get_duckie_state": 1.2998874737360793e-06, "in-drivable-lane": 1.849999999999988, "deviation-heading": 11.509567425488806, "agent_compute-ego0": 0.015186656424643893, "complete-iteration": 0.2600057327578606, "set_robot_commands": 0.00209658529041808, "deviation-center-line": 3.217941488978158, "driven_lanedir_consec": 24.7640904894726, "sim_compute_sim_state": 0.012711700055124758, "sim_compute_performance-ego0": 0.0018864261617668463}, "LF-norm-small_loop-000-ego0": {"driven_any": 26.9624087829597, "get_ui_image": 0.02597376925065853, "step_physics": 0.12603372499210252, "survival_time": 59.99999999999873, "driven_lanedir": 26.41961758301415, "get_state_dump": 0.0043972425913433545, "get_robot_state": 0.0035240312698580243, "sim_render-ego0": 0.003626239190589974, "get_duckie_state": 1.1658886886456923e-06, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 9.105520840479963, "agent_compute-ego0": 0.016908906877884558, "complete-iteration": 0.190747801012838, "set_robot_commands": 0.002164630072003697, "deviation-center-line": 2.5176161510247583, "driven_lanedir_consec": 26.41961758301415, "sim_compute_sim_state": 0.006165269808804959, "sim_compute_performance-ego0": 0.0018787933924513792}}
set_robot_commands_max0.002183245183228454
set_robot_commands_mean0.0021555533913351116
set_robot_commands_median0.0021711915458469564
set_robot_commands_min0.00209658529041808
sim_compute_performance-ego0_max0.0019127284358879807
sim_compute_performance-ego0_mean0.0018868995745116527
sim_compute_performance-ego0_median0.0018826097771091129
sim_compute_performance-ego0_min0.0018696503079404048
sim_compute_sim_state_max0.013847782252531663
sim_compute_sim_state_mean0.010564550521669538
sim_compute_sim_state_median0.011122575012670766
sim_compute_sim_state_min0.006165269808804959
sim_render-ego0_max0.0036440006799245256
sim_render-ego0_mean0.0036241925824790273
sim_render-ego0_median0.0036297022154885062
sim_render-ego0_min0.00359336521901457
simulation-passed1
step_physics_max0.18983564567407105
step_physics_mean0.161826788585053
step_physics_median0.1657188918370192
step_physics_min0.12603372499210252
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6193213428Jean-Sébastien Grondin 🇨🇦real-exercise-3aido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.100000000000051
in-drivable-lane_median1.050000000000011
driven_lanedir_consec_median1.4697360212247588
deviation-center-line_median0.5375729371962144


other stats
agent_compute-ego0_max0.07086729882332274
agent_compute-ego0_mean0.05364930940733124
agent_compute-ego0_median0.05809335856365648
agent_compute-ego0_min0.02754322167868926
complete-iteration_max0.39298269470331026
complete-iteration_mean0.33955494193477953
complete-iteration_median0.35358727084633046
complete-iteration_min0.25806253134314694
deviation-center-line_max1.5322633349018626
deviation-center-line_mean0.7157986886802992
deviation-center-line_min0.2557855454269057
deviation-heading_max2.802265941219749
deviation-heading_mean1.9512664245933231
deviation-heading_median1.8752736994194088
deviation-heading_min1.252252358314727
driven_any_max2.079161234979404
driven_any_mean1.460132074769574
driven_any_median1.601207993426529
driven_any_min0.558951077245835
driven_lanedir_consec_max1.8182750430816832
driven_lanedir_consec_mean1.3080559173829869
driven_lanedir_consec_min0.474476584000745
driven_lanedir_max1.8182750430816832
driven_lanedir_mean1.3080559173829869
driven_lanedir_median1.4697360212247588
driven_lanedir_min0.474476584000745
get_duckie_state_max0.030082441028490618
get_duckie_state_mean0.021264498354806132
get_duckie_state_median0.02492893207027403
get_duckie_state_min0.005117688250185839
get_robot_state_max0.004548985340873602
get_robot_state_mean0.004429740067675358
get_robot_state_median0.00444389392561355
get_robot_state_min0.004282187078600732
get_state_dump_max0.010112505915679469
get_state_dump_mean0.008760369876623507
get_state_dump_median0.00930314539867694
get_state_dump_min0.006322682793460675
get_ui_image_max0.05801563173811013
get_ui_image_mean0.050414603176127754
get_ui_image_median0.05154780324209883
get_ui_image_min0.04054717448220324
in-drivable-lane_max1.9500000000000275
in-drivable-lane_mean1.0125000000000124
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0393473867905425, "get_ui_image": 0.04863024482611102, "step_physics": 0.15195348125098324, "survival_time": 16.400000000000098, "driven_lanedir": 1.807670188160989, "get_state_dump": 0.010112505915679469, "get_robot_state": 0.004502105133149399, "sim_render-ego0": 0.004437090053384427, "get_duckie_state": 0.030082441028490618, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 1.877529149056911, "agent_compute-ego0": 0.06653913466039037, "complete-iteration": 0.33150825312072385, "set_robot_commands": 0.0030613133972539003, "deviation-center-line": 0.5291634979164275, "driven_lanedir_consec": 1.807670188160989, "sim_compute_sim_state": 0.009679606620301592, "sim_compute_performance-ego0": 0.0023970872073188015}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.558951077245835, "get_ui_image": 0.05801563173811013, "step_physics": 0.23122597409185963, "survival_time": 5.299999999999989, "driven_lanedir": 0.474476584000745, "get_state_dump": 0.009059952798290787, "get_robot_state": 0.004282187078600732, "sim_render-ego0": 0.004332849912554304, "get_duckie_state": 0.024099116013428876, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 1.252252358314727, "agent_compute-ego0": 0.02754322167868926, "complete-iteration": 0.375666288571937, "set_robot_commands": 0.002856673481308411, "deviation-center-line": 0.5459823764760011, "driven_lanedir_consec": 0.474476584000745, "sim_compute_sim_state": 0.011832564790672233, "sim_compute_performance-ego0": 0.0023066841553304796}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1630686000625154, "get_ui_image": 0.05446536165808663, "step_physics": 0.20050309394216775, "survival_time": 9.800000000000004, "driven_lanedir": 1.1318018542885289, "get_state_dump": 0.009546337999063096, "get_robot_state": 0.004548985340873602, "sim_render-ego0": 0.004588784300131241, "get_duckie_state": 0.02575874812711919, "in-drivable-lane": 0.0, "deviation-heading": 1.873018249781906, "agent_compute-ego0": 0.07086729882332274, "complete-iteration": 0.39298269470331026, "set_robot_commands": 0.003045460899469211, "deviation-center-line": 0.2557855454269057, "driven_lanedir_consec": 1.1318018542885289, "sim_compute_sim_state": 0.01711158825056202, "sim_compute_performance-ego0": 0.002434350512354507}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.079161234979404, "get_ui_image": 0.04054717448220324, "step_physics": 0.13502648054663816, "survival_time": 16.700000000000102, "driven_lanedir": 1.8182750430816832, "get_state_dump": 0.006322682793460675, "get_robot_state": 0.0043856827180777025, "sim_render-ego0": 0.004322324582000277, "get_duckie_state": 0.005117688250185839, "in-drivable-lane": 1.6500000000000234, "deviation-heading": 2.802265941219749, "agent_compute-ego0": 0.049647582466922587, "complete-iteration": 0.25806253134314694, "set_robot_commands": 0.002832720884636267, "deviation-center-line": 1.5322633349018626, "driven_lanedir_consec": 1.8182750430816832, "sim_compute_sim_state": 0.007422988094500641, "sim_compute_performance-ego0": 0.002330423468974099}}
set_robot_commands_max0.0030613133972539003
set_robot_commands_mean0.002949042165666947
set_robot_commands_median0.0029510671903888114
set_robot_commands_min0.002832720884636267
sim_compute_performance-ego0_max0.002434350512354507
sim_compute_performance-ego0_mean0.0023671363359944715
sim_compute_performance-ego0_median0.0023637553381464504
sim_compute_performance-ego0_min0.0023066841553304796
sim_compute_sim_state_max0.01711158825056202
sim_compute_sim_state_mean0.01151168693900912
sim_compute_sim_state_median0.01075608570548691
sim_compute_sim_state_min0.007422988094500641
sim_render-ego0_max0.004588784300131241
sim_render-ego0_mean0.004420262212017563
sim_render-ego0_median0.004384969982969366
sim_render-ego0_min0.004322324582000277
simulation-passed1
step_physics_max0.23122597409185963
step_physics_mean0.17967725745791222
step_physics_median0.1762282875965755
step_physics_min0.13502648054663816
survival_time_max16.700000000000102
survival_time_mean12.050000000000049
survival_time_min5.299999999999989
No reset possible
6192813430Jean-Sébastien Grondin 🇨🇦sim-exercise-3aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:37:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.453644276170213
survival_time_median59.99999999999873
deviation-center-line_median4.579033841088524
in-drivable-lane_median8.099999999999845


other stats
agent_compute-ego0_max0.016563998570946432
agent_compute-ego0_mean0.015582979072837608
agent_compute-ego0_median0.015369412801744142
agent_compute-ego0_min0.015029092116915712
complete-iteration_max0.2577009677489929
complete-iteration_mean0.2254203555982973
complete-iteration_median0.2310765948918936
complete-iteration_min0.1818272648604089
deviation-center-line_max5.08414086982271
deviation-center-line_mean4.509644590895583
deviation-center-line_min3.796369811582573
deviation-heading_max19.08123344835598
deviation-heading_mean15.757143129499433
deviation-heading_median15.840353338587564
deviation-heading_min12.266632392466615
driven_any_max10.876005602132889
driven_any_mean10.63503559383676
driven_any_median10.575240562719696
driven_any_min10.513655647774767
driven_lanedir_consec_max8.841077460090787
driven_lanedir_consec_mean8.439794517232539
driven_lanedir_consec_min8.010812056498946
driven_lanedir_max8.841077460090787
driven_lanedir_mean8.439794517232539
driven_lanedir_median8.453644276170213
driven_lanedir_min8.010812056498946
get_duckie_state_max1.2454938928253149e-06
get_duckie_state_mean1.2149223181528417e-06
get_duckie_state_median1.2157163850274512e-06
get_duckie_state_min1.1827626097311486e-06
get_robot_state_max0.003575555887150824
get_robot_state_mean0.0035128618755705843
get_robot_state_median0.0034983273251269083
get_robot_state_min0.003479236964877698
get_state_dump_max0.0045072964883466045
get_state_dump_mean0.004443757440724241
get_state_dump_median0.00445233435555362
get_state_dump_min0.004363064563443123
get_ui_image_max0.035419895091124316
get_ui_image_mean0.030320740262237217
get_ui_image_median0.030223974875863844
get_ui_image_min0.025415116206096867
in-drivable-lane_max11.09999999999981
in-drivable-lane_mean8.499999999999845
in-drivable-lane_min6.69999999999988
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.876005602132889, "get_ui_image": 0.02845100876095889, "step_physics": 0.15085308061452035, "survival_time": 59.99999999999873, "driven_lanedir": 8.841077460090787, "get_state_dump": 0.0045072964883466045, "get_robot_state": 0.003575555887150824, "sim_render-ego0": 0.003666687766082281, "get_duckie_state": 1.1827626097311486e-06, "in-drivable-lane": 8.799999999999848, "deviation-heading": 12.266632392466615, "agent_compute-ego0": 0.015577858433338329, "complete-iteration": 0.2201036291257428, "set_robot_commands": 0.002154375492384987, "deviation-center-line": 3.796369811582573, "driven_lanedir_consec": 8.841077460090787, "sim_compute_sim_state": 0.0093235415681812, "sim_compute_performance-ego0": 0.0019167295403524204}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.61625455186649, "get_ui_image": 0.035419895091124316, "step_physics": 0.17794688615473384, "survival_time": 59.99999999999873, "driven_lanedir": 8.354366789304613, "get_state_dump": 0.004363064563443123, "get_robot_state": 0.0034915700145406983, "sim_render-ego0": 0.003590798794875832, "get_duckie_state": 1.2454938928253149e-06, "in-drivable-lane": 7.399999999999841, "deviation-heading": 19.08123344835598, "agent_compute-ego0": 0.015160967170149956, "complete-iteration": 0.2577009677489929, "set_robot_commands": 0.002122842699760799, "deviation-center-line": 5.08414086982271, "driven_lanedir_consec": 8.354366789304613, "sim_compute_sim_state": 0.013670771247044291, "sim_compute_performance-ego0": 0.0018575447584369797}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.513655647774767, "get_ui_image": 0.0319969409907688, "step_physics": 0.16554980591671553, "survival_time": 59.99999999999873, "driven_lanedir": 8.552921763035812, "get_state_dump": 0.004445140308186375, "get_robot_state": 0.003479236964877698, "sim_render-ego0": 0.0035923063308372786, "get_duckie_state": 1.2296125553331209e-06, "in-drivable-lane": 6.69999999999988, "deviation-heading": 17.61978961325756, "agent_compute-ego0": 0.016563998570946432, "complete-iteration": 0.24204956065804437, "set_robot_commands": 0.0021707312848347608, "deviation-center-line": 4.088168386280549, "driven_lanedir_consec": 8.552921763035812, "sim_compute_sim_state": 0.012308177701837316, "sim_compute_performance-ego0": 0.0018652998140511368}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.5342265735729, "get_ui_image": 0.025415116206096867, "step_physics": 0.11967857989740809, "survival_time": 59.99999999999873, "driven_lanedir": 8.010812056498946, "get_state_dump": 0.004459528402920865, "get_robot_state": 0.0035050846357131183, "sim_render-ego0": 0.003581684495289062, "get_duckie_state": 1.2018202147217813e-06, "in-drivable-lane": 11.09999999999981, "deviation-heading": 14.060917063917572, "agent_compute-ego0": 0.015029092116915712, "complete-iteration": 0.1818272648604089, "set_robot_commands": 0.002168709789088723, "deviation-center-line": 5.0698992958965, "driven_lanedir_consec": 8.010812056498946, "sim_compute_sim_state": 0.006043673157195664, "sim_compute_performance-ego0": 0.00186706998763136}}
set_robot_commands_max0.0021707312848347608
set_robot_commands_mean0.002154164816517318
set_robot_commands_median0.0021615426407368553
set_robot_commands_min0.002122842699760799
sim_compute_performance-ego0_max0.0019167295403524204
sim_compute_performance-ego0_mean0.0018766610251179745
sim_compute_performance-ego0_median0.0018661849008412485
sim_compute_performance-ego0_min0.0018575447584369797
sim_compute_sim_state_max0.013670771247044291
sim_compute_sim_state_mean0.010336540918564618
sim_compute_sim_state_median0.010815859635009258
sim_compute_sim_state_min0.006043673157195664
sim_render-ego0_max0.003666687766082281
sim_render-ego0_mean0.0036078693467711137
sim_render-ego0_median0.0035915525628565552
sim_render-ego0_min0.003581684495289062
simulation-passed1
step_physics_max0.17794688615473384
step_physics_mean0.15350708814584446
step_physics_median0.15820144326561794
step_physics_min0.11967857989740809
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6192413424Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:26:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.3055100793175
survival_time_median41.99999999999975
deviation-center-line_median2.028406424800308
in-drivable-lane_median11.74999999999983


other stats
agent_compute-ego0_max0.016256627732942213
agent_compute-ego0_mean0.015565709438113
agent_compute-ego0_median0.01545067987695261
agent_compute-ego0_min0.01510485026560457
complete-iteration_max0.2829778765288877
complete-iteration_mean0.2415508870789277
complete-iteration_median0.2423629361586477
complete-iteration_min0.19849979946952775
deviation-center-line_max2.5674181805461904
deviation-center-line_mean1.84413798394327
deviation-center-line_min0.7523209056262734
deviation-heading_max9.49647075549407
deviation-heading_mean6.902198637477109
deviation-heading_median7.191440690000686
deviation-heading_min3.7294424144129943
driven_any_max25.39713773439819
driven_any_mean17.0002640391284
driven_any_median17.483253046223766
driven_any_min7.637412329667874
driven_lanedir_consec_max15.61792954102498
driven_lanedir_consec_mean11.10815832606966
driven_lanedir_consec_min6.203683604618661
driven_lanedir_max15.61792954102498
driven_lanedir_mean11.113924396148
driven_lanedir_median11.31704221947418
driven_lanedir_min6.203683604618661
get_duckie_state_max1.2068566283375537e-06
get_duckie_state_mean1.1864750562711062e-06
get_duckie_state_median1.1863789373319373e-06
get_duckie_state_min1.1662857220829972e-06
get_robot_state_max0.003732628151972035
get_robot_state_mean0.0036527132248268296
get_robot_state_median0.0036496127251927487
get_robot_state_min0.003578999296949786
get_state_dump_max0.004674325887341082
get_state_dump_mean0.004607710644017403
get_state_dump_median0.004608614461532386
get_state_dump_min0.00453928776566376
get_ui_image_max0.03641020902962235
get_ui_image_mean0.030916886698470543
get_ui_image_median0.03054830243621214
get_ui_image_min0.02616073289183554
in-drivable-lane_max25.34999999999997
in-drivable-lane_mean13.07499999999992
in-drivable-lane_min3.450000000000049
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.637412329667874, "get_ui_image": 0.028642476079318503, "step_physics": 0.15694225308749657, "survival_time": 18.800000000000132, "driven_lanedir": 6.203683604618661, "get_state_dump": 0.004674325887341082, "get_robot_state": 0.003732628151972035, "sim_render-ego0": 0.0038025714358221, "get_duckie_state": 1.188930845387102e-06, "in-drivable-lane": 3.450000000000049, "deviation-heading": 3.7294424144129943, "agent_compute-ego0": 0.016256627732942213, "complete-iteration": 0.22815937325556016, "set_robot_commands": 0.0023419597737036587, "deviation-center-line": 0.7523209056262734, "driven_lanedir_consec": 6.203683604618661, "sim_compute_sim_state": 0.009708468414428064, "sim_compute_performance-ego0": 0.001978155156345519}, "LF-norm-zigzag-000-ego0": {"driven_any": 19.186600129022064, "get_ui_image": 0.03641020902962235, "step_physics": 0.20199997505154924, "survival_time": 46.09999999999952, "driven_lanedir": 15.61792954102498, "get_state_dump": 0.0046209268683601945, "get_robot_state": 0.003665376716936138, "sim_render-ego0": 0.00374623574518305, "get_duckie_state": 1.1838270292767724e-06, "in-drivable-lane": 7.49999999999984, "deviation-heading": 9.49647075549407, "agent_compute-ego0": 0.015220101450530576, "complete-iteration": 0.2829778765288877, "set_robot_commands": 0.002204952363978228, "deviation-center-line": 2.5674181805461904, "driven_lanedir_consec": 15.61792954102498, "sim_compute_sim_state": 0.013075187172688229, "sim_compute_performance-ego0": 0.001955725131546302}, "LF-norm-techtrack-000-ego0": {"driven_any": 15.779905963425463, "get_ui_image": 0.032454128793105774, "step_physics": 0.18030959626902704, "survival_time": 37.899999999999984, "driven_lanedir": 8.608917103952917, "get_state_dump": 0.00453928776566376, "get_robot_state": 0.003578999296949786, "sim_render-ego0": 0.003685332726741183, "get_duckie_state": 1.2068566283375537e-06, "in-drivable-lane": 15.99999999999982, "deviation-heading": 6.428593325133083, "agent_compute-ego0": 0.01568125830337464, "complete-iteration": 0.25656649906173523, "set_robot_commands": 0.002157028798843404, "deviation-center-line": 1.6931875197035933, "driven_lanedir_consec": 8.58585282363956, "sim_compute_sim_state": 0.012171322177992508, "sim_compute_performance-ego0": 0.001915701136130432}, "LF-norm-small_loop-000-ego0": {"driven_any": 25.39713773439819, "get_ui_image": 0.02616073289183554, "step_physics": 0.13483475666062025, "survival_time": 59.99999999999873, "driven_lanedir": 14.025167334995444, "get_state_dump": 0.004596302054704576, "get_robot_state": 0.0036338487334493593, "sim_render-ego0": 0.003722565457981691, "get_duckie_state": 1.1662857220829972e-06, "in-drivable-lane": 25.34999999999997, "deviation-heading": 7.954288054868289, "agent_compute-ego0": 0.01510485026560457, "complete-iteration": 0.19849979946952775, "set_robot_commands": 0.0021907638054306957, "deviation-center-line": 2.3636253298970233, "driven_lanedir_consec": 14.025167334995444, "sim_compute_sim_state": 0.0062425029367134035, "sim_compute_performance-ego0": 0.0019392528502172872}}
set_robot_commands_max0.0023419597737036587
set_robot_commands_mean0.0022236761854889965
set_robot_commands_median0.0021978580847044618
set_robot_commands_min0.002157028798843404
sim_compute_performance-ego0_max0.001978155156345519
sim_compute_performance-ego0_mean0.0019472085685598851
sim_compute_performance-ego0_median0.0019474889908817944
sim_compute_performance-ego0_min0.001915701136130432
sim_compute_sim_state_max0.013075187172688229
sim_compute_sim_state_mean0.01029937017545555
sim_compute_sim_state_median0.010939895296210284
sim_compute_sim_state_min0.0062425029367134035
sim_render-ego0_max0.0038025714358221
sim_render-ego0_mean0.003739176341432006
sim_render-ego0_median0.0037344006015823704
sim_render-ego0_min0.003685332726741183
simulation-passed1
step_physics_max0.20199997505154924
step_physics_mean0.16852164526717328
step_physics_median0.16862592467826182
step_physics_min0.13483475666062025
survival_time_max59.99999999999873
survival_time_mean40.69999999999959
survival_time_min18.800000000000132
No reset possible
6192313423Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.399999999999989
in-drivable-lane_median0.4999999999999982
driven_lanedir_consec_median1.4452386099651844
deviation-center-line_median0.2667596579026946


other stats
agent_compute-ego0_max0.017953325720394358
agent_compute-ego0_mean0.016351339522568356
agent_compute-ego0_median0.015873870893689846
agent_compute-ego0_min0.015704290582499374
complete-iteration_max0.34555384692023783
complete-iteration_mean0.2824933444208773
complete-iteration_median0.2902317061729145
complete-iteration_min0.2039561184174424
deviation-center-line_max0.5121928472330224
deviation-center-line_mean0.313444756249711
deviation-center-line_min0.20806686196043248
deviation-heading_max2.1369767284287815
deviation-heading_mean1.3135939729743225
deviation-heading_median1.1904315876192535
deviation-heading_min0.736535988230001
driven_any_max2.3197267136965434
driven_any_mean1.680173112752879
driven_any_median1.910210584275776
driven_any_min0.580544568763421
driven_lanedir_consec_max2.207287483695789
driven_lanedir_consec_mean1.4101301045255734
driven_lanedir_consec_min0.542755714476136
driven_lanedir_max2.207287483695789
driven_lanedir_mean1.4101301045255734
driven_lanedir_median1.4452386099651844
driven_lanedir_min0.542755714476136
get_duckie_state_max0.023821821649565953
get_duckie_state_mean0.017197726750554268
get_duckie_state_median0.0203882199779949
get_duckie_state_min0.004192645396661321
get_robot_state_max0.003707937165802601
get_robot_state_mean0.0036118970630278687
get_robot_state_median0.003596757530072414
get_robot_state_min0.0035461360261640476
get_state_dump_max0.008403827215879019
get_state_dump_mean0.007440756603634125
get_state_dump_median0.008025941756115176
get_state_dump_min0.005307315686427125
get_ui_image_max0.03928990457572189
get_ui_image_mean0.03327531077978865
get_ui_image_median0.033613790833939186
get_ui_image_min0.026583756875554355
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.6374999999999977
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.3197267136965434, "get_ui_image": 0.03201074272621679, "step_physics": 0.18618125587929296, "survival_time": 6.499999999999985, "driven_lanedir": 2.207287483695789, "get_state_dump": 0.008403827215879019, "get_robot_state": 0.0035461360261640476, "sim_render-ego0": 0.0035577111571799707, "get_duckie_state": 0.023821821649565953, "in-drivable-lane": 0.0, "deviation-heading": 2.1369767284287815, "agent_compute-ego0": 0.01579523996542428, "complete-iteration": 0.28492092722244844, "set_robot_commands": 0.0020771481608616487, "deviation-center-line": 0.5121928472330224, "driven_lanedir_consec": 2.207287483695789, "sim_compute_sim_state": 0.00760485379750492, "sim_compute_performance-ego0": 0.0018433068544810056}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.580544568763421, "get_ui_image": 0.03928990457572189, "step_physics": 0.23831913517970665, "survival_time": 2.499999999999999, "driven_lanedir": 0.542755714476136, "get_state_dump": 0.008195919149062213, "get_robot_state": 0.003707937165802601, "sim_render-ego0": 0.003801285051832012, "get_duckie_state": 0.02088783769046559, "in-drivable-lane": 0.0, "deviation-heading": 0.736535988230001, "agent_compute-ego0": 0.017953325720394358, "complete-iteration": 0.34555384692023783, "set_robot_commands": 0.0022797304041245405, "deviation-center-line": 0.25537155632404696, "driven_lanedir_consec": 0.542755714476136, "sim_compute_sim_state": 0.009028224384083468, "sim_compute_performance-ego0": 0.0020036183151544307}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.939306341135685, "get_ui_image": 0.03521683894166159, "step_physics": 0.1930210787221926, "survival_time": 5.399999999999989, "driven_lanedir": 1.4152795939245966, "get_state_dump": 0.00785596436316814, "get_robot_state": 0.003555468463022774, "sim_render-ego0": 0.003605597609773689, "get_duckie_state": 0.01988860226552421, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.4489720232460428, "agent_compute-ego0": 0.015704290582499374, "complete-iteration": 0.2955424851233806, "set_robot_commands": 0.002158154041395275, "deviation-center-line": 0.27814775948134224, "driven_lanedir_consec": 1.4152795939245966, "sim_compute_sim_state": 0.01260998708392502, "sim_compute_performance-ego0": 0.0018459153831551927}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.8811148274158669, "get_ui_image": 0.026583756875554355, "step_physics": 0.13454000446774544, "survival_time": 5.399999999999989, "driven_lanedir": 1.475197626005772, "get_state_dump": 0.005307315686427125, "get_robot_state": 0.003638046597122053, "sim_render-ego0": 0.0036919401326310744, "get_duckie_state": 0.004192645396661321, "in-drivable-lane": 1.5499999999999945, "deviation-heading": 0.9318911519924648, "agent_compute-ego0": 0.01595250182195541, "complete-iteration": 0.2039561184174424, "set_robot_commands": 0.0021518020454896697, "deviation-center-line": 0.20806686196043248, "driven_lanedir_consec": 1.475197626005772, "sim_compute_sim_state": 0.005877623864270131, "sim_compute_performance-ego0": 0.00193213104108058}}
set_robot_commands_max0.0022797304041245405
set_robot_commands_mean0.002166708662967784
set_robot_commands_median0.0021549780434424724
set_robot_commands_min0.0020771481608616487
sim_compute_performance-ego0_max0.0020036183151544307
sim_compute_performance-ego0_mean0.0019062428984678024
sim_compute_performance-ego0_median0.0018890232121178865
sim_compute_performance-ego0_min0.0018433068544810056
sim_compute_sim_state_max0.01260998708392502
sim_compute_sim_state_mean0.008780172282445885
sim_compute_sim_state_median0.008316539090794193
sim_compute_sim_state_min0.005877623864270131
sim_render-ego0_max0.003801285051832012
sim_render-ego0_mean0.0036641334878541863
sim_render-ego0_median0.003648768871202381
sim_render-ego0_min0.0035577111571799707
simulation-passed1
step_physics_max0.23831913517970665
step_physics_mean0.18801536856223444
step_physics_median0.1896011673007428
step_physics_min0.13454000446774544
survival_time_max6.499999999999985
survival_time_mean4.94999999999999
survival_time_min2.499999999999999
No reset possible
6192213422Raphael Jeanmobile-segmentation-pedestrianaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:21:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.759585240412077
survival_time_median24.25000000000021
deviation-center-line_median1.2481079536939768
in-drivable-lane_median6.350000000000035


other stats
agent_compute-ego0_max0.016655691858630833
agent_compute-ego0_mean0.01586636889814496
agent_compute-ego0_median0.015706572555200762
agent_compute-ego0_min0.015396638623547478
complete-iteration_max0.2823694329220074
complete-iteration_mean0.2371838827753473
complete-iteration_median0.23336511053916584
complete-iteration_min0.19963587710105013
deviation-center-line_max3.38683671527321
deviation-center-line_mean1.5451164035441285
deviation-center-line_min0.2974129915153503
deviation-heading_max13.201627455997563
deviation-heading_mean6.06031745367838
deviation-heading_median4.7213384236864835
deviation-heading_min1.5969655113429873
driven_any_max25.520904005844272
driven_any_mean12.938011035700333
driven_any_median9.911734929439197
driven_any_min6.407670278078661
driven_lanedir_consec_max24.446976113162652
driven_lanedir_consec_mean10.174479978122422
driven_lanedir_consec_min2.7317733185028756
driven_lanedir_max24.446976113162652
driven_lanedir_mean10.174479978122422
driven_lanedir_median6.759585240412077
driven_lanedir_min2.7317733185028756
get_duckie_state_max1.647688764815128e-06
get_duckie_state_mean1.5902576751410629e-06
get_duckie_state_median1.5938452279033458e-06
get_duckie_state_min1.525651479942431e-06
get_robot_state_max0.0036703099886070943
get_robot_state_mean0.0036161043353873986
get_robot_state_median0.0036222966429889695
get_robot_state_min0.0035495140669645616
get_state_dump_max0.0047647817653812445
get_state_dump_mean0.0045950118809440915
get_state_dump_median0.004586563610755745
get_state_dump_min0.004442138536883631
get_ui_image_max0.0359238904002109
get_ui_image_mean0.030597126834688293
get_ui_image_median0.030415498178987737
get_ui_image_min0.025633620580566813
in-drivable-lane_max10.55000000000015
in-drivable-lane_mean5.912500000000055
in-drivable-lane_min0.3999999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.013175707677878, "get_ui_image": 0.028128543605107, "step_physics": 0.1430070161440414, "survival_time": 31.40000000000031, "driven_lanedir": 8.40904119959618, "get_state_dump": 0.004548531078951158, "get_robot_state": 0.0036703099886070943, "sim_render-ego0": 0.003767927803561115, "get_duckie_state": 1.525651479942431e-06, "in-drivable-lane": 10.55000000000015, "deviation-heading": 4.97340009123082, "agent_compute-ego0": 0.015777656876604963, "complete-iteration": 0.2126145192284273, "set_robot_commands": 0.002323342430951675, "deviation-center-line": 1.5853346804249295, "driven_lanedir_consec": 8.40904119959618, "sim_compute_sim_state": 0.009282104540705112, "sim_compute_performance-ego0": 0.002017010945015378}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.810294151200515, "get_ui_image": 0.0359238904002109, "step_physics": 0.20216021037310275, "survival_time": 17.100000000000108, "driven_lanedir": 5.110129281227976, "get_state_dump": 0.004624596142560331, "get_robot_state": 0.0035947613396380457, "sim_render-ego0": 0.003701631251298999, "get_duckie_state": 1.638345746187705e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 4.469276756142147, "agent_compute-ego0": 0.016655691858630833, "complete-iteration": 0.2823694329220074, "set_robot_commands": 0.0021680172956372143, "deviation-center-line": 0.910881226963024, "driven_lanedir_consec": 5.110129281227976, "sim_compute_sim_state": 0.01150709477527496, "sim_compute_performance-ego0": 0.0019442715380699224}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.407670278078661, "get_ui_image": 0.03270245275286846, "step_physics": 0.17703078297034422, "survival_time": 15.80000000000009, "driven_lanedir": 2.7317733185028756, "get_state_dump": 0.0047647817653812445, "get_robot_state": 0.003649831946339893, "sim_render-ego0": 0.003754166022460167, "get_duckie_state": 1.5493447096189865e-06, "in-drivable-lane": 8.900000000000016, "deviation-heading": 1.5969655113429873, "agent_compute-ego0": 0.015396638623547478, "complete-iteration": 0.25411570184990434, "set_robot_commands": 0.0022231472027414603, "deviation-center-line": 0.2974129915153503, "driven_lanedir_consec": 2.7317733185028756, "sim_compute_sim_state": 0.012541890520402686, "sim_compute_performance-ego0": 0.0019658709926184043}, "LF-norm-small_loop-000-ego0": {"driven_any": 25.520904005844272, "get_ui_image": 0.025633620580566813, "step_physics": 0.1365620879507581, "survival_time": 59.99999999999873, "driven_lanedir": 24.446976113162652, "get_state_dump": 0.004442138536883631, "get_robot_state": 0.0035495140669645616, "sim_render-ego0": 0.0035858833224052793, "get_duckie_state": 1.647688764815128e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 13.201627455997563, "agent_compute-ego0": 0.015635488233796565, "complete-iteration": 0.19963587710105013, "set_robot_commands": 0.0021510080532864866, "deviation-center-line": 3.38683671527321, "driven_lanedir_consec": 24.446976113162652, "sim_compute_sim_state": 0.0061080249322641895, "sim_compute_performance-ego0": 0.00188448109495749}}
set_robot_commands_max0.002323342430951675
set_robot_commands_mean0.002216378745654209
set_robot_commands_median0.0021955822491893373
set_robot_commands_min0.0021510080532864866
sim_compute_performance-ego0_max0.002017010945015378
sim_compute_performance-ego0_mean0.0019529086426652987
sim_compute_performance-ego0_median0.0019550712653441634
sim_compute_performance-ego0_min0.00188448109495749
sim_compute_sim_state_max0.012541890520402686
sim_compute_sim_state_mean0.009859778692161736
sim_compute_sim_state_median0.010394599657990037
sim_compute_sim_state_min0.0061080249322641895
sim_render-ego0_max0.003767927803561115
sim_render-ego0_mean0.00370240209993139
sim_render-ego0_median0.0037278986368795832
sim_render-ego0_min0.0035858833224052793
simulation-passed1
step_physics_max0.20216021037310275
step_physics_mean0.16469002435956162
step_physics_median0.1600188995571928
step_physics_min0.1365620879507581
survival_time_max59.99999999999873
survival_time_mean31.07499999999981
survival_time_min15.80000000000009
No reset possible
6192113421Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:37:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.728535821981438
survival_time_median59.99999999999873
deviation-center-line_median3.6161303184123295
in-drivable-lane_median0.17499999999999005


other stats
agent_compute-ego0_max0.012229612526746711
agent_compute-ego0_mean0.011994238151896508
agent_compute-ego0_median0.01200392948995522
agent_compute-ego0_min0.011739481100928872
complete-iteration_max0.2226836353813381
complete-iteration_mean0.1921596190117479
complete-iteration_median0.19260196185528888
complete-iteration_min0.16075091695507598
deviation-center-line_max4.101027929971816
deviation-center-line_mean3.544518694054996
deviation-center-line_min2.8447862094235083
deviation-heading_max12.5721717669159
deviation-heading_mean10.405488325523132
deviation-heading_median10.587468677286765
deviation-heading_min7.874844180603106
driven_any_max12.08991394913746
driven_any_mean12.087396707125611
driven_any_median12.08979995449807
driven_any_min12.080072970368846
driven_lanedir_consec_max11.907854153513227
driven_lanedir_consec_mean11.753060220040055
driven_lanedir_consec_min11.647315082684123
driven_lanedir_max11.907854153513227
driven_lanedir_mean11.753060220040055
driven_lanedir_median11.728535821981438
driven_lanedir_min11.647315082684123
get_duckie_state_max1.287976470616934e-06
get_duckie_state_mean1.2151704640511568e-06
get_duckie_state_median1.2037061235489793e-06
get_duckie_state_min1.1652931384897352e-06
get_robot_state_max0.003609224124117557
get_robot_state_mean0.003552902399947701
get_robot_state_median0.0035373985916252043
get_robot_state_min0.0035275882924228385
get_state_dump_max0.004687716025893238
get_state_dump_mean0.004522711956729301
get_state_dump_median0.004506909976295388
get_state_dump_min0.004389311848433191
get_ui_image_max0.035632823528000755
get_ui_image_mean0.030801075285022995
get_ui_image_median0.03058134566536553
get_ui_image_min0.02640878628136018
in-drivable-lane_max0.649999999999963
in-drivable-lane_mean0.2499999999999858
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.080072970368846, "get_ui_image": 0.028103379583874908, "step_physics": 0.09558979240087148, "survival_time": 59.99999999999873, "driven_lanedir": 11.907854153513227, "get_state_dump": 0.004484286216970884, "get_robot_state": 0.003609224124117557, "sim_render-ego0": 0.003686782819444591, "get_duckie_state": 1.2032098317523484e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.874844180603106, "agent_compute-ego0": 0.011739481100928872, "complete-iteration": 0.16075091695507598, "set_robot_commands": 0.00216209144020557, "deviation-center-line": 2.8447862094235083, "driven_lanedir_consec": 11.907854153513227, "sim_compute_sim_state": 0.00938091289987175, "sim_compute_performance-ego0": 0.0019160474369071304}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.089798864083322, "get_ui_image": 0.035632823528000755, "step_physics": 0.1459129470075596, "survival_time": 59.99999999999873, "driven_lanedir": 11.647315082684123, "get_state_dump": 0.004389311848433191, "get_robot_state": 0.0035275882924228385, "sim_render-ego0": 0.003608407029303583, "get_duckie_state": 1.2042024153456104e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 12.5721717669159, "agent_compute-ego0": 0.01185473256265988, "complete-iteration": 0.2226836353813381, "set_robot_commands": 0.0021428240030433214, "deviation-center-line": 4.101027929971816, "driven_lanedir_consec": 11.647315082684123, "sim_compute_sim_state": 0.01367257179368247, "sim_compute_performance-ego0": 0.0018644579046473316}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.08991394913746, "get_ui_image": 0.033059311746856154, "step_physics": 0.13714284702304202, "survival_time": 59.99999999999873, "driven_lanedir": 11.669191742260884, "get_state_dump": 0.004687716025893238, "get_robot_state": 0.0035403185740398627, "sim_render-ego0": 0.003690877028250079, "get_duckie_state": 1.287976470616934e-06, "in-drivable-lane": 0.649999999999963, "deviation-heading": 10.101257726291248, "agent_compute-ego0": 0.012229612526746711, "complete-iteration": 0.2113228316708072, "set_robot_commands": 0.002111946911140842, "deviation-center-line": 3.438514498109819, "driven_lanedir_consec": 11.669191742260884, "sim_compute_sim_state": 0.012881247626057671, "sim_compute_performance-ego0": 0.0018985720101641576}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.089801044912816, "get_ui_image": 0.02640878628136018, "step_physics": 0.11329076391374142, "survival_time": 59.99999999999873, "driven_lanedir": 11.787879901701992, "get_state_dump": 0.004529533735619894, "get_robot_state": 0.0035344786092105455, "sim_render-ego0": 0.003627877747585732, "get_duckie_state": 1.1652931384897352e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.073679628282278, "agent_compute-ego0": 0.012153126417250555, "complete-iteration": 0.17388109203977054, "set_robot_commands": 0.002123599048458865, "deviation-center-line": 3.79374613871484, "driven_lanedir_consec": 11.787879901701992, "sim_compute_sim_state": 0.006270204952217757, "sim_compute_performance-ego0": 0.0018641670776545056}}
set_robot_commands_max0.00216209144020557
set_robot_commands_mean0.00213511535071215
set_robot_commands_median0.002133211525751093
set_robot_commands_min0.002111946911140842
sim_compute_performance-ego0_max0.0019160474369071304
sim_compute_performance-ego0_mean0.0018858111073432817
sim_compute_performance-ego0_median0.0018815149574057445
sim_compute_performance-ego0_min0.0018641670776545056
sim_compute_sim_state_max0.01367257179368247
sim_compute_sim_state_mean0.010551234317957412
sim_compute_sim_state_median0.01113108026296471
sim_compute_sim_state_min0.006270204952217757
sim_render-ego0_max0.003690877028250079
sim_render-ego0_mean0.003653486156145996
sim_render-ego0_median0.0036573302835151617
sim_render-ego0_min0.003608407029303583
simulation-passed1
step_physics_max0.1459129470075596
step_physics_mean0.12298408758630364
step_physics_median0.12521680546839173
step_physics_min0.09558979240087148
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6192013420Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.074999999999994
in-drivable-lane_median0.9999999999999964
driven_lanedir_consec_median1.0602065957668216
deviation-center-line_median0.1850549920190991


other stats
agent_compute-ego0_max0.0172612468401591
agent_compute-ego0_mean0.016080795372556078
agent_compute-ego0_median0.016029422653132473
agent_compute-ego0_min0.015003089343800263
complete-iteration_max0.34748145937919617
complete-iteration_mean0.27929733733346207
complete-iteration_median0.2843972646198698
complete-iteration_min0.2009133607149124
deviation-center-line_max0.2483206725401143
deviation-center-line_mean0.17972194797234575
deviation-center-line_min0.10045713531107033
deviation-heading_max1.2368586350949706
deviation-heading_mean0.7119002064464027
deviation-heading_median0.5754565653867711
deviation-heading_min0.4598290599170981
driven_any_max2.698380158366798
driven_any_mean1.4964678022879652
driven_any_median1.3756173858472858
driven_any_min0.5362562790904905
driven_lanedir_consec_max1.8192505266100112
driven_lanedir_consec_mean1.1139295716795536
driven_lanedir_consec_min0.5160545685745596
driven_lanedir_max1.8192505266100112
driven_lanedir_mean1.1139295716795536
driven_lanedir_median1.0602065957668216
driven_lanedir_min0.5160545685745596
get_duckie_state_max0.024269396683265426
get_duckie_state_mean0.01712923157378336
get_duckie_state_median0.020078292839667375
get_duckie_state_min0.004090943932533264
get_robot_state_max0.0036695400873819986
get_robot_state_mean0.0035900884243062095
get_robot_state_median0.003579251057115094
get_robot_state_min0.0035323114956126492
get_state_dump_max0.00850800974615689
get_state_dump_mean0.007340126303279617
get_state_dump_median0.007795295732862809
get_state_dump_min0.005261904001235962
get_ui_image_max0.039093012611071266
get_ui_image_mean0.03385037120338466
get_ui_image_median0.03461371483715746
get_ui_image_min0.027081042528152462
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean1.137499999999996
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.698380158366798, "get_ui_image": 0.03309883578070279, "step_physics": 0.16576004686026738, "survival_time": 7.199999999999982, "driven_lanedir": 1.8192505266100112, "get_state_dump": 0.00850800974615689, "get_robot_state": 0.0035997144107160896, "sim_render-ego0": 0.0036814771849533606, "get_duckie_state": 0.024269396683265426, "in-drivable-lane": 2.549999999999991, "deviation-heading": 1.2368586350949706, "agent_compute-ego0": 0.016471336627828664, "complete-iteration": 0.26708123930569355, "set_robot_commands": 0.002088201457056506, "deviation-center-line": 0.2483206725401143, "driven_lanedir_consec": 1.8192505266100112, "sim_compute_sim_state": 0.007641700218463767, "sim_compute_performance-ego0": 0.001877617013865504}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5362562790904905, "get_ui_image": 0.039093012611071266, "step_physics": 0.24192946155865988, "survival_time": 2.3499999999999996, "driven_lanedir": 0.5160545685745596, "get_state_dump": 0.007906332612037659, "get_robot_state": 0.0036695400873819986, "sim_render-ego0": 0.0038095364967981977, "get_duckie_state": 0.020398467779159542, "in-drivable-lane": 0.0, "deviation-heading": 0.6544876960967536, "agent_compute-ego0": 0.0172612468401591, "complete-iteration": 0.34748145937919617, "set_robot_commands": 0.0023579845825831094, "deviation-center-line": 0.16477990916953614, "driven_lanedir_consec": 0.5160545685745596, "sim_compute_sim_state": 0.00899068514506022, "sim_compute_performance-ego0": 0.001979296406110128}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.4717787326816925, "get_ui_image": 0.03612859389361213, "step_physics": 0.19951329511754656, "survival_time": 4.199999999999993, "driven_lanedir": 1.451223383944342, "get_state_dump": 0.00768425885368796, "get_robot_state": 0.0035323114956126492, "sim_render-ego0": 0.003587173013126149, "get_duckie_state": 0.019758117900175207, "in-drivable-lane": 0.0, "deviation-heading": 0.4598290599170981, "agent_compute-ego0": 0.015003089343800263, "complete-iteration": 0.3017132899340461, "set_robot_commands": 0.002047168507295496, "deviation-center-line": 0.20533007486866217, "driven_lanedir_consec": 1.451223383944342, "sim_compute_sim_state": 0.012548488729140338, "sim_compute_performance-ego0": 0.001833046183866613}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.2794560390128789, "get_ui_image": 0.027081042528152462, "step_physics": 0.13098457753658294, "survival_time": 3.949999999999994, "driven_lanedir": 0.6691898075893014, "get_state_dump": 0.005261904001235962, "get_robot_state": 0.0035587877035140993, "sim_render-ego0": 0.003901553153991699, "get_duckie_state": 0.004090943932533264, "in-drivable-lane": 1.999999999999993, "deviation-heading": 0.4964254346767887, "agent_compute-ego0": 0.01558750867843628, "complete-iteration": 0.2009133607149124, "set_robot_commands": 0.002279222011566162, "deviation-center-line": 0.10045713531107033, "driven_lanedir_consec": 0.6691898075893014, "sim_compute_sim_state": 0.0061116814613342285, "sim_compute_performance-ego0": 0.0019718557596206665}}
set_robot_commands_max0.0023579845825831094
set_robot_commands_mean0.0021931441396253184
set_robot_commands_median0.002183711734311334
set_robot_commands_min0.002047168507295496
sim_compute_performance-ego0_max0.001979296406110128
sim_compute_performance-ego0_mean0.001915453840865728
sim_compute_performance-ego0_median0.0019247363867430853
sim_compute_performance-ego0_min0.001833046183866613
sim_compute_sim_state_max0.012548488729140338
sim_compute_sim_state_mean0.00882313888849964
sim_compute_sim_state_median0.008316192681761994
sim_compute_sim_state_min0.0061116814613342285
sim_render-ego0_max0.003901553153991699
sim_render-ego0_mean0.003744934962217351
sim_render-ego0_median0.0037455068408757783
sim_render-ego0_min0.003587173013126149
simulation-passed1
step_physics_max0.24192946155865988
step_physics_mean0.18454684526826415
step_physics_median0.18263667098890696
step_physics_min0.13098457753658294
survival_time_max7.199999999999982
survival_time_mean4.424999999999992
survival_time_min2.3499999999999996
No reset possible
6191913420Raphael Jeanmobile-segmentation-pedestrianaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:04:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.624999999999991
in-drivable-lane_median0.274999999999999
driven_lanedir_consec_median1.176990246628138
deviation-center-line_median0.25598351906723815


other stats
agent_compute-ego0_max0.01859439184906286
agent_compute-ego0_mean0.01727148016720793
agent_compute-ego0_median0.017089162210623423
agent_compute-ego0_min0.016313204398522012
complete-iteration_max0.3473513474067052
complete-iteration_mean0.2820012280565448
complete-iteration_median0.29428455435901607
complete-iteration_min0.192084456101442
deviation-center-line_max0.34362939594201414
deviation-center-line_mean0.25513476420187364
deviation-center-line_min0.16494262273100407
deviation-heading_max1.4568160051878822
deviation-heading_mean1.0644832035659164
deviation-heading_median1.0594534713699346
deviation-heading_min0.6822098663359144
driven_any_max2.248241372777031
driven_any_mean1.4865067382528407
driven_any_median1.5808377414238195
driven_any_min0.5361100973866928
driven_lanedir_consec_max2.1789342423963185
driven_lanedir_consec_mean1.261777772898623
driven_lanedir_consec_min0.5141963559418973
driven_lanedir_max2.1789342423963185
driven_lanedir_mean1.261777772898623
driven_lanedir_median1.176990246628138
driven_lanedir_min0.5141963559418973
get_duckie_state_max0.02487146186828613
get_duckie_state_mean0.017540513145491758
get_duckie_state_median0.02056071613359889
get_duckie_state_min0.004169158446483123
get_robot_state_max0.0036849119724371494
get_robot_state_mean0.0036606600866741753
get_robot_state_median0.003661573251088461
get_robot_state_min0.0036345818720826314
get_state_dump_max0.008596878051757812
get_state_dump_mean0.00750476222743822
get_state_dump_median0.00807510822191151
get_state_dump_min0.0052719544141720505
get_ui_image_max0.03964597483476003
get_ui_image_mean0.03386215709317042
get_ui_image_median0.03448471400934622
get_ui_image_min0.026833225519229204
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.549999999999998
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.248241372777031, "get_ui_image": 0.03275798988342285, "step_physics": 0.1802441177368164, "survival_time": 6.199999999999986, "driven_lanedir": 2.1789342423963185, "get_state_dump": 0.008596878051757812, "get_robot_state": 0.0036433544158935545, "sim_render-ego0": 0.0037403526306152343, "get_duckie_state": 0.02487146186828613, "in-drivable-lane": 0.0, "deviation-heading": 1.411659975334146, "agent_compute-ego0": 0.01652229118347168, "complete-iteration": 0.2824538707733154, "set_robot_commands": 0.0021862697601318357, "deviation-center-line": 0.34362939594201414, "driven_lanedir_consec": 2.1789342423963185, "sim_compute_sim_state": 0.007843345642089843, "sim_compute_performance-ego0": 0.001957012176513672}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5361100973866928, "get_ui_image": 0.03964597483476003, "step_physics": 0.2404788831869761, "survival_time": 2.3499999999999996, "driven_lanedir": 0.5141963559418973, "get_state_dump": 0.008123397827148438, "get_robot_state": 0.0036797920862833657, "sim_render-ego0": 0.003822192549705506, "get_duckie_state": 0.02077612280845642, "in-drivable-lane": 0.0, "deviation-heading": 0.6822098663359144, "agent_compute-ego0": 0.017656033237775166, "complete-iteration": 0.3473513474067052, "set_robot_commands": 0.0021868695815404258, "deviation-center-line": 0.17254508701405805, "driven_lanedir_consec": 0.5141963559418973, "sim_compute_sim_state": 0.008920460939407349, "sim_compute_performance-ego0": 0.0019723822673161826}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.960822850256018, "get_ui_image": 0.036211438135269586, "step_physics": 0.1984590215420504, "survival_time": 5.399999999999989, "driven_lanedir": 1.625303333749585, "get_state_dump": 0.008026818616674581, "get_robot_state": 0.0036345818720826314, "sim_render-ego0": 0.003748834679979797, "get_duckie_state": 0.020345309458741353, "in-drivable-lane": 0.549999999999998, "deviation-heading": 1.4568160051878822, "agent_compute-ego0": 0.01859439184906286, "complete-iteration": 0.30611523794471673, "set_robot_commands": 0.0021968872175304167, "deviation-center-line": 0.33942195112041823, "driven_lanedir_consec": 1.625303333749585, "sim_compute_sim_state": 0.012908515580203554, "sim_compute_performance-ego0": 0.0018988552443478088}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.200852632591621, "get_ui_image": 0.026833225519229204, "step_physics": 0.12192654609680176, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7286771595066913, "get_state_dump": 0.0052719544141720505, "get_robot_state": 0.0036849119724371494, "sim_render-ego0": 0.003768178132864145, "get_duckie_state": 0.004169158446483123, "in-drivable-lane": 1.649999999999994, "deviation-heading": 0.7072469674057235, "agent_compute-ego0": 0.016313204398522012, "complete-iteration": 0.192084456101442, "set_robot_commands": 0.002188887351598495, "deviation-center-line": 0.16494262273100407, "driven_lanedir_consec": 0.7286771595066913, "sim_compute_sim_state": 0.005910634994506836, "sim_compute_performance-ego0": 0.0019314197393564077}}
set_robot_commands_max0.0021968872175304167
set_robot_commands_mean0.0021897284777002935
set_robot_commands_median0.0021878784665694605
set_robot_commands_min0.0021862697601318357
sim_compute_performance-ego0_max0.0019723822673161826
sim_compute_performance-ego0_mean0.0019399173568835175
sim_compute_performance-ego0_median0.00194421595793504
sim_compute_performance-ego0_min0.0018988552443478088
sim_compute_sim_state_max0.012908515580203554
sim_compute_sim_state_mean0.008895739289051895
sim_compute_sim_state_median0.008381903290748595
sim_compute_sim_state_min0.005910634994506836
sim_render-ego0_max0.003822192549705506
sim_render-ego0_mean0.0037698894982911703
sim_render-ego0_median0.0037585064064219703
sim_render-ego0_min0.0037403526306152343
simulation-passed1
step_physics_max0.2404788831869761
step_physics_mean0.18527714214066116
step_physics_median0.1893515696394334
step_physics_min0.12192654609680176
survival_time_max6.199999999999986
survival_time_mean4.449999999999992
survival_time_min2.3499999999999996
No reset possible
6191713418Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.440777672323755
survival_time_median59.42499999999876
deviation-center-line_median3.073818110721355
in-drivable-lane_median6.874999999999924


other stats
agent_compute-ego0_max0.016300840037209646
agent_compute-ego0_mean0.015566582341704247
agent_compute-ego0_median0.015547759739813895
agent_compute-ego0_min0.01486996984997955
complete-iteration_max0.25420300109045846
complete-iteration_mean0.21719863060541883
complete-iteration_median0.21621844802460757
complete-iteration_min0.18215462528200177
deviation-center-line_max4.30116499363939
deviation-center-line_mean2.653965095733888
deviation-center-line_min0.1670591678534524
deviation-heading_max10.136798928234418
deviation-heading_mean7.290994369975312
deviation-heading_median8.916762383650426
deviation-heading_min1.193653784365978
driven_any_max28.758948865140333
driven_any_mean22.044988584516712
driven_any_median28.33362013614945
driven_any_min2.753765200627609
driven_lanedir_consec_max26.46346270302903
driven_lanedir_consec_mean18.07610943614705
driven_lanedir_consec_min0.9594196969116492
driven_lanedir_max26.46346270302903
driven_lanedir_mean18.07610943614705
driven_lanedir_median22.440777672323755
driven_lanedir_min0.9594196969116492
get_duckie_state_max1.3098133096687006e-06
get_duckie_state_mean1.2325421280119751e-06
get_duckie_state_median1.215123737028956e-06
get_duckie_state_min1.1901077283212882e-06
get_robot_state_max0.0035774106687924655
get_robot_state_mean0.0035486358471394264
get_robot_state_median0.0035527288630131494
get_robot_state_min0.0035116749937389416
get_state_dump_max0.004578996359756051
get_state_dump_mean0.0044517307482020586
get_state_dump_median0.004423280505916605
get_state_dump_min0.004381365621218971
get_ui_image_max0.0355435848236084
get_ui_image_mean0.030419795102105504
get_ui_image_median0.03029799179447413
get_ui_image_min0.025539611995865363
in-drivable-lane_max12.849999999999763
in-drivable-lane_mean7.562499999999857
in-drivable-lane_min3.6499999999998174
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 28.22248321311745, "get_ui_image": 0.02820909124481253, "step_physics": 0.13084570377913315, "survival_time": 58.84999999999879, "driven_lanedir": 26.46346270302903, "get_state_dump": 0.004422939289203119, "get_robot_state": 0.0035774106687924655, "sim_render-ego0": 0.003620287760813896, "get_duckie_state": 1.239857568400825e-06, "in-drivable-lane": 3.6499999999998174, "deviation-heading": 7.978669259865285, "agent_compute-ego0": 0.015606529239078126, "complete-iteration": 0.1996226229772908, "set_robot_commands": 0.002195869925066652, "deviation-center-line": 2.9882607571780206, "driven_lanedir_consec": 26.46346270302903, "sim_compute_sim_state": 0.0091799066507958, "sim_compute_performance-ego0": 0.0018866060140379825}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.753765200627609, "get_ui_image": 0.0355435848236084, "step_physics": 0.1764485444341387, "survival_time": 6.949999999999983, "driven_lanedir": 0.9594196969116492, "get_state_dump": 0.004423621722630092, "get_robot_state": 0.0035428711346217564, "sim_render-ego0": 0.0036323904991149903, "get_duckie_state": 1.190389905657087e-06, "in-drivable-lane": 4.249999999999985, "deviation-heading": 1.193653784365978, "agent_compute-ego0": 0.016300840037209646, "complete-iteration": 0.25420300109045846, "set_robot_commands": 0.002160540648869106, "deviation-center-line": 0.1670591678534524, "driven_lanedir_consec": 0.9594196969116492, "sim_compute_sim_state": 0.010208792345864432, "sim_compute_performance-ego0": 0.0018658978598458424}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.758948865140333, "get_ui_image": 0.03238689234413573, "step_physics": 0.15657047764844045, "survival_time": 59.99999999999873, "driven_lanedir": 21.718862263570784, "get_state_dump": 0.004578996359756051, "get_robot_state": 0.0035625865914045425, "sim_render-ego0": 0.003659195943637057, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 12.849999999999763, "deviation-heading": 10.136798928234418, "agent_compute-ego0": 0.01486996984997955, "complete-iteration": 0.23281427307192432, "set_robot_commands": 0.00214589287299697, "deviation-center-line": 3.1593754642646887, "driven_lanedir_consec": 21.718862263570784, "sim_compute_sim_state": 0.013060217793041423, "sim_compute_performance-ego0": 0.0018999816773833083}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.444757059181452, "get_ui_image": 0.025539611995865363, "step_physics": 0.11947235735528772, "survival_time": 59.99999999999873, "driven_lanedir": 23.16269308107673, "get_state_dump": 0.004381365621218971, "get_robot_state": 0.0035116749937389416, "sim_render-ego0": 0.0035588516978598155, "get_duckie_state": 1.1901077283212882e-06, "in-drivable-lane": 9.49999999999986, "deviation-heading": 9.854855507435568, "agent_compute-ego0": 0.015488990240549665, "complete-iteration": 0.18215462528200177, "set_robot_commands": 0.002145248289211505, "deviation-center-line": 4.30116499363939, "driven_lanedir_consec": 23.16269308107673, "sim_compute_sim_state": 0.006126629720619577, "sim_compute_performance-ego0": 0.0018528837843997392}}
set_robot_commands_max0.002195869925066652
set_robot_commands_mean0.002161887934036058
set_robot_commands_median0.0021532167609330374
set_robot_commands_min0.002145248289211505
sim_compute_performance-ego0_max0.0018999816773833083
sim_compute_performance-ego0_mean0.001876342333916718
sim_compute_performance-ego0_median0.0018762519369419123
sim_compute_performance-ego0_min0.0018528837843997392
sim_compute_sim_state_max0.013060217793041423
sim_compute_sim_state_mean0.009643886627580308
sim_compute_sim_state_median0.009694349498330116
sim_compute_sim_state_min0.006126629720619577
sim_render-ego0_max0.003659195943637057
sim_render-ego0_mean0.00361768147535644
sim_render-ego0_median0.003626339129964443
sim_render-ego0_min0.0035588516978598155
simulation-passed1
step_physics_max0.1764485444341387
step_physics_mean0.14583427080425002
step_physics_median0.14370809071378682
step_physics_min0.11947235735528772
survival_time_max59.99999999999873
survival_time_mean46.44999999999906
survival_time_min6.949999999999983
No reset possible
6191613417Sara Qunaibi 🇯🇴baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6191013413Jerome Labonte 🇨🇦real-exercise-3aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.4399723044420085
survival_time_median59.99999999999873
deviation-center-line_median3.8459819237280657
in-drivable-lane_median5.349999999999735


other stats
agent_compute-ego0_max0.017083491215003122
agent_compute-ego0_mean0.016260990790780836
agent_compute-ego0_median0.016237362834635026
agent_compute-ego0_min0.015485746278850163
complete-iteration_max0.20012824025181905
complete-iteration_mean0.17875627847039433
complete-iteration_median0.17991688527433602
complete-iteration_min0.1550631030810862
deviation-center-line_max5.879712823082976
deviation-center-line_mean4.106852933166374
deviation-center-line_min2.8557350621263904
deviation-heading_max11.075592240830142
deviation-heading_mean8.757803827983414
deviation-heading_median8.767200735083026
deviation-heading_min6.421221600937464
driven_any_max7.921035072210141
driven_any_mean7.919377713243758
driven_any_median7.920969123554562
driven_any_min7.914537533655768
driven_lanedir_consec_max7.129579974309771
driven_lanedir_consec_mean6.022780153556209
driven_lanedir_consec_min4.081596031031047
driven_lanedir_max7.3563012026646675
driven_lanedir_mean6.841456446464614
driven_lanedir_median6.934681689582845
driven_lanedir_min6.140161204028097
get_duckie_state_max1.153977685526547e-06
get_duckie_state_mean1.123257223315084e-06
get_duckie_state_median1.1275749619457745e-06
get_duckie_state_min1.0839012838422409e-06
get_robot_state_max0.0035602031996804016
get_robot_state_mean0.003523514679726911
get_robot_state_median0.0035198085214772096
get_robot_state_min0.0034942384762728243
get_state_dump_max0.0045025596809228395
get_state_dump_mean0.004406948421122529
get_state_dump_median0.004393372607171585
get_state_dump_min0.0043384887892241085
get_ui_image_max0.0357881215688688
get_ui_image_mean0.03058370647581293
get_ui_image_median0.03048713032550161
get_ui_image_min0.025572443683379693
in-drivable-lane_max12.149999999999553
in-drivable-lane_mean6.462499999999766
in-drivable-lane_min3.000000000000042
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914537533655768, "get_ui_image": 0.028462903287190384, "step_physics": 0.09798842226833626, "survival_time": 59.99999999999873, "driven_lanedir": 7.3563012026646675, "get_state_dump": 0.0045025596809228395, "get_robot_state": 0.0035602031996804016, "sim_render-ego0": 0.00369555705989231, "get_duckie_state": 1.1164580257012386e-06, "in-drivable-lane": 3.000000000000042, "deviation-heading": 6.421221600937464, "agent_compute-ego0": 0.016074105563707693, "complete-iteration": 0.16857134114693445, "set_robot_commands": 0.0021495356547842413, "deviation-center-line": 2.8557350621263904, "driven_lanedir_consec": 4.081596031031047, "sim_compute_sim_state": 0.010149943441475162, "sim_compute_performance-ego0": 0.0019136840953715736}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921035072210141, "get_ui_image": 0.0357881215688688, "step_physics": 0.11927888157167205, "survival_time": 59.99999999999873, "driven_lanedir": 7.129579974309771, "get_state_dump": 0.0043384887892241085, "get_robot_state": 0.003516558107984354, "sim_render-ego0": 0.003611222393407512, "get_duckie_state": 1.0839012838422409e-06, "in-drivable-lane": 3.9499999999997897, "deviation-heading": 11.075592240830142, "agent_compute-ego0": 0.017083491215003122, "complete-iteration": 0.20012824025181905, "set_robot_commands": 0.002179001094300384, "deviation-center-line": 4.218680739940799, "driven_lanedir_consec": 7.129579974309771, "sim_compute_sim_state": 0.012376546462707774, "sim_compute_performance-ego0": 0.0018813782786449528}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.920999718939692, "get_ui_image": 0.03251135736381283, "step_physics": 0.11459346456789753, "survival_time": 59.99999999999873, "driven_lanedir": 6.7397834048559195, "get_state_dump": 0.00443308776264683, "get_robot_state": 0.0034942384762728243, "sim_render-ego0": 0.0035801156176615517, "get_duckie_state": 1.13869189819031e-06, "in-drivable-lane": 6.74999999999968, "deviation-heading": 10.14516444994689, "agent_compute-ego0": 0.015485746278850163, "complete-iteration": 0.19126242940173757, "set_robot_commands": 0.00205021674785884, "deviation-center-line": 3.4732831075153325, "driven_lanedir_consec": 6.7397834048559195, "sim_compute_sim_state": 0.013200459134866557, "sim_compute_performance-ego0": 0.001843061971227692}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920938528169431, "get_ui_image": 0.025572443683379693, "step_physics": 0.09148670175887463, "survival_time": 59.99999999999873, "driven_lanedir": 6.140161204028097, "get_state_dump": 0.00435365745169634, "get_robot_state": 0.003523058934970065, "sim_render-ego0": 0.0035762628051859455, "get_duckie_state": 1.153977685526547e-06, "in-drivable-lane": 12.149999999999553, "deviation-heading": 7.389237020219164, "agent_compute-ego0": 0.016400620105562362, "complete-iteration": 0.1550631030810862, "set_robot_commands": 0.002183049247227144, "deviation-center-line": 5.879712823082976, "driven_lanedir_consec": 6.140161204028097, "sim_compute_sim_state": 0.006028651595611953, "sim_compute_performance-ego0": 0.0018670070578315472}}
set_robot_commands_max0.002183049247227144
set_robot_commands_mean0.0021404506860426523
set_robot_commands_median0.0021642683745423125
set_robot_commands_min0.00205021674785884
sim_compute_performance-ego0_max0.0019136840953715736
sim_compute_performance-ego0_mean0.0018762828507689416
sim_compute_performance-ego0_median0.00187419266823825
sim_compute_performance-ego0_min0.001843061971227692
sim_compute_sim_state_max0.013200459134866557
sim_compute_sim_state_mean0.01043890015866536
sim_compute_sim_state_median0.011263244952091469
sim_compute_sim_state_min0.006028651595611953
sim_render-ego0_max0.00369555705989231
sim_render-ego0_mean0.0036157894690368297
sim_render-ego0_median0.003595669005534532
sim_render-ego0_min0.0035762628051859455
simulation-passed1
step_physics_max0.11927888157167205
step_physics_mean0.10583686754169512
step_physics_median0.1062909434181169
step_physics_min0.09148670175887463
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6190913410Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.25213774739314
survival_time_median59.99999999999873
deviation-center-line_median3.25574814101218
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego0_max0.01197238488558627
agent_compute-ego0_mean0.011777411591103432
agent_compute-ego0_median0.011783660301856454
agent_compute-ego0_min0.01156994087511455
complete-iteration_max0.2070264051994813
complete-iteration_mean0.17775056374063103
complete-iteration_median0.1739727761922133
complete-iteration_min0.15603029737861626
deviation-center-line_max3.2963063512832877
deviation-center-line_mean3.0961937508693613
deviation-center-line_min2.5769723701697957
deviation-heading_max11.297181242226518
deviation-heading_mean9.463216188932604
deviation-heading_median10.00523539815606
deviation-heading_min6.545212717191776
driven_any_max11.673039391252903
driven_any_mean11.67064454286869
driven_any_median11.672996331793705
driven_any_min11.663546116634452
driven_lanedir_consec_max11.55665548664216
driven_lanedir_consec_mean11.246881031586234
driven_lanedir_consec_min10.926593144916495
driven_lanedir_max11.55665548664216
driven_lanedir_mean11.246881031586234
driven_lanedir_median11.25213774739314
driven_lanedir_min10.926593144916495
get_duckie_state_max1.840051465189328e-06
get_duckie_state_mean1.6961268441663197e-06
get_duckie_state_median1.6650589776972152e-06
get_duckie_state_min1.6143379560815206e-06
get_robot_state_max0.0035962437114350305
get_robot_state_mean0.0035084890485504684
get_robot_state_median0.0034912401790126576
get_robot_state_min0.003455232124741528
get_state_dump_max0.004493585732656157
get_state_dump_mean0.004373326289663704
get_state_dump_median0.004354703138511842
get_state_dump_min0.004290313148974975
get_ui_image_max0.03531388041379549
get_ui_image_mean0.030291164695571405
get_ui_image_median0.03015433689835268
get_ui_image_min0.025542104571784765
in-drivable-lane_max2.499999999999993
in-drivable-lane_mean0.9499999999999972
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.663546116634452, "get_ui_image": 0.028323472489127508, "step_physics": 0.09202624697371584, "survival_time": 59.99999999999873, "driven_lanedir": 11.55665548664216, "get_state_dump": 0.004493585732656157, "get_robot_state": 0.0035962437114350305, "sim_render-ego0": 0.003761122566178677, "get_duckie_state": 1.840051465189328e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.545212717191776, "agent_compute-ego0": 0.011965071331154396, "complete-iteration": 0.15782025751722148, "set_robot_commands": 0.0022099077651939426, "deviation-center-line": 2.5769723701697957, "driven_lanedir_consec": 11.55665548664216, "sim_compute_sim_state": 0.00941124625448184, "sim_compute_performance-ego0": 0.0019544000728839044}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.6730256935455, "get_ui_image": 0.03531388041379549, "step_physics": 0.13073712582393648, "survival_time": 59.99999999999873, "driven_lanedir": 10.926593144916495, "get_state_dump": 0.004381399170544423, "get_robot_state": 0.003476508551096539, "sim_render-ego0": 0.0035568282169465915, "get_duckie_state": 1.6389540291944213e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 10.216340999321728, "agent_compute-ego0": 0.01197238488558627, "complete-iteration": 0.2070264051994813, "set_robot_commands": 0.002177480853268943, "deviation-center-line": 3.2963063512832877, "driven_lanedir_consec": 10.926593144916495, "sim_compute_sim_state": 0.013506017259316678, "sim_compute_performance-ego0": 0.0018309584068914536}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.673039391252903, "get_ui_image": 0.03198520130757785, "step_physics": 0.11881474710126204, "survival_time": 59.99999999999873, "driven_lanedir": 11.336902125779938, "get_state_dump": 0.004290313148974975, "get_robot_state": 0.003455232124741528, "sim_render-ego0": 0.003518900208231015, "get_duckie_state": 1.691163926200009e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.297181242226518, "agent_compute-ego0": 0.011602249272558512, "complete-iteration": 0.19012529486720509, "set_robot_commands": 0.002008083758008768, "deviation-center-line": 3.286151303048689, "driven_lanedir_consec": 11.336902125779938, "sim_compute_sim_state": 0.012556242605331638, "sim_compute_performance-ego0": 0.001821397643204434}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672966970041909, "get_ui_image": 0.025542104571784765, "step_physics": 0.09747716906068724, "survival_time": 59.99999999999873, "driven_lanedir": 11.16737336900634, "get_state_dump": 0.00432800710647926, "get_robot_state": 0.003505971806928776, "sim_render-ego0": 0.003562390258369795, "get_duckie_state": 1.6143379560815206e-06, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 9.794129796990392, "agent_compute-ego0": 0.01156994087511455, "complete-iteration": 0.15603029737861626, "set_robot_commands": 0.0020629448457919588, "deviation-center-line": 3.225344978975672, "driven_lanedir_consec": 11.16737336900634, "sim_compute_sim_state": 0.0060564574353601614, "sim_compute_performance-ego0": 0.0018508281437780937}}
set_robot_commands_max0.0022099077651939426
set_robot_commands_mean0.0021146043055659033
set_robot_commands_median0.002120212849530451
set_robot_commands_min0.002008083758008768
sim_compute_performance-ego0_max0.0019544000728839044
sim_compute_performance-ego0_mean0.0018643960666894712
sim_compute_performance-ego0_median0.0018408932753347736
sim_compute_performance-ego0_min0.001821397643204434
sim_compute_sim_state_max0.013506017259316678
sim_compute_sim_state_mean0.01038249088862258
sim_compute_sim_state_median0.01098374442990674
sim_compute_sim_state_min0.0060564574353601614
sim_render-ego0_max0.003761122566178677
sim_render-ego0_mean0.003599810312431519
sim_render-ego0_median0.0035596092376581935
sim_render-ego0_min0.003518900208231015
simulation-passed1
step_physics_max0.13073712582393648
step_physics_mean0.10976382223990042
step_physics_median0.10814595808097464
step_physics_min0.09202624697371584
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6190813409Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:22:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.655314014515708
survival_time_median39.24999999999979
deviation-center-line_median1.8446981918041725
in-drivable-lane_median4.525000000000064


other stats
agent_compute-ego0_max0.012049300959467645
agent_compute-ego0_mean0.011884318250296531
agent_compute-ego0_median0.01187956576456372
agent_compute-ego0_min0.011728840512591049
complete-iteration_max0.20458138992654223
complete-iteration_mean0.1790309038742436
complete-iteration_median0.1793200345046328
complete-iteration_min0.15290215656116649
deviation-center-line_max2.5672026142602524
deviation-center-line_mean1.8425775952609036
deviation-center-line_min1.1137113831750174
deviation-heading_max6.86412650426875
deviation-heading_mean5.2188874270452
deviation-heading_median5.109419352012029
deviation-heading_min3.792584499887992
driven_any_max11.66356569922064
driven_any_mean7.791724931210997
driven_any_median7.476136981936189
driven_any_min4.551060061750973
driven_lanedir_consec_max11.58955262826332
driven_lanedir_consec_mean6.695999576488177
driven_lanedir_consec_min3.8838176486579687
driven_lanedir_max11.58955262826332
driven_lanedir_mean6.698296334324711
driven_lanedir_median5.659907530188777
driven_lanedir_min3.8838176486579687
get_duckie_state_max1.1824893450361208e-06
get_duckie_state_mean1.13861524449925e-06
get_duckie_state_median1.1367893143285057e-06
get_duckie_state_min1.098393004303868e-06
get_robot_state_max0.003557069017726317
get_robot_state_mean0.0035148713953756946
get_robot_state_median0.0035103250876779976
get_robot_state_min0.003481766388420466
get_state_dump_max0.004477858900666594
get_state_dump_mean0.004416697387301512
get_state_dump_median0.0044090803350673915
get_state_dump_min0.004370769978404672
get_ui_image_max0.03626228406933544
get_ui_image_mean0.03074525946360865
get_ui_image_median0.030486611659201992
get_ui_image_min0.02574553046669517
in-drivable-lane_max12.599999999999351
in-drivable-lane_mean5.41249999999987
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.66356569922064, "get_ui_image": 0.028324172657594196, "step_physics": 0.09141473349286158, "survival_time": 59.99999999999873, "driven_lanedir": 11.58955262826332, "get_state_dump": 0.004439840904381948, "get_robot_state": 0.003557069017726317, "sim_render-ego0": 0.0036938778069692288, "get_duckie_state": 1.098393004303868e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.971739713937755, "agent_compute-ego0": 0.011916741244898152, "complete-iteration": 0.15682181827630923, "set_robot_commands": 0.0021171373292667283, "deviation-center-line": 2.291374243052993, "driven_lanedir_consec": 11.58955262826332, "sim_compute_sim_state": 0.009368950282405754, "sim_compute_performance-ego0": 0.0019110295298097532}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.551060061750973, "get_ui_image": 0.03626228406933544, "step_physics": 0.12982033704095797, "survival_time": 24.30000000000021, "driven_lanedir": 3.8838176486579687, "get_state_dump": 0.004378319765752836, "get_robot_state": 0.003493457849020831, "sim_render-ego0": 0.003626164959196682, "get_duckie_state": 1.1710415630614734e-06, "in-drivable-lane": 3.600000000000051, "deviation-heading": 3.792584499887992, "agent_compute-ego0": 0.012049300959467645, "complete-iteration": 0.20458138992654223, "set_robot_commands": 0.0020861517966895135, "deviation-center-line": 1.1137113831750174, "driven_lanedir_consec": 3.8838176486579687, "sim_compute_sim_state": 0.010920176515833798, "sim_compute_performance-ego0": 0.001867589519743557}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.372758678546999, "get_ui_image": 0.03264905066080979, "step_physics": 0.13022347548797125, "survival_time": 28.50000000000027, "driven_lanedir": 4.248510864788577, "get_state_dump": 0.004370769978404672, "get_robot_state": 0.003481766388420466, "sim_render-ego0": 0.0035974808206908964, "get_duckie_state": 1.1824893450361208e-06, "in-drivable-lane": 5.4500000000000774, "deviation-heading": 5.247098990086305, "agent_compute-ego0": 0.011842390284229284, "complete-iteration": 0.2018182507329563, "set_robot_commands": 0.002038814558039196, "deviation-center-line": 1.3980221405553512, "driven_lanedir_consec": 4.239323833442441, "sim_compute_sim_state": 0.01168586911336762, "sim_compute_performance-ego0": 0.00185118748719972}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.579515285325378, "get_ui_image": 0.02574553046669517, "step_physics": 0.09398063722547594, "survival_time": 49.9999999999993, "driven_lanedir": 7.071304195588976, "get_state_dump": 0.004477858900666594, "get_robot_state": 0.003527192326335164, "sim_render-ego0": 0.0036010039555323826, "get_duckie_state": 1.1025370655955371e-06, "in-drivable-lane": 12.599999999999351, "deviation-heading": 6.86412650426875, "agent_compute-ego0": 0.011728840512591049, "complete-iteration": 0.15290215656116649, "set_robot_commands": 0.0020555178006807645, "deviation-center-line": 2.5672026142602524, "driven_lanedir_consec": 7.071304195588976, "sim_compute_sim_state": 0.00584477168339473, "sim_compute_performance-ego0": 0.001862646697403549}}
set_robot_commands_max0.0021171373292667283
set_robot_commands_mean0.002074405371169051
set_robot_commands_median0.002070834798685139
set_robot_commands_min0.002038814558039196
sim_compute_performance-ego0_max0.0019110295298097532
sim_compute_performance-ego0_mean0.0018731133085391448
sim_compute_performance-ego0_median0.0018651181085735527
sim_compute_performance-ego0_min0.00185118748719972
sim_compute_sim_state_max0.01168586911336762
sim_compute_sim_state_mean0.009454941898750477
sim_compute_sim_state_median0.010144563399119776
sim_compute_sim_state_min0.00584477168339473
sim_render-ego0_max0.0036938778069692288
sim_render-ego0_mean0.0036296318855972977
sim_render-ego0_median0.003613584457364532
sim_render-ego0_min0.0035974808206908964
simulation-passed1
step_physics_max0.13022347548797125
step_physics_mean0.11135979581181668
step_physics_median0.11190048713321696
step_physics_min0.09141473349286158
survival_time_max59.99999999999873
survival_time_mean40.699999999999626
survival_time_min24.30000000000021
No reset possible
6190713408Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:29:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.160132620284031
survival_time_median59.99999999999873
deviation-center-line_median2.830085964579273
in-drivable-lane_median3.124999999999991


other stats
agent_compute-ego0_max0.012120476287589287
agent_compute-ego0_mean0.011787692998872211
agent_compute-ego0_median0.011742038194781836
agent_compute-ego0_min0.011546219318335896
complete-iteration_max0.20238812996088515
complete-iteration_mean0.17891597454755925
complete-iteration_median0.17901096345510004
complete-iteration_min0.15525384131915165
deviation-center-line_max3.382699471271807
deviation-center-line_mean2.536641433164677
deviation-center-line_min1.1036943322283563
deviation-heading_max11.93352526065974
deviation-heading_mean8.302187593045915
deviation-heading_median8.337671361270308
deviation-heading_min4.599882388983306
driven_any_max11.67303617268748
driven_any_mean9.733612495617042
driven_any_median11.668252975963645
driven_any_min3.924907857853401
driven_lanedir_consec_max11.565395906892071
driven_lanedir_consec_mean8.743417970615791
driven_lanedir_consec_min3.08801073500303
driven_lanedir_max11.565395906892071
driven_lanedir_mean8.74542676960425
driven_lanedir_median10.160132620284031
driven_lanedir_min3.0960459309568655
get_duckie_state_max1.2941112473219562e-06
get_duckie_state_mean1.1701519877034188e-06
get_duckie_state_median1.133034171708716e-06
get_duckie_state_min1.120428360074287e-06
get_robot_state_max0.003678899522030185
get_robot_state_mean0.0035895674605516768
get_robot_state_median0.003589132575302756
get_robot_state_min0.003501105169571012
get_state_dump_max0.00461608129190215
get_state_dump_mean0.004471335935184072
get_state_dump_median0.004456923764313786
get_state_dump_min0.00435541492020657
get_ui_image_max0.035426069953658004
get_ui_image_mean0.030245292303782145
get_ui_image_median0.030119318961937605
get_ui_image_min0.02531646133759536
in-drivable-lane_max9.80000000000001
in-drivable-lane_mean4.0124999999999975
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.663550257108986, "get_ui_image": 0.02802706479430695, "step_physics": 0.09162497718963496, "survival_time": 59.99999999999873, "driven_lanedir": 11.565395906892071, "get_state_dump": 0.004535783835989946, "get_robot_state": 0.003678899522030185, "sim_render-ego0": 0.003805158934327189, "get_duckie_state": 1.1373022811597432e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.343674414645636, "agent_compute-ego0": 0.0119341759757138, "complete-iteration": 0.15737179574323237, "set_robot_commands": 0.0023055475617725584, "deviation-center-line": 2.394860218524701, "driven_lanedir_consec": 11.565395906892071, "sim_compute_sim_state": 0.00936078846603508, "sim_compute_performance-ego0": 0.0020111929268563024}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.67303617268748, "get_ui_image": 0.035426069953658004, "step_physics": 0.12655439424475068, "survival_time": 59.99999999999873, "driven_lanedir": 10.965419679179703, "get_state_dump": 0.00435541492020657, "get_robot_state": 0.003501105169571012, "sim_render-ego0": 0.0036025503890698995, "get_duckie_state": 1.120428360074287e-06, "in-drivable-lane": 2.299999999999926, "deviation-heading": 10.33166830789498, "agent_compute-ego0": 0.011549900413849868, "complete-iteration": 0.20238812996088515, "set_robot_commands": 0.00205417358309502, "deviation-center-line": 3.2653117106338447, "driven_lanedir_consec": 10.965419679179703, "sim_compute_sim_state": 0.013416836998246294, "sim_compute_performance-ego0": 0.001852576877552703}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.924907857853401, "get_ui_image": 0.03221157312956826, "step_physics": 0.1293680622786213, "survival_time": 21.100000000000165, "driven_lanedir": 3.0960459309568655, "get_state_dump": 0.00461608129190215, "get_robot_state": 0.003630587958838641, "sim_render-ego0": 0.0037173339942950167, "get_duckie_state": 1.2941112473219562e-06, "in-drivable-lane": 3.950000000000056, "deviation-heading": 4.599882388983306, "agent_compute-ego0": 0.012120476287589287, "complete-iteration": 0.20065013116696767, "set_robot_commands": 0.002264994537858535, "deviation-center-line": 1.1036943322283563, "driven_lanedir_consec": 3.08801073500303, "sim_compute_sim_state": 0.010671902491973084, "sim_compute_performance-ego0": 0.0019596569927026195}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.6729556948183, "get_ui_image": 0.02531646133759536, "step_physics": 0.09666075555609228, "survival_time": 59.99999999999873, "driven_lanedir": 9.35484556138836, "get_state_dump": 0.004378063692637625, "get_robot_state": 0.0035476771917668706, "sim_render-ego0": 0.0036129739064161824, "get_duckie_state": 1.1287660622576888e-06, "in-drivable-lane": 9.80000000000001, "deviation-heading": 11.93352526065974, "agent_compute-ego0": 0.011546219318335896, "complete-iteration": 0.15525384131915165, "set_robot_commands": 0.002151143640205326, "deviation-center-line": 3.382699471271807, "driven_lanedir_consec": 9.35484556138836, "sim_compute_sim_state": 0.006054841112236893, "sim_compute_performance-ego0": 0.0019088402874364544}}
set_robot_commands_max0.0023055475617725584
set_robot_commands_mean0.0021939648307328597
set_robot_commands_median0.0022080690890319303
set_robot_commands_min0.00205417358309502
sim_compute_performance-ego0_max0.0020111929268563024
sim_compute_performance-ego0_mean0.00193306677113702
sim_compute_performance-ego0_median0.0019342486400695368
sim_compute_performance-ego0_min0.001852576877552703
sim_compute_sim_state_max0.013416836998246294
sim_compute_sim_state_mean0.009876092267122836
sim_compute_sim_state_median0.01001634547900408
sim_compute_sim_state_min0.006054841112236893
sim_render-ego0_max0.003805158934327189
sim_render-ego0_mean0.003684504306027072
sim_render-ego0_median0.0036651539503556
sim_render-ego0_min0.0036025503890698995
simulation-passed1
step_physics_max0.1293680622786213
step_physics_mean0.1110520473172748
step_physics_median0.11160757490042147
step_physics_min0.09162497718963496
survival_time_max59.99999999999873
survival_time_mean50.27499999999908
survival_time_min21.100000000000165
No reset possible
6190613407Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:24:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.987719480157828
survival_time_median47.17499999999946
deviation-center-line_median3.36803551814467
in-drivable-lane_median5.924999999999995


other stats
agent_compute-ego0_max0.012234055025632991
agent_compute-ego0_mean0.011854744367127305
agent_compute-ego0_median0.011823184026782108
agent_compute-ego0_min0.011538554389312007
complete-iteration_max0.2166339326758468
complete-iteration_mean0.18314269293544228
complete-iteration_median0.1810980851412699
complete-iteration_min0.1537406687833825
deviation-center-line_max5.3751850814078175
deviation-center-line_mean3.1354865556355787
deviation-center-line_min0.4306901048451559
deviation-heading_max11.30648303201325
deviation-heading_mean6.6376227090948685
deviation-heading_median6.722517946004282
deviation-heading_min1.798971912357661
driven_any_max12.08982345971183
driven_any_mean8.419504917566947
driven_any_median9.41507613205134
driven_any_min2.758043946453273
driven_lanedir_consec_max11.600921053399496
driven_lanedir_consec_mean7.2294328159067645
driven_lanedir_consec_min1.341371249911906
driven_lanedir_max11.600921053399496
driven_lanedir_mean7.2294328159067645
driven_lanedir_median7.987719480157828
driven_lanedir_min1.341371249911906
get_duckie_state_max1.1537791688078944e-06
get_duckie_state_mean1.1133209385400866e-06
get_duckie_state_median1.1186208119216629e-06
get_duckie_state_min1.0622629615091265e-06
get_robot_state_max0.0035174172883426814
get_robot_state_mean0.0034886198036687193
get_robot_state_median0.003486471075688768
get_robot_state_min0.00346411977495466
get_state_dump_max0.004319695885791335
get_state_dump_mean0.004303307502335371
get_state_dump_median0.004311131746147594
get_state_dump_min0.00427127063125496
get_ui_image_max0.035800858600054254
get_ui_image_mean0.030511637464082933
get_ui_image_median0.03025556886227645
get_ui_image_min0.025734553531724574
in-drivable-lane_max7.949999999999946
in-drivable-lane_mean5.287499999999978
in-drivable-lane_min1.3499999999999766
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.080008977998492, "get_ui_image": 0.028031713261790915, "step_physics": 0.09587345095498676, "survival_time": 59.99999999999873, "driven_lanedir": 11.600921053399496, "get_state_dump": 0.00427127063125496, "get_robot_state": 0.0035174172883426814, "sim_render-ego0": 0.003567249550608969, "get_duckie_state": 1.0622629615091265e-06, "in-drivable-lane": 1.3499999999999766, "deviation-heading": 8.372728260244598, "agent_compute-ego0": 0.011538554389312007, "complete-iteration": 0.1600984012356011, "set_robot_commands": 0.0020566764818837897, "deviation-center-line": 4.651715469869479, "driven_lanedir_consec": 11.600921053399496, "sim_compute_sim_state": 0.009325455864899164, "sim_compute_performance-ego0": 0.0018479329759532664}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.08982345971183, "get_ui_image": 0.035800858600054254, "step_physics": 0.13982902319604015, "survival_time": 59.99999999999873, "driven_lanedir": 10.841502261132144, "get_state_dump": 0.004302953304001731, "get_robot_state": 0.003495895495323416, "sim_render-ego0": 0.0036521487986416142, "get_duckie_state": 1.1537791688078944e-06, "in-drivable-lane": 4.499999999999915, "deviation-heading": 11.30648303201325, "agent_compute-ego0": 0.01176200877816155, "complete-iteration": 0.2166339326758468, "set_robot_commands": 0.0021722050729540364, "deviation-center-line": 5.3751850814078175, "driven_lanedir_consec": 10.841502261132144, "sim_compute_sim_state": 0.013663163292318656, "sim_compute_performance-ego0": 0.0018813822489793257}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.750143286104187, "get_ui_image": 0.03247942446276199, "step_physics": 0.1291333773108416, "survival_time": 34.350000000000186, "driven_lanedir": 5.133936699183511, "get_state_dump": 0.004319695885791335, "get_robot_state": 0.0034770466560541196, "sim_render-ego0": 0.003628934538641641, "get_duckie_state": 1.1286763257758562e-06, "in-drivable-lane": 7.949999999999946, "deviation-heading": 5.072307631763966, "agent_compute-ego0": 0.012234055025632991, "complete-iteration": 0.20209776904693869, "set_robot_commands": 0.002046220870905144, "deviation-center-line": 2.084355566419861, "driven_lanedir_consec": 5.133936699183511, "sim_compute_sim_state": 0.012865548217019369, "sim_compute_performance-ego0": 0.001842990517616272}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.758043946453273, "get_ui_image": 0.025734553531724574, "step_physics": 0.09528457388585929, "survival_time": 14.650000000000071, "driven_lanedir": 1.341371249911906, "get_state_dump": 0.004319310188293457, "get_robot_state": 0.00346411977495466, "sim_render-ego0": 0.0036062942881162473, "get_duckie_state": 1.1085652980674691e-06, "in-drivable-lane": 7.350000000000076, "deviation-heading": 1.798971912357661, "agent_compute-ego0": 0.011884359275402668, "complete-iteration": 0.1537406687833825, "set_robot_commands": 0.002047074895326783, "deviation-center-line": 0.4306901048451559, "driven_lanedir_consec": 1.341371249911906, "sim_compute_sim_state": 0.005482374405374332, "sim_compute_performance-ego0": 0.0018465267557676148}}
set_robot_commands_max0.0021722050729540364
set_robot_commands_mean0.0020805443302674385
set_robot_commands_median0.0020518756886052864
set_robot_commands_min0.002046220870905144
sim_compute_performance-ego0_max0.0018813822489793257
sim_compute_performance-ego0_mean0.0018547081245791196
sim_compute_performance-ego0_median0.0018472298658604408
sim_compute_performance-ego0_min0.001842990517616272
sim_compute_sim_state_max0.013663163292318656
sim_compute_sim_state_mean0.01033413544490288
sim_compute_sim_state_median0.011095502040959267
sim_compute_sim_state_min0.005482374405374332
sim_render-ego0_max0.0036521487986416142
sim_render-ego0_mean0.003613656794002118
sim_render-ego0_median0.003617614413378944
sim_render-ego0_min0.003567249550608969
simulation-passed1
step_physics_max0.13982902319604015
step_physics_mean0.11503010633693196
step_physics_median0.11250341413291418
step_physics_min0.09528457388585929
survival_time_max59.99999999999873
survival_time_mean42.24999999999943
survival_time_min14.650000000000071
No reset possible
6190513406Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.373221541775592
survival_time_median59.99999999999873
deviation-center-line_median4.110668279937645
in-drivable-lane_median2.374999999999993


other stats
agent_compute-ego0_max0.012524094726100112
agent_compute-ego0_mean0.01217744201485654
agent_compute-ego0_median0.012162931952051675
agent_compute-ego0_min0.011859809429222698
complete-iteration_max0.20703758567270605
complete-iteration_mean0.17554605677456314
complete-iteration_median0.1722111338679737
complete-iteration_min0.15072437368959907
deviation-center-line_max5.4146275217614095
deviation-center-line_mean3.8769051712555744
deviation-center-line_min1.8716566033855977
deviation-heading_max8.148842695871732
deviation-heading_mean6.9775615373564195
deviation-heading_median7.140589412808119
deviation-heading_min5.480224627937709
driven_any_max11.256266401373896
driven_any_mean9.555866087858888
driven_any_median11.251603802565295
driven_any_min4.463990344931059
driven_lanedir_consec_max11.06955044358099
driven_lanedir_consec_mean8.419544408668132
driven_lanedir_consec_min3.862184107540354
driven_lanedir_max11.06955044358099
driven_lanedir_mean8.421944216358243
driven_lanedir_median9.373221541775592
driven_lanedir_min3.871783338300799
get_duckie_state_max1.5017962214922664e-06
get_duckie_state_mean1.4944877984167866e-06
get_duckie_state_median1.4957242166866967e-06
get_duckie_state_min1.484706538801487e-06
get_robot_state_max0.0036021088878876164
get_robot_state_mean0.0035215013995651967
get_robot_state_median0.003503556110518852
get_robot_state_min0.003476784489335466
get_state_dump_max0.004552636912819944
get_state_dump_mean0.004455975676839356
get_state_dump_median0.004475144777341367
get_state_dump_min0.004320976239854748
get_ui_image_max0.03588011529710558
get_ui_image_mean0.030362877542254155
get_ui_image_median0.02999396615977291
get_ui_image_min0.025583462552365217
in-drivable-lane_max15.949999999999129
in-drivable-lane_mean5.224999999999776
in-drivable-lane_min0.19999999999998863
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.246978452009628, "get_ui_image": 0.027936926293035628, "step_physics": 0.09390273062414572, "survival_time": 59.99999999999873, "driven_lanedir": 11.06955044358099, "get_state_dump": 0.004552636912819944, "get_robot_state": 0.0036021088878876164, "sim_render-ego0": 0.003737896308613062, "get_duckie_state": 1.4946323747341084e-06, "in-drivable-lane": 0.19999999999998863, "deviation-heading": 7.117684667190137, "agent_compute-ego0": 0.01199594028387141, "complete-iteration": 0.1592490954958926, "set_robot_commands": 0.002186318619066631, "deviation-center-line": 4.78487937511036, "driven_lanedir_consec": 11.06955044358099, "sim_compute_sim_state": 0.00929613653368795, "sim_compute_performance-ego0": 0.0019590941992131596}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.463990344931059, "get_ui_image": 0.03588011529710558, "step_physics": 0.13206762737698025, "survival_time": 24.700000000000216, "driven_lanedir": 3.871783338300799, "get_state_dump": 0.004523724257343947, "get_robot_state": 0.003510452039314039, "sim_render-ego0": 0.0036210999344334456, "get_duckie_state": 1.5017962214922664e-06, "in-drivable-lane": 2.5000000000000355, "deviation-heading": 5.480224627937709, "agent_compute-ego0": 0.012524094726100112, "complete-iteration": 0.20703758567270605, "set_robot_commands": 0.0021645916832817927, "deviation-center-line": 1.8716566033855977, "driven_lanedir_consec": 3.862184107540354, "sim_compute_sim_state": 0.010805114591964569, "sim_compute_performance-ego0": 0.0018624561001556088}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.256266401373896, "get_ui_image": 0.0320510060265102, "step_physics": 0.11245110926282692, "survival_time": 59.99999999999873, "driven_lanedir": 8.075858903818249, "get_state_dump": 0.004320976239854748, "get_robot_state": 0.003476784489335466, "sim_render-ego0": 0.0036057355898206776, "get_duckie_state": 1.484706538801487e-06, "in-drivable-lane": 15.949999999999129, "deviation-heading": 7.1634941584261, "agent_compute-ego0": 0.01232992362023194, "complete-iteration": 0.1851731722400548, "set_robot_commands": 0.0021319796302534957, "deviation-center-line": 3.4364571847649295, "driven_lanedir_consec": 8.075858903818249, "sim_compute_sim_state": 0.012879969376906268, "sim_compute_performance-ego0": 0.0018506653600687984}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.256229153120962, "get_ui_image": 0.025583462552365217, "step_physics": 0.0916875709006431, "survival_time": 59.99999999999873, "driven_lanedir": 10.670584179732938, "get_state_dump": 0.004426565297338786, "get_robot_state": 0.003496660181723665, "sim_render-ego0": 0.0035916865616416453, "get_duckie_state": 1.496816058639285e-06, "in-drivable-lane": 2.2499999999999503, "deviation-heading": 8.148842695871732, "agent_compute-ego0": 0.011859809429222698, "complete-iteration": 0.15072437368959907, "set_robot_commands": 0.002073477745850219, "deviation-center-line": 5.4146275217614095, "driven_lanedir_consec": 10.670584179732938, "sim_compute_sim_state": 0.006061212506322043, "sim_compute_performance-ego0": 0.0018654756998638627}}
set_robot_commands_max0.002186318619066631
set_robot_commands_mean0.0021390919196130347
set_robot_commands_median0.0021482856567676444
set_robot_commands_min0.002073477745850219
sim_compute_performance-ego0_max0.0019590941992131596
sim_compute_performance-ego0_mean0.0018844228398253572
sim_compute_performance-ego0_median0.001863965900009736
sim_compute_performance-ego0_min0.0018506653600687984
sim_compute_sim_state_max0.012879969376906268
sim_compute_sim_state_mean0.009760608252220209
sim_compute_sim_state_median0.010050625562826258
sim_compute_sim_state_min0.006061212506322043
sim_render-ego0_max0.003737896308613062
sim_render-ego0_mean0.003639104598627207
sim_render-ego0_median0.003613417762127062
sim_render-ego0_min0.0035916865616416453
simulation-passed1
step_physics_max0.13206762737698025
step_physics_mean0.107527259541149
step_physics_median0.10317691994348632
step_physics_min0.0916875709006431
survival_time_max59.99999999999873
survival_time_mean51.1749999999991
survival_time_min24.700000000000216
No reset possible
6190413405Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.077530701501255
survival_time_median59.99999999999873
deviation-center-line_median2.8023298709114197
in-drivable-lane_median19.549999999999535


other stats
agent_compute-ego0_max0.0120716876342517
agent_compute-ego0_mean0.011928296933118648
agent_compute-ego0_median0.011897312512902
agent_compute-ego0_min0.0118468750724189
complete-iteration_max0.25995814900438324
complete-iteration_mean0.20926500342203017
complete-iteration_median0.19869098198800955
complete-iteration_min0.17971990070771815
deviation-center-line_max4.397699937252742
deviation-center-line_mean2.5757532571975914
deviation-center-line_min0.300653349714784
deviation-heading_max17.40244794370841
deviation-heading_mean9.01279278906276
deviation-heading_median8.626532064622918
deviation-heading_min1.3956590832967977
driven_any_max11.67297697910103
driven_any_mean8.987349314414935
driven_any_median11.662775645417325
driven_any_min0.9508689877240616
driven_lanedir_consec_max8.105021514716215
driven_lanedir_consec_mean4.757725843033293
driven_lanedir_consec_min0.7708204544144492
driven_lanedir_max8.105021514716215
driven_lanedir_mean4.9065695828097144
driven_lanedir_median5.375218181054097
driven_lanedir_min0.7708204544144492
get_duckie_state_max1.3927932980654143e-06
get_duckie_state_mean1.3018859865843616e-06
get_duckie_state_median1.2853231862386425e-06
get_duckie_state_min1.244104275794748e-06
get_robot_state_max0.003762430989871315
get_robot_state_mean0.003700582307520706
get_robot_state_median0.003688032770788444
get_robot_state_min0.0036638326986346216
get_state_dump_max0.0046135628848746855
get_state_dump_mean0.004562125114475777
get_state_dump_median0.004557756452136233
get_state_dump_min0.004519424668755956
get_ui_image_max0.03662350999207056
get_ui_image_mean0.03094793658763699
get_ui_image_median0.03052109038204476
get_ui_image_min0.026126055594387895
in-drivable-lane_max34.3499999999993
in-drivable-lane_mean18.69999999999959
in-drivable-lane_min1.3499999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.653399761347057, "get_ui_image": 0.028321293172590144, "step_physics": 0.11377800156135146, "survival_time": 59.99999999999873, "driven_lanedir": 8.105021514716215, "get_state_dump": 0.004519424668755956, "get_robot_state": 0.0036638326986346216, "sim_render-ego0": 0.0037098724975077736, "get_duckie_state": 1.244104275794748e-06, "in-drivable-lane": 16.59999999999961, "deviation-heading": 9.241492557358123, "agent_compute-ego0": 0.011939716974364828, "complete-iteration": 0.17971990070771815, "set_robot_commands": 0.002280907269619982, "deviation-center-line": 4.397699937252742, "driven_lanedir_consec": 8.105021514716215, "sim_compute_sim_state": 0.009480613951480558, "sim_compute_performance-ego0": 0.0019495000847174068}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9508689877240616, "get_ui_image": 0.03662350999207056, "step_physics": 0.18472463744027273, "survival_time": 5.899999999999987, "driven_lanedir": 0.7708204544144492, "get_state_dump": 0.004561314061910165, "get_robot_state": 0.0036878565780254975, "sim_render-ego0": 0.00377195021685432, "get_duckie_state": 1.3062933913799895e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 1.3956590832967977, "agent_compute-ego0": 0.0120716876342517, "complete-iteration": 0.25995814900438324, "set_robot_commands": 0.002300683189840878, "deviation-center-line": 0.300653349714784, "driven_lanedir_consec": 0.7708204544144492, "sim_compute_sim_state": 0.010133478821826582, "sim_compute_performance-ego0": 0.0020043048538079785}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.67297697910103, "get_ui_image": 0.032720887591499374, "step_physics": 0.1297021920635341, "survival_time": 59.99999999999873, "driven_lanedir": 4.5069021654425585, "get_state_dump": 0.0046135628848746855, "get_robot_state": 0.003762430989871315, "sim_render-ego0": 0.0038269080289893105, "get_duckie_state": 1.3927932980654143e-06, "in-drivable-lane": 34.3499999999993, "deviation-heading": 8.01157157188771, "agent_compute-ego0": 0.0118468750724189, "complete-iteration": 0.2033857489307159, "set_robot_commands": 0.002281980451001017, "deviation-center-line": 2.7773775695912675, "driven_lanedir_consec": 3.911527206336874, "sim_compute_sim_state": 0.012519086231101465, "sim_compute_performance-ego0": 0.0020371605017897886}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.67215152948759, "get_ui_image": 0.026126055594387895, "step_physics": 0.13351984087573202, "survival_time": 59.99999999999873, "driven_lanedir": 6.243534196665636, "get_state_dump": 0.004554198842362301, "get_robot_state": 0.0036882089635513903, "sim_render-ego0": 0.0037302806117353983, "get_duckie_state": 1.2643529810972952e-06, "in-drivable-lane": 22.49999999999946, "deviation-heading": 17.40244794370841, "agent_compute-ego0": 0.01185490805143917, "complete-iteration": 0.19399621504530323, "set_robot_commands": 0.002263576958598344, "deviation-center-line": 2.827282172231572, "driven_lanedir_consec": 6.243534196665636, "sim_compute_sim_state": 0.006218317843396697, "sim_compute_performance-ego0": 0.001968195793729936}}
set_robot_commands_max0.002300683189840878
set_robot_commands_mean0.002281786967265055
set_robot_commands_median0.0022814438603104997
set_robot_commands_min0.002263576958598344
sim_compute_performance-ego0_max0.0020371605017897886
sim_compute_performance-ego0_mean0.0019897903085112773
sim_compute_performance-ego0_median0.001986250323768957
sim_compute_performance-ego0_min0.0019495000847174068
sim_compute_sim_state_max0.012519086231101465
sim_compute_sim_state_mean0.009587874211951326
sim_compute_sim_state_median0.00980704638665357
sim_compute_sim_state_min0.006218317843396697
sim_render-ego0_max0.0038269080289893105
sim_render-ego0_mean0.003759752838771701
sim_render-ego0_median0.003751115414294859
sim_render-ego0_min0.0037098724975077736
simulation-passed1
step_physics_max0.18472463744027273
step_physics_mean0.1404311679852226
step_physics_median0.13161101646963305
step_physics_min0.11377800156135146
survival_time_max59.99999999999873
survival_time_mean46.47499999999904
survival_time_min5.899999999999987
No reset possible
6190113402Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:38:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.36964741031727
survival_time_median59.99999999999873
deviation-center-line_median2.6993120919261893
in-drivable-lane_median1.3249999999999993


other stats
agent_compute-ego0_max0.016720580022400563
agent_compute-ego0_mean0.016333301380272156
agent_compute-ego0_median0.016233580259871705
agent_compute-ego0_min0.01614546497894465
complete-iteration_max0.2827242550305979
complete-iteration_mean0.2460723305856092
complete-iteration_median0.24995758143111177
complete-iteration_min0.20164990444961536
deviation-center-line_max3.652039776046597
deviation-center-line_mean2.8038260570553195
deviation-center-line_min2.1646402683223034
deviation-heading_max12.238725428651756
deviation-heading_mean10.056974281908012
deviation-heading_median10.132221116022924
deviation-heading_min7.724729466934449
driven_any_max27.079801184172013
driven_any_mean24.388600952075027
driven_any_median26.690558935335815
driven_any_min17.093484753456465
driven_lanedir_consec_max26.73960838308306
driven_lanedir_consec_mean22.9805880092962
driven_lanedir_consec_min14.443448833467183
driven_lanedir_max26.73960838308306
driven_lanedir_mean22.9805880092962
driven_lanedir_median25.36964741031727
driven_lanedir_min14.443448833467183
get_duckie_state_max1.2224659534616336e-06
get_duckie_state_mean1.2061635562075454e-06
get_duckie_state_median1.2046506544930634e-06
get_duckie_state_min1.1928869623824222e-06
get_robot_state_max0.003698021843471098
get_robot_state_mean0.003615533657605868
get_robot_state_median0.0036003046686901435
get_robot_state_min0.003563503449572087
get_state_dump_max0.00464838271732632
get_state_dump_mean0.004624728884450562
get_state_dump_median0.004647187944455111
get_state_dump_min0.004556156931565708
get_ui_image_max0.0362589664999194
get_ui_image_mean0.03107272335663022
get_ui_image_median0.03078906021411757
get_ui_image_min0.02645380649836633
in-drivable-lane_max5.299999999999744
in-drivable-lane_mean1.9874999999999357
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 26.848812965590728, "get_ui_image": 0.028626311331565533, "step_physics": 0.16032299689706617, "survival_time": 59.99999999999873, "driven_lanedir": 26.09405166543363, "get_state_dump": 0.00464838271732632, "get_robot_state": 0.0036166490464285945, "sim_render-ego0": 0.003678326007229998, "get_duckie_state": 1.1928869623824222e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.238725428651756, "agent_compute-ego0": 0.016232993779432565, "complete-iteration": 0.23104567710406376, "set_robot_commands": 0.0021400904278274777, "deviation-center-line": 2.8331931996779955, "driven_lanedir_consec": 26.09405166543363, "sim_compute_sim_state": 0.009797314422315203, "sim_compute_performance-ego0": 0.0019063888044778157}, "LF-norm-zigzag-000-ego0": {"driven_any": 26.532304905080903, "get_ui_image": 0.0362589664999194, "step_physics": 0.1999528300851509, "survival_time": 59.99999999999873, "driven_lanedir": 24.645243155200912, "get_state_dump": 0.004646382859902616, "get_robot_state": 0.003583960290951693, "sim_render-ego0": 0.0037137130019468233, "get_duckie_state": 1.2224659534616336e-06, "in-drivable-lane": 2.599999999999998, "deviation-heading": 11.93106477131369, "agent_compute-ego0": 0.01614546497894465, "complete-iteration": 0.2827242550305979, "set_robot_commands": 0.0021969813490588896, "deviation-center-line": 3.652039776046597, "driven_lanedir_consec": 24.645243155200912, "sim_compute_sim_state": 0.014216122877389364, "sim_compute_performance-ego0": 0.001928057301352165}, "LF-norm-techtrack-000-ego0": {"driven_any": 17.093484753456465, "get_ui_image": 0.03295180909666961, "step_physics": 0.19068169836167911, "survival_time": 39.299999999999905, "driven_lanedir": 14.443448833467183, "get_state_dump": 0.004556156931565708, "get_robot_state": 0.003563503449572087, "sim_render-ego0": 0.0036763505681194223, "get_duckie_state": 1.2039077933286016e-06, "in-drivable-lane": 5.299999999999744, "deviation-heading": 8.333377460732159, "agent_compute-ego0": 0.016234166740310845, "complete-iteration": 0.2688694857581598, "set_robot_commands": 0.00212678582119972, "deviation-center-line": 2.1646402683223034, "driven_lanedir_consec": 14.443448833467183, "sim_compute_sim_state": 0.013092268528144574, "sim_compute_performance-ego0": 0.001911717721437408}, "LF-norm-small_loop-000-ego0": {"driven_any": 27.079801184172013, "get_ui_image": 0.02645380649836633, "step_physics": 0.1356263190483074, "survival_time": 59.99999999999873, "driven_lanedir": 26.73960838308306, "get_state_dump": 0.004647993029007606, "get_robot_state": 0.003698021843471098, "sim_render-ego0": 0.0037743670060970103, "get_duckie_state": 1.205393515657525e-06, "in-drivable-lane": 0.05000000000000071, "deviation-heading": 7.724729466934449, "agent_compute-ego0": 0.016720580022400563, "complete-iteration": 0.20164990444961536, "set_robot_commands": 0.002288621827823534, "deviation-center-line": 2.5654309841743834, "driven_lanedir_consec": 26.73960838308306, "sim_compute_sim_state": 0.006364801543439854, "sim_compute_performance-ego0": 0.0019957078287345382}}
set_robot_commands_max0.002288621827823534
set_robot_commands_mean0.002188119856477405
set_robot_commands_median0.0021685358884431837
set_robot_commands_min0.00212678582119972
sim_compute_performance-ego0_max0.0019957078287345382
sim_compute_performance-ego0_mean0.0019354679140004816
sim_compute_performance-ego0_median0.0019198875113947869
sim_compute_performance-ego0_min0.0019063888044778157
sim_compute_sim_state_max0.014216122877389364
sim_compute_sim_state_mean0.01086762684282225
sim_compute_sim_state_median0.01144479147522989
sim_compute_sim_state_min0.006364801543439854
sim_render-ego0_max0.0037743670060970103
sim_render-ego0_mean0.0037106891458483135
sim_render-ego0_median0.0036960195045884106
sim_render-ego0_min0.0036763505681194223
simulation-passed1
step_physics_max0.1999528300851509
step_physics_mean0.17164596109805091
step_physics_median0.17550234762937267
step_physics_min0.1356263190483074
survival_time_max59.99999999999873
survival_time_mean54.82499999999902
survival_time_min39.299999999999905
No reset possible
6190013401Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:36:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2221068305081175
survival_time_median59.99999999999873
deviation-center-line_median3.4458248235409172
in-drivable-lane_median16.84999999999951


other stats
agent_compute-ego0_max0.01227435065149566
agent_compute-ego0_mean0.011900198648216126
agent_compute-ego0_median0.011839654126036277
agent_compute-ego0_min0.011647135689296291
complete-iteration_max0.23887404653055289
complete-iteration_mean0.2051005731216577
complete-iteration_median0.20314411894665668
complete-iteration_min0.17524000806276446
deviation-center-line_max4.390018281146998
deviation-center-line_mean3.6023400616980408
deviation-center-line_min3.1276923185633327
deviation-heading_max36.45060839508992
deviation-heading_mean30.20098066763467
deviation-heading_median30.056683715736852
deviation-heading_min24.23994684397508
driven_any_max10.42208735334868
driven_any_mean10.417701691873985
driven_any_median10.422025420849486
driven_any_min10.404668572448278
driven_lanedir_consec_max4.024734212619151
driven_lanedir_consec_mean3.0601794980701307
driven_lanedir_consec_min1.771770118645137
driven_lanedir_max5.74342864562723
driven_lanedir_mean5.254596712085425
driven_lanedir_median5.204065299114936
driven_lanedir_min4.8668276044845955
get_duckie_state_max1.1956661964435562e-06
get_duckie_state_mean1.1702064272763826e-06
get_duckie_state_median1.1729360321578536e-06
get_duckie_state_min1.1392874483462675e-06
get_robot_state_max0.003674442821696438
get_robot_state_mean0.0036439388419666654
get_robot_state_median0.0036555667602450126
get_robot_state_min0.003590179025680199
get_state_dump_max0.004594953133601332
get_state_dump_mean0.0045595446990788924
get_state_dump_median0.004558422781843428
get_state_dump_min0.004526380099027381
get_ui_image_max0.03613884046016188
get_ui_image_mean0.03055349739266871
get_ui_image_median0.03016558277120598
get_ui_image_min0.025743983568101005
in-drivable-lane_max21.19999999999941
in-drivable-lane_mean16.437499999999602
in-drivable-lane_min10.849999999999977
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.404668572448278, "get_ui_image": 0.027788920366793847, "step_physics": 0.12131889912607668, "survival_time": 59.99999999999873, "driven_lanedir": 4.921294511696614, "get_state_dump": 0.0045708784155801966, "get_robot_state": 0.003664666270336243, "sim_render-ego0": 0.003738001720990666, "get_duckie_state": 1.1392874483462675e-06, "in-drivable-lane": 21.19999999999941, "deviation-heading": 24.23994684397508, "agent_compute-ego0": 0.011888038308098354, "complete-iteration": 0.18681174829341687, "set_robot_commands": 0.002223830933773349, "deviation-center-line": 3.1276923185633327, "driven_lanedir_consec": 4.024734212619151, "sim_compute_sim_state": 0.00958584726700477, "sim_compute_performance-ego0": 0.0019616755121057974}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.42208735334868, "get_ui_image": 0.03613884046016188, "step_physics": 0.16214243359212374, "survival_time": 59.99999999999873, "driven_lanedir": 5.486836086533259, "get_state_dump": 0.00454596714810666, "get_robot_state": 0.0036464672501537823, "sim_render-ego0": 0.003837496116695356, "get_duckie_state": 1.1557643359944187e-06, "in-drivable-lane": 13.999999999999638, "deviation-heading": 32.47462722165619, "agent_compute-ego0": 0.01227435065149566, "complete-iteration": 0.23887404653055289, "set_robot_commands": 0.002336428226975974, "deviation-center-line": 3.581026133171586, "driven_lanedir_consec": 3.345755317605266, "sim_compute_sim_state": 0.011877324956342838, "sim_compute_performance-ego0": 0.0020013659522495697}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.422027228116448, "get_ui_image": 0.032542245175618115, "step_physics": 0.150048203114963, "survival_time": 59.99999999999873, "driven_lanedir": 4.8668276044845955, "get_state_dump": 0.004594953133601332, "get_robot_state": 0.003590179025680199, "sim_render-ego0": 0.0037580014863280234, "get_duckie_state": 1.1956661964435562e-06, "in-drivable-lane": 19.699999999999388, "deviation-heading": 27.63874020981751, "agent_compute-ego0": 0.0117912699439742, "complete-iteration": 0.21947648959989652, "set_robot_commands": 0.002253733308587245, "deviation-center-line": 3.3106235139102487, "driven_lanedir_consec": 1.771770118645137, "sim_compute_sim_state": 0.008849300214591174, "sim_compute_performance-ego0": 0.0019744536362520165}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.422023613582525, "get_ui_image": 0.025743983568101005, "step_physics": 0.11544175846789104, "survival_time": 59.99999999999873, "driven_lanedir": 5.74342864562723, "get_state_dump": 0.004526380099027381, "get_robot_state": 0.003674442821696438, "sim_render-ego0": 0.0037830963817663136, "get_duckie_state": 1.1901077283212882e-06, "in-drivable-lane": 10.849999999999977, "deviation-heading": 36.45060839508992, "agent_compute-ego0": 0.011647135689296291, "complete-iteration": 0.17524000806276446, "set_robot_commands": 0.0022577796748635376, "deviation-center-line": 4.390018281146998, "driven_lanedir_consec": 3.0984583434109685, "sim_compute_sim_state": 0.00609957050225022, "sim_compute_performance-ego0": 0.001994285257928675}}
set_robot_commands_max0.002336428226975974
set_robot_commands_mean0.0022679430360500264
set_robot_commands_median0.0022557564917253916
set_robot_commands_min0.002223830933773349
sim_compute_performance-ego0_max0.0020013659522495697
sim_compute_performance-ego0_mean0.0019829450896340145
sim_compute_performance-ego0_median0.001984369447090346
sim_compute_performance-ego0_min0.0019616755121057974
sim_compute_sim_state_max0.011877324956342838
sim_compute_sim_state_mean0.00910301073504725
sim_compute_sim_state_median0.009217573740797971
sim_compute_sim_state_min0.00609957050225022
sim_render-ego0_max0.003837496116695356
sim_render-ego0_mean0.00377914892644509
sim_render-ego0_median0.003770548934047169
sim_render-ego0_min0.003738001720990666
simulation-passed1
step_physics_max0.16214243359212374
step_physics_mean0.13723782357526362
step_physics_median0.13568355112051983
step_physics_min0.11544175846789104
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6189913400Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:20:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.255830211755771
survival_time_median32.10000000000011
deviation-center-line_median1.5582067236069297
in-drivable-lane_median8.049999999999905


other stats
agent_compute-ego0_max0.012406557130876425
agent_compute-ego0_mean0.0122119223460636
agent_compute-ego0_median0.012184392812525624
agent_compute-ego0_min0.01207234662832673
complete-iteration_max0.2118986322486197
complete-iteration_mean0.18424807526263612
complete-iteration_median0.18530838150896028
complete-iteration_min0.15447690578400416
deviation-center-line_max2.262925519103612
deviation-center-line_mean1.588805189114512
deviation-center-line_min0.9758817901405769
deviation-heading_max7.717796840424277
deviation-heading_mean5.538027574526003
deviation-heading_median5.4614873397852985
deviation-heading_min3.511338778109138
driven_any_max8.273753618554027
driven_any_mean5.70127754530853
driven_any_median5.426106914459998
driven_any_min3.6791427337600986
driven_lanedir_consec_max5.883031236401875
driven_lanedir_consec_mean4.219970471958854
driven_lanedir_consec_min2.4851902279219993
driven_lanedir_max5.883651514193295
driven_lanedir_mean4.220356940376776
driven_lanedir_median4.256293009695906
driven_lanedir_min2.4851902279219993
get_duckie_state_max1.5724946073549697e-06
get_duckie_state_mean1.5110368171542797e-06
get_duckie_state_median1.5095376793950508e-06
get_duckie_state_min1.4525773024720478e-06
get_robot_state_max0.0035342342260892747
get_robot_state_mean0.0034981931648806514
get_robot_state_median0.0035097465252440074
get_robot_state_min0.003439045382945317
get_state_dump_max0.004480512590064495
get_state_dump_mean0.004390797942585938
get_state_dump_median0.0043956237754587575
get_state_dump_min0.004291431629361741
get_ui_image_max0.036080948089512746
get_ui_image_mean0.03052216405224415
get_ui_image_median0.030227322091087742
get_ui_image_min0.025553063937288376
in-drivable-lane_max12.699999999999374
in-drivable-lane_mean8.16249999999981
in-drivable-lane_min3.8500000000000543
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.273753618554027, "get_ui_image": 0.028123954645137197, "step_physics": 0.1010954714312996, "survival_time": 48.449999999999385, "driven_lanedir": 5.883651514193295, "get_state_dump": 0.004398476954587956, "get_robot_state": 0.0035340810559459567, "sim_render-ego0": 0.00366222317685786, "get_duckie_state": 1.5347274308352129e-06, "in-drivable-lane": 12.699999999999374, "deviation-heading": 7.717796840424277, "agent_compute-ego0": 0.01207234662832673, "complete-iteration": 0.1666703302835681, "set_robot_commands": 0.0021644464473134463, "deviation-center-line": 2.262925519103612, "driven_lanedir_consec": 5.883031236401875, "sim_compute_sim_state": 0.009648754178863211, "sim_compute_performance-ego0": 0.001890340785390323}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.412834397045955, "get_ui_image": 0.036080948089512746, "step_physics": 0.13666023068002778, "survival_time": 26.30000000000024, "driven_lanedir": 3.7156663305029416, "get_state_dump": 0.004480512590064495, "get_robot_state": 0.0035342342260892747, "sim_render-ego0": 0.003719732476366539, "get_duckie_state": 1.484347927954889e-06, "in-drivable-lane": 3.8500000000000543, "deviation-heading": 5.317883735731679, "agent_compute-ego0": 0.012272488233939068, "complete-iteration": 0.2118986322486197, "set_robot_commands": 0.0021305550207901727, "deviation-center-line": 1.6289130401183984, "driven_lanedir_consec": 3.7156663305029416, "sim_compute_sim_state": 0.01101576444998638, "sim_compute_performance-ego0": 0.0019229354170739537}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.439379431874041, "get_ui_image": 0.032330689537038285, "step_physics": 0.13039495194225287, "survival_time": 37.899999999999984, "driven_lanedir": 4.79691968888887, "get_state_dump": 0.004392770596329559, "get_robot_state": 0.003485411994542058, "sim_render-ego0": 0.0036730995605428543, "get_duckie_state": 1.5724946073549697e-06, "in-drivable-lane": 9.09999999999971, "deviation-heading": 5.605090943838918, "agent_compute-ego0": 0.012406557130876425, "complete-iteration": 0.20394643273435248, "set_robot_commands": 0.002069565304340267, "deviation-center-line": 1.4875004070954612, "driven_lanedir_consec": 4.7959940930086, "sim_compute_sim_state": 0.013228475497802412, "sim_compute_performance-ego0": 0.0018858727416188035}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.6791427337600986, "get_ui_image": 0.025553063937288376, "step_physics": 0.09531678356919816, "survival_time": 22.10000000000018, "driven_lanedir": 2.4851902279219993, "get_state_dump": 0.004291431629361741, "get_robot_state": 0.003439045382945317, "sim_render-ego0": 0.0036432430921774146, "get_duckie_state": 1.4525773024720478e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 3.511338778109138, "agent_compute-ego0": 0.01209629739111218, "complete-iteration": 0.15447690578400416, "set_robot_commands": 0.0020699915444608737, "deviation-center-line": 0.9758817901405769, "driven_lanedir_consec": 2.4851902279219993, "sim_compute_sim_state": 0.006135008943269269, "sim_compute_performance-ego0": 0.001855201699663769}}
set_robot_commands_max0.0021644464473134463
set_robot_commands_mean0.00210863957922619
set_robot_commands_median0.0021002732826255234
set_robot_commands_min0.002069565304340267
sim_compute_performance-ego0_max0.0019229354170739537
sim_compute_performance-ego0_mean0.001888587660936712
sim_compute_performance-ego0_median0.0018881067635045632
sim_compute_performance-ego0_min0.001855201699663769
sim_compute_sim_state_max0.013228475497802412
sim_compute_sim_state_mean0.01000700076748032
sim_compute_sim_state_median0.010332259314424797
sim_compute_sim_state_min0.006135008943269269
sim_render-ego0_max0.003719732476366539
sim_render-ego0_mean0.003674574576486167
sim_render-ego0_median0.003667661368700357
sim_render-ego0_min0.0036432430921774146
simulation-passed1
step_physics_max0.13666023068002778
step_physics_mean0.1158668594056946
step_physics_median0.11574521168677623
step_physics_min0.09531678356919816
survival_time_max48.449999999999385
survival_time_mean33.68749999999994
survival_time_min22.10000000000018
No reset possible
6189713398Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:19:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1757852159891178
survival_time_median29.125000000000277
deviation-center-line_median0.3881736403632092
in-drivable-lane_median12.750000000000156


other stats
agent_compute-ego0_max0.012664842377802368
agent_compute-ego0_mean0.012448745175161237
agent_compute-ego0_median0.012603434626342488
agent_compute-ego0_min0.0119232690701576
complete-iteration_max0.2379891186786715
complete-iteration_mean0.19414653804664636
complete-iteration_median0.1852466552491167
complete-iteration_min0.1681037230096805
deviation-center-line_max3.579859105771736
deviation-center-line_mean1.149148744293864
deviation-center-line_min0.24038859067730112
deviation-heading_max13.200711298594742
deviation-heading_mean4.563050530279666
deviation-heading_median2.036563078126746
deviation-heading_min0.9783646662704304
driven_any_max9.997126812318012
driven_any_mean5.211186642007833
driven_any_median4.710198585294073
driven_any_min1.4272225851251743
driven_lanedir_consec_max8.954722915151578
driven_lanedir_consec_mean3.0040722847266297
driven_lanedir_consec_min0.7099957917767066
driven_lanedir_max8.954722915151578
driven_lanedir_mean3.0040722847266297
driven_lanedir_median1.1757852159891178
driven_lanedir_min0.7099957917767066
get_duckie_state_max1.3115233525716749e-06
get_duckie_state_mean1.2495547883271226e-06
get_duckie_state_median1.247870923742929e-06
get_duckie_state_min1.190953953250958e-06
get_robot_state_max0.0036760371094639354
get_robot_state_mean0.0036082708702498143
get_robot_state_median0.003595207073140012
get_robot_state_min0.003566632225255298
get_state_dump_max0.004587070395549138
get_state_dump_mean0.004535195471833084
get_state_dump_median0.004544203564618546
get_state_dump_min0.004465304362546107
get_ui_image_max0.03610322127739588
get_ui_image_mean0.030718015820682773
get_ui_image_median0.030539960217658313
get_ui_image_min0.0256889215700186
in-drivable-lane_max22.200000000000255
in-drivable-lane_mean12.962500000000116
in-drivable-lane_min4.149999999999896
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.997126812318012, "get_ui_image": 0.02837623724036173, "step_physics": 0.1080752772951404, "survival_time": 59.99999999999873, "driven_lanedir": 8.954722915151578, "get_state_dump": 0.004505857837686531, "get_robot_state": 0.0036760371094639354, "sim_render-ego0": 0.0037180218073251743, "get_duckie_state": 1.1968572967554706e-06, "in-drivable-lane": 4.149999999999896, "deviation-heading": 13.200711298594742, "agent_compute-ego0": 0.0119232690701576, "complete-iteration": 0.1737804925014931, "set_robot_commands": 0.002256390851899845, "deviation-center-line": 3.579859105771736, "driven_lanedir_consec": 8.954722915151578, "sim_compute_sim_state": 0.00919341147690391, "sim_compute_performance-ego0": 0.001973855902412154}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4272225851251743, "get_ui_image": 0.03610322127739588, "step_physics": 0.12165714676181476, "survival_time": 9.55, "driven_lanedir": 0.7578632168664337, "get_state_dump": 0.004587070395549138, "get_robot_state": 0.0036212950944900513, "sim_render-ego0": 0.003786484400431315, "get_duckie_state": 1.2988845507303874e-06, "in-drivable-lane": 4.350000000000011, "deviation-heading": 1.8000384400627802, "agent_compute-ego0": 0.012589062253634134, "complete-iteration": 0.1967128179967403, "set_robot_commands": 0.002199850976467133, "deviation-center-line": 0.24038859067730112, "driven_lanedir_consec": 0.7578632168664337, "sim_compute_sim_state": 0.010112533966700235, "sim_compute_performance-ego0": 0.0019744373857975006}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.337069898350791, "get_ui_image": 0.0327036831949549, "step_physics": 0.16585074196498778, "survival_time": 26.900000000000247, "driven_lanedir": 0.7099957917767066, "get_state_dump": 0.004582549291550561, "get_robot_state": 0.003569119051789972, "sim_render-ego0": 0.0037334182045676498, "get_duckie_state": 1.3115233525716749e-06, "in-drivable-lane": 22.200000000000255, "deviation-heading": 0.9783646662704304, "agent_compute-ego0": 0.01261780699905084, "complete-iteration": 0.2379891186786715, "set_robot_commands": 0.002092637467251638, "deviation-center-line": 0.25629626734370936, "driven_lanedir_consec": 0.7099957917767066, "sim_compute_sim_state": 0.01086262338457833, "sim_compute_performance-ego0": 0.0019000801836625983}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.083327272237354, "get_ui_image": 0.0256889215700186, "step_physics": 0.10727115117820205, "survival_time": 31.35000000000031, "driven_lanedir": 1.593707215111802, "get_state_dump": 0.004465304362546107, "get_robot_state": 0.003566632225255298, "sim_render-ego0": 0.0037381812265724138, "get_duckie_state": 1.190953953250958e-06, "in-drivable-lane": 21.1500000000003, "deviation-heading": 2.273087716190712, "agent_compute-ego0": 0.012664842377802368, "complete-iteration": 0.1681037230096805, "set_robot_commands": 0.0021497667974727168, "deviation-center-line": 0.520051013382709, "driven_lanedir_consec": 1.593707215111802, "sim_compute_sim_state": 0.0065717302310238975, "sim_compute_performance-ego0": 0.0019103110216225788}}
set_robot_commands_max0.002256390851899845
set_robot_commands_mean0.002174661523272833
set_robot_commands_median0.002174808886969925
set_robot_commands_min0.002092637467251638
sim_compute_performance-ego0_max0.0019744373857975006
sim_compute_performance-ego0_mean0.001939671123373708
sim_compute_performance-ego0_median0.0019420834620173665
sim_compute_performance-ego0_min0.0019000801836625983
sim_compute_sim_state_max0.01086262338457833
sim_compute_sim_state_mean0.009185074764801592
sim_compute_sim_state_median0.009652972721802072
sim_compute_sim_state_min0.0065717302310238975
sim_render-ego0_max0.003786484400431315
sim_render-ego0_mean0.003744026409724138
sim_render-ego0_median0.0037357997155700313
sim_render-ego0_min0.0037180218073251743
simulation-passed1
step_physics_max0.16585074196498778
step_physics_mean0.12571357930003624
step_physics_median0.11486621202847758
step_physics_min0.10727115117820205
survival_time_max59.99999999999873
survival_time_mean31.94999999999982
survival_time_min9.55
No reset possible
6189613397Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:12:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.200000000000038
in-drivable-lane_median1.6000000000000032
driven_lanedir_consec_median1.61951672505609
deviation-center-line_median0.638647305911564


other stats
agent_compute-ego0_max0.01595179309928995
agent_compute-ego0_mean0.015328810751411575
agent_compute-ego0_median0.015275686023423845
agent_compute-ego0_min0.014812077859508674
complete-iteration_max0.3069285197823243
complete-iteration_mean0.2613769403663794
complete-iteration_median0.2694698209646483
complete-iteration_min0.19963959975389656
deviation-center-line_max2.8332390963389367
deviation-center-line_mean1.135960850427579
deviation-center-line_min0.433309693548251
deviation-heading_max7.420621064618355
deviation-heading_mean3.911381938054158
deviation-heading_median2.9963795499745167
deviation-heading_min2.232147587649242
driven_any_max5.759234876466605
driven_any_mean2.7051028884708903
driven_any_median1.9510779901982545
driven_any_min1.159020697020446
driven_lanedir_consec_max3.827575477624531
driven_lanedir_consec_mean2.0380394547204905
driven_lanedir_consec_min1.0855488911452509
driven_lanedir_max3.827575477624531
driven_lanedir_mean2.0380394547204905
driven_lanedir_median1.61951672505609
driven_lanedir_min1.0855488911452509
get_duckie_state_max0.02377171480157076
get_duckie_state_mean0.017198250708329633
get_duckie_state_median0.020426596757185923
get_duckie_state_min0.004168094517375929
get_robot_state_max0.0036508453653213823
get_robot_state_mean0.0035681883230053724
get_robot_state_median0.0035601797067199644
get_robot_state_min0.0035015485132601776
get_state_dump_max0.00825898275629196
get_state_dump_mean0.007207172692248827
get_state_dump_median0.007727631992920175
get_state_dump_min0.005114444026862997
get_ui_image_max0.03924030192354892
get_ui_image_mean0.03308947206430786
get_ui_image_median0.033362430368931884
get_ui_image_min0.026392725595818744
in-drivable-lane_max8.650000000000079
in-drivable-lane_mean2.9625000000000212
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0425431663937834, "get_ui_image": 0.03176564590105992, "step_physics": 0.1593627884360774, "survival_time": 13.100000000000051, "driven_lanedir": 1.9328429696419, "get_state_dump": 0.00825898275629196, "get_robot_state": 0.0035015485132601776, "sim_render-ego0": 0.003526581557531321, "get_duckie_state": 0.02377171480157076, "in-drivable-lane": 0.0, "deviation-heading": 3.37935977758801, "agent_compute-ego0": 0.014812077859508674, "complete-iteration": 0.25700004109864905, "set_robot_commands": 0.0021063791934981544, "deviation-center-line": 0.5631984773498889, "driven_lanedir_consec": 1.9328429696419, "sim_compute_sim_state": 0.00798637060158153, "sim_compute_performance-ego0": 0.0018270042912588373}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.759234876466605, "get_ui_image": 0.03924030192354892, "step_physics": 0.19872950058215297, "survival_time": 32.85000000000027, "driven_lanedir": 3.827575477624531, "get_state_dump": 0.007840188803281465, "get_robot_state": 0.0036508453653213823, "sim_render-ego0": 0.003702441247400904, "get_duckie_state": 0.02059578279593795, "in-drivable-lane": 8.650000000000079, "deviation-heading": 7.420621064618355, "agent_compute-ego0": 0.015537145289968936, "complete-iteration": 0.3069285197823243, "set_robot_commands": 0.002238670018668595, "deviation-center-line": 2.8332390963389367, "driven_lanedir_consec": 3.827575477624531, "sim_compute_sim_state": 0.013375038796282828, "sim_compute_performance-ego0": 0.001929543300964912}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.159020697020446, "get_ui_image": 0.03495921483680384, "step_physics": 0.17969948498170768, "survival_time": 6.649999999999984, "driven_lanedir": 1.0855488911452509, "get_state_dump": 0.007615075182558885, "get_robot_state": 0.003545702393375226, "sim_render-ego0": 0.0035917349715731037, "get_duckie_state": 0.020257410718433892, "in-drivable-lane": 0.0, "deviation-heading": 2.232147587649242, "agent_compute-ego0": 0.015014226756878753, "complete-iteration": 0.2819396008306475, "set_robot_commands": 0.0021719114104313637, "deviation-center-line": 0.433309693548251, "driven_lanedir_consec": 1.0855488911452509, "sim_compute_sim_state": 0.013167456014832454, "sim_compute_performance-ego0": 0.001838769485701376}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.8596128140027253, "get_ui_image": 0.026392725595818744, "step_physics": 0.130745197707861, "survival_time": 11.300000000000026, "driven_lanedir": 1.30619048047028, "get_state_dump": 0.005114444026862997, "get_robot_state": 0.0035746570200647027, "sim_render-ego0": 0.0036363969290309018, "get_duckie_state": 0.004168094517375929, "in-drivable-lane": 3.2000000000000064, "deviation-heading": 2.613399322361024, "agent_compute-ego0": 0.01595179309928995, "complete-iteration": 0.19963959975389656, "set_robot_commands": 0.002215914789275451, "deviation-center-line": 0.7140961344732392, "driven_lanedir_consec": 1.30619048047028, "sim_compute_sim_state": 0.005856588548500632, "sim_compute_performance-ego0": 0.0019007695403918297}}
set_robot_commands_max0.002238670018668595
set_robot_commands_mean0.002183218852968391
set_robot_commands_median0.0021939130998534073
set_robot_commands_min0.0021063791934981544
sim_compute_performance-ego0_max0.001929543300964912
sim_compute_performance-ego0_mean0.001874021654579239
sim_compute_performance-ego0_median0.0018697695130466029
sim_compute_performance-ego0_min0.0018270042912588373
sim_compute_sim_state_max0.013375038796282828
sim_compute_sim_state_mean0.01009636349029936
sim_compute_sim_state_median0.010576913308206991
sim_compute_sim_state_min0.005856588548500632
sim_render-ego0_max0.003702441247400904
sim_render-ego0_mean0.0036142886763840575
sim_render-ego0_median0.0036140659503020025
sim_render-ego0_min0.003526581557531321
simulation-passed1
step_physics_max0.19872950058215297
step_physics_mean0.16713424292694978
step_physics_median0.16953113670889253
step_physics_min0.130745197707861
survival_time_max32.85000000000027
survival_time_mean15.975000000000083
survival_time_min6.649999999999984
No reset possible
6189513395Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:10:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.599999999999981
in-drivable-lane_median0.09999999999999964
driven_lanedir_consec_median1.982760473894334
deviation-center-line_median0.42150413764217354


other stats
agent_compute-ego0_max0.016092931129494493
agent_compute-ego0_mean0.01540270830089808
agent_compute-ego0_median0.015265153099019943
agent_compute-ego0_min0.014987595876057944
complete-iteration_max0.3149772742573096
complete-iteration_mean0.27523218661185034
complete-iteration_median0.2885059874513176
complete-iteration_min0.2089394972874568
deviation-center-line_max1.4313446882915268
deviation-center-line_mean0.6395294572160575
deviation-center-line_min0.2837648652883562
deviation-heading_max4.800459563843141
deviation-heading_mean2.57644031527781
deviation-heading_median2.1949774231230363
deviation-heading_min1.1153468510220264
driven_any_max6.009173760030385
driven_any_mean2.865492100117251
driven_any_median2.0970935919258578
driven_any_min1.258607456586904
driven_lanedir_consec_max5.189985989535797
driven_lanedir_consec_mean2.573600830805409
driven_lanedir_consec_min1.1388963858971706
driven_lanedir_max5.189985989535797
driven_lanedir_mean2.573600830805409
driven_lanedir_median1.982760473894334
driven_lanedir_min1.1388963858971706
get_duckie_state_max0.024282890955607095
get_duckie_state_mean0.01724855584900653
get_duckie_state_median0.020270986127569102
get_duckie_state_min0.004169360185280824
get_robot_state_max0.0036200400517911327
get_robot_state_mean0.00358533670903703
get_robot_state_median0.003575432667365441
get_robot_state_min0.003570441449626108
get_state_dump_max0.008515742619832357
get_state_dump_mean0.007302026536028811
get_state_dump_median0.0077602266069399985
get_state_dump_min0.005171910310402894
get_ui_image_max0.03968261577645127
get_ui_image_mean0.033976518664902464
get_ui_image_median0.03468483640906516
get_ui_image_min0.026853786065028265
in-drivable-lane_max1.5000000000000115
in-drivable-lane_mean0.4250000000000027
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.0659914285693177, "get_ui_image": 0.032775745391845704, "step_physics": 0.17944942156473795, "survival_time": 7.449999999999981, "driven_lanedir": 1.9357233876047304, "get_state_dump": 0.008515742619832357, "get_robot_state": 0.0035782210032145184, "sim_render-ego0": 0.00369202454884847, "get_duckie_state": 0.024282890955607095, "in-drivable-lane": 0.0, "deviation-heading": 2.109830170620994, "agent_compute-ego0": 0.014987595876057944, "complete-iteration": 0.27954176425933835, "set_robot_commands": 0.002173115412394206, "deviation-center-line": 0.39565529613688066, "driven_lanedir_consec": 1.9357233876047304, "sim_compute_sim_state": 0.008110807736714682, "sim_compute_performance-ego0": 0.001890230178833008}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.009173760030385, "get_ui_image": 0.03968261577645127, "step_physics": 0.20631330049767785, "survival_time": 19.550000000000143, "driven_lanedir": 5.189985989535797, "get_state_dump": 0.007706876311983381, "get_robot_state": 0.0036200400517911327, "sim_render-ego0": 0.0036573701975296954, "get_duckie_state": 0.020384332355187863, "in-drivable-lane": 1.5000000000000115, "deviation-heading": 4.800459563843141, "agent_compute-ego0": 0.016092931129494493, "complete-iteration": 0.3149772742573096, "set_robot_commands": 0.0022691907931347284, "deviation-center-line": 1.4313446882915268, "driven_lanedir_consec": 5.189985989535797, "sim_compute_sim_state": 0.013268176390200243, "sim_compute_performance-ego0": 0.0018992728116560952}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.258607456586904, "get_ui_image": 0.03659392742628462, "step_physics": 0.19334629144561424, "survival_time": 4.399999999999992, "driven_lanedir": 1.1388963858971706, "get_state_dump": 0.007813576901896616, "get_robot_state": 0.003570441449626108, "sim_render-ego0": 0.003676127851679084, "get_duckie_state": 0.02015763989995035, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 1.1153468510220264, "agent_compute-ego0": 0.015349505992417923, "complete-iteration": 0.2974702106432968, "set_robot_commands": 0.002112091257331077, "deviation-center-line": 0.2837648652883562, "driven_lanedir_consec": 1.1388963858971706, "sim_compute_sim_state": 0.01290122578653057, "sim_compute_performance-ego0": 0.001862258053897472}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.128195755282398, "get_ui_image": 0.026853786065028265, "step_physics": 0.1402813914494637, "survival_time": 7.7499999999999805, "driven_lanedir": 2.0297975601839373, "get_state_dump": 0.005171910310402894, "get_robot_state": 0.0035726443315163637, "sim_render-ego0": 0.003683317930270464, "get_duckie_state": 0.004169360185280824, "in-drivable-lane": 0.0, "deviation-heading": 2.280124675625079, "agent_compute-ego0": 0.015180800205621963, "complete-iteration": 0.2089394972874568, "set_robot_commands": 0.0022249649732540813, "deviation-center-line": 0.4473529791474664, "driven_lanedir_consec": 2.0297975601839373, "sim_compute_sim_state": 0.00578383757517888, "sim_compute_performance-ego0": 0.0019312714919065817}}
set_robot_commands_max0.0022691907931347284
set_robot_commands_mean0.002194840609028523
set_robot_commands_median0.0021990401928241436
set_robot_commands_min0.002112091257331077
sim_compute_performance-ego0_max0.0019312714919065817
sim_compute_performance-ego0_mean0.0018957581340732891
sim_compute_performance-ego0_median0.0018947514952445516
sim_compute_performance-ego0_min0.001862258053897472
sim_compute_sim_state_max0.013268176390200243
sim_compute_sim_state_mean0.010016011872156094
sim_compute_sim_state_median0.010506016761622626
sim_compute_sim_state_min0.00578383757517888
sim_render-ego0_max0.00369202454884847
sim_render-ego0_mean0.003677210132081929
sim_render-ego0_median0.003679722890974774
sim_render-ego0_min0.0036573701975296954
simulation-passed1
step_physics_max0.20631330049767785
step_physics_mean0.17984760123937343
step_physics_median0.1863978565051761
step_physics_min0.1402813914494637
survival_time_max19.550000000000143
survival_time_mean9.787500000000025
survival_time_min4.399999999999992
No reset possible
6189313394Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:39:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.476654620586913
survival_time_median59.99999999999873
deviation-center-line_median3.9173176462386943
in-drivable-lane_median2.124999999999991


other stats
agent_compute-ego0_max0.01576149672096119
agent_compute-ego0_mean0.01505583455223128
agent_compute-ego0_median0.01508727141165118
agent_compute-ego0_min0.01428729866466157
complete-iteration_max0.25936153131559625
complete-iteration_mean0.2238316818836031
complete-iteration_median0.22750361882876
complete-iteration_min0.18095795856129615
deviation-center-line_max4.377872366788693
deviation-center-line_mean3.907161108399299
deviation-center-line_min3.4161367743311137
deviation-heading_max18.637650685534783
deviation-heading_mean15.883748783824696
deviation-heading_median15.567454715227097
deviation-heading_min13.762435019309816
driven_any_max19.56995361918501
driven_any_mean19.35155432709064
driven_any_median19.28193701347182
driven_any_min19.27238966223391
driven_lanedir_consec_max17.968911398324444
driven_lanedir_consec_mean17.508492915477582
driven_lanedir_consec_min17.11175102241207
driven_lanedir_max17.968911398324444
driven_lanedir_mean17.508492915477582
driven_lanedir_median17.476654620586913
driven_lanedir_min17.11175102241207
get_duckie_state_max1.5001908428563762e-06
get_duckie_state_mean1.4466409579998846e-06
get_duckie_state_median1.4387499184334506e-06
get_duckie_state_min1.4088731522762606e-06
get_robot_state_max0.003545112157245162
get_robot_state_mean0.0034696003678041532
get_robot_state_median0.0034515642305893465
get_robot_state_min0.0034301608527927572
get_state_dump_max0.00426744044968528
get_state_dump_mean0.004236217740175627
get_state_dump_median0.004235035275340974
get_state_dump_min0.00420735996033528
get_ui_image_max0.035352094088069205
get_ui_image_mean0.030164749546908617
get_ui_image_median0.029886164633459493
get_ui_image_min0.025534574832646276
in-drivable-lane_max2.749999999999953
in-drivable-lane_mean2.187499999999966
in-drivable-lane_min1.7499999999999254
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 19.282951578950588, "get_ui_image": 0.02802026500114295, "step_physics": 0.1464445084755268, "survival_time": 59.99999999999873, "driven_lanedir": 17.968911398324444, "get_state_dump": 0.00426744044968528, "get_robot_state": 0.003545112157245162, "sim_render-ego0": 0.0035999480334050846, "get_duckie_state": 1.411453869618742e-06, "in-drivable-lane": 1.7499999999999698, "deviation-heading": 13.762435019309816, "agent_compute-ego0": 0.015604265921320347, "complete-iteration": 0.21469843893821391, "set_robot_commands": 0.002153743812186235, "deviation-center-line": 4.056572749237021, "driven_lanedir_consec": 17.968911398324444, "sim_compute_sim_state": 0.009099406862536834, "sim_compute_performance-ego0": 0.0018871136251635396}, "LF-norm-zigzag-000-ego0": {"driven_any": 19.56995361918501, "get_ui_image": 0.035352094088069205, "step_physics": 0.18001799698574755, "survival_time": 59.99999999999873, "driven_lanedir": 17.11175102241207, "get_state_dump": 0.00422846705192928, "get_robot_state": 0.003453919730714517, "sim_render-ego0": 0.0035501405857286286, "get_duckie_state": 1.466045967248159e-06, "in-drivable-lane": 2.749999999999953, "deviation-heading": 18.637650685534783, "agent_compute-ego0": 0.01576149672096119, "complete-iteration": 0.25936153131559625, "set_robot_commands": 0.002038083406014804, "deviation-center-line": 4.377872366788693, "driven_lanedir_consec": 17.11175102241207, "sim_compute_sim_state": 0.01304952330037418, "sim_compute_performance-ego0": 0.0018376267819877072}, "LF-norm-techtrack-000-ego0": {"driven_any": 19.27238966223391, "get_ui_image": 0.03175206426577604, "step_physics": 0.16606141228560703, "survival_time": 59.99999999999873, "driven_lanedir": 17.24893324879677, "get_state_dump": 0.00420735996033528, "get_robot_state": 0.0034301608527927572, "sim_render-ego0": 0.003587531805236969, "get_duckie_state": 1.4088731522762606e-06, "in-drivable-lane": 2.5000000000000124, "deviation-heading": 16.58160351787201, "agent_compute-ego0": 0.014570276901982012, "complete-iteration": 0.24030879871930608, "set_robot_commands": 0.002092605824275974, "deviation-center-line": 3.778062543240368, "driven_lanedir_consec": 17.24893324879677, "sim_compute_sim_state": 0.012668237995843308, "sim_compute_performance-ego0": 0.0018663932441374744}, "LF-norm-small_loop-000-ego0": {"driven_any": 19.280922447993053, "get_ui_image": 0.025534574832646276, "step_physics": 0.1198910142261718, "survival_time": 59.99999999999873, "driven_lanedir": 17.704375992377052, "get_state_dump": 0.004241603498752667, "get_robot_state": 0.003449208730464176, "sim_render-ego0": 0.003546447976244975, "get_duckie_state": 1.5001908428563762e-06, "in-drivable-lane": 1.7499999999999254, "deviation-heading": 14.553305912582182, "agent_compute-ego0": 0.01428729866466157, "complete-iteration": 0.18095795856129615, "set_robot_commands": 0.002065522188350223, "deviation-center-line": 3.4161367743311137, "driven_lanedir_consec": 17.704375992377052, "sim_compute_sim_state": 0.006023926500674588, "sim_compute_performance-ego0": 0.001846045081958882}}
set_robot_commands_max0.002153743812186235
set_robot_commands_mean0.0020874888077068087
set_robot_commands_median0.0020790640063130987
set_robot_commands_min0.002038083406014804
sim_compute_performance-ego0_max0.0018871136251635396
sim_compute_performance-ego0_mean0.0018592946833119008
sim_compute_performance-ego0_median0.001856219163048178
sim_compute_performance-ego0_min0.0018376267819877072
sim_compute_sim_state_max0.01304952330037418
sim_compute_sim_state_mean0.010210273664857227
sim_compute_sim_state_median0.01088382242919007
sim_compute_sim_state_min0.006023926500674588
sim_render-ego0_max0.0035999480334050846
sim_render-ego0_mean0.0035710171001539144
sim_render-ego0_median0.003568836195482799
sim_render-ego0_min0.003546447976244975
simulation-passed1
step_physics_max0.18001799698574755
step_physics_mean0.1531037329932633
step_physics_median0.1562529603805669
step_physics_min0.1198910142261718
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6188613388Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median23.574037596415444
survival_time_median59.99999999999873
deviation-center-line_median3.6848653070447064
in-drivable-lane_median3.849999999999961


other stats
agent_compute-ego0_max0.01632106214836178
agent_compute-ego0_mean0.015712023476180587
agent_compute-ego0_median0.015772634005169386
agent_compute-ego0_min0.014981763746021788
complete-iteration_max0.2620946886537474
complete-iteration_mean0.227225133669962
complete-iteration_median0.22960839065088023
complete-iteration_min0.18758906472434012
deviation-center-line_max3.922867748851533
deviation-center-line_mean3.5611442989677062
deviation-center-line_min2.9519788329298793
deviation-heading_max15.73872033697291
deviation-heading_mean13.66128729300796
deviation-heading_median13.501752996771597
deviation-heading_min11.902922841515732
driven_any_max26.516077865301487
driven_any_mean26.440376556974925
driven_any_median26.42480740679296
driven_any_min26.395813549012296
driven_lanedir_consec_max24.68808813498933
driven_lanedir_consec_mean22.786504830566297
driven_lanedir_consec_min19.309855994444955
driven_lanedir_max24.68808813498933
driven_lanedir_mean22.786504830566297
driven_lanedir_median23.574037596415444
driven_lanedir_min19.309855994444955
get_duckie_state_max1.874196340797545e-06
get_duckie_state_mean1.7690321090914228e-06
get_duckie_state_median1.7744416896747014e-06
get_duckie_state_min1.6530487162187435e-06
get_robot_state_max0.003698269790852695
get_robot_state_mean0.003581826980663874
get_robot_state_median0.0035764153652842294
get_robot_state_min0.0034762074012343433
get_state_dump_max0.0045114589869033085
get_state_dump_mean0.00442655298930223
get_state_dump_median0.004434702001344552
get_state_dump_min0.004325348967616505
get_ui_image_max0.03615725606208439
get_ui_image_mean0.030896249559896373
get_ui_image_median0.030542442741044652
get_ui_image_min0.0263428566954118
in-drivable-lane_max12.799999999999732
in-drivable-lane_mean5.712499999999915
in-drivable-lane_min2.350000000000005
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 26.516077865301487, "get_ui_image": 0.02854734535121997, "step_physics": 0.14654440705127064, "survival_time": 59.99999999999873, "driven_lanedir": 24.68808813498933, "get_state_dump": 0.004421054274712276, "get_robot_state": 0.003551043836798497, "sim_render-ego0": 0.003714991052581508, "get_duckie_state": 1.6530487162187435e-06, "in-drivable-lane": 2.350000000000005, "deviation-heading": 11.902922841515732, "agent_compute-ego0": 0.015973072464916728, "complete-iteration": 0.216363356174974, "set_robot_commands": 0.0022291599165688548, "deviation-center-line": 3.698999911635742, "driven_lanedir_consec": 24.68808813498933, "sim_compute_sim_state": 0.009351508603504952, "sim_compute_performance-ego0": 0.001948043567552654}, "LF-norm-zigzag-000-ego0": {"driven_any": 26.44543218112178, "get_ui_image": 0.03615725606208439, "step_physics": 0.17994485111855946, "survival_time": 59.99999999999873, "driven_lanedir": 23.860332675290312, "get_state_dump": 0.004448349727976828, "get_robot_state": 0.003601786893769962, "sim_render-ego0": 0.00373367445355748, "get_duckie_state": 1.8303241459753592e-06, "in-drivable-lane": 2.699999999999944, "deviation-heading": 15.73872033697291, "agent_compute-ego0": 0.01632106214836178, "complete-iteration": 0.2620946886537474, "set_robot_commands": 0.0022721552630447527, "deviation-center-line": 3.922867748851533, "driven_lanedir_consec": 23.860332675290312, "sim_compute_sim_state": 0.01354432741271566, "sim_compute_performance-ego0": 0.001986000361192435}, "LF-norm-techtrack-000-ego0": {"driven_any": 26.40418263246413, "get_ui_image": 0.03253754013086933, "step_physics": 0.16664756108680237, "survival_time": 59.99999999999873, "driven_lanedir": 23.28774251754058, "get_state_dump": 0.004325348967616505, "get_robot_state": 0.0034762074012343433, "sim_render-ego0": 0.0035932739013239904, "get_duckie_state": 1.7185592333740438e-06, "in-drivable-lane": 4.999999999999978, "deviation-heading": 12.349016203172468, "agent_compute-ego0": 0.015572195545422048, "complete-iteration": 0.24285342512678643, "set_robot_commands": 0.002138113995376574, "deviation-center-line": 3.670730702453671, "driven_lanedir_consec": 23.28774251754058, "sim_compute_sim_state": 0.012616134305282198, "sim_compute_performance-ego0": 0.0018659594851072189}, "LF-norm-small_loop-000-ego0": {"driven_any": 26.395813549012296, "get_ui_image": 0.0263428566954118, "step_physics": 0.12365354566550274, "survival_time": 59.99999999999873, "driven_lanedir": 19.309855994444955, "get_state_dump": 0.0045114589869033085, "get_robot_state": 0.003698269790852695, "sim_render-ego0": 0.00376927147896264, "get_duckie_state": 1.874196340797545e-06, "in-drivable-lane": 12.799999999999732, "deviation-heading": 14.654489790370723, "agent_compute-ego0": 0.014981763746021788, "complete-iteration": 0.18758906472434012, "set_robot_commands": 0.002327764957373982, "deviation-center-line": 2.9519788329298793, "driven_lanedir_consec": 19.309855994444955, "sim_compute_sim_state": 0.006192131106005819, "sim_compute_performance-ego0": 0.002025664398612627}}
set_robot_commands_max0.002327764957373982
set_robot_commands_mean0.0022417985330910406
set_robot_commands_median0.0022506575898068037
set_robot_commands_min0.002138113995376574
sim_compute_performance-ego0_max0.002025664398612627
sim_compute_performance-ego0_mean0.001956416953116234
sim_compute_performance-ego0_median0.0019670219643725443
sim_compute_performance-ego0_min0.0018659594851072189
sim_compute_sim_state_max0.01354432741271566
sim_compute_sim_state_mean0.010426025356877158
sim_compute_sim_state_median0.010983821454393576
sim_compute_sim_state_min0.006192131106005819
sim_render-ego0_max0.00376927147896264
sim_render-ego0_mean0.0037028027216064047
sim_render-ego0_median0.0037243327530694943
sim_render-ego0_min0.0035932739013239904
simulation-passed1
step_physics_max0.17994485111855946
step_physics_mean0.1541975912305338
step_physics_median0.15659598406903652
step_physics_min0.12365354566550274
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6188513387Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.069615750098148
survival_time_median53.62499999999909
deviation-center-line_median2.4527153016549197
in-drivable-lane_median5.550000000000059


other stats
agent_compute-ego0_max0.01252670797182692
agent_compute-ego0_mean0.0123628568229823
agent_compute-ego0_median0.012367683190465856
agent_compute-ego0_min0.012189352939170565
complete-iteration_max0.19533640572002955
complete-iteration_mean0.17688357943275695
complete-iteration_median0.17977611617581435
complete-iteration_min0.15264567965936962
deviation-center-line_max3.5631257218558328
deviation-center-line_mean2.1687732095599177
deviation-center-line_min0.20653651307399845
deviation-heading_max11.300216939945278
deviation-heading_mean7.383876039946902
deviation-heading_median8.472390843564668
deviation-heading_min1.2905055327129928
driven_any_max10.422442064001944
driven_any_mean7.546519925834102
driven_any_median9.24329009116012
driven_any_min1.2770574570142266
driven_lanedir_consec_max9.291695290164748
driven_lanedir_consec_mean6.037016802523843
driven_lanedir_consec_min0.7171404197343318
driven_lanedir_max9.291695290164748
driven_lanedir_mean6.037016802523843
driven_lanedir_median7.069615750098148
driven_lanedir_min0.7171404197343318
get_duckie_state_max1.3919992311908046e-06
get_duckie_state_mean1.327399446705456e-06
get_duckie_state_median1.3318793882646257e-06
get_duckie_state_min1.253839779101769e-06
get_robot_state_max0.0035048994196146157
get_robot_state_mean0.003469939337299041
get_robot_state_median0.0034747895478236548
get_robot_state_min0.003425278833934239
get_state_dump_max0.004572318058823864
get_state_dump_mean0.004408968196406577
get_state_dump_median0.0043808202899170735
get_state_dump_min0.0043019141469682965
get_ui_image_max0.036152824049904234
get_ui_image_mean0.030689609337996037
get_ui_image_median0.03037883220961648
get_ui_image_min0.02584794888284695
in-drivable-lane_max16.49999999999915
in-drivable-lane_mean7.824999999999815
in-drivable-lane_min3.699999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.413777267522285, "get_ui_image": 0.027991337541934353, "step_physics": 0.09928984110004002, "survival_time": 59.99999999999873, "driven_lanedir": 9.291695290164748, "get_state_dump": 0.0043540421770970885, "get_robot_state": 0.0034966913488484936, "sim_render-ego0": 0.0037020195731513206, "get_duckie_state": 1.36380985714216e-06, "in-drivable-lane": 4.800000000000068, "deviation-heading": 10.544258258496429, "agent_compute-ego0": 0.012189352939170565, "complete-iteration": 0.1642959487130501, "set_robot_commands": 0.0021167786095561236, "deviation-center-line": 3.1757645679532525, "driven_lanedir_consec": 9.291695290164748, "sim_compute_sim_state": 0.009186291277756003, "sim_compute_performance-ego0": 0.001892660976349563}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2770574570142266, "get_ui_image": 0.036152824049904234, "step_physics": 0.12194569196019854, "survival_time": 8.349999999999984, "driven_lanedir": 0.7171404197343318, "get_state_dump": 0.0043019141469682965, "get_robot_state": 0.003425278833934239, "sim_render-ego0": 0.003585450706027803, "get_duckie_state": 1.2999489193870908e-06, "in-drivable-lane": 3.699999999999992, "deviation-heading": 1.2905055327129928, "agent_compute-ego0": 0.012337112710589454, "complete-iteration": 0.19533640572002955, "set_robot_commands": 0.002020214285169329, "deviation-center-line": 0.20653651307399845, "driven_lanedir_consec": 0.7171404197343318, "sim_compute_sim_state": 0.009681196439833869, "sim_compute_performance-ego0": 0.0018145527158464703}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.422442064001944, "get_ui_image": 0.0327663268772986, "step_physics": 0.1211787189274009, "survival_time": 59.99999999999873, "driven_lanedir": 8.996157374052409, "get_state_dump": 0.004572318058823864, "get_robot_state": 0.0035048994196146157, "sim_render-ego0": 0.003672792155180843, "get_duckie_state": 1.3919992311908046e-06, "in-drivable-lane": 6.30000000000005, "deviation-heading": 11.300216939945278, "agent_compute-ego0": 0.01239825367034226, "complete-iteration": 0.19525628363857855, "set_robot_commands": 0.0021164627694567474, "deviation-center-line": 3.5631257218558328, "driven_lanedir_consec": 8.996157374052409, "sim_compute_sim_state": 0.013065075100113411, "sim_compute_performance-ego0": 0.001900787853777756}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.072802914797954, "get_ui_image": 0.02584794888284695, "step_physics": 0.09262681788672351, "survival_time": 47.24999999999945, "driven_lanedir": 5.143074126143886, "get_state_dump": 0.004407598402737059, "get_robot_state": 0.003452887746798816, "sim_render-ego0": 0.003603053143362162, "get_duckie_state": 1.253839779101769e-06, "in-drivable-lane": 16.49999999999915, "deviation-heading": 6.4005234286329085, "agent_compute-ego0": 0.01252670797182692, "complete-iteration": 0.15264567965936962, "set_robot_commands": 0.002054210697117618, "deviation-center-line": 1.7296660353565867, "driven_lanedir_consec": 5.143074126143886, "sim_compute_sim_state": 0.006208733322756487, "sim_compute_performance-ego0": 0.0018436528159498412}}
set_robot_commands_max0.0021167786095561236
set_robot_commands_mean0.0020769165903249545
set_robot_commands_median0.002085336733287183
set_robot_commands_min0.002020214285169329
sim_compute_performance-ego0_max0.001900787853777756
sim_compute_performance-ego0_mean0.0018629135904809076
sim_compute_performance-ego0_median0.001868156896149702
sim_compute_performance-ego0_min0.0018145527158464703
sim_compute_sim_state_max0.013065075100113411
sim_compute_sim_state_mean0.009535324035114943
sim_compute_sim_state_median0.009433743858794936
sim_compute_sim_state_min0.006208733322756487
sim_render-ego0_max0.0037020195731513206
sim_render-ego0_mean0.003640828894430532
sim_render-ego0_median0.0036379226492715025
sim_render-ego0_min0.003585450706027803
simulation-passed1
step_physics_max0.12194569196019854
step_physics_mean0.10876026746859074
step_physics_median0.11023428001372046
step_physics_min0.09262681788672351
survival_time_max59.99999999999873
survival_time_mean43.899999999999224
survival_time_min8.349999999999984
No reset possible
6188413386Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.145904743094439
survival_time_median52.824999999999136
deviation-center-line_median2.813116925902751
in-drivable-lane_median9.699999999999774


other stats
agent_compute-ego0_max0.012347405796760542
agent_compute-ego0_mean0.011820836726023538
agent_compute-ego0_median0.011758819010914292
agent_compute-ego0_min0.01141830308550502
complete-iteration_max0.2074015153576039
complete-iteration_mean0.17577197439629527
complete-iteration_median0.17400886943426755
complete-iteration_min0.14766864335904212
deviation-center-line_max3.848682942847323
deviation-center-line_mean2.929492718467137
deviation-center-line_min2.2430540792157236
deviation-heading_max10.819366452437224
deviation-heading_mean9.091585904835531
deviation-heading_median9.55271978381044
deviation-heading_min6.441537599284016
driven_any_max10.422422983670751
driven_any_mean8.880748114387272
driven_any_median9.103514580765872
driven_any_min6.893540312346589
driven_lanedir_consec_max9.829683891797323
driven_lanedir_consec_mean7.169904696772422
driven_lanedir_consec_min4.558125409103486
driven_lanedir_max9.829683891797323
driven_lanedir_mean7.172715471058619
driven_lanedir_median7.145904743094439
driven_lanedir_min4.5693685062482725
get_duckie_state_max1.138588356177992e-06
get_duckie_state_mean1.09854321008049e-06
get_duckie_state_median1.1001348038938385e-06
get_duckie_state_min1.0553148763562915e-06
get_robot_state_max0.0034928808204339606
get_robot_state_mean0.003442409571854739
get_robot_state_median0.003432529665701027
get_robot_state_min0.0034116981355829393
get_state_dump_max0.004253843709661105
get_state_dump_mean0.004204388950207997
get_state_dump_median0.004195941326570007
get_state_dump_min0.004171829438030869
get_ui_image_max0.0350634383946592
get_ui_image_mean0.029931535786636022
get_ui_image_median0.029686069265310353
get_ui_image_min0.02529056622126418
in-drivable-lane_max12.849999999999325
in-drivable-lane_mean8.56249999999969
in-drivable-lane_min1.9999999999998863
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.413761283227691, "get_ui_image": 0.027585951315175484, "step_physics": 0.09844982554573103, "survival_time": 59.99999999999873, "driven_lanedir": 9.829683891797323, "get_state_dump": 0.004171829438030869, "get_robot_state": 0.0034928808204339606, "sim_render-ego0": 0.0035628877412667384, "get_duckie_state": 1.0553148763562915e-06, "in-drivable-lane": 1.9999999999998863, "deviation-heading": 10.357883138362824, "agent_compute-ego0": 0.011650130115480446, "complete-iteration": 0.1621445340975238, "set_robot_commands": 0.0022364953078397804, "deviation-center-line": 3.848682942847323, "driven_lanedir_consec": 9.829683891797323, "sim_compute_sim_state": 0.009071664945172033, "sim_compute_performance-ego0": 0.0018505569699404144}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.793267878304051, "get_ui_image": 0.0350634383946592, "step_physics": 0.13267211006298107, "survival_time": 45.649999999999544, "driven_lanedir": 5.507278143528301, "get_state_dump": 0.004186421306701927, "get_robot_state": 0.003427418368650474, "sim_render-ego0": 0.003561768281381553, "get_duckie_state": 1.081230864743957e-06, "in-drivable-lane": 12.849999999999325, "deviation-heading": 6.441537599284016, "agent_compute-ego0": 0.012347405796760542, "complete-iteration": 0.2074015153576039, "set_robot_commands": 0.002071917448315109, "deviation-center-line": 2.2430540792157236, "driven_lanedir_consec": 5.507278143528301, "sim_compute_sim_state": 0.012171128907401924, "sim_compute_performance-ego0": 0.0018250279666558397}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.893540312346589, "get_ui_image": 0.03178618721544522, "step_physics": 0.11434087947323349, "survival_time": 40.49999999999984, "driven_lanedir": 4.5693685062482725, "get_state_dump": 0.004253843709661105, "get_robot_state": 0.0034116981355829393, "sim_render-ego0": 0.003518931815715371, "get_duckie_state": 1.138588356177992e-06, "in-drivable-lane": 11.699999999999878, "deviation-heading": 8.747556429258058, "agent_compute-ego0": 0.011867507906348138, "complete-iteration": 0.1858732047710113, "set_robot_commands": 0.0020153754736433487, "deviation-center-line": 2.2473117853845244, "driven_lanedir_consec": 4.558125409103486, "sim_compute_sim_state": 0.01280106245809948, "sim_compute_performance-ego0": 0.0018052960735655008}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.422422983670751, "get_ui_image": 0.02529056622126418, "step_physics": 0.08982844912539314, "survival_time": 59.99999999999873, "driven_lanedir": 8.784531342660578, "get_state_dump": 0.004205461346438088, "get_robot_state": 0.0034376409627515808, "sim_render-ego0": 0.003509974896560402, "get_duckie_state": 1.11903874304372e-06, "in-drivable-lane": 7.699999999999669, "deviation-heading": 10.819366452437224, "agent_compute-ego0": 0.01141830308550502, "complete-iteration": 0.14766864335904212, "set_robot_commands": 0.002076281198951029, "deviation-center-line": 3.378922066420978, "driven_lanedir_consec": 8.784531342660578, "sim_compute_sim_state": 0.00600672740920398, "sim_compute_performance-ego0": 0.001820862640647666}}
set_robot_commands_max0.0022364953078397804
set_robot_commands_mean0.0021000173571873166
set_robot_commands_median0.002074099323633069
set_robot_commands_min0.0020153754736433487
sim_compute_performance-ego0_max0.0018505569699404144
sim_compute_performance-ego0_mean0.0018254359127023551
sim_compute_performance-ego0_median0.001822945303651753
sim_compute_performance-ego0_min0.0018052960735655008
sim_compute_sim_state_max0.01280106245809948
sim_compute_sim_state_mean0.010012645929969354
sim_compute_sim_state_median0.010621396926286978
sim_compute_sim_state_min0.00600672740920398
sim_render-ego0_max0.0035628877412667384
sim_render-ego0_mean0.003538390683731016
sim_render-ego0_median0.003540350048548462
sim_render-ego0_min0.003509974896560402
simulation-passed1
step_physics_max0.13267211006298107
step_physics_mean0.10882281605183468
step_physics_median0.10639535250948226
step_physics_min0.08982844912539314
survival_time_max59.99999999999873
survival_time_mean51.53749999999921
survival_time_min40.49999999999984
No reset possible
6188313385Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:22:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.840339790623757
survival_time_median38.949999999999925
deviation-center-line_median2.171946745800867
in-drivable-lane_median10.799999999999391


other stats
agent_compute-ego0_max0.013070019410581004
agent_compute-ego0_mean0.012192550158143531
agent_compute-ego0_median0.01193423970000768
agent_compute-ego0_min0.01183170182197776
complete-iteration_max0.21376278449077996
complete-iteration_mean0.1842842164993639
complete-iteration_median0.18651993517256948
complete-iteration_min0.1503342111615369
deviation-center-line_max2.7235920092830477
deviation-center-line_mean1.815239766075882
deviation-center-line_min0.19347356341874433
deviation-heading_max8.350556736537333
deviation-heading_mean5.864677174978686
deviation-heading_median7.011203682090014
deviation-heading_min1.0857445991973829
driven_any_max9.758289975802697
driven_any_mean6.944473767683683
driven_any_median6.883122507059896
driven_any_min4.253360080812248
driven_lanedir_consec_max6.937224820349089
driven_lanedir_consec_mean4.832507910923015
driven_lanedir_consec_min0.7121272420954572
driven_lanedir_max6.937224820349089
driven_lanedir_mean4.832507910923015
driven_lanedir_median5.840339790623757
driven_lanedir_min0.7121272420954572
get_duckie_state_max1.3210335556341676e-06
get_duckie_state_mean1.2505680546122785e-06
get_duckie_state_median1.252733910811077e-06
get_duckie_state_min1.175770841192791e-06
get_robot_state_max0.0034959351229492783
get_robot_state_mean0.003483660502797221
get_robot_state_median0.003488456248864143
get_robot_state_min0.00346179439051132
get_state_dump_max0.00433291592737184
get_state_dump_mean0.004255953837058193
get_state_dump_median0.004240421180225676
get_state_dump_min0.004210057060409583
get_ui_image_max0.035560431827432064
get_ui_image_mean0.030094008411049297
get_ui_image_median0.029680135050705526
get_ui_image_min0.025455331715354083
in-drivable-lane_max20.00000000000022
in-drivable-lane_mean11.424999999999716
in-drivable-lane_min4.099999999999863
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.2238190963341316, "get_ui_image": 0.027482992279500424, "step_physics": 0.10123288602292684, "survival_time": 40.84999999999982, "driven_lanedir": 6.0377044750082, "get_state_dump": 0.004210057060409583, "get_robot_state": 0.0034959351229492783, "sim_render-ego0": 0.003761255070749297, "get_duckie_state": 1.175770841192791e-06, "in-drivable-lane": 6.549999999999628, "deviation-heading": 5.840886324609878, "agent_compute-ego0": 0.01183170182197776, "complete-iteration": 0.1660095945838611, "set_robot_commands": 0.002251430070779143, "deviation-center-line": 2.2766264331005006, "driven_lanedir_consec": 6.0377044750082, "sim_compute_sim_state": 0.009725881089208178, "sim_compute_performance-ego0": 0.001942640994755155}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.54242591778566, "get_ui_image": 0.035560431827432064, "step_physics": 0.13288981156207802, "survival_time": 37.05000000000003, "driven_lanedir": 5.642975106239314, "get_state_dump": 0.004259371371924716, "get_robot_state": 0.00346179439051132, "sim_render-ego0": 0.0035680201497039384, "get_duckie_state": 1.261819083735628e-06, "in-drivable-lane": 4.099999999999863, "deviation-heading": 8.18152103957015, "agent_compute-ego0": 0.011853998562075058, "complete-iteration": 0.20703027576127783, "set_robot_commands": 0.002069094431689486, "deviation-center-line": 2.0672670585012347, "driven_lanedir_consec": 5.642975106239314, "sim_compute_sim_state": 0.01145622286835128, "sim_compute_performance-ego0": 0.0018360168143424064}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.253360080812248, "get_ui_image": 0.031877277821910625, "step_physics": 0.14279687501946275, "survival_time": 24.450000000000212, "driven_lanedir": 0.7121272420954572, "get_state_dump": 0.004221470988526636, "get_robot_state": 0.003486027036394392, "sim_render-ego0": 0.003648994406875299, "get_duckie_state": 1.3210335556341676e-06, "in-drivable-lane": 20.00000000000022, "deviation-heading": 1.0857445991973829, "agent_compute-ego0": 0.013070019410581004, "complete-iteration": 0.21376278449077996, "set_robot_commands": 0.0020519495010375977, "deviation-center-line": 0.19347356341874433, "driven_lanedir_consec": 0.7121272420954572, "sim_compute_sim_state": 0.010694576769459004, "sim_compute_performance-ego0": 0.0018409831183297293}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.758289975802697, "get_ui_image": 0.025455331715354083, "step_physics": 0.0914103221284212, "survival_time": 54.74999999999903, "driven_lanedir": 6.937224820349089, "get_state_dump": 0.00433291592737184, "get_robot_state": 0.0034908854613338943, "sim_render-ego0": 0.003666983903759587, "get_duckie_state": 1.2436487378865262e-06, "in-drivable-lane": 15.049999999999155, "deviation-heading": 8.350556736537333, "agent_compute-ego0": 0.0120144808379403, "complete-iteration": 0.1503342111615369, "set_robot_commands": 0.00219452837957953, "deviation-center-line": 2.7235920092830477, "driven_lanedir_consec": 6.937224820349089, "sim_compute_sim_state": 0.005804887870802497, "sim_compute_performance-ego0": 0.0018892832046007587}}
set_robot_commands_max0.002251430070779143
set_robot_commands_mean0.0021417505957714396
set_robot_commands_median0.0021318114056345077
set_robot_commands_min0.0020519495010375977
sim_compute_performance-ego0_max0.001942640994755155
sim_compute_performance-ego0_mean0.0018772310330070123
sim_compute_performance-ego0_median0.001865133161465244
sim_compute_performance-ego0_min0.0018360168143424064
sim_compute_sim_state_max0.01145622286835128
sim_compute_sim_state_mean0.00942039214945524
sim_compute_sim_state_median0.010210228929333593
sim_compute_sim_state_min0.005804887870802497
sim_render-ego0_max0.003761255070749297
sim_render-ego0_mean0.0036613133827720305
sim_render-ego0_median0.0036579891553174433
sim_render-ego0_min0.0035680201497039384
simulation-passed1
step_physics_max0.14279687501946275
step_physics_mean0.1170824736832222
step_physics_median0.11706134879250243
step_physics_min0.0914103221284212
survival_time_max54.74999999999903
survival_time_mean39.27499999999977
survival_time_min24.450000000000212
No reset possible
6187613378Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:27:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.976895969119006
survival_time_median44.49999999999961
deviation-center-line_median2.3072483977978377
in-drivable-lane_median8.249999999999645


other stats
agent_compute-ego0_max0.012243816059620893
agent_compute-ego0_mean0.011980481429848295
agent_compute-ego0_median0.011986939586287266
agent_compute-ego0_min0.01170423048719776
complete-iteration_max0.2192392087596795
complete-iteration_mean0.185736365306067
complete-iteration_median0.18523936023039012
complete-iteration_min0.1532275320038082
deviation-center-line_max3.5464721085635893
deviation-center-line_mean2.5181654974507612
deviation-center-line_min1.91169308564378
deviation-heading_max9.728011293563656
deviation-heading_mean7.591580541016779
deviation-heading_median7.200735618386336
deviation-heading_min6.236839633730786
driven_any_max10.41376148749644
driven_any_mean8.247485067705922
driven_any_median7.592371358726609
driven_any_min7.391436065874029
driven_lanedir_consec_max9.65002376189977
driven_lanedir_consec_mean6.685613235007393
driven_lanedir_consec_min5.1386372398917946
driven_lanedir_max9.65002376189977
driven_lanedir_mean6.687323777523776
driven_lanedir_median5.976895969119006
driven_lanedir_min5.145479409957326
get_duckie_state_max1.4516033757840934e-06
get_duckie_state_mean1.3943099784421484e-06
get_duckie_state_median1.3996731703338242e-06
get_duckie_state_min1.3262901973168518e-06
get_robot_state_max0.003536806416253464
get_robot_state_mean0.0035320156602562567
get_robot_state_median0.003532550745510735
get_robot_state_min0.0035261547337500933
get_state_dump_max0.004545410162657667
get_state_dump_mean0.0044851262971871385
get_state_dump_median0.00448923969334548
get_state_dump_min0.004416615639399927
get_ui_image_max0.03680550718360892
get_ui_image_mean0.031218717418706465
get_ui_image_median0.03100476784751802
get_ui_image_min0.02605982679618089
in-drivable-lane_max13.74999999999941
in-drivable-lane_mean8.337499999999649
in-drivable-lane_min3.099999999999895
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.41376148749644, "get_ui_image": 0.02877273269735903, "step_physics": 0.10661922426247578, "survival_time": 59.99999999999873, "driven_lanedir": 9.65002376189977, "get_state_dump": 0.004416615639399927, "get_robot_state": 0.003536806416253464, "sim_render-ego0": 0.003620258080373696, "get_duckie_state": 1.3262901973168518e-06, "in-drivable-lane": 3.099999999999895, "deviation-heading": 9.728011293563656, "agent_compute-ego0": 0.01170423048719776, "complete-iteration": 0.17203813766460435, "set_robot_commands": 0.0021104342137447107, "deviation-center-line": 3.5464721085635893, "driven_lanedir_consec": 9.65002376189977, "sim_compute_sim_state": 0.009272213283923149, "sim_compute_performance-ego0": 0.0019089347813945328}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.609850611997366, "get_ui_image": 0.03680550718360892, "step_physics": 0.1420714558839531, "survival_time": 44.5999999999996, "driven_lanedir": 5.145479409957326, "get_state_dump": 0.004545410162657667, "get_robot_state": 0.003533933357589055, "sim_render-ego0": 0.003678381376277159, "get_duckie_state": 1.4516033757840934e-06, "in-drivable-lane": 13.74999999999941, "deviation-heading": 6.4149875981644815, "agent_compute-ego0": 0.012243816059620893, "complete-iteration": 0.2192392087596795, "set_robot_commands": 0.0020935647565066347, "deviation-center-line": 1.91169308564378, "driven_lanedir_consec": 5.1386372398917946, "sim_compute_sim_state": 0.012304491585606555, "sim_compute_performance-ego0": 0.0018876431904074056}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.391436065874029, "get_ui_image": 0.033236802997677006, "step_physics": 0.12457049359923685, "survival_time": 43.349999999999675, "driven_lanedir": 6.044792206606986, "get_state_dump": 0.0044420743318197365, "get_robot_state": 0.0035311681334324148, "sim_render-ego0": 0.003637838198841991, "get_duckie_state": 1.3626665563627322e-06, "in-drivable-lane": 7.049999999999734, "deviation-heading": 7.986483638608189, "agent_compute-ego0": 0.01203941694602439, "complete-iteration": 0.1984405827961759, "set_robot_commands": 0.002098618289842034, "deviation-center-line": 2.397886128125793, "driven_lanedir_consec": 6.044792206606986, "sim_compute_sim_state": 0.012929773825104884, "sim_compute_performance-ego0": 0.0018808819731259677}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.574892105455853, "get_ui_image": 0.02605982679618089, "step_physics": 0.09317845193285776, "survival_time": 44.399999999999615, "driven_lanedir": 5.908999731631026, "get_state_dump": 0.004536405054871223, "get_robot_state": 0.0035261547337500933, "sim_render-ego0": 0.0036535729707561273, "get_duckie_state": 1.436679784304916e-06, "in-drivable-lane": 9.449999999999555, "deviation-heading": 6.236839633730786, "agent_compute-ego0": 0.01193446222655014, "complete-iteration": 0.1532275320038082, "set_robot_commands": 0.002141040409375632, "deviation-center-line": 2.2166106674698822, "driven_lanedir_consec": 5.908999731631026, "sim_compute_sim_state": 0.006220402411856721, "sim_compute_performance-ego0": 0.001903154182219532}}
set_robot_commands_max0.002141040409375632
set_robot_commands_mean0.002110914417367253
set_robot_commands_median0.0021045262517933724
set_robot_commands_min0.0020935647565066347
sim_compute_performance-ego0_max0.0019089347813945328
sim_compute_performance-ego0_mean0.0018951535317868597
sim_compute_performance-ego0_median0.0018953986863134691
sim_compute_performance-ego0_min0.0018808819731259677
sim_compute_sim_state_max0.012929773825104884
sim_compute_sim_state_mean0.010181720276622829
sim_compute_sim_state_median0.010788352434764852
sim_compute_sim_state_min0.006220402411856721
sim_render-ego0_max0.003678381376277159
sim_render-ego0_mean0.0036475126565622433
sim_render-ego0_median0.0036457055847990594
sim_render-ego0_min0.003620258080373696
simulation-passed1
step_physics_max0.1420714558839531
step_physics_mean0.11660990641963088
step_physics_median0.1155948589308563
step_physics_min0.09317845193285776
survival_time_max59.99999999999873
survival_time_mean48.0874999999994
survival_time_min43.349999999999675
No reset possible
6187413376Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:26:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.573167077947575
survival_time_median52.42499999999916
deviation-center-line_median2.8117401097667756
in-drivable-lane_median4.299999999999897


other stats
agent_compute-ego0_max0.012453856856323952
agent_compute-ego0_mean0.01213582574497256
agent_compute-ego0_median0.01209974735492514
agent_compute-ego0_min0.011889951413716009
complete-iteration_max0.2001430641773135
complete-iteration_mean0.17719855934591938
complete-iteration_median0.17748353503129563
complete-iteration_min0.15368410314377273
deviation-center-line_max3.8824896890181897
deviation-center-line_mean2.428496278126505
deviation-center-line_min0.20801520395427836
deviation-heading_max12.268006855193992
deviation-heading_mean7.31249415205613
deviation-heading_median7.806479642347825
deviation-heading_min1.3690104683348776
driven_any_max10.422449265385572
driven_any_mean7.450435630728041
driven_any_median9.033646666355152
driven_any_min1.3119999248162852
driven_lanedir_consec_max10.256071395247403
driven_lanedir_consec_mean6.533386004599217
driven_lanedir_consec_min0.7311384672543149
driven_lanedir_max10.256071395247403
driven_lanedir_mean6.53346921321971
driven_lanedir_median7.573333495188561
driven_lanedir_min0.7311384672543149
get_duckie_state_max1.331451632001815e-06
get_duckie_state_mean1.2255225751023671e-06
get_duckie_state_median1.2344354399433473e-06
get_duckie_state_min1.1017677885209592e-06
get_robot_state_max0.003583237888612517
get_robot_state_mean0.003544081943219679
get_robot_state_median0.00354748726262755
get_robot_state_min0.0034981153590111
get_state_dump_max0.0045552475507869275
get_state_dump_mean0.00448827513439865
get_state_dump_median0.004493542158236412
get_state_dump_min0.004410768670334848
get_ui_image_max0.03560308107109957
get_ui_image_mean0.03025111021547064
get_ui_image_median0.029993980651493377
get_ui_image_min0.02541339848779623
in-drivable-lane_max9.549999999999525
in-drivable-lane_mean4.537499999999829
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.413801392556849, "get_ui_image": 0.02782070110679963, "step_physics": 0.09957968940544289, "survival_time": 59.99999999999873, "driven_lanedir": 10.256071395247403, "get_state_dump": 0.0044535266469658465, "get_robot_state": 0.003583237888612517, "sim_render-ego0": 0.003647399484664574, "get_duckie_state": 1.1017677885209592e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.844469510225643, "agent_compute-ego0": 0.011889951413716009, "complete-iteration": 0.16431579939233174, "set_robot_commands": 0.002181156390314793, "deviation-center-line": 3.8824896890181897, "driven_lanedir_consec": 10.256071395247403, "sim_compute_sim_state": 0.009158668073388956, "sim_compute_performance-ego0": 0.0019170914363305237}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3119999248162852, "get_ui_image": 0.03560308107109957, "step_physics": 0.1263163921444915, "survival_time": 8.549999999999986, "driven_lanedir": 0.7311384672543149, "get_state_dump": 0.0045552475507869275, "get_robot_state": 0.0035394416298977164, "sim_render-ego0": 0.003622250501499619, "get_duckie_state": 1.2295190678086391e-06, "in-drivable-lane": 3.7999999999999954, "deviation-heading": 1.3690104683348776, "agent_compute-ego0": 0.012453856856323952, "complete-iteration": 0.2001430641773135, "set_robot_commands": 0.002191011295762173, "deviation-center-line": 0.20801520395427836, "driven_lanedir_consec": 0.7311384672543149, "sim_compute_sim_state": 0.009898116422253984, "sim_compute_performance-ego0": 0.001878451469332673}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.422449265385572, "get_ui_image": 0.03216726019618712, "step_physics": 0.11735173903535943, "survival_time": 59.99999999999873, "driven_lanedir": 9.222879932160549, "get_state_dump": 0.004533557669506978, "get_robot_state": 0.0035555328953573843, "sim_render-ego0": 0.0036858152489578793, "get_duckie_state": 1.331451632001815e-06, "in-drivable-lane": 4.799999999999798, "deviation-heading": 12.268006855193992, "agent_compute-ego0": 0.012132697657284192, "complete-iteration": 0.19065127067025953, "set_robot_commands": 0.002126746531033099, "deviation-center-line": 3.462454165634883, "driven_lanedir_consec": 9.222879932160549, "sim_compute_sim_state": 0.013086215343999426, "sim_compute_performance-ego0": 0.001925684232497394}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.653491940153456, "get_ui_image": 0.02541339848779623, "step_physics": 0.09435280181782814, "survival_time": 44.84999999999959, "driven_lanedir": 5.923787058216574, "get_state_dump": 0.004410768670334848, "get_robot_state": 0.0034981153590111, "sim_render-ego0": 0.003580381716280047, "get_duckie_state": 1.2393518120780554e-06, "in-drivable-lane": 9.549999999999525, "deviation-heading": 6.768489774470007, "agent_compute-ego0": 0.012066797052566086, "complete-iteration": 0.15368410314377273, "set_robot_commands": 0.002271428140075276, "deviation-center-line": 2.161026053898668, "driven_lanedir_consec": 5.923454223734602, "sim_compute_sim_state": 0.006152838003927456, "sim_compute_performance-ego0": 0.001847057937248247}}
set_robot_commands_max0.002271428140075276
set_robot_commands_mean0.002192585589296335
set_robot_commands_median0.002186083843038483
set_robot_commands_min0.002126746531033099
sim_compute_performance-ego0_max0.001925684232497394
sim_compute_performance-ego0_mean0.0018920712688522095
sim_compute_performance-ego0_median0.0018977714528315983
sim_compute_performance-ego0_min0.001847057937248247
sim_compute_sim_state_max0.013086215343999426
sim_compute_sim_state_mean0.009573959460892456
sim_compute_sim_state_median0.009528392247821472
sim_compute_sim_state_min0.006152838003927456
sim_render-ego0_max0.0036858152489578793
sim_render-ego0_mean0.0036339617378505305
sim_render-ego0_median0.0036348249930820966
sim_render-ego0_min0.003580381716280047
simulation-passed1
step_physics_max0.1263163921444915
step_physics_mean0.10940015560078048
step_physics_median0.10846571422040116
step_physics_min0.09435280181782814
survival_time_max59.99999999999873
survival_time_mean43.349999999999255
survival_time_min8.549999999999986
No reset possible
6187113373Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.23347130092167
survival_time_median59.99999999999873
deviation-center-line_median3.345299819563138
in-drivable-lane_median4.874999999999812


other stats
agent_compute-ego0_max0.016611183017219335
agent_compute-ego0_mean0.016041189809219328
agent_compute-ego0_median0.015950606923416988
agent_compute-ego0_min0.015652362372824
complete-iteration_max0.26621877243874176
complete-iteration_mean0.23285740727030313
complete-iteration_median0.236450229138517
complete-iteration_min0.19231039836543684
deviation-center-line_max3.912107510553547
deviation-center-line_mean2.969261201208099
deviation-center-line_min1.2743376551525731
deviation-heading_max12.67120592570582
deviation-heading_mean9.538475935175706
deviation-heading_median11.181767658854024
deviation-heading_min3.119162497288959
driven_any_max27.951323735338764
driven_any_mean23.21602628692939
driven_any_median27.80046221747741
driven_any_min9.311856977423986
driven_lanedir_consec_max25.767271852964775
driven_lanedir_consec_mean19.62832846098056
driven_lanedir_consec_min8.27909938911412
driven_lanedir_max25.767271852964775
driven_lanedir_mean19.62832846098056
driven_lanedir_median22.23347130092167
driven_lanedir_min8.27909938911412
get_duckie_state_max1.4763688366180852e-06
get_duckie_state_mean1.4008984893187952e-06
get_duckie_state_median1.3916021977534995e-06
get_duckie_state_min1.3440207251500969e-06
get_robot_state_max0.0037035171832768346
get_robot_state_mean0.003632592703601498
get_robot_state_median0.003624056966422293
get_robot_state_min0.0035787396982845717
get_state_dump_max0.004648072622840899
get_state_dump_mean0.004594342791107114
get_state_dump_median0.004603274557413805
get_state_dump_min0.004522749426759947
get_ui_image_max0.03605173291215095
get_ui_image_mean0.03092632840896635
get_ui_image_median0.03088639855055308
get_ui_image_min0.025880783622608296
in-drivable-lane_max12.79999999999979
in-drivable-lane_mean6.299999999999862
in-drivable-lane_min2.6500000000000377
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.311856977423986, "get_ui_image": 0.02871896600381856, "step_physics": 0.14944996697236929, "survival_time": 20.90000000000016, "driven_lanedir": 8.27909938911412, "get_state_dump": 0.004648072622840899, "get_robot_state": 0.003640103738461588, "sim_render-ego0": 0.003770432210480683, "get_duckie_state": 1.3440207251500969e-06, "in-drivable-lane": 2.6500000000000377, "deviation-heading": 3.119162497288959, "agent_compute-ego0": 0.015652362372824, "complete-iteration": 0.2193513138481996, "set_robot_commands": 0.0022504688162792268, "deviation-center-line": 1.2743376551525731, "driven_lanedir_consec": 8.27909938911412, "sim_compute_sim_state": 0.009156224266725963, "sim_compute_performance-ego0": 0.0019774675938280784}, "LF-norm-zigzag-000-ego0": {"driven_any": 27.91703461184346, "get_ui_image": 0.03605173291215095, "step_physics": 0.1842828594973244, "survival_time": 59.99999999999873, "driven_lanedir": 25.767271852964775, "get_state_dump": 0.004522749426759947, "get_robot_state": 0.003608010194382997, "sim_render-ego0": 0.0036747062533820894, "get_duckie_state": 1.400138416655554e-06, "in-drivable-lane": 3.2999999999998977, "deviation-heading": 9.880282925799328, "agent_compute-ego0": 0.015819256748386863, "complete-iteration": 0.26621877243874176, "set_robot_commands": 0.0022363458247506352, "deviation-center-line": 3.912107510553547, "driven_lanedir_consec": 25.767271852964775, "sim_compute_sim_state": 0.013990659102313624, "sim_compute_performance-ego0": 0.0019512684716471624}, "LF-norm-techtrack-000-ego0": {"driven_any": 27.951323735338764, "get_ui_image": 0.0330538310972876, "step_physics": 0.1738148680535284, "survival_time": 59.99999999999873, "driven_lanedir": 23.856164232615992, "get_state_dump": 0.004614009746008372, "get_robot_state": 0.0037035171832768346, "sim_render-ego0": 0.003858060463580561, "get_duckie_state": 1.4763688366180852e-06, "in-drivable-lane": 6.449999999999725, "deviation-heading": 12.483252391908715, "agent_compute-ego0": 0.016611183017219335, "complete-iteration": 0.2535491444288344, "set_robot_commands": 0.002325110193295443, "deviation-center-line": 3.624068860987283, "driven_lanedir_consec": 23.856164232615992, "sim_compute_sim_state": 0.013420611198101314, "sim_compute_performance-ego0": 0.0020614359202134817}, "LF-norm-small_loop-000-ego0": {"driven_any": 27.68388982311136, "get_ui_image": 0.025880783622608296, "step_physics": 0.12812665995709802, "survival_time": 59.99999999999873, "driven_lanedir": 20.61077836922735, "get_state_dump": 0.004592539368819238, "get_robot_state": 0.0035787396982845717, "sim_render-ego0": 0.003626762480660342, "get_duckie_state": 1.3830659788514451e-06, "in-drivable-lane": 12.79999999999979, "deviation-heading": 12.67120592570582, "agent_compute-ego0": 0.016081957098447116, "complete-iteration": 0.19231039836543684, "set_robot_commands": 0.002171631359637131, "deviation-center-line": 3.0665307781389934, "driven_lanedir_consec": 20.61077836922735, "sim_compute_sim_state": 0.006271608465418629, "sim_compute_performance-ego0": 0.0018982579567152495}}
set_robot_commands_max0.002325110193295443
set_robot_commands_mean0.002245889048490609
set_robot_commands_median0.0022434073205149308
set_robot_commands_min0.002171631359637131
sim_compute_performance-ego0_max0.0020614359202134817
sim_compute_performance-ego0_mean0.0019721074856009933
sim_compute_performance-ego0_median0.0019643680327376205
sim_compute_performance-ego0_min0.0018982579567152495
sim_compute_sim_state_max0.013990659102313624
sim_compute_sim_state_mean0.010709775758139882
sim_compute_sim_state_median0.01128841773241364
sim_compute_sim_state_min0.006271608465418629
sim_render-ego0_max0.003858060463580561
sim_render-ego0_mean0.003732490352025919
sim_render-ego0_median0.003722569231931386
sim_render-ego0_min0.003626762480660342
simulation-passed1
step_physics_max0.1842828594973244
step_physics_mean0.15891858862008
step_physics_median0.16163241751294882
step_physics_min0.12812665995709802
survival_time_max59.99999999999873
survival_time_mean50.224999999999085
survival_time_min20.90000000000016
No reset possible
6186713369Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:33:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.516604313447512
survival_time_median59.99999999999873
deviation-center-line_median3.061698062130092
in-drivable-lane_median7.849999999999888


other stats
agent_compute-ego0_max0.01566539576024185
agent_compute-ego0_mean0.015351490759562558
agent_compute-ego0_median0.01547581349483239
agent_compute-ego0_min0.014788940288343596
complete-iteration_max0.2573723777148448
complete-iteration_mean0.2151443483326626
complete-iteration_median0.2125600843396553
complete-iteration_min0.17808484693649507
deviation-center-line_max3.4028190310870507
deviation-center-line_mean2.691162368585617
deviation-center-line_min1.238434318995234
deviation-heading_max12.415445215069523
deviation-heading_mean9.5815563843072
deviation-heading_median10.74343179578234
deviation-heading_min4.423916730594595
driven_any_max28.09204187265919
driven_any_mean24.72883575790291
driven_any_median28.006424118772763
driven_any_min14.810452921406927
driven_lanedir_consec_max24.54410135508989
driven_lanedir_consec_mean20.357285063015368
driven_lanedir_consec_min11.851830270076547
driven_lanedir_max24.54410135508989
driven_lanedir_mean20.357285063015368
driven_lanedir_median22.516604313447512
driven_lanedir_min11.851830270076547
get_duckie_state_max1.254427145164674e-06
get_duckie_state_mean1.220689412641471e-06
get_duckie_state_median1.228540932675951e-06
get_duckie_state_min1.171248640049308e-06
get_robot_state_max0.0035230086909400094
get_robot_state_mean0.0034738781501201556
get_robot_state_median0.003470242767905712
get_robot_state_min0.003432018373729188
get_state_dump_max0.004376763805163889
get_state_dump_mean0.0042987250781065635
get_state_dump_median0.004298176197684079
get_state_dump_min0.004221784111894208
get_ui_image_max0.035550201068214334
get_ui_image_mean0.030170096665186694
get_ui_image_median0.029877395199077023
get_ui_image_min0.02537539519437842
in-drivable-lane_max10.74999999999968
in-drivable-lane_mean8.049999999999836
in-drivable-lane_min5.749999999999886
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.810452921406927, "get_ui_image": 0.027721125402568297, "step_physics": 0.12535423629077863, "survival_time": 32.3500000000003, "driven_lanedir": 11.851830270076547, "get_state_dump": 0.004221784111894208, "get_robot_state": 0.0035230086909400094, "sim_render-ego0": 0.0036198187757421423, "get_duckie_state": 1.2141686898690685e-06, "in-drivable-lane": 6.65000000000007, "deviation-heading": 4.423916730594595, "agent_compute-ego0": 0.01566539576024185, "complete-iteration": 0.1935755654617592, "set_robot_commands": 0.0021506765006500997, "deviation-center-line": 1.238434318995234, "driven_lanedir_consec": 11.851830270076547, "sim_compute_sim_state": 0.00936305817262626, "sim_compute_performance-ego0": 0.0018856856558057996}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.09204187265919, "get_ui_image": 0.035550201068214334, "step_physics": 0.17743518449781737, "survival_time": 59.99999999999873, "driven_lanedir": 24.54410135508989, "get_state_dump": 0.004376763805163889, "get_robot_state": 0.003479818221829912, "sim_render-ego0": 0.003565978845092875, "get_duckie_state": 1.254427145164674e-06, "in-drivable-lane": 5.749999999999886, "deviation-heading": 11.391637648597705, "agent_compute-ego0": 0.01538347840606918, "complete-iteration": 0.2573723777148448, "set_robot_commands": 0.002063189418389339, "deviation-center-line": 3.4028190310870507, "driven_lanedir_consec": 24.54410135508989, "sim_compute_sim_state": 0.013587797611182575, "sim_compute_performance-ego0": 0.0018564670111714157}, "LF-norm-techtrack-000-ego0": {"driven_any": 27.948049317994865, "get_ui_image": 0.03203366499558575, "step_physics": 0.1558842361221504, "survival_time": 59.99999999999873, "driven_lanedir": 23.01137872472081, "get_state_dump": 0.004300645944180834, "get_robot_state": 0.003460667313981513, "sim_render-ego0": 0.003547256733356765, "get_duckie_state": 1.2429131754828334e-06, "in-drivable-lane": 9.049999999999706, "deviation-heading": 10.095225942966977, "agent_compute-ego0": 0.0155681485835956, "complete-iteration": 0.23154460321755135, "set_robot_commands": 0.0020875702491906364, "deviation-center-line": 2.9117699490202504, "driven_lanedir_consec": 23.01137872472081, "sim_compute_sim_state": 0.012751392678952436, "sim_compute_performance-ego0": 0.001841729328495378}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.064798919550658, "get_ui_image": 0.02537539519437842, "step_physics": 0.11672961801216068, "survival_time": 59.99999999999873, "driven_lanedir": 22.021829902174215, "get_state_dump": 0.004295706451187324, "get_robot_state": 0.003432018373729188, "sim_render-ego0": 0.0034829605429694613, "get_duckie_state": 1.171248640049308e-06, "in-drivable-lane": 10.74999999999968, "deviation-heading": 12.415445215069523, "agent_compute-ego0": 0.014788940288343596, "complete-iteration": 0.17808484693649507, "set_robot_commands": 0.0020568805570705647, "deviation-center-line": 3.211626175239934, "driven_lanedir_consec": 22.021829902174215, "sim_compute_sim_state": 0.006037593781203652, "sim_compute_performance-ego0": 0.0018169465013388095}}
set_robot_commands_max0.0021506765006500997
set_robot_commands_mean0.00208957918132516
set_robot_commands_median0.0020753798337899876
set_robot_commands_min0.0020568805570705647
sim_compute_performance-ego0_max0.0018856856558057996
sim_compute_performance-ego0_mean0.001850207124202851
sim_compute_performance-ego0_median0.0018490981698333969
sim_compute_performance-ego0_min0.0018169465013388095
sim_compute_sim_state_max0.013587797611182575
sim_compute_sim_state_mean0.010434960560991233
sim_compute_sim_state_median0.011057225425789349
sim_compute_sim_state_min0.006037593781203652
sim_render-ego0_max0.0036198187757421423
sim_render-ego0_mean0.003554003724290311
sim_render-ego0_median0.00355661778922482
sim_render-ego0_min0.0034829605429694613
simulation-passed1
step_physics_max0.17743518449781737
step_physics_mean0.14385081873072678
step_physics_median0.14061923620646452
step_physics_min0.11672961801216068
survival_time_max59.99999999999873
survival_time_mean53.08749999999912
survival_time_min32.3500000000003
No reset possible
6186113364Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:15:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.986775420051837
survival_time_median17.07500000000011
deviation-center-line_median0.8426041600225705
in-drivable-lane_median4.700000000000003


other stats
agent_compute-ego0_max0.0119111947541366
agent_compute-ego0_mean0.011638403846631083
agent_compute-ego0_median0.011628192615621794
agent_compute-ego0_min0.011386035401144143
complete-iteration_max0.20507547148951777
complete-iteration_mean0.1813902309466463
complete-iteration_median0.1874852681805551
complete-iteration_min0.14551491593595725
deviation-center-line_max2.031368840542658
deviation-center-line_mean0.9829264811899406
deviation-center-line_min0.21512876417196275
deviation-heading_max12.03277843464748
deviation-heading_mean5.099614897711116
deviation-heading_median3.7243287872549784
deviation-heading_min0.9170235816870308
driven_any_max9.15584061794237
driven_any_mean4.013204137062693
driven_any_median2.801233358433922
driven_any_min1.2945092134405565
driven_lanedir_consec_max6.130985639246779
driven_lanedir_consec_mean2.697026053895809
driven_lanedir_consec_min0.6835677362327823
driven_lanedir_max6.132092677509641
driven_lanedir_mean2.697666812937819
driven_lanedir_median1.9875034190044272
driven_lanedir_min0.6835677362327823
get_duckie_state_max1.456511854634854e-06
get_duckie_state_mean1.4181177622246737e-06
get_duckie_state_median1.4241123002131522e-06
get_duckie_state_min1.367734593837535e-06
get_robot_state_max0.0035139850986883195
get_robot_state_mean0.0034766702442510385
get_robot_state_median0.0034682501076562363
get_robot_state_min0.003456195663003361
get_state_dump_max0.004316647402267385
get_state_dump_mean0.004284093030831915
get_state_dump_median0.004288148077091849
get_state_dump_min0.00424342856687658
get_ui_image_max0.03536015117869658
get_ui_image_mean0.03020805311105373
get_ui_image_median0.030037583946814803
get_ui_image_min0.025396893371888742
in-drivable-lane_max14.949999999999289
in-drivable-lane_mean7.037499999999837
in-drivable-lane_min3.800000000000054
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.15584061794237, "get_ui_image": 0.02788273849629777, "step_physics": 0.1075193739516172, "survival_time": 53.4999999999991, "driven_lanedir": 6.132092677509641, "get_state_dump": 0.004316647402267385, "get_robot_state": 0.0035139850986883195, "sim_render-ego0": 0.003702811722884548, "get_duckie_state": 1.367734593837535e-06, "in-drivable-lane": 14.949999999999289, "deviation-heading": 12.03277843464748, "agent_compute-ego0": 0.0119111947541366, "complete-iteration": 0.17239077440719533, "set_robot_commands": 0.0022186912408395975, "deviation-center-line": 2.031368840542658, "driven_lanedir_consec": 6.130985639246779, "sim_compute_sim_state": 0.009345574205329103, "sim_compute_performance-ego0": 0.001905849111291652}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2945092134405565, "get_ui_image": 0.03536015117869658, "step_physics": 0.13063262630911435, "survival_time": 8.449999999999985, "driven_lanedir": 0.6835677362327823, "get_state_dump": 0.00424342856687658, "get_robot_state": 0.003456195663003361, "sim_render-ego0": 0.003530967936796301, "get_duckie_state": 1.4249016256893385e-06, "in-drivable-lane": 3.999999999999993, "deviation-heading": 1.2991737633284628, "agent_compute-ego0": 0.011715318174923169, "complete-iteration": 0.2025797619539149, "set_robot_commands": 0.0020407564499798944, "deviation-center-line": 0.23987320687956343, "driven_lanedir_consec": 0.6835677362327823, "sim_compute_sim_state": 0.00971666223862592, "sim_compute_performance-ego0": 0.0018111733829273896}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.054632167037252, "get_ui_image": 0.032192429397331836, "step_physics": 0.13564008891337204, "survival_time": 24.25000000000021, "driven_lanedir": 3.2689992230003666, "get_state_dump": 0.004281420275998214, "get_robot_state": 0.00345893161287033, "sim_render-ego0": 0.0035314196912349495, "get_duckie_state": 1.456511854634854e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 6.1494838111814945, "agent_compute-ego0": 0.011386035401144143, "complete-iteration": 0.20507547148951777, "set_robot_commands": 0.002052616680600516, "deviation-center-line": 1.4453351131655776, "driven_lanedir_consec": 3.2675432250951864, "sim_compute_sim_state": 0.010641755881132904, "sim_compute_performance-ego0": 0.0018169683684046867}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5478345498305917, "get_ui_image": 0.025396893371888742, "step_physics": 0.08814997169839676, "survival_time": 9.900000000000006, "driven_lanedir": 0.706007615008488, "get_state_dump": 0.004294875878185483, "get_robot_state": 0.0034775686024421425, "sim_render-ego0": 0.0035365370649788246, "get_duckie_state": 1.423322974736966e-06, "in-drivable-lane": 5.400000000000014, "deviation-heading": 0.9170235816870308, "agent_compute-ego0": 0.01154106705632042, "complete-iteration": 0.14551491593595725, "set_robot_commands": 0.0020678510617970223, "deviation-center-line": 0.21512876417196275, "driven_lanedir_consec": 0.706007615008488, "sim_compute_sim_state": 0.005151777411226052, "sim_compute_performance-ego0": 0.0018251181846887024}}
set_robot_commands_max0.0022186912408395975
set_robot_commands_mean0.0020949788583042575
set_robot_commands_median0.0020602338711987692
set_robot_commands_min0.0020407564499798944
sim_compute_performance-ego0_max0.001905849111291652
sim_compute_performance-ego0_mean0.0018397772618281075
sim_compute_performance-ego0_median0.0018210432765466945
sim_compute_performance-ego0_min0.0018111733829273896
sim_compute_sim_state_max0.010641755881132904
sim_compute_sim_state_mean0.008713942434078494
sim_compute_sim_state_median0.009531118221977513
sim_compute_sim_state_min0.005151777411226052
sim_render-ego0_max0.003702811722884548
sim_render-ego0_mean0.003575434103973656
sim_render-ego0_median0.003533978378106887
sim_render-ego0_min0.003530967936796301
simulation-passed1
step_physics_max0.13564008891337204
step_physics_mean0.11548551521812508
step_physics_median0.11907600013036576
step_physics_min0.08814997169839676
survival_time_max53.4999999999991
survival_time_mean24.024999999999824
survival_time_min8.449999999999985
No reset possible
6185913362Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:38:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.35185045539324
survival_time_median59.99999999999873
deviation-center-line_median3.4893887466936984
in-drivable-lane_median11.124999999999794


other stats
agent_compute-ego0_max0.0165801840360516
agent_compute-ego0_mean0.015971640563825086
agent_compute-ego0_median0.01588159903797083
agent_compute-ego0_min0.01554318014330709
complete-iteration_max0.25206983178779546
complete-iteration_mean0.2149276635132662
complete-iteration_median0.21394743341688907
complete-iteration_min0.1797459554314911
deviation-center-line_max3.642795867061261
deviation-center-line_mean3.302594815168326
deviation-center-line_min2.588805900224646
deviation-heading_max12.33865692961706
deviation-heading_mean10.35402037079216
deviation-heading_median10.580677809146229
deviation-heading_min7.916068935259128
driven_any_max29.14740434843791
driven_any_mean28.72760389456108
driven_any_median28.658574245361876
driven_any_min28.44586273908266
driven_lanedir_consec_max28.159880048420543
driven_lanedir_consec_mean23.192430725822764
driven_lanedir_consec_min19.906141944084027
driven_lanedir_max28.159880048420543
driven_lanedir_mean23.192430725822764
driven_lanedir_median22.35185045539324
driven_lanedir_min19.906141944084027
get_duckie_state_max1.2018202147217813e-06
get_duckie_state_mean1.1842514851210416e-06
get_duckie_state_median1.1910010535552242e-06
get_duckie_state_min1.1531836186519372e-06
get_robot_state_max0.00360551722143016
get_robot_state_mean0.0035333977353066625
get_robot_state_median0.0035223081447401214
get_robot_state_min0.0034834574303162485
get_state_dump_max0.0044091123029850205
get_state_dump_mean0.004356276135361265
get_state_dump_median0.004366097898904132
get_state_dump_min0.004283796440651772
get_ui_image_max0.03561956241267805
get_ui_image_mean0.03049477684209984
get_ui_image_median0.03037340932841305
get_ui_image_min0.02561272629889521
in-drivable-lane_max16.39999999999977
in-drivable-lane_mean9.949999999999823
in-drivable-lane_min1.1499999999999346
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 29.14740434843791, "get_ui_image": 0.028458631802955135, "step_physics": 0.13189738517399135, "survival_time": 59.99999999999873, "driven_lanedir": 28.159880048420543, "get_state_dump": 0.004368142025556096, "get_robot_state": 0.00360551722143016, "sim_render-ego0": 0.00367537644582426, "get_duckie_state": 1.2018202147217813e-06, "in-drivable-lane": 1.1499999999999346, "deviation-heading": 7.916068935259128, "agent_compute-ego0": 0.015658859805600233, "complete-iteration": 0.20116509128669025, "set_robot_commands": 0.0022083907004300006, "deviation-center-line": 2.588805900224646, "driven_lanedir_consec": 28.159880048420543, "sim_compute_sim_state": 0.009289186860401366, "sim_compute_performance-ego0": 0.0019203383757808027}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.7224829884058, "get_ui_image": 0.03561956241267805, "step_physics": 0.17087383155123975, "survival_time": 59.99999999999873, "driven_lanedir": 23.273379330917184, "get_state_dump": 0.004364053772252168, "get_robot_state": 0.003522128884143178, "sim_render-ego0": 0.0035825585644012883, "get_duckie_state": 1.1922914122264648e-06, "in-drivable-lane": 9.09999999999978, "deviation-heading": 12.33865692961706, "agent_compute-ego0": 0.0165801840360516, "complete-iteration": 0.25206983178779546, "set_robot_commands": 0.0021980382520689953, "deviation-center-line": 3.642795867061261, "driven_lanedir_consec": 23.273379330917184, "sim_compute_sim_state": 0.01336464576181226, "sim_compute_performance-ego0": 0.001881854321736281}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.594665502317948, "get_ui_image": 0.032288186853870963, "step_physics": 0.1507180924221042, "survival_time": 59.99999999999873, "driven_lanedir": 21.4303215798693, "get_state_dump": 0.004283796440651772, "get_robot_state": 0.0034834574303162485, "sim_render-ego0": 0.003622448513847306, "get_duckie_state": 1.1897106948839831e-06, "in-drivable-lane": 13.149999999999809, "deviation-heading": 11.022741080785153, "agent_compute-ego0": 0.01554318014330709, "complete-iteration": 0.22672977554708793, "set_robot_commands": 0.0021720810000048787, "deviation-center-line": 3.4579212790902196, "driven_lanedir_consec": 21.4303215798693, "sim_compute_sim_state": 0.01266329234883152, "sim_compute_performance-ego0": 0.0018764479174205007}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.44586273908266, "get_ui_image": 0.02561272629889521, "step_physics": 0.11624632925911808, "survival_time": 59.99999999999873, "driven_lanedir": 19.906141944084027, "get_state_dump": 0.0044091123029850205, "get_robot_state": 0.0035224874053370646, "sim_render-ego0": 0.0035932201032932353, "get_duckie_state": 1.1531836186519372e-06, "in-drivable-lane": 16.39999999999977, "deviation-heading": 10.1386145375073, "agent_compute-ego0": 0.016104338270341426, "complete-iteration": 0.1797459554314911, "set_robot_commands": 0.0022019603468794112, "deviation-center-line": 3.520856214297177, "driven_lanedir_consec": 19.906141944084027, "sim_compute_sim_state": 0.006087487583652722, "sim_compute_performance-ego0": 0.001886929600165349}}
set_robot_commands_max0.0022083907004300006
set_robot_commands_mean0.0021951175748458215
set_robot_commands_median0.0021999992994742035
set_robot_commands_min0.0021720810000048787
sim_compute_performance-ego0_max0.0019203383757808027
sim_compute_performance-ego0_mean0.0018913925537757332
sim_compute_performance-ego0_median0.001884391960950815
sim_compute_performance-ego0_min0.0018764479174205007
sim_compute_sim_state_max0.01336464576181226
sim_compute_sim_state_mean0.010351153138674466
sim_compute_sim_state_median0.010976239604616442
sim_compute_sim_state_min0.006087487583652722
sim_render-ego0_max0.00367537644582426
sim_render-ego0_mean0.003618400906841523
sim_render-ego0_median0.0036078343085702703
sim_render-ego0_min0.0035825585644012883
simulation-passed1
step_physics_max0.17087383155123975
step_physics_mean0.14243390960161334
step_physics_median0.14130773879804778
step_physics_min0.11624632925911808
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6185813361Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:07:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7059922086702425
survival_time_median8.274999999999988
deviation-center-line_median0.35555274512715407
in-drivable-lane_median3.624999999999998


other stats
agent_compute-ego0_max0.012963231920919397
agent_compute-ego0_mean0.012594612887751771
agent_compute-ego0_median0.012641304886496224
agent_compute-ego0_min0.012132609857095257
complete-iteration_max0.23368434648256045
complete-iteration_mean0.2021159126597916
complete-iteration_median0.2057202161014736
complete-iteration_min0.16333887195365887
deviation-center-line_max0.6914645272690948
deviation-center-line_mean0.38771649639730255
deviation-center-line_min0.14829596806580728
deviation-heading_max4.958320106114014
deviation-heading_mean2.6479482822505354
deviation-heading_median2.32664218190113
deviation-heading_min0.9801886590858678
driven_any_max4.003149999175249
driven_any_mean1.9829729584436029
driven_any_median1.4106587810681115
driven_any_min1.1074242724629388
driven_lanedir_consec_max1.54191603451768
driven_lanedir_consec_mean0.8757682348105698
driven_lanedir_consec_min0.5491724873841134
driven_lanedir_max1.54191603451768
driven_lanedir_mean0.8771778944278361
driven_lanedir_median0.7088115279047756
driven_lanedir_min0.5491724873841134
get_duckie_state_max1.239112800899072e-06
get_duckie_state_mean1.197001392388184e-06
get_duckie_state_median1.2022417944830818e-06
get_duckie_state_min1.1444091796875e-06
get_robot_state_max0.0036604764013445294
get_robot_state_mean0.003563038860788151
get_robot_state_median0.003547418135422486
get_robot_state_min0.003496842770963102
get_state_dump_max0.004445950727205019
get_state_dump_mean0.004372980348141123
get_state_dump_median0.004368647939408779
get_state_dump_min0.004308674786541913
get_ui_image_max0.03521411096727526
get_ui_image_mean0.03018172574697256
get_ui_image_median0.030079473825069043
get_ui_image_min0.02535384437047689
in-drivable-lane_max11.600000000000122
in-drivable-lane_mean5.525000000000026
in-drivable-lane_min3.2499999999999885
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.2247880769794273, "get_ui_image": 0.027775021823676856, "step_physics": 0.13465646956418012, "survival_time": 7.349999999999982, "driven_lanedir": 0.5808347389923099, "get_state_dump": 0.004445950727205019, "get_robot_state": 0.003569685124062203, "sim_render-ego0": 0.003771558001234725, "get_duckie_state": 1.216256940687025e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 2.183352734110937, "agent_compute-ego0": 0.01262753879701769, "complete-iteration": 0.1993107827934059, "set_robot_commands": 0.0021622632000897384, "deviation-center-line": 0.33367748022588445, "driven_lanedir_consec": 0.5754620261069636, "sim_compute_sim_state": 0.00828681926469545, "sim_compute_performance-ego0": 0.0019421029735255885}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5965294851567955, "get_ui_image": 0.03521411096727526, "step_physics": 0.1610594839663119, "survival_time": 9.199999999999996, "driven_lanedir": 0.8367883168172414, "get_state_dump": 0.004308674786541913, "get_robot_state": 0.003496842770963102, "sim_render-ego0": 0.0035866376515981315, "get_duckie_state": 1.1882266482791384e-06, "in-drivable-lane": 3.9000000000000066, "deviation-heading": 2.469931629691322, "agent_compute-ego0": 0.012132609857095257, "complete-iteration": 0.23368434648256045, "set_robot_commands": 0.0020707645931759395, "deviation-center-line": 0.3774280100284236, "driven_lanedir_consec": 0.8365223912335213, "sim_compute_sim_state": 0.009860190829715213, "sim_compute_performance-ego0": 0.0018833572800095017}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1074242724629388, "get_ui_image": 0.03238392582646123, "step_physics": 0.1433355278438992, "survival_time": 6.699999999999984, "driven_lanedir": 0.5491724873841134, "get_state_dump": 0.0043329839353208185, "get_robot_state": 0.003525151146782769, "sim_render-ego0": 0.003677933304398148, "get_duckie_state": 1.1444091796875e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 0.9801886590858678, "agent_compute-ego0": 0.012655070975974752, "complete-iteration": 0.21212964940954135, "set_robot_commands": 0.0020983943232783563, "deviation-center-line": 0.14829596806580728, "driven_lanedir_consec": 0.5491724873841134, "sim_compute_sim_state": 0.008153330838238751, "sim_compute_performance-ego0": 0.001897428653858326}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.003149999175249, "get_ui_image": 0.02535384437047689, "step_physics": 0.10252025398466814, "survival_time": 21.50000000000017, "driven_lanedir": 1.54191603451768, "get_state_dump": 0.004404311943496739, "get_robot_state": 0.0036604764013445294, "sim_render-ego0": 0.0037582307846529576, "get_duckie_state": 1.239112800899072e-06, "in-drivable-lane": 11.600000000000122, "deviation-heading": 4.958320106114014, "agent_compute-ego0": 0.012963231920919397, "complete-iteration": 0.16333887195365887, "set_robot_commands": 0.0022305960998181126, "deviation-center-line": 0.6914645272690948, "driven_lanedir_consec": 1.54191603451768, "sim_compute_sim_state": 0.006387382538302039, "sim_compute_performance-ego0": 0.0019896506156832877}}
set_robot_commands_max0.0022305960998181126
set_robot_commands_mean0.002140504554090537
set_robot_commands_median0.0021303287616840473
set_robot_commands_min0.0020707645931759395
sim_compute_performance-ego0_max0.0019896506156832877
sim_compute_performance-ego0_mean0.001928134880769176
sim_compute_performance-ego0_median0.0019197658136919573
sim_compute_performance-ego0_min0.0018833572800095017
sim_compute_sim_state_max0.009860190829715213
sim_compute_sim_state_mean0.008171930867737863
sim_compute_sim_state_median0.008220075051467102
sim_compute_sim_state_min0.006387382538302039
sim_render-ego0_max0.003771558001234725
sim_render-ego0_mean0.0036985899354709906
sim_render-ego0_median0.0037180820445255527
sim_render-ego0_min0.0035866376515981315
simulation-passed1
step_physics_max0.1610594839663119
step_physics_mean0.13539293383976483
step_physics_median0.13899599870403967
step_physics_min0.10252025398466814
survival_time_max21.50000000000017
survival_time_mean11.187500000000034
survival_time_min6.699999999999984
No reset possible
6185713360Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:39:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median21.84218804759697
survival_time_median59.99999999999873
deviation-center-line_median3.442296333714956
in-drivable-lane_median5.449999999999899


other stats
agent_compute-ego0_max0.015895078819459126
agent_compute-ego0_mean0.015566781200437524
agent_compute-ego0_median0.01565026462723274
agent_compute-ego0_min0.015071516727825486
complete-iteration_max0.2600830462850401
complete-iteration_mean0.22135933809335975
complete-iteration_median0.222927606373802
complete-iteration_min0.1794990933407951
deviation-center-line_max4.211496832371706
deviation-center-line_mean3.622072905563316
deviation-center-line_min3.392202122451646
deviation-heading_max16.547642963299207
deviation-heading_mean14.20154937093885
deviation-heading_median14.19713827707189
deviation-heading_min11.864277966312416
driven_any_max25.66737914041556
driven_any_mean25.600163687620512
driven_any_median25.59547857059039
driven_any_min25.542318468885693
driven_lanedir_consec_max24.424100385067643
driven_lanedir_consec_mean22.068466177392043
driven_lanedir_consec_min20.16538822930659
driven_lanedir_max24.424100385067643
driven_lanedir_mean22.06924717615865
driven_lanedir_median21.84218804759697
driven_lanedir_min20.16851222437302
get_duckie_state_max1.2315977225196452e-06
get_duckie_state_mean1.1772537707885436e-06
get_duckie_state_median1.1685686643475e-06
get_duckie_state_min1.1402800319395296e-06
get_robot_state_max0.0035782682210777723
get_robot_state_mean0.0035108777505968337
get_robot_state_median0.003500102759400176
get_robot_state_min0.0034650372625092086
get_state_dump_max0.004426630013789066
get_state_dump_mean0.004341046428998047
get_state_dump_median0.0043387824947093544
get_state_dump_min0.0042599907127844104
get_ui_image_max0.03558267145530072
get_ui_image_mean0.030271825097581924
get_ui_image_median0.02997620486895508
get_ui_image_min0.025552219197116824
in-drivable-lane_max9.449999999999832
in-drivable-lane_mean5.312499999999895
in-drivable-lane_min0.8999999999999488
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 25.584540496911455, "get_ui_image": 0.028005595608218126, "step_physics": 0.14348756899742365, "survival_time": 59.99999999999873, "driven_lanedir": 24.424100385067643, "get_state_dump": 0.004309908138723, "get_robot_state": 0.0035782682210777723, "sim_render-ego0": 0.0035863845771198764, "get_duckie_state": 1.2315977225196452e-06, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 11.864277966312416, "agent_compute-ego0": 0.015895078819459126, "complete-iteration": 0.21230374188546236, "set_robot_commands": 0.002208293427237861, "deviation-center-line": 3.3944437867648416, "driven_lanedir_consec": 24.424100385067643, "sim_compute_sim_state": 0.00926291277565428, "sim_compute_performance-ego0": 0.001893759766387304}, "LF-norm-zigzag-000-ego0": {"driven_any": 25.606416644269338, "get_ui_image": 0.03558267145530072, "step_physics": 0.17959678996909567, "survival_time": 59.99999999999873, "driven_lanedir": 22.70456799022513, "get_state_dump": 0.004426630013789066, "get_robot_state": 0.003504558367891971, "sim_render-ego0": 0.0036129850233524263, "get_duckie_state": 1.1525880684959798e-06, "in-drivable-lane": 3.1499999999999586, "deviation-heading": 16.547642963299207, "agent_compute-ego0": 0.015736557859663762, "complete-iteration": 0.2600830462850401, "set_robot_commands": 0.0021558679410758163, "deviation-center-line": 4.211496832371706, "driven_lanedir_consec": 22.70456799022513, "sim_compute_sim_state": 0.013519484832026776, "sim_compute_performance-ego0": 0.0018721827857202536}, "LF-norm-techtrack-000-ego0": {"driven_any": 25.66737914041556, "get_ui_image": 0.03194681412969203, "step_physics": 0.15823539925256835, "survival_time": 59.99999999999873, "driven_lanedir": 20.16851222437302, "get_state_dump": 0.0042599907127844104, "get_robot_state": 0.0034650372625092086, "sim_render-ego0": 0.0035720619929025415, "get_duckie_state": 1.1402800319395296e-06, "in-drivable-lane": 9.449999999999832, "deviation-heading": 14.166146506497697, "agent_compute-ego0": 0.015563971394801717, "complete-iteration": 0.23355147086214165, "set_robot_commands": 0.002149413169968833, "deviation-center-line": 3.49014888066507, "driven_lanedir_consec": 20.16538822930659, "sim_compute_sim_state": 0.012434768240021031, "sim_compute_performance-ego0": 0.001851405231879216}, "LF-norm-small_loop-000-ego0": {"driven_any": 25.542318468885693, "get_ui_image": 0.025552219197116824, "step_physics": 0.1174436310348066, "survival_time": 59.99999999999873, "driven_lanedir": 20.979808104968814, "get_state_dump": 0.004367656850695709, "get_robot_state": 0.003495647150908382, "sim_render-ego0": 0.003537879002084343, "get_duckie_state": 1.1845492601990204e-06, "in-drivable-lane": 7.749999999999839, "deviation-heading": 14.22813004764608, "agent_compute-ego0": 0.015071516727825486, "complete-iteration": 0.1794990933407951, "set_robot_commands": 0.00215121232698998, "deviation-center-line": 3.392202122451646, "driven_lanedir_consec": 20.979808104968814, "sim_compute_sim_state": 0.005953092559191905, "sim_compute_performance-ego0": 0.0018520454482968704}}
set_robot_commands_max0.002208293427237861
set_robot_commands_mean0.0021661967163181224
set_robot_commands_median0.0021535401340328983
set_robot_commands_min0.002149413169968833
sim_compute_performance-ego0_max0.001893759766387304
sim_compute_performance-ego0_mean0.001867348308070911
sim_compute_performance-ego0_median0.001862114117008562
sim_compute_performance-ego0_min0.001851405231879216
sim_compute_sim_state_max0.013519484832026776
sim_compute_sim_state_mean0.010292564601723498
sim_compute_sim_state_median0.010848840507837656
sim_compute_sim_state_min0.005953092559191905
sim_render-ego0_max0.0036129850233524263
sim_render-ego0_mean0.003577327648864797
sim_render-ego0_median0.003579223285011209
sim_render-ego0_min0.003537879002084343
simulation-passed1
step_physics_max0.17959678996909567
step_physics_mean0.14969084731347357
step_physics_median0.150861484124996
step_physics_min0.1174436310348066
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6185513359Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6185413358Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6185313358Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6185113356Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6185013355Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6184913355Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6184613352Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:25
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 107 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6184513352Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 93 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6184313351Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 96 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6184213350Sophie CHAUDONNERETreal-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:36:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.28697991350404
survival_time_median59.99999999999873
deviation-center-line_median4.59283032978729
in-drivable-lane_median4.074999999999884


other stats
agent_compute-ego0_max0.012221626794705485
agent_compute-ego0_mean0.011908986437429894
agent_compute-ego0_median0.0118073626025134
agent_compute-ego0_min0.011799593749987297
complete-iteration_max0.22082277440111603
complete-iteration_mean0.19229954262756488
complete-iteration_median0.19228215052821457
complete-iteration_min0.16381109505271435
deviation-center-line_max4.804392177526576
deviation-center-line_mean4.3873276359463365
deviation-center-line_min3.5592577066841895
deviation-heading_max18.7996201782239
deviation-heading_mean16.49553189027913
deviation-heading_median15.979891799398867
deviation-heading_min15.222723784094873
driven_any_max18.108081665010463
driven_any_mean14.648050117092662
driven_any_median13.872194275945107
driven_any_min12.739730251469966
driven_lanedir_consec_max15.033114101095778
driven_lanedir_consec_mean12.697874098186992
driven_lanedir_consec_min11.184422464644118
driven_lanedir_max15.033114101095778
driven_lanedir_mean12.697874098186992
driven_lanedir_median12.28697991350404
driven_lanedir_min11.184422464644118
get_duckie_state_max1.1887181112907213e-06
get_duckie_state_mean1.1766582206325864e-06
get_duckie_state_median1.1762115580156185e-06
get_duckie_state_min1.1654916552083877e-06
get_robot_state_max0.0036162921133684575
get_robot_state_mean0.0035390034007787906
get_robot_state_median0.0035331079505266103
get_robot_state_min0.0034735055886934837
get_state_dump_max0.004450561005705898
get_state_dump_mean0.004328451982445761
get_state_dump_median0.004293695278310657
get_state_dump_min0.004275856367455831
get_ui_image_max0.035538661886909226
get_ui_image_mean0.03033692900286825
get_ui_image_median0.03019780411906882
get_ui_image_min0.025413445886426127
in-drivable-lane_max7.499999999999837
in-drivable-lane_mean4.387499999999874
in-drivable-lane_min1.899999999999892
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 18.108081665010463, "get_ui_image": 0.02814446222176659, "step_physics": 0.11735206619091176, "survival_time": 59.99999999999873, "driven_lanedir": 15.033114101095778, "get_state_dump": 0.004450561005705898, "get_robot_state": 0.0036162921133684575, "sim_render-ego0": 0.0036863587877335497, "get_duckie_state": 1.1654916552083877e-06, "in-drivable-lane": 7.499999999999837, "deviation-heading": 15.222723784094873, "agent_compute-ego0": 0.012221626794705485, "complete-iteration": 0.1829835463324554, "set_robot_commands": 0.0021853266310235247, "deviation-center-line": 3.5592577066841895, "driven_lanedir_consec": 15.033114101095778, "sim_compute_sim_state": 0.009341039824346815, "sim_compute_performance-ego0": 0.0019149524186870435}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.24095810500408, "get_ui_image": 0.035538661886909226, "step_physics": 0.14441524159402078, "survival_time": 59.99999999999873, "driven_lanedir": 11.349236961438368, "get_state_dump": 0.004275941729644852, "get_robot_state": 0.0035503325513955657, "sim_render-ego0": 0.003596538707278948, "get_duckie_state": 1.1654916552083877e-06, "in-drivable-lane": 3.949999999999996, "deviation-heading": 18.7996201782239, "agent_compute-ego0": 0.011802540532158972, "complete-iteration": 0.22082277440111603, "set_robot_commands": 0.00216404782246789, "deviation-center-line": 4.804392177526576, "driven_lanedir_consec": 11.349236961438368, "sim_compute_sim_state": 0.013529065248868944, "sim_compute_performance-ego0": 0.0018836254879000976}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.50343044688614, "get_ui_image": 0.032251146016371045, "step_physics": 0.12967984642613242, "survival_time": 59.99999999999873, "driven_lanedir": 13.224722865569714, "get_state_dump": 0.004275856367455831, "get_robot_state": 0.0035158833496576544, "sim_render-ego0": 0.003581587222096922, "get_duckie_state": 1.1887181112907213e-06, "in-drivable-lane": 1.899999999999892, "deviation-heading": 16.360734443469163, "agent_compute-ego0": 0.011812184672867826, "complete-iteration": 0.20158075472397372, "set_robot_commands": 0.002141853256289111, "deviation-center-line": 4.701063046916265, "driven_lanedir_consec": 13.224722865569714, "sim_compute_sim_state": 0.012390535538837772, "sim_compute_performance-ego0": 0.0018645248047815177}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.739730251469966, "get_ui_image": 0.025413445886426127, "step_physics": 0.10509552149649563, "survival_time": 59.99999999999873, "driven_lanedir": 11.184422464644118, "get_state_dump": 0.004311448826976462, "get_robot_state": 0.0034735055886934837, "sim_render-ego0": 0.0035359041577671885, "get_duckie_state": 1.1869314608228495e-06, "in-drivable-lane": 4.199999999999772, "deviation-heading": 15.59904915532857, "agent_compute-ego0": 0.011799593749987297, "complete-iteration": 0.16381109505271435, "set_robot_commands": 0.002213877901050272, "deviation-center-line": 4.484597612658316, "driven_lanedir_consec": 11.184422464644118, "sim_compute_sim_state": 0.006056396093694098, "sim_compute_performance-ego0": 0.0018432237623533937}}
set_robot_commands_max0.002213877901050272
set_robot_commands_mean0.0021762764027076996
set_robot_commands_median0.002174687226745707
set_robot_commands_min0.002141853256289111
sim_compute_performance-ego0_max0.0019149524186870435
sim_compute_performance-ego0_mean0.0018765816184305132
sim_compute_performance-ego0_median0.0018740751463408075
sim_compute_performance-ego0_min0.0018432237623533937
sim_compute_sim_state_max0.013529065248868944
sim_compute_sim_state_mean0.010329259176436909
sim_compute_sim_state_median0.010865787681592297
sim_compute_sim_state_min0.006056396093694098
sim_render-ego0_max0.0036863587877335497
sim_render-ego0_mean0.003600097218719152
sim_render-ego0_median0.003589062964687935
sim_render-ego0_min0.0035359041577671885
simulation-passed1
step_physics_max0.14441524159402078
step_physics_mean0.12413566892689017
step_physics_median0.12351595630852208
step_physics_min0.10509552149649563
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6184013348Sophie CHAUDONNERETreal-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.082183418784394
survival_time_median59.99999999999873
deviation-center-line_median3.444613548703579
in-drivable-lane_median1.0749999999999638


other stats
agent_compute-ego0_max0.012045507724835015
agent_compute-ego0_mean0.011882903226507792
agent_compute-ego0_median0.01188441359133248
agent_compute-ego0_min0.011717277998531192
complete-iteration_max0.20479768817371177
complete-iteration_mean0.1749029465261645
complete-iteration_median0.1722611903548737
complete-iteration_min0.15029171722119894
deviation-center-line_max3.594386832056849
deviation-center-line_mean3.2990743738917785
deviation-center-line_min2.712683566103108
deviation-heading_max12.117390442900955
deviation-heading_mean10.642462379669718
deviation-heading_median10.345503491136348
deviation-heading_min9.761452093505222
driven_any_max16.891150657995944
driven_any_mean13.732869788690104
driven_any_median12.963905415676091
driven_any_min12.11251766541229
driven_lanedir_consec_max16.564336046909414
driven_lanedir_consec_mean13.03661942803882
driven_lanedir_consec_min11.417774827677066
driven_lanedir_max16.564336046909414
driven_lanedir_mean13.2203911362134
driven_lanedir_median12.410733815890696
driven_lanedir_min11.495760866162795
get_duckie_state_max1.1823655762938435e-06
get_duckie_state_mean1.1490643967398991e-06
get_duckie_state_median1.167079788957607e-06
get_duckie_state_min1.07973243275054e-06
get_robot_state_max0.0035350445803754237
get_robot_state_mean0.0034778387123698693
get_robot_state_median0.0034629500577292973
get_robot_state_min0.0034504101536454606
get_state_dump_max0.004287434458037797
get_state_dump_mean0.004238612248836012
get_state_dump_median0.00424284938967893
get_state_dump_min0.004181315757948394
get_ui_image_max0.035481238742355106
get_ui_image_mean0.030103788139619597
get_ui_image_median0.029820926977533985
get_ui_image_min0.025292059861055323
in-drivable-lane_max2.3500000000000334
in-drivable-lane_mean1.1249999999999902
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.891150657995944, "get_ui_image": 0.027696864988087214, "step_physics": 0.09500994729956024, "survival_time": 59.99999999999873, "driven_lanedir": 16.564336046909414, "get_state_dump": 0.004181315757948394, "get_robot_state": 0.0035350445803754237, "sim_render-ego0": 0.0035591844118802772, "get_duckie_state": 1.07973243275054e-06, "in-drivable-lane": 0.05000000000000071, "deviation-heading": 9.761452093505222, "agent_compute-ego0": 0.011835568949741488, "complete-iteration": 0.1591279510653684, "set_robot_commands": 0.002098817610919326, "deviation-center-line": 3.3842697440236007, "driven_lanedir_consec": 16.564336046909414, "sim_compute_sim_state": 0.009283936291709729, "sim_compute_performance-ego0": 0.0018528311774692963}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.11251766541229, "get_ui_image": 0.035481238742355106, "step_physics": 0.1284532979763517, "survival_time": 59.99999999999873, "driven_lanedir": 11.495760866162795, "get_state_dump": 0.004287434458037797, "get_robot_state": 0.0034504101536454606, "sim_render-ego0": 0.0035420555953280712, "get_duckie_state": 1.1646975883337778e-06, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 10.297741096931858, "agent_compute-ego0": 0.012045507724835015, "complete-iteration": 0.20479768817371177, "set_robot_commands": 0.002041698196944746, "deviation-center-line": 3.594386832056849, "driven_lanedir_consec": 11.495760866162795, "sim_compute_sim_state": 0.01359463373290609, "sim_compute_performance-ego0": 0.0018262585235773571}, "LF-norm-techtrack-000-ego0": {"driven_any": 13.018425916420762, "get_ui_image": 0.031944988966980746, "step_physics": 0.11432387985655112, "survival_time": 59.99999999999873, "driven_lanedir": 12.1528616603754, "get_state_dump": 0.004203112496622992, "get_robot_state": 0.0034623580808742756, "sim_render-ego0": 0.0035176491558700676, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 2.099999999999927, "deviation-heading": 12.117390442900955, "agent_compute-ego0": 0.01193325823292347, "complete-iteration": 0.185394429644379, "set_robot_commands": 0.002015272643941328, "deviation-center-line": 3.5049573533835567, "driven_lanedir_consec": 11.417774827677066, "sim_compute_sim_state": 0.0120943565352771, "sim_compute_performance-ego0": 0.0018252550215645696}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.90938491493142, "get_ui_image": 0.025292059861055323, "step_physics": 0.09207426221245632, "survival_time": 59.99999999999873, "driven_lanedir": 12.668605971405992, "get_state_dump": 0.004282586282734867, "get_robot_state": 0.0034635420345843185, "sim_render-ego0": 0.0035147466429266503, "get_duckie_state": 1.169461989581436e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.39326588534084, "agent_compute-ego0": 0.011717277998531192, "complete-iteration": 0.15029171722119894, "set_robot_commands": 0.0020528153317060003, "deviation-center-line": 2.712683566103108, "driven_lanedir_consec": 12.668605971405992, "sim_compute_sim_state": 0.0059846523500898295, "sim_compute_performance-ego0": 0.0018332504809250145}}
set_robot_commands_max0.002098817610919326
set_robot_commands_mean0.00205215094587785
set_robot_commands_median0.002047256764325373
set_robot_commands_min0.002015272643941328
sim_compute_performance-ego0_max0.0018528311774692963
sim_compute_performance-ego0_mean0.0018343988008840597
sim_compute_performance-ego0_median0.0018297545022511856
sim_compute_performance-ego0_min0.0018252550215645696
sim_compute_sim_state_max0.01359463373290609
sim_compute_sim_state_mean0.010239394727495688
sim_compute_sim_state_median0.010689146413493417
sim_compute_sim_state_min0.0059846523500898295
sim_render-ego0_max0.0035591844118802772
sim_render-ego0_mean0.0035334089515012667
sim_render-ego0_median0.003529852375599069
sim_render-ego0_min0.0035147466429266503
simulation-passed1
step_physics_max0.1284532979763517
step_physics_mean0.10746534683622984
step_physics_median0.10466691357805567
step_physics_min0.09207426221245632
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6183913347Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:11:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1302 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6183813347Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simabortedyesgpu-prod-010:03:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 96 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6183713347Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simabortedyesgpu-prod-010:04:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 65 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6183613346Sophie CHAUDONNERETsim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:31:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.9566846819785
survival_time_median59.99999999999873
deviation-center-line_median3.658193211887612
in-drivable-lane_median7.424999999999878


other stats
agent_compute-ego0_max0.01227341524071737
agent_compute-ego0_mean0.012023706156180643
agent_compute-ego0_median0.012099264233696935
agent_compute-ego0_min0.01162288091661134
complete-iteration_max0.2350336058493734
complete-iteration_mean0.19630641262156523
complete-iteration_median0.1939918547248364
complete-iteration_min0.1622083351872148
deviation-center-line_max4.2792134635638055
deviation-center-line_mean3.4380467355264415
deviation-center-line_min2.156587054766737
deviation-heading_max17.436530067289606
deviation-heading_mean14.220372955013222
deviation-heading_median15.373132783113192
deviation-heading_min8.698696186536898
driven_any_max16.8415851723257
driven_any_mean12.405870174035991
driven_any_median13.13745325206903
driven_any_min6.5069890196802085
driven_lanedir_consec_max13.41527526448868
driven_lanedir_consec_mean10.222471794006228
driven_lanedir_consec_min5.561242547579221
driven_lanedir_max13.41527526448868
driven_lanedir_mean10.222471794006228
driven_lanedir_median10.9566846819785
driven_lanedir_min5.561242547579221
get_duckie_state_max1.2177015522139753e-06
get_duckie_state_mean1.159880481383084e-06
get_duckie_state_median1.165485502161643e-06
get_duckie_state_min1.0908493689950758e-06
get_robot_state_max0.003666567663467496
get_robot_state_mean0.0035118365578496024
get_robot_state_median0.0034678429415556395
get_robot_state_min0.0034450926848196366
get_state_dump_max0.004487842370013039
get_state_dump_mean0.004349297211623913
get_state_dump_median0.004347641005504142
get_state_dump_min0.004214064465474328
get_ui_image_max0.03570420551455624
get_ui_image_mean0.030146869825971256
get_ui_image_median0.029869155522488634
get_ui_image_min0.025144962744351528
in-drivable-lane_max9.949999999999848
in-drivable-lane_mean7.049999999999913
in-drivable-lane_min3.4000000000000483
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.8415851723257, "get_ui_image": 0.02788057394766192, "step_physics": 0.11582545178021916, "survival_time": 59.99999999999873, "driven_lanedir": 13.41527526448868, "get_state_dump": 0.004412019381812966, "get_robot_state": 0.003666567663467496, "sim_render-ego0": 0.003848154082286368, "get_duckie_state": 1.2177015522139753e-06, "in-drivable-lane": 9.949999999999848, "deviation-heading": 14.939597665818397, "agent_compute-ego0": 0.01227341524071737, "complete-iteration": 0.1819555402099838, "set_robot_commands": 0.0024097865070530416, "deviation-center-line": 3.0405488963303213, "driven_lanedir_consec": 13.41527526448868, "sim_compute_sim_state": 0.009535591767094316, "sim_compute_performance-ego0": 0.0020284059144972167}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.5069890196802085, "get_ui_image": 0.03570420551455624, "step_physics": 0.1598393061421629, "survival_time": 30.6000000000003, "driven_lanedir": 5.561242547579221, "get_state_dump": 0.004487842370013039, "get_robot_state": 0.0034854085371505963, "sim_render-ego0": 0.003622644293755536, "get_duckie_state": 1.1831473370749644e-06, "in-drivable-lane": 3.4000000000000483, "deviation-heading": 8.698696186536898, "agent_compute-ego0": 0.012229026044562434, "complete-iteration": 0.2350336058493734, "set_robot_commands": 0.002115344145558592, "deviation-center-line": 2.156587054766737, "driven_lanedir_consec": 5.561242547579221, "sim_compute_sim_state": 0.011624064375486888, "sim_compute_performance-ego0": 0.0018485253631193525}, "LF-norm-techtrack-000-ego0": {"driven_any": 13.81645293794023, "get_ui_image": 0.03185773709731535, "step_physics": 0.13472945048946028, "survival_time": 59.99999999999873, "driven_lanedir": 11.8627409265839, "get_state_dump": 0.004283262629195316, "get_robot_state": 0.0034450926848196366, "sim_render-ego0": 0.0035733396465037885, "get_duckie_state": 1.0908493689950758e-06, "in-drivable-lane": 4.949999999999964, "deviation-heading": 17.436530067289606, "agent_compute-ego0": 0.011969502422831438, "complete-iteration": 0.20602816923968895, "set_robot_commands": 0.0020977900883835817, "deviation-center-line": 4.2792134635638055, "driven_lanedir_consec": 11.8627409265839, "sim_compute_sim_state": 0.01216367678678006, "sim_compute_performance-ego0": 0.0018350246248396112}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.45845356619783, "get_ui_image": 0.025144962744351528, "step_physics": 0.1043578693015093, "survival_time": 59.99999999999873, "driven_lanedir": 10.050628437373105, "get_state_dump": 0.004214064465474328, "get_robot_state": 0.0034502773459606823, "sim_render-ego0": 0.0035291331495273916, "get_duckie_state": 1.1478236672483215e-06, "in-drivable-lane": 9.899999999999793, "deviation-heading": 15.806667900407987, "agent_compute-ego0": 0.01162288091661134, "complete-iteration": 0.1622083351872148, "set_robot_commands": 0.00204495466519752, "deviation-center-line": 4.275837527444902, "driven_lanedir_consec": 10.050628437373105, "sim_compute_sim_state": 0.005951468692433328, "sim_compute_performance-ego0": 0.0018201418264422388}}
set_robot_commands_max0.0024097865070530416
set_robot_commands_mean0.0021669688515481835
set_robot_commands_median0.002106567116971086
set_robot_commands_min0.00204495466519752
sim_compute_performance-ego0_max0.0020284059144972167
sim_compute_performance-ego0_mean0.0018830244322246047
sim_compute_performance-ego0_median0.001841774993979482
sim_compute_performance-ego0_min0.0018201418264422388
sim_compute_sim_state_max0.01216367678678006
sim_compute_sim_state_mean0.009818700405448648
sim_compute_sim_state_median0.0105798280712906
sim_compute_sim_state_min0.005951468692433328
sim_render-ego0_max0.003848154082286368
sim_render-ego0_mean0.003643317793018271
sim_render-ego0_median0.0035979919701296624
sim_render-ego0_min0.0035291331495273916
simulation-passed1
step_physics_max0.1598393061421629
step_physics_mean0.12868801942833794
step_physics_median0.1252774511348397
step_physics_min0.1043578693015093
survival_time_max59.99999999999873
survival_time_mean52.649999999999125
survival_time_min30.6000000000003
No reset possible
6183313343Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:39:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.795835069195338
survival_time_median59.99999999999873
deviation-center-line_median3.887998416196
in-drivable-lane_median1.7499999999999685


other stats
agent_compute-ego0_max0.0150693935915195
agent_compute-ego0_mean0.014718861901492105
agent_compute-ego0_median0.01479528339379634
agent_compute-ego0_min0.01421548722685624
complete-iteration_max0.25689623099778913
complete-iteration_mean0.21589237575626297
complete-iteration_median0.21625830231856347
complete-iteration_min0.1741566673901357
deviation-center-line_max4.033197735074259
deviation-center-line_mean3.7283289287189993
deviation-center-line_min3.1041211474097374
deviation-heading_max13.854141513282368
deviation-heading_mean13.452520451767786
deviation-heading_median13.44957692090872
deviation-heading_min13.056786451971336
driven_any_max24.62642494126961
driven_any_mean24.409107228455017
driven_any_median24.495780947374374
driven_any_min24.018442077801687
driven_lanedir_consec_max23.645644878824303
driven_lanedir_consec_mean22.85475471032044
driven_lanedir_consec_min22.1817038240668
driven_lanedir_max23.645644878824303
driven_lanedir_mean22.85475471032044
driven_lanedir_median22.795835069195338
driven_lanedir_min22.1817038240668
get_duckie_state_max1.2137312178409269e-06
get_duckie_state_mean1.1611739165776973e-06
get_duckie_state_median1.1552680441977876e-06
get_duckie_state_min1.120428360074287e-06
get_robot_state_max0.0035903169947996624
get_robot_state_mean0.003534444166559859
get_robot_state_median0.003537233624232004
get_robot_state_min0.003472992422975767
get_state_dump_max0.004429570840459184
get_state_dump_mean0.004318299341162079
get_state_dump_median0.00430775740859312
get_state_dump_min0.0042281117070028925
get_ui_image_max0.03569038245799043
get_ui_image_mean0.0301683203167562
get_ui_image_median0.02986727090402011
get_ui_image_min0.025248357000994145
in-drivable-lane_max3.39999999999985
in-drivable-lane_mean1.7249999999999466
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 24.499759545100275, "get_ui_image": 0.027769257087294604, "step_physics": 0.13386238782630178, "survival_time": 59.99999999999873, "driven_lanedir": 23.645644878824303, "get_state_dump": 0.00432337551291638, "get_robot_state": 0.0035903169947996624, "sim_render-ego0": 0.0036708423239702383, "get_duckie_state": 1.120428360074287e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.854141513282368, "agent_compute-ego0": 0.015059718482202536, "complete-iteration": 0.20200802801451417, "set_robot_commands": 0.002257980375266095, "deviation-center-line": 3.1041211474097374, "driven_lanedir_consec": 23.645644878824303, "sim_compute_sim_state": 0.009487087383159096, "sim_compute_performance-ego0": 0.0019122440550944687}, "LF-norm-zigzag-000-ego0": {"driven_any": 24.018442077801687, "get_ui_image": 0.03569038245799043, "step_physics": 0.1767731405713973, "survival_time": 59.99999999999873, "driven_lanedir": 22.988560441624006, "get_state_dump": 0.004429570840459184, "get_robot_state": 0.003554399364893879, "sim_render-ego0": 0.003651659454930136, "get_duckie_state": 1.2137312178409269e-06, "in-drivable-lane": 0.5499999999999865, "deviation-heading": 13.056786451971336, "agent_compute-ego0": 0.0150693935915195, "complete-iteration": 0.25689623099778913, "set_robot_commands": 0.0021303678730147566, "deviation-center-line": 4.033197735074259, "driven_lanedir_consec": 22.988560441624006, "sim_compute_sim_state": 0.013618033494083808, "sim_compute_performance-ego0": 0.001901136846169147}, "LF-norm-techtrack-000-ego0": {"driven_any": 24.62642494126961, "get_ui_image": 0.03196528472074561, "step_physics": 0.1561624749713297, "survival_time": 59.99999999999873, "driven_lanedir": 22.60310969676666, "get_state_dump": 0.004292139304269859, "get_robot_state": 0.003520067883570129, "sim_render-ego0": 0.003579899432954939, "get_duckie_state": 1.1889166280093736e-06, "in-drivable-lane": 2.9499999999999504, "deviation-heading": 13.434177360922186, "agent_compute-ego0": 0.01453084830539014, "complete-iteration": 0.23050857662261276, "set_robot_commands": 0.0021050706890401592, "deviation-center-line": 3.79671729267967, "driven_lanedir_consec": 22.60310969676666, "sim_compute_sim_state": 0.01242531666052927, "sim_compute_performance-ego0": 0.0018558631233132749}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.49180234964848, "get_ui_image": 0.025248357000994145, "step_physics": 0.1133973219313292, "survival_time": 59.99999999999873, "driven_lanedir": 22.1817038240668, "get_state_dump": 0.0042281117070028925, "get_robot_state": 0.003472992422975767, "sim_render-ego0": 0.0035360973145344373, "get_duckie_state": 1.1216194603862016e-06, "in-drivable-lane": 3.39999999999985, "deviation-heading": 13.46497648089525, "agent_compute-ego0": 0.01421548722685624, "complete-iteration": 0.1741566673901357, "set_robot_commands": 0.002102521734372662, "deviation-center-line": 3.979279539712331, "driven_lanedir_consec": 22.1817038240668, "sim_compute_sim_state": 0.006042643053942576, "sim_compute_performance-ego0": 0.0018419469028190213}}
set_robot_commands_max0.002257980375266095
set_robot_commands_mean0.002148985167923418
set_robot_commands_median0.002117719281027458
set_robot_commands_min0.002102521734372662
sim_compute_performance-ego0_max0.0019122440550944687
sim_compute_performance-ego0_mean0.001877797731848978
sim_compute_performance-ego0_median0.001878499984741211
sim_compute_performance-ego0_min0.0018419469028190213
sim_compute_sim_state_max0.013618033494083808
sim_compute_sim_state_mean0.010393270147928688
sim_compute_sim_state_median0.010956202021844184
sim_compute_sim_state_min0.006042643053942576
sim_render-ego0_max0.0036708423239702383
sim_render-ego0_mean0.003609624631597438
sim_render-ego0_median0.0036157794439425376
sim_render-ego0_min0.0035360973145344373
simulation-passed1
step_physics_max0.1767731405713973
step_physics_mean0.1450488313250895
step_physics_median0.14501243139881576
step_physics_min0.1133973219313292
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6183113341Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:38:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median23.13266938227944
survival_time_median59.99999999999873
deviation-center-line_median2.927556779838655
in-drivable-lane_median0.17499999999999005


other stats
agent_compute-ego0_max0.01625349644676736
agent_compute-ego0_mean0.015801653590922712
agent_compute-ego0_median0.01593127357870415
agent_compute-ego0_min0.015090570759515184
complete-iteration_max0.26914281854378796
complete-iteration_mean0.2320638937352485
complete-iteration_median0.23533987085785496
complete-iteration_min0.1884330146814961
deviation-center-line_max3.376784704631697
deviation-center-line_mean2.9908017525304267
deviation-center-line_min2.7313087458126986
deviation-heading_max13.872646595422964
deviation-heading_mean13.00878035009817
deviation-heading_median13.317936018052908
deviation-heading_min11.526602768863905
driven_any_max24.22865300290253
driven_any_mean23.09732562856227
driven_any_median24.034856889972296
driven_any_min20.090935731401977
driven_lanedir_consec_max23.19926705017333
driven_lanedir_consec_mean22.107600599743023
driven_lanedir_consec_min18.96579658423988
driven_lanedir_max23.19926705017333
driven_lanedir_mean22.107600599743023
driven_lanedir_median23.13266938227944
driven_lanedir_min18.96579658423988
get_duckie_state_max1.128251503830179e-06
get_duckie_state_mean1.078511951191074e-06
get_duckie_state_median1.0824124084523477e-06
get_duckie_state_min1.020971484029422e-06
get_robot_state_max0.0035687886507286817
get_robot_state_mean0.0035134815030790174
get_robot_state_median0.0035130671914868506
get_robot_state_min0.0034590029786136854
get_state_dump_max0.004448731078593359
get_state_dump_mean0.00435201421747659
get_state_dump_median0.0043331696330061766
get_state_dump_min0.004292986525300647
get_ui_image_max0.035807366496516065
get_ui_image_mean0.030541617388505415
get_ui_image_median0.030273572789143763
get_ui_image_min0.025811957479218064
in-drivable-lane_max1.4499999999999176
in-drivable-lane_mean0.4499999999999744
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 23.98581487412552, "get_ui_image": 0.028036413343621728, "step_physics": 0.14949278053296397, "survival_time": 59.99999999999873, "driven_lanedir": 23.11855541031825, "get_state_dump": 0.004365426912395087, "get_robot_state": 0.0035687886507286817, "sim_render-ego0": 0.0037022133254687255, "get_duckie_state": 1.0539252593257246e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.872646595422964, "agent_compute-ego0": 0.016237149528420834, "complete-iteration": 0.21899587685222133, "set_robot_commands": 0.002203965167221082, "deviation-center-line": 2.7313087458126986, "driven_lanedir_consec": 23.11855541031825, "sim_compute_sim_state": 0.009375488629051291, "sim_compute_performance-ego0": 0.001940740931540306}, "LF-norm-zigzag-000-ego0": {"driven_any": 20.090935731401977, "get_ui_image": 0.035807366496516065, "step_physics": 0.18902575540217592, "survival_time": 51.29999999999922, "driven_lanedir": 18.96579658423988, "get_state_dump": 0.004292986525300647, "get_robot_state": 0.0034590029786136854, "sim_render-ego0": 0.0035374064756577297, "get_duckie_state": 1.128251503830179e-06, "in-drivable-lane": 1.4499999999999176, "deviation-heading": 11.526602768863905, "agent_compute-ego0": 0.01625349644676736, "complete-iteration": 0.26914281854378796, "set_robot_commands": 0.0020904339044676783, "deviation-center-line": 2.912253123028973, "driven_lanedir_consec": 18.96579658423988, "sim_compute_sim_state": 0.012780249408993076, "sim_compute_performance-ego0": 0.0018248063563836236}, "LF-norm-techtrack-000-ego0": {"driven_any": 24.083898905819076, "get_ui_image": 0.032510732234665794, "step_physics": 0.17547856322136846, "survival_time": 59.99999999999873, "driven_lanedir": 23.146783354240625, "get_state_dump": 0.004448731078593359, "get_robot_state": 0.0035559884912266916, "sim_render-ego0": 0.0037858023631582647, "get_duckie_state": 1.1108995575789707e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.661934942936677, "agent_compute-ego0": 0.015090570759515184, "complete-iteration": 0.2516838648634886, "set_robot_commands": 0.0022716105331687703, "deviation-center-line": 3.376784704631697, "driven_lanedir_consec": 23.146783354240625, "sim_compute_sim_state": 0.01250023329684776, "sim_compute_performance-ego0": 0.001968128496562313}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.22865300290253, "get_ui_image": 0.025811957479218064, "step_physics": 0.12571210190219545, "survival_time": 59.99999999999873, "driven_lanedir": 23.19926705017333, "get_state_dump": 0.004300912353617265, "get_robot_state": 0.00347014589174701, "sim_render-ego0": 0.003522086203048668, "get_duckie_state": 1.020971484029422e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 12.97393709316914, "agent_compute-ego0": 0.015625397628987462, "complete-iteration": 0.1884330146814961, "set_robot_commands": 0.002075768231750031, "deviation-center-line": 2.942860436648337, "driven_lanedir_consec": 23.19926705017333, "sim_compute_sim_state": 0.006011702833723566, "sim_compute_performance-ego0": 0.001832653342635308}}
set_robot_commands_max0.0022716105331687703
set_robot_commands_mean0.00216044445915189
set_robot_commands_median0.00214719953584438
set_robot_commands_min0.002075768231750031
sim_compute_performance-ego0_max0.001968128496562313
sim_compute_performance-ego0_mean0.001891582281780388
sim_compute_performance-ego0_median0.001886697137087807
sim_compute_performance-ego0_min0.0018248063563836236
sim_compute_sim_state_max0.012780249408993076
sim_compute_sim_state_mean0.010166918542153925
sim_compute_sim_state_median0.010937860962949526
sim_compute_sim_state_min0.006011702833723566
sim_render-ego0_max0.0037858023631582647
sim_render-ego0_mean0.003636877091833347
sim_render-ego0_median0.003619809900563227
sim_render-ego0_min0.003522086203048668
simulation-passed1
step_physics_max0.18902575540217592
step_physics_mean0.15992730026467594
step_physics_median0.16248567187716623
step_physics_min0.12571210190219545
survival_time_max59.99999999999873
survival_time_mean57.82499999999885
survival_time_min51.29999999999922
No reset possible
6182913339Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:31:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median16.25376023170104
survival_time_median49.54999999999932
deviation-center-line_median2.4870715276994875
in-drivable-lane_median7.699999999999973


other stats
agent_compute-ego0_max0.015476741096525814
agent_compute-ego0_mean0.015126707913865804
agent_compute-ego0_median0.01505883435137045
agent_compute-ego0_min0.014912421856196496
complete-iteration_max0.26442633451417435
complete-iteration_mean0.2310848587404904
complete-iteration_median0.2370405515156943
complete-iteration_min0.1858319974163986
deviation-center-line_max3.0123476761217227
deviation-center-line_mean2.36850505450406
deviation-center-line_min1.4875294864955406
deviation-heading_max11.16623251841192
deviation-heading_mean8.807597899656237
deviation-heading_median9.47358779296858
deviation-heading_min5.1169834942758685
driven_any_max26.01532900121024
driven_any_mean20.584176854511664
driven_any_median21.40447649254908
driven_any_min13.51242543173826
driven_lanedir_consec_max23.103797132289554
driven_lanedir_consec_mean16.121487324028745
driven_lanedir_consec_min8.874631700423354
driven_lanedir_max23.103797132289554
driven_lanedir_mean16.121487324028745
driven_lanedir_median16.25376023170104
driven_lanedir_min8.874631700423354
get_duckie_state_max1.730867269930494e-06
get_duckie_state_mean1.6517761868476166e-06
get_duckie_state_median1.6453693508744075e-06
get_duckie_state_min1.585498775711157e-06
get_robot_state_max0.003535208574200042
get_robot_state_mean0.00349708695587251
get_robot_state_median0.003503604495058846
get_robot_state_min0.0034459302591723067
get_state_dump_max0.004491471087186577
get_state_dump_mean0.004408660340244655
get_state_dump_median0.004420285320202576
get_state_dump_min0.004302599633386893
get_ui_image_max0.03507433344227399
get_ui_image_mean0.030179773402193254
get_ui_image_median0.030181795069281057
get_ui_image_min0.02528117002793693
in-drivable-lane_max16.749999999999815
in-drivable-lane_mean9.224999999999897
in-drivable-lane_min4.749999999999826
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.954172001440114, "get_ui_image": 0.027882219122135166, "step_physics": 0.1503428520675211, "survival_time": 39.09999999999992, "driven_lanedir": 14.616803771237477, "get_state_dump": 0.004491471087186577, "get_robot_state": 0.003535208574200042, "sim_render-ego0": 0.003748669630418487, "get_duckie_state": 1.585498775711157e-06, "in-drivable-lane": 4.749999999999826, "deviation-heading": 8.41090071772885, "agent_compute-ego0": 0.015476741096525814, "complete-iteration": 0.21915812662887085, "set_robot_commands": 0.002273277913625822, "deviation-center-line": 2.055779839131187, "driven_lanedir_consec": 14.616803771237477, "sim_compute_sim_state": 0.00935853517222983, "sim_compute_performance-ego0": 0.0019717307839813816}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.51242543173826, "get_ui_image": 0.03507433344227399, "step_physics": 0.18553732753724092, "survival_time": 32.20000000000031, "driven_lanedir": 8.874631700423354, "get_state_dump": 0.004302599633386893, "get_robot_state": 0.0034459302591723067, "sim_render-ego0": 0.00353616337443507, "get_duckie_state": 1.5868697055550509e-06, "in-drivable-lane": 10.500000000000137, "deviation-heading": 5.1169834942758685, "agent_compute-ego0": 0.01503055114154668, "complete-iteration": 0.26442633451417435, "set_robot_commands": 0.0020145704579907792, "deviation-center-line": 1.4875294864955406, "driven_lanedir_consec": 8.874631700423354, "sim_compute_sim_state": 0.013598350036975949, "sim_compute_performance-ego0": 0.001814376845840336}, "LF-norm-techtrack-000-ego0": {"driven_any": 26.01532900121024, "get_ui_image": 0.032481371016426945, "step_physics": 0.17882495061444006, "survival_time": 59.99999999999873, "driven_lanedir": 17.890716692164602, "get_state_dump": 0.004472344840793784, "get_robot_state": 0.003523456365440807, "sim_render-ego0": 0.003653347442588838, "get_duckie_state": 1.7038689961937644e-06, "in-drivable-lane": 16.749999999999815, "deviation-heading": 11.16623251841192, "agent_compute-ego0": 0.015087117561194224, "complete-iteration": 0.25492297640251776, "set_robot_commands": 0.0021571251474550423, "deviation-center-line": 2.918363216267788, "driven_lanedir_consec": 17.890716692164602, "sim_compute_sim_state": 0.012756310732140333, "sim_compute_performance-ego0": 0.001890427067714567}, "LF-norm-small_loop-000-ego0": {"driven_any": 25.85478098365805, "get_ui_image": 0.02528117002793693, "step_physics": 0.1241534770676536, "survival_time": 59.99999999999873, "driven_lanedir": 23.103797132289554, "get_state_dump": 0.0043682257996113675, "get_robot_state": 0.003483752624676885, "sim_render-ego0": 0.003577203575915639, "get_duckie_state": 1.730867269930494e-06, "in-drivable-lane": 4.89999999999981, "deviation-heading": 10.536274868208308, "agent_compute-ego0": 0.014912421856196496, "complete-iteration": 0.1858319974163986, "set_robot_commands": 0.0020963180869147738, "deviation-center-line": 3.0123476761217227, "driven_lanedir_consec": 23.103797132289554, "sim_compute_sim_state": 0.0060094689250885696, "sim_compute_performance-ego0": 0.0018742959961903088}}
set_robot_commands_max0.002273277913625822
set_robot_commands_mean0.002135322901496604
set_robot_commands_median0.002126721617184908
set_robot_commands_min0.0020145704579907792
sim_compute_performance-ego0_max0.0019717307839813816
sim_compute_performance-ego0_mean0.0018877076734316483
sim_compute_performance-ego0_median0.001882361531952438
sim_compute_performance-ego0_min0.001814376845840336
sim_compute_sim_state_max0.013598350036975949
sim_compute_sim_state_mean0.01043066621660867
sim_compute_sim_state_median0.011057422952185082
sim_compute_sim_state_min0.0060094689250885696
sim_render-ego0_max0.003748669630418487
sim_render-ego0_mean0.003628846005839509
sim_render-ego0_median0.0036152755092522383
sim_render-ego0_min0.00353616337443507
simulation-passed1
step_physics_max0.18553732753724092
step_physics_mean0.15971465182171393
step_physics_median0.16458390134098058
step_physics_min0.1241534770676536
survival_time_max59.99999999999873
survival_time_mean47.82499999999942
survival_time_min32.20000000000031
No reset possible
6182813338Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:22:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.581858376525132
survival_time_median34.84999999999937
deviation-center-line_median1.4444184986764943
in-drivable-lane_median2.699999999999958


other stats
agent_compute-ego0_max0.02384151879304685
agent_compute-ego0_mean0.01783282819804996
agent_compute-ego0_median0.01609790257160093
agent_compute-ego0_min0.015293988855951136
complete-iteration_max0.2688857620547277
complete-iteration_mean0.23172317379923163
complete-iteration_median0.23352362920590528
complete-iteration_min0.19095967473038825
deviation-center-line_max3.2174427710871942
deviation-center-line_mean1.5872876304234174
deviation-center-line_min0.2428707532534861
deviation-heading_max13.367972369137412
deviation-heading_mean6.3636936070712515
deviation-heading_median5.463487892126601
deviation-heading_min1.1598262748943924
driven_any_max26.817360702366944
driven_any_mean15.061565686706835
driven_any_median15.12635901595435
driven_any_min3.1761840125517016
driven_lanedir_consec_max25.805354840153036
driven_lanedir_consec_mean13.712961915438347
driven_lanedir_consec_min1.882776068550088
driven_lanedir_max25.805354840153036
driven_lanedir_mean13.712961915438347
driven_lanedir_median13.581858376525132
driven_lanedir_min1.882776068550088
get_duckie_state_max1.13218258588742e-06
get_duckie_state_mean1.1023599020202325e-06
get_duckie_state_median1.1002511701113785e-06
get_duckie_state_min1.0767546819707536e-06
get_robot_state_max0.00361925279171044
get_robot_state_mean0.003564018924014746
get_robot_state_median0.003551338504579231
get_robot_state_min0.003534145895190084
get_state_dump_max0.004430054030152383
get_state_dump_mean0.004402201261002882
get_state_dump_median0.004399750095621988
get_state_dump_min0.004379250822615167
get_ui_image_max0.03617962991228755
get_ui_image_mean0.03054588991387735
get_ui_image_median0.030202388115448807
get_ui_image_min0.025599153512324224
in-drivable-lane_max4.400000000000014
in-drivable-lane_mean2.4499999999999824
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 26.817360702366944, "get_ui_image": 0.027991474518470224, "step_physics": 0.14824664682075445, "survival_time": 59.99999999999873, "driven_lanedir": 24.9684156655917, "get_state_dump": 0.004379250822615167, "get_robot_state": 0.00361925279171044, "sim_render-ego0": 0.0035959687657796968, "get_duckie_state": 1.0767546819707536e-06, "in-drivable-lane": 2.1499999999999275, "deviation-heading": 13.367972369137412, "agent_compute-ego0": 0.01591385314109224, "complete-iteration": 0.2172356078666414, "set_robot_commands": 0.002233969182594928, "deviation-center-line": 3.2174427710871942, "driven_lanedir_consec": 24.9684156655917, "sim_compute_sim_state": 0.009280235344523892, "sim_compute_performance-ego0": 0.0018956325731110711}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.1761840125517016, "get_ui_image": 0.03617962991228755, "step_physics": 0.18218472581472456, "survival_time": 7.99999999999998, "driven_lanedir": 1.882776068550088, "get_state_dump": 0.004419760674423312, "get_robot_state": 0.0035516401255352896, "sim_render-ego0": 0.0036462004880727446, "get_duckie_state": 1.1106455548209434e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 1.1598262748943924, "agent_compute-ego0": 0.02384151879304685, "complete-iteration": 0.2688857620547277, "set_robot_commands": 0.0021725559826963436, "deviation-center-line": 0.2428707532534861, "driven_lanedir_consec": 1.882776068550088, "sim_compute_sim_state": 0.010945431193950013, "sim_compute_performance-ego0": 0.001864828678391735}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.948289808175552, "get_ui_image": 0.032413301712427386, "step_physics": 0.17444300040220603, "survival_time": 9.700000000000005, "driven_lanedir": 2.195301087458566, "get_state_dump": 0.004379739516820663, "get_robot_state": 0.003551036883623172, "sim_render-ego0": 0.0036740608704395783, "get_duckie_state": 1.13218258588742e-06, "in-drivable-lane": 4.400000000000014, "deviation-heading": 1.3735021179282516, "agent_compute-ego0": 0.016281952002109624, "complete-iteration": 0.24981165054516916, "set_robot_commands": 0.0022338219178028597, "deviation-center-line": 0.35451949351359946, "driven_lanedir_consec": 2.195301087458566, "sim_compute_sim_state": 0.010866991678873698, "sim_compute_performance-ego0": 0.001887960923023713}, "LF-norm-small_loop-000-ego0": {"driven_any": 26.304428223733147, "get_ui_image": 0.025599153512324224, "step_physics": 0.1284560184494641, "survival_time": 59.99999999999873, "driven_lanedir": 25.805354840153036, "get_state_dump": 0.004430054030152383, "get_robot_state": 0.003534145895190084, "sim_render-ego0": 0.003543780705613161, "get_duckie_state": 1.0898567854018136e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.55347366632495, "agent_compute-ego0": 0.015293988855951136, "complete-iteration": 0.19095967473038825, "set_robot_commands": 0.002158743654262215, "deviation-center-line": 2.534317503839389, "driven_lanedir_consec": 25.805354840153036, "sim_compute_sim_state": 0.006011258156273784, "sim_compute_performance-ego0": 0.001852944927549084}}
set_robot_commands_max0.002233969182594928
set_robot_commands_mean0.0021997726843390867
set_robot_commands_median0.0022031889502496017
set_robot_commands_min0.002158743654262215
sim_compute_performance-ego0_max0.0018956325731110711
sim_compute_performance-ego0_mean0.0018753417755189008
sim_compute_performance-ego0_median0.001876394800707724
sim_compute_performance-ego0_min0.001852944927549084
sim_compute_sim_state_max0.010945431193950013
sim_compute_sim_state_mean0.009275979093405346
sim_compute_sim_state_median0.010073613511698797
sim_compute_sim_state_min0.006011258156273784
sim_render-ego0_max0.0036740608704395783
sim_render-ego0_mean0.003615002707476295
sim_render-ego0_median0.0036210846269262207
sim_render-ego0_min0.003543780705613161
simulation-passed1
step_physics_max0.18218472581472456
step_physics_mean0.15833259787178727
step_physics_median0.16134482361148025
step_physics_min0.1284560184494641
survival_time_max59.99999999999873
survival_time_mean34.42499999999936
survival_time_min7.99999999999998
No reset possible
6182613336Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.901860796214027
survival_time_median59.99999999999873
deviation-center-line_median4.325323750009577
in-drivable-lane_median5.87499999999989


other stats
agent_compute-ego0_max0.012046054241361468
agent_compute-ego0_mean0.011818327425322269
agent_compute-ego0_median0.01183009872230066
agent_compute-ego0_min0.011567058015326278
complete-iteration_max0.1927584061316904
complete-iteration_mean0.17232403866357351
complete-iteration_median0.17391271366862632
complete-iteration_min0.14871232118535102
deviation-center-line_max6.157953845051643
deviation-center-line_mean4.375863368329961
deviation-center-line_min2.6948521282490483
deviation-heading_max11.461483570606214
deviation-heading_mean9.715102506798752
deviation-heading_median9.333217027439904
deviation-heading_min8.732492401708988
driven_any_max7.921055869519273
driven_any_mean7.919336644626981
driven_any_median7.920994512836668
driven_any_min7.914301683315313
driven_lanedir_consec_max7.462734824985519
driven_lanedir_consec_mean6.441991203779471
driven_lanedir_consec_min4.5015083977043115
driven_lanedir_max7.462734824985519
driven_lanedir_mean6.903161098850413
driven_lanedir_median6.901860796214027
driven_lanedir_min6.346187977988075
get_duckie_state_max1.5601428918894085e-06
get_duckie_state_mean1.5256506120235497e-06
get_duckie_state_median1.5231195238607312e-06
get_duckie_state_min1.4962205084833276e-06
get_robot_state_max0.003658577762575173
get_robot_state_mean0.0035492997185375963
get_robot_state_median0.0035317490043290747
get_robot_state_min0.003475123102917064
get_state_dump_max0.004438110434145455
get_state_dump_mean0.004378464448263405
get_state_dump_median0.004399127408328601
get_state_dump_min0.0042774925422509645
get_ui_image_max0.035919350847217264
get_ui_image_mean0.030478240697211167
get_ui_image_median0.030277410315832032
get_ui_image_min0.025438791309963356
in-drivable-lane_max9.249999999999735
in-drivable-lane_mean5.737499999999856
in-drivable-lane_min1.949999999999907
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914301683315313, "get_ui_image": 0.027976934161412528, "step_physics": 0.09628214129401089, "survival_time": 59.99999999999873, "driven_lanedir": 6.346187977988075, "get_state_dump": 0.004433176301103349, "get_robot_state": 0.003658577762575173, "sim_render-ego0": 0.0037122235310067743, "get_duckie_state": 1.5601428918894085e-06, "in-drivable-lane": 9.249999999999735, "deviation-heading": 9.450614192257976, "agent_compute-ego0": 0.0117801299797903, "complete-iteration": 0.1609790464126498, "set_robot_commands": 0.002220116288933925, "deviation-center-line": 2.6948521282490483, "driven_lanedir_consec": 4.5015083977043115, "sim_compute_sim_state": 0.008883223744058092, "sim_compute_performance-ego0": 0.0019520992641147228}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921055869519273, "get_ui_image": 0.035919350847217264, "step_physics": 0.11666707353329876, "survival_time": 59.99999999999873, "driven_lanedir": 7.181820274912999, "get_state_dump": 0.004365078515553852, "get_robot_state": 0.0034989609904928468, "sim_render-ego0": 0.0035981770657579864, "get_duckie_state": 1.5083300283211255e-06, "in-drivable-lane": 3.500000000000038, "deviation-heading": 11.461483570606214, "agent_compute-ego0": 0.012046054241361468, "complete-iteration": 0.1927584061316904, "set_robot_commands": 0.002192370996784906, "deviation-center-line": 4.180186445325387, "driven_lanedir_consec": 7.181820274912999, "sim_compute_sim_state": 0.01254944817211904, "sim_compute_performance-ego0": 0.0018445953143625632}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921045149856072, "get_ui_image": 0.03257788647025154, "step_physics": 0.11312026366107568, "survival_time": 59.99999999999873, "driven_lanedir": 7.462734824985519, "get_state_dump": 0.004438110434145455, "get_robot_state": 0.0035645370181653026, "sim_render-ego0": 0.0036839744034258153, "get_duckie_state": 1.537909019400337e-06, "in-drivable-lane": 1.949999999999907, "deviation-heading": 9.215819862621832, "agent_compute-ego0": 0.011880067464811022, "complete-iteration": 0.1868463809246028, "set_robot_commands": 0.0021491072557053895, "deviation-center-line": 4.470461054693768, "driven_lanedir_consec": 7.462734824985519, "sim_compute_sim_state": 0.013452563456552014, "sim_compute_performance-ego0": 0.001900769788756359}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920943875817263, "get_ui_image": 0.025438791309963356, "step_physics": 0.09031380979742833, "survival_time": 59.99999999999873, "driven_lanedir": 6.621901317515055, "get_state_dump": 0.0042774925422509645, "get_robot_state": 0.003475123102917064, "sim_render-ego0": 0.003548474831942416, "get_duckie_state": 1.4962205084833276e-06, "in-drivable-lane": 8.24999999999974, "deviation-heading": 8.732492401708988, "agent_compute-ego0": 0.011567058015326278, "complete-iteration": 0.14871232118535102, "set_robot_commands": 0.002183484991424586, "deviation-center-line": 6.157953845051643, "driven_lanedir_consec": 6.621901317515055, "sim_compute_sim_state": 0.005998491347580528, "sim_compute_performance-ego0": 0.0018334491961603857}}
set_robot_commands_max0.002220116288933925
set_robot_commands_mean0.0021862698832122015
set_robot_commands_median0.0021879279941047457
set_robot_commands_min0.0021491072557053895
sim_compute_performance-ego0_max0.0019520992641147228
sim_compute_performance-ego0_mean0.0018827283908485076
sim_compute_performance-ego0_median0.001872682551559461
sim_compute_performance-ego0_min0.0018334491961603857
sim_compute_sim_state_max0.013452563456552014
sim_compute_sim_state_mean0.01022093168007742
sim_compute_sim_state_median0.010716335958088566
sim_compute_sim_state_min0.005998491347580528
sim_render-ego0_max0.0037122235310067743
sim_render-ego0_mean0.003635712458033248
sim_render-ego0_median0.003641075734591901
sim_render-ego0_min0.003548474831942416
simulation-passed1
step_physics_max0.11666707353329876
step_physics_mean0.1040958220714534
step_physics_median0.10470120247754328
step_physics_min0.09031380979742833
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6182513334Jerome Labonte 🇨🇦real-exercise-3aido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:10:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.375000000000057
in-drivable-lane_median0.350000000000005
driven_lanedir_consec_median1.5361553405181887
deviation-center-line_median0.5637691032503301


other stats
agent_compute-ego0_max0.01606322481082036
agent_compute-ego0_mean0.015930520906628005
agent_compute-ego0_median0.015984167268265893
agent_compute-ego0_min0.015690524279159873
complete-iteration_max0.26671305757302505
complete-iteration_mean0.21582873334187003
complete-iteration_median0.21359682344567468
complete-iteration_min0.16940822890310575
deviation-center-line_max1.3961459900122892
deviation-center-line_mean0.7047904556414771
deviation-center-line_min0.29547762605295935
deviation-heading_max2.4469292157256786
deviation-heading_mean1.7287173940608385
deviation-heading_median1.7227262148569469
deviation-heading_min1.0224879308037822
driven_any_max2.0459605527477818
driven_any_mean1.4651171988937888
driven_any_median1.6377330138436923
driven_any_min0.5390422151399888
driven_lanedir_consec_max1.883014912784159
driven_lanedir_consec_mean1.3701062851465775
driven_lanedir_consec_min0.5250995467657741
driven_lanedir_max1.883014912784159
driven_lanedir_mean1.3701062851465775
driven_lanedir_median1.5361553405181887
driven_lanedir_min0.5250995467657741
get_duckie_state_max0.02366675222321023
get_duckie_state_mean0.01698099362090015
get_duckie_state_median0.020071625578534473
get_duckie_state_min0.004113971103321422
get_robot_state_max0.0035905838012695312
get_robot_state_mean0.0035335408672592743
get_robot_state_median0.0035261455036344983
get_robot_state_min0.0034912886604985694
get_state_dump_max0.00815052577844089
get_state_dump_mean0.007117972594129954
get_state_dump_median0.007609541730566339
get_state_dump_min0.0051022811369462445
get_ui_image_max0.03898934217599722
get_ui_image_mean0.032970494873440455
get_ui_image_median0.033321447766155275
get_ui_image_min0.026249741785454028
in-drivable-lane_max1.3000000000000185
in-drivable-lane_mean0.5000000000000071
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.026085112914014, "get_ui_image": 0.03141561269031023, "step_physics": 0.10194279221584308, "survival_time": 16.300000000000097, "driven_lanedir": 1.883014912784159, "get_state_dump": 0.00815052577844089, "get_robot_state": 0.0034912886604985694, "sim_render-ego0": 0.003560795331949123, "get_duckie_state": 0.02366675222321023, "in-drivable-lane": 0.70000000000001, "deviation-heading": 2.310485239613355, "agent_compute-ego0": 0.015690524279159873, "complete-iteration": 0.19999826136714455, "set_robot_commands": 0.0021264881169030425, "deviation-center-line": 0.6662912044076709, "driven_lanedir_consec": 1.883014912784159, "sim_compute_sim_state": 0.008063259474728086, "sim_compute_performance-ego0": 0.0018158381867481664}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5390422151399888, "get_ui_image": 0.03898934217599722, "step_physics": 0.16238281360039344, "survival_time": 5.14999999999999, "driven_lanedir": 0.5250995467657741, "get_state_dump": 0.007661957007188063, "get_robot_state": 0.0035905838012695312, "sim_render-ego0": 0.0036670198807349577, "get_duckie_state": 0.020134898332449105, "in-drivable-lane": 0.0, "deviation-heading": 1.0224879308037822, "agent_compute-ego0": 0.01606322481082036, "complete-iteration": 0.26671305757302505, "set_robot_commands": 0.002132839881456815, "deviation-center-line": 0.46124700209298936, "driven_lanedir_consec": 0.5250995467657741, "sim_compute_sim_state": 0.010128429302802453, "sim_compute_performance-ego0": 0.001883458632689256}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2493809147733708, "get_ui_image": 0.03522728284200032, "step_physics": 0.12327816145760671, "survival_time": 10.450000000000014, "driven_lanedir": 1.2399754700586292, "get_state_dump": 0.007557126453944615, "get_robot_state": 0.003507157734462193, "sim_render-ego0": 0.003643762497674851, "get_duckie_state": 0.02000835282461984, "in-drivable-lane": 0.0, "deviation-heading": 1.1349671901005387, "agent_compute-ego0": 0.01602144127800351, "complete-iteration": 0.2271953855242048, "set_robot_commands": 0.0022909084955851236, "deviation-center-line": 0.29547762605295935, "driven_lanedir_consec": 1.2399754700586292, "sim_compute_sim_state": 0.013740686007908412, "sim_compute_performance-ego0": 0.001844416345868792}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.0459605527477818, "get_ui_image": 0.026249741785454028, "step_physics": 0.10065605568163324, "survival_time": 16.4500000000001, "driven_lanedir": 1.832335210977748, "get_state_dump": 0.0051022811369462445, "get_robot_state": 0.0035451332728068034, "sim_render-ego0": 0.003696904760418516, "get_duckie_state": 0.004113971103321422, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 2.4469292157256786, "agent_compute-ego0": 0.015946893258528275, "complete-iteration": 0.16940822890310575, "set_robot_commands": 0.0021528894251043144, "deviation-center-line": 1.3961459900122892, "driven_lanedir_consec": 1.832335210977748, "sim_compute_sim_state": 0.00593531203992439, "sim_compute_performance-ego0": 0.001929621985464385}}
set_robot_commands_max0.0022909084955851236
set_robot_commands_mean0.0021757814797623235
set_robot_commands_median0.0021428646532805646
set_robot_commands_min0.0021264881169030425
sim_compute_performance-ego0_max0.001929621985464385
sim_compute_performance-ego0_mean0.0018683337876926496
sim_compute_performance-ego0_median0.001863937489279024
sim_compute_performance-ego0_min0.0018158381867481664
sim_compute_sim_state_max0.013740686007908412
sim_compute_sim_state_mean0.009466921706340836
sim_compute_sim_state_median0.009095844388765269
sim_compute_sim_state_min0.00593531203992439
sim_render-ego0_max0.003696904760418516
sim_render-ego0_mean0.003642120617694362
sim_render-ego0_median0.003655391189204904
sim_render-ego0_min0.003560795331949123
simulation-passed1
step_physics_max0.16238281360039344
step_physics_mean0.12206495573886912
step_physics_median0.1126104768367249
step_physics_min0.10065605568163324
survival_time_max16.4500000000001
survival_time_mean12.087500000000048
survival_time_min5.14999999999999
No reset possible
6182413333Jerome Labonte 🇨🇦real-exercise-3aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.565142426483632
survival_time_median59.99999999999873
deviation-center-line_median3.6683627757494106
in-drivable-lane_median8.499999999999867


other stats
agent_compute-ego0_max0.01637988795076637
agent_compute-ego0_mean0.01562075132986652
agent_compute-ego0_median0.015561628599746538
agent_compute-ego0_min0.01497986016920663
complete-iteration_max0.1932745263737306
complete-iteration_mean0.17401056192912973
complete-iteration_median0.1752256747887623
complete-iteration_min0.15231637176526375
deviation-center-line_max5.927160408939487
deviation-center-line_mean3.3603992466980075
deviation-center-line_min0.17771102635372016
deviation-heading_max10.350914448546144
deviation-heading_mean7.491575430777863
deviation-heading_median9.183784596901187
deviation-heading_min1.2478180807629349
driven_any_max7.921097976936619
driven_any_mean6.531910872469346
driven_any_median7.921001665915021
driven_any_min2.364542181110722
driven_lanedir_consec_max7.514860006591295
driven_lanedir_consec_mean5.181225033593929
driven_lanedir_consec_min0.07975527481715394
driven_lanedir_max7.514860006591295
driven_lanedir_mean5.183183239817193
driven_lanedir_median6.565142426483632
driven_lanedir_min0.0875880997102132
get_duckie_state_max1.0795339160318874e-06
get_duckie_state_mean1.0627626579460513e-06
get_duckie_state_median1.0752658065808604e-06
get_duckie_state_min1.020985102590596e-06
get_robot_state_max0.0035156197157887484
get_robot_state_mean0.0034855863226904435
get_robot_state_median0.0034815289396528996
get_robot_state_min0.0034636676956672253
get_state_dump_max0.004286531405484646
get_state_dump_mean0.004230802319586663
get_state_dump_median0.004218148582402195
get_state_dump_min0.004200380708057616
get_ui_image_max0.03520172462177515
get_ui_image_mean0.030146475101503624
get_ui_image_median0.029873022749687457
get_ui_image_min0.02563813028486444
in-drivable-lane_max17.350000000000133
in-drivable-lane_mean8.924999999999969
in-drivable-lane_min1.350000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.364542181110722, "get_ui_image": 0.02812153557045164, "step_physics": 0.10214070908941504, "survival_time": 18.900000000000137, "driven_lanedir": 0.0875880997102132, "get_state_dump": 0.004209564354929257, "get_robot_state": 0.0035156197157887484, "sim_render-ego0": 0.0036566383291360255, "get_duckie_state": 1.020985102590596e-06, "in-drivable-lane": 17.350000000000133, "deviation-heading": 1.2478180807629349, "agent_compute-ego0": 0.01637988795076637, "complete-iteration": 0.17046197989370704, "set_robot_commands": 0.00208631039923917, "deviation-center-line": 0.17771102635372016, "driven_lanedir_consec": 0.07975527481715394, "sim_compute_sim_state": 0.008411817626147912, "sim_compute_performance-ego0": 0.0018695149383947528}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921036083078817, "get_ui_image": 0.03520172462177515, "step_physics": 0.11521427418965284, "survival_time": 59.99999999999873, "driven_lanedir": 6.376027493116609, "get_state_dump": 0.004226732809875133, "get_robot_state": 0.0034712063680580516, "sim_render-ego0": 0.0035774435826284898, "get_duckie_state": 1.071791764004443e-06, "in-drivable-lane": 9.89999999999976, "deviation-heading": 9.491488115881364, "agent_compute-ego0": 0.015393123539361628, "complete-iteration": 0.1932745263737306, "set_robot_commands": 0.0020411151533420635, "deviation-center-line": 3.2618586461083576, "driven_lanedir_consec": 6.376027493116609, "sim_compute_sim_state": 0.012235626193704852, "sim_compute_performance-ego0": 0.001841905412824823}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921097976936619, "get_ui_image": 0.03162450992892327, "step_physics": 0.10446973783983776, "survival_time": 59.99999999999873, "driven_lanedir": 7.514860006591295, "get_state_dump": 0.004200380708057616, "get_robot_state": 0.0034636676956672253, "sim_render-ego0": 0.0035591798459957483, "get_duckie_state": 1.078739849157278e-06, "in-drivable-lane": 1.350000000000006, "deviation-heading": 10.350914448546144, "agent_compute-ego0": 0.01573013366013145, "complete-iteration": 0.17998936968381757, "set_robot_commands": 0.0020297266462264113, "deviation-center-line": 4.074866905390464, "driven_lanedir_consec": 7.514860006591295, "sim_compute_sim_state": 0.013001644045585996, "sim_compute_performance-ego0": 0.001838205458222579}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920967248751227, "get_ui_image": 0.02563813028486444, "step_physics": 0.0903425613708242, "survival_time": 59.99999999999873, "driven_lanedir": 6.754257359850655, "get_state_dump": 0.004286531405484646, "get_robot_state": 0.0034918515112477475, "sim_render-ego0": 0.003565121054351578, "get_duckie_state": 1.0795339160318874e-06, "in-drivable-lane": 7.099999999999973, "deviation-heading": 8.876081077921011, "agent_compute-ego0": 0.01497986016920663, "complete-iteration": 0.15231637176526375, "set_robot_commands": 0.002076306807607735, "deviation-center-line": 5.927160408939487, "driven_lanedir_consec": 6.754257359850655, "sim_compute_sim_state": 0.006002017203020514, "sim_compute_performance-ego0": 0.0018614041219643016}}
set_robot_commands_max0.00208631039923917
set_robot_commands_mean0.002058364751603845
set_robot_commands_median0.0020587109804748992
set_robot_commands_min0.0020297266462264113
sim_compute_performance-ego0_max0.0018695149383947528
sim_compute_performance-ego0_mean0.0018527574828516144
sim_compute_performance-ego0_median0.0018516547673945625
sim_compute_performance-ego0_min0.001838205458222579
sim_compute_sim_state_max0.013001644045585996
sim_compute_sim_state_mean0.009912776267114818
sim_compute_sim_state_median0.010323721909926382
sim_compute_sim_state_min0.006002017203020514
sim_render-ego0_max0.0036566383291360255
sim_render-ego0_mean0.0035895957030279606
sim_render-ego0_median0.003571282318490034
sim_render-ego0_min0.0035591798459957483
simulation-passed1
step_physics_max0.11521427418965284
step_physics_mean0.10304182062243246
step_physics_median0.1033052234646264
step_physics_min0.0903425613708242
survival_time_max59.99999999999873
survival_time_mean49.72499999999908
survival_time_min18.900000000000137
No reset possible
6182313332Raphael Jeanmobile-segmentationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.97219425033605
survival_time_median50.09999999999929
deviation-center-line_median2.736919515397043
in-drivable-lane_median1.175000000000011


other stats
agent_compute-ego0_max0.01617350943578868
agent_compute-ego0_mean0.01595898767929
agent_compute-ego0_median0.016051937827939247
agent_compute-ego0_min0.015558565625492833
complete-iteration_max0.2582759468084966
complete-iteration_mean0.22108592846258407
complete-iteration_median0.2216590428559967
complete-iteration_min0.1827496813298463
deviation-center-line_max3.605732320962248
deviation-center-line_mean2.440900977014217
deviation-center-line_min0.6840325563005341
deviation-heading_max13.52473717928836
deviation-heading_mean8.622430665822428
deviation-heading_median9.69194110478653
deviation-heading_min1.5811032744282851
driven_any_max24.470228008602607
driven_any_mean17.17562057919509
driven_any_median20.2024152376348
driven_any_min3.827423832908158
driven_lanedir_consec_max23.45508390800766
driven_lanedir_consec_mean16.186669190228265
driven_lanedir_consec_min3.347204352233306
driven_lanedir_max23.45508390800766
driven_lanedir_mean16.186669190228265
driven_lanedir_median18.97219425033605
driven_lanedir_min3.347204352233306
get_duckie_state_max1.182961126449801e-06
get_duckie_state_mean1.157018480354198e-06
get_duckie_state_median1.1507960658616738e-06
get_duckie_state_min1.1435206632436431e-06
get_robot_state_max0.003543593424447575
get_robot_state_mean0.003495047039464231
get_robot_state_median0.0034851022897312623
get_robot_state_min0.003466390153946825
get_state_dump_max0.00438257448421502
get_state_dump_mean0.004320638080567355
get_state_dump_median0.00431504156308821
get_state_dump_min0.00426989471187798
get_ui_image_max0.03542309954799681
get_ui_image_mean0.030314200429918225
get_ui_image_median0.03014254977606984
get_ui_image_min0.025548602619536412
in-drivable-lane_max2.64999999999985
in-drivable-lane_mean1.3999999999999613
in-drivable-lane_min0.5999999999999739
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.051020074536055, "get_ui_image": 0.028115660507486474, "step_physics": 0.14596682957240514, "survival_time": 40.199999999999854, "driven_lanedir": 14.874495519804908, "get_state_dump": 0.00438257448421502, "get_robot_state": 0.003543593424447575, "sim_render-ego0": 0.003623956775072939, "get_duckie_state": 1.1435206632436431e-06, "in-drivable-lane": 2.64999999999985, "deviation-heading": 7.451860449683363, "agent_compute-ego0": 0.015558565625492833, "complete-iteration": 0.21457336733800284, "set_robot_commands": 0.002140584791669194, "deviation-center-line": 1.951256334493944, "driven_lanedir_consec": 14.874495519804908, "sim_compute_sim_state": 0.009272363615332183, "sim_compute_performance-ego0": 0.001895352476131842}, "LF-norm-zigzag-000-ego0": {"driven_any": 24.470228008602607, "get_ui_image": 0.03542309954799681, "step_physics": 0.1778780641801947, "survival_time": 59.99999999999873, "driven_lanedir": 23.45508390800766, "get_state_dump": 0.00426989471187798, "get_robot_state": 0.003466390153946825, "sim_render-ego0": 0.0035778229480778346, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 0.5999999999999739, "deviation-heading": 11.932021759889697, "agent_compute-ego0": 0.01617350943578868, "complete-iteration": 0.2582759468084966, "set_robot_commands": 0.0021090217672914986, "deviation-center-line": 3.5225826963001423, "driven_lanedir_consec": 23.45508390800766, "sim_compute_sim_state": 0.0134541565532192, "sim_compute_performance-ego0": 0.001850286391652891}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.827423832908158, "get_ui_image": 0.0321694390446532, "step_physics": 0.1545201808798547, "survival_time": 10.15000000000001, "driven_lanedir": 3.347204352233306, "get_state_dump": 0.004348020927578795, "get_robot_state": 0.0034751529787101, "sim_render-ego0": 0.003548156981374703, "get_duckie_state": 1.1511877471325444e-06, "in-drivable-lane": 1.6000000000000227, "deviation-heading": 1.5811032744282851, "agent_compute-ego0": 0.016095417387345257, "complete-iteration": 0.22874471837399052, "set_robot_commands": 0.0020553247601378197, "deviation-center-line": 0.6840325563005341, "driven_lanedir_consec": 3.347204352233306, "sim_compute_sim_state": 0.01064229362151202, "sim_compute_performance-ego0": 0.0018187539250242944}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.353810400733543, "get_ui_image": 0.025548602619536412, "step_physics": 0.11989774533255114, "survival_time": 59.99999999999873, "driven_lanedir": 23.069892980867188, "get_state_dump": 0.004282062198597624, "get_robot_state": 0.0034950516007524247, "sim_render-ego0": 0.0035452757350213325, "get_duckie_state": 1.182961126449801e-06, "in-drivable-lane": 0.7499999999999991, "deviation-heading": 13.52473717928836, "agent_compute-ego0": 0.01600845826853324, "complete-iteration": 0.1827496813298463, "set_robot_commands": 0.002090753861807665, "deviation-center-line": 3.605732320962248, "driven_lanedir_consec": 23.069892980867188, "sim_compute_sim_state": 0.0059589468172249645, "sim_compute_performance-ego0": 0.001850432102924382}}
set_robot_commands_max0.002140584791669194
set_robot_commands_mean0.0020989212952265443
set_robot_commands_median0.002099887814549582
set_robot_commands_min0.0020553247601378197
sim_compute_performance-ego0_max0.001895352476131842
sim_compute_performance-ego0_mean0.001853706223933352
sim_compute_performance-ego0_median0.0018503592472886364
sim_compute_performance-ego0_min0.0018187539250242944
sim_compute_sim_state_max0.0134541565532192
sim_compute_sim_state_mean0.009831940151822092
sim_compute_sim_state_median0.0099573286184221
sim_compute_sim_state_min0.0059589468172249645
sim_render-ego0_max0.003623956775072939
sim_render-ego0_mean0.003573803109886702
sim_render-ego0_median0.003562989964726269
sim_render-ego0_min0.0035452757350213325
simulation-passed1
step_physics_max0.1778780641801947
step_physics_mean0.14956570499125144
step_physics_median0.15024350522612992
step_physics_min0.11989774533255114
survival_time_max59.99999999999873
survival_time_mean42.58749999999933
survival_time_min10.15000000000001
No reset possible
6182113330Dishank Bansal 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simerroryesgpu-prod-010:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6181913329Dishank Bansal 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simerroryesgpu-prod-010:11:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6181613327Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:17:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9200371744171756
survival_time_median21.600000000000172
deviation-center-line_median0.45484246736204376
in-drivable-lane_median12.27500000000011


other stats
agent_compute-ego0_max0.012125026155433446
agent_compute-ego0_mean0.011867415245681611
agent_compute-ego0_median0.011803161646450847
agent_compute-ego0_min0.011738311534391302
complete-iteration_max0.24261410449932871
complete-iteration_mean0.19895182945443687
complete-iteration_median0.19352267567765127
complete-iteration_min0.16614786196311623
deviation-center-line_max0.8459344097597241
deviation-center-line_mean0.5124365254096638
deviation-center-line_min0.2941267571548435
deviation-heading_max5.833717667273057
deviation-heading_mean3.184722031262785
deviation-heading_median2.867408189077323
deviation-heading_min1.170354079623439
driven_any_max9.48266831297538
driven_any_mean4.966232434940886
driven_any_median3.878963779393762
driven_any_min2.624333868000638
driven_lanedir_consec_max1.7138645290480428
driven_lanedir_consec_mean1.0900867586644214
driven_lanedir_consec_min0.8064081567752917
driven_lanedir_max1.904994617173139
driven_lanedir_mean1.1612188822263354
driven_lanedir_median0.9667363774784554
driven_lanedir_min0.8064081567752917
get_duckie_state_max1.8103917439778649e-06
get_duckie_state_mean1.6469571854683602e-06
get_duckie_state_median1.670679665388997e-06
get_duckie_state_min1.4360776671175829e-06
get_robot_state_max0.003576248043383177
get_robot_state_mean0.0035559819013932315
get_robot_state_median0.0035511091662063458
get_robot_state_min0.003545461229777058
get_state_dump_max0.004461649443288582
get_state_dump_mean0.004366266337806688
get_state_dump_median0.004398474106332428
get_state_dump_min0.004206467695273314
get_ui_image_max0.03581836367438001
get_ui_image_mean0.03038451298088598
get_ui_image_median0.03009841718098533
get_ui_image_min0.025522853887193254
in-drivable-lane_max46.49999999999923
in-drivable-lane_mean19.79999999999988
in-drivable-lane_min8.15000000000007
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.48266831297538, "get_ui_image": 0.027722340381562943, "step_physics": 0.10300389338096291, "survival_time": 51.34999999999922, "driven_lanedir": 0.8064081567752917, "get_state_dump": 0.004206467695273314, "get_robot_state": 0.003545461229777058, "sim_render-ego0": 0.0036002163293296723, "get_duckie_state": 1.4360776671175829e-06, "in-drivable-lane": 46.49999999999923, "deviation-heading": 1.170354079623439, "agent_compute-ego0": 0.011765940875858649, "complete-iteration": 0.16614786196311623, "set_robot_commands": 0.0020794938046644635, "deviation-center-line": 0.2941267571548435, "driven_lanedir_consec": 0.8064081567752917, "sim_compute_sim_state": 0.008301927421807315, "sim_compute_performance-ego0": 0.0018469814196634849}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.954321862123588, "get_ui_image": 0.03581836367438001, "step_physics": 0.16551018502202286, "survival_time": 27.300000000000253, "driven_lanedir": 1.904994617173139, "get_state_dump": 0.004354526617409324, "get_robot_state": 0.003549974622848483, "sim_render-ego0": 0.003615056792822355, "get_duckie_state": 1.6253434761786592e-06, "in-drivable-lane": 14.900000000000135, "deviation-heading": 5.833717667273057, "agent_compute-ego0": 0.012125026155433446, "complete-iteration": 0.24261410449932871, "set_robot_commands": 0.002387528881512351, "deviation-center-line": 0.8459344097597241, "driven_lanedir_consec": 1.7138645290480428, "sim_compute_sim_state": 0.013311438412291475, "sim_compute_performance-ego0": 0.0018630733873552115}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.624333868000638, "get_ui_image": 0.03247449398040771, "step_physics": 0.15054322878519694, "survival_time": 14.950000000000076, "driven_lanedir": 1.0265762740837094, "get_state_dump": 0.0044424215952555334, "get_robot_state": 0.003552243709564209, "sim_render-ego0": 0.003691169420878093, "get_duckie_state": 1.8103917439778649e-06, "in-drivable-lane": 8.15000000000007, "deviation-heading": 2.9787107477498753, "agent_compute-ego0": 0.01184038241704305, "complete-iteration": 0.21924310048421225, "set_robot_commands": 0.002148969173431397, "deviation-center-line": 0.5228517510197417, "driven_lanedir_consec": 1.0031561504830535, "sim_compute_sim_state": 0.008576690355936686, "sim_compute_performance-ego0": 0.0018915383021036783}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.8036056966639364, "get_ui_image": 0.025522853887193254, "step_physics": 0.10831471371426478, "survival_time": 15.900000000000093, "driven_lanedir": 0.9068964808732014, "get_state_dump": 0.004461649443288582, "get_robot_state": 0.003576248043383177, "sim_render-ego0": 0.003692248771930563, "get_duckie_state": 1.716015854599334e-06, "in-drivable-lane": 9.650000000000084, "deviation-heading": 2.7561056304047704, "agent_compute-ego0": 0.011738311534391302, "complete-iteration": 0.1678022508710903, "set_robot_commands": 0.0021670073924767185, "deviation-center-line": 0.38683318370434583, "driven_lanedir_consec": 0.8369181983512977, "sim_compute_sim_state": 0.006332383260457867, "sim_compute_performance-ego0": 0.001915392083434102}}
set_robot_commands_max0.002387528881512351
set_robot_commands_mean0.002195749813021232
set_robot_commands_median0.0021579882829540573
set_robot_commands_min0.0020794938046644635
sim_compute_performance-ego0_max0.001915392083434102
sim_compute_performance-ego0_mean0.0018792462981391193
sim_compute_performance-ego0_median0.001877305844729445
sim_compute_performance-ego0_min0.0018469814196634849
sim_compute_sim_state_max0.013311438412291475
sim_compute_sim_state_mean0.009130609862623335
sim_compute_sim_state_median0.008439308888872
sim_compute_sim_state_min0.006332383260457867
sim_render-ego0_max0.003692248771930563
sim_render-ego0_mean0.0036496728287401703
sim_render-ego0_median0.003653113106850223
sim_render-ego0_min0.0036002163293296723
simulation-passed1
step_physics_max0.16551018502202286
step_physics_mean0.13184300522561188
step_physics_median0.12942897124973085
step_physics_min0.10300389338096291
survival_time_max51.34999999999922
survival_time_mean27.37499999999991
survival_time_min14.950000000000076
No reset possible
6181513326Dishank Bansal 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simerroryesgpu-prod-010:13:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6181413325Fernanda Custodio Pereira do Carmo 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.352270696736456
survival_time_median31.424999999999972
deviation-center-line_median1.0792084433144502
in-drivable-lane_median5.549999999999951


other stats
agent_compute-ego0_max0.013311843718251877
agent_compute-ego0_mean0.012418726584235429
agent_compute-ego0_median0.012252990707018524
agent_compute-ego0_min0.011857081204652786
complete-iteration_max0.23332056307023571
complete-iteration_mean0.1889771107043021
complete-iteration_median0.1822489039172806
complete-iteration_min0.15809007191241134
deviation-center-line_max1.86955912704002
deviation-center-line_mean1.034250834032487
deviation-center-line_min0.10902732246102698
deviation-heading_max9.394349666986576
deviation-heading_mean5.064590496108437
deviation-heading_median5.013372086606009
deviation-heading_min0.8372681442351548
driven_any_max11.255993572801264
driven_any_mean5.772860955879526
driven_any_median5.7281082748186645
driven_any_min0.3792337010795138
driven_lanedir_consec_max7.0387787159770685
driven_lanedir_consec_mean2.9891423580989076
driven_lanedir_consec_min0.2132493229456496
driven_lanedir_max7.0387787159770685
driven_lanedir_mean3.0269391218269797
driven_lanedir_median2.4278642241926
driven_lanedir_min0.2132493229456496
get_duckie_state_max1.4774134901703382e-06
get_duckie_state_mean1.4426967565201425e-06
get_duckie_state_median1.4543558940255784e-06
get_duckie_state_min1.3846617478590745e-06
get_robot_state_max0.003497519458715732
get_robot_state_mean0.0034478228860292067
get_robot_state_median0.0034345356105480564
get_robot_state_min0.0034247008643049823
get_state_dump_max0.004231352645617265
get_state_dump_mean0.004200169010615547
get_state_dump_median0.004201331567825522
get_state_dump_min0.004166660261193878
get_ui_image_max0.03562842645952778
get_ui_image_mean0.030174608662126064
get_ui_image_median0.02997201142443062
get_ui_image_min0.02512598534011523
in-drivable-lane_max42.449999999998994
in-drivable-lane_mean13.737499999999724
in-drivable-lane_min1.3999999999999964
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.633795875136187, "get_ui_image": 0.027799697449574105, "step_physics": 0.09683427759088002, "survival_time": 41.54999999999978, "driven_lanedir": 7.0387787159770685, "get_state_dump": 0.004231352645617265, "get_robot_state": 0.003497519458715732, "sim_render-ego0": 0.0035436167739904844, "get_duckie_state": 1.3846617478590745e-06, "in-drivable-lane": 3.149999999999821, "deviation-heading": 5.773901047211791, "agent_compute-ego0": 0.011857081204652786, "complete-iteration": 0.1614678972042524, "set_robot_commands": 0.0020607953461316917, "deviation-center-line": 1.86955912704002, "driven_lanedir_consec": 7.0387787159770685, "sim_compute_sim_state": 0.00972511046207868, "sim_compute_performance-ego0": 0.001841200372347465}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3792337010795138, "get_ui_image": 0.03562842645952778, "step_physics": 0.15970776542540518, "survival_time": 3.049999999999997, "driven_lanedir": 0.2132493229456496, "get_state_dump": 0.00422511177678262, "get_robot_state": 0.003433750521752142, "sim_render-ego0": 0.003596136646886026, "get_duckie_state": 1.453584240328881e-06, "in-drivable-lane": 1.3999999999999964, "deviation-heading": 0.8372681442351548, "agent_compute-ego0": 0.013311843718251877, "complete-iteration": 0.23332056307023571, "set_robot_commands": 0.00205058051693824, "deviation-center-line": 0.10902732246102698, "driven_lanedir_consec": 0.2132493229456496, "sim_compute_sim_state": 0.00945703060396256, "sim_compute_performance-ego0": 0.0018308354962256648}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.8224206745011418, "get_ui_image": 0.03214432539928713, "step_physics": 0.13473479474177125, "survival_time": 21.300000000000168, "driven_lanedir": 2.238017072595534, "get_state_dump": 0.004177551358868423, "get_robot_state": 0.0034247008643049823, "sim_render-ego0": 0.0035488119728392126, "get_duckie_state": 1.4774134901703382e-06, "in-drivable-lane": 7.95000000000008, "deviation-heading": 4.252843126000227, "agent_compute-ego0": 0.012042583291368683, "complete-iteration": 0.2030299106303088, "set_robot_commands": 0.0020352660632524332, "deviation-center-line": 0.7642079953784663, "driven_lanedir_consec": 2.092496621247305, "sim_compute_sim_state": 0.009023838355892997, "sim_compute_performance-ego0": 0.0018196407469988427}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.255993572801264, "get_ui_image": 0.02512598534011523, "step_physics": 0.098562088139746, "survival_time": 59.99999999999873, "driven_lanedir": 2.6177113757896664, "get_state_dump": 0.004166660261193878, "get_robot_state": 0.003435320699343971, "sim_render-ego0": 0.0035468726035061725, "get_duckie_state": 1.4551275477222755e-06, "in-drivable-lane": 42.449999999998994, "deviation-heading": 9.394349666986576, "agent_compute-ego0": 0.012463398122668366, "complete-iteration": 0.15809007191241134, "set_robot_commands": 0.0020338573821081308, "deviation-center-line": 1.3942088912504342, "driven_lanedir_consec": 2.6120447722256075, "sim_compute_sim_state": 0.006845751372503301, "sim_compute_performance-ego0": 0.0018311078899805988}}
set_robot_commands_max0.0020607953461316917
set_robot_commands_mean0.0020451248271076243
set_robot_commands_median0.002042923290095337
set_robot_commands_min0.0020338573821081308
sim_compute_performance-ego0_max0.001841200372347465
sim_compute_performance-ego0_mean0.001830696126388143
sim_compute_performance-ego0_median0.001830971693103132
sim_compute_performance-ego0_min0.0018196407469988427
sim_compute_sim_state_max0.00972511046207868
sim_compute_sim_state_mean0.008762932698609385
sim_compute_sim_state_median0.009240434479927777
sim_compute_sim_state_min0.006845751372503301
sim_render-ego0_max0.003596136646886026
sim_render-ego0_mean0.0035588594993054734
sim_render-ego0_median0.003547842288172693
sim_render-ego0_min0.0035436167739904844
simulation-passed1
step_physics_max0.15970776542540518
step_physics_mean0.12245973147445063
step_physics_median0.11664844144075864
step_physics_min0.09683427759088002
survival_time_max59.99999999999873
survival_time_mean31.474999999999667
survival_time_min3.049999999999997
No reset possible
6181313324Jerome Labonte 🇨🇦real-exercise-3aido5-LFP-sim-validationLFP-simsuccessyesgpu-prod-010:08:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.77500000000006
in-drivable-lane_median0.70000000000001
driven_lanedir_consec_median1.5954415426104236
deviation-center-line_median0.639473545485512


other stats
agent_compute-ego0_max0.01648848747538629
agent_compute-ego0_mean0.01597632432212519
agent_compute-ego0_median0.016000209061271184
agent_compute-ego0_min0.015416391690572104
complete-iteration_max0.2554670026369184
complete-iteration_mean0.21438844104763724
complete-iteration_median0.2189088625742019
complete-iteration_min0.16426903640522678
deviation-center-line_max0.9654100404869836
deviation-center-line_mean0.6363537190444168
deviation-center-line_min0.3010577447196596
deviation-heading_max2.6438131359482173
deviation-heading_mean1.9608084067156868
deviation-heading_median1.7937875414791211
deviation-heading_min1.611845407956287
driven_any_max2.1123605394787712
driven_any_mean1.513254363021046
driven_any_median1.6908460979998796
driven_any_min0.5589647166056535
driven_lanedir_consec_max2.018821493147864
driven_lanedir_consec_mean1.3687086439502376
driven_lanedir_consec_min0.2651299974322394
driven_lanedir_max2.018821493147864
driven_lanedir_mean1.3687086439502376
driven_lanedir_median1.5954415426104236
driven_lanedir_min0.2651299974322394
get_duckie_state_max0.02393562938227798
get_duckie_state_mean0.017224352536570377
get_duckie_state_median0.020452594458319946
get_duckie_state_min0.00405659184736364
get_robot_state_max0.0035896278987421052
get_robot_state_mean0.003542224287737614
get_robot_state_median0.00354091201505256
get_robot_state_min0.0034974452221032343
get_state_dump_max0.008190389835473263
get_state_dump_mean0.007195320685603088
get_state_dump_median0.00776955202196266
get_state_dump_min0.005051788863013772
get_ui_image_max0.038173107343299366
get_ui_image_mean0.03267910794218312
get_ui_image_median0.03321856582014113
get_ui_image_min0.026106192785150865
in-drivable-lane_max1.849999999999995
in-drivable-lane_mean0.8125000000000038
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.046013473200803, "get_ui_image": 0.03138069456273859, "step_physics": 0.1052713784304532, "survival_time": 16.4500000000001, "driven_lanedir": 2.018821493147864, "get_state_dump": 0.008190389835473263, "get_robot_state": 0.0034974452221032343, "sim_render-ego0": 0.0035664645108309657, "get_duckie_state": 0.02393562938227798, "in-drivable-lane": 0.0, "deviation-heading": 1.7608618899858888, "agent_compute-ego0": 0.015416391690572104, "complete-iteration": 0.203342554063508, "set_robot_commands": 0.0021038004846283885, "deviation-center-line": 0.6018225891776213, "driven_lanedir_consec": 2.018821493147864, "sim_compute_sim_state": 0.008059874447909269, "sim_compute_performance-ego0": 0.0018357797102494672}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5589647166056535, "get_ui_image": 0.038173107343299366, "step_physics": 0.1512904055764742, "survival_time": 5.299999999999989, "driven_lanedir": 0.2651299974322394, "get_state_dump": 0.007715091527065384, "get_robot_state": 0.0035896278987421052, "sim_render-ego0": 0.003639744820995866, "get_duckie_state": 0.02027680717896078, "in-drivable-lane": 1.849999999999995, "deviation-heading": 1.826713192972354, "agent_compute-ego0": 0.01648848747538629, "complete-iteration": 0.2554670026369184, "set_robot_commands": 0.0021804961088661835, "deviation-center-line": 0.3010577447196596, "driven_lanedir_consec": 0.2651299974322394, "sim_compute_sim_state": 0.01015355208209742, "sim_compute_performance-ego0": 0.001873054237009209}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.3356787227989564, "get_ui_image": 0.03505643707754366, "step_physics": 0.12911566169807195, "survival_time": 11.100000000000025, "driven_lanedir": 1.3153773915310447, "get_state_dump": 0.007824012516859935, "get_robot_state": 0.003576767284239354, "sim_render-ego0": 0.0038221310072415614, "get_duckie_state": 0.02062838173767911, "in-drivable-lane": 0.0, "deviation-heading": 1.611845407956287, "agent_compute-ego0": 0.016088281511725866, "complete-iteration": 0.2344751710848958, "set_robot_commands": 0.002249168173614639, "deviation-center-line": 0.6771245017934028, "driven_lanedir_consec": 1.3153773915310447, "sim_compute_sim_state": 0.014020951874052995, "sim_compute_performance-ego0": 0.0020062602688913386}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.1123605394787712, "get_ui_image": 0.026106192785150865, "step_physics": 0.0960300508667441, "survival_time": 16.950000000000106, "driven_lanedir": 1.8755056936898025, "get_state_dump": 0.005051788863013772, "get_robot_state": 0.0035050567458657657, "sim_render-ego0": 0.0035590550478766946, "get_duckie_state": 0.00405659184736364, "in-drivable-lane": 1.40000000000002, "deviation-heading": 2.6438131359482173, "agent_compute-ego0": 0.015912136610816505, "complete-iteration": 0.16426903640522678, "set_robot_commands": 0.002253896348616656, "deviation-center-line": 0.9654100404869836, "driven_lanedir_consec": 1.8755056936898025, "sim_compute_sim_state": 0.005875602890463436, "sim_compute_performance-ego0": 0.0018381883116329416}}
set_robot_commands_max0.002253896348616656
set_robot_commands_mean0.0021968402789314667
set_robot_commands_median0.002214832141240411
set_robot_commands_min0.0021038004846283885
sim_compute_performance-ego0_max0.0020062602688913386
sim_compute_performance-ego0_mean0.0018883206319457392
sim_compute_performance-ego0_median0.0018556212743210752
sim_compute_performance-ego0_min0.0018357797102494672
sim_compute_sim_state_max0.014020951874052995
sim_compute_sim_state_mean0.00952749532363078
sim_compute_sim_state_median0.009106713265003345
sim_compute_sim_state_min0.005875602890463436
sim_render-ego0_max0.0038221310072415614
sim_render-ego0_mean0.003646848846736272
sim_render-ego0_median0.003603104665913416
sim_render-ego0_min0.0035590550478766946
simulation-passed1
step_physics_max0.1512904055764742
step_physics_mean0.12042687414293587
step_physics_median0.1171935200642626
step_physics_min0.0960300508667441
survival_time_max16.950000000000106
survival_time_mean12.450000000000054
survival_time_min5.299999999999989
No reset possible
6181213323Jerome Labonte 🇨🇦real-exercise-3aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.64528021047294
survival_time_median59.99999999999873
deviation-center-line_median4.115196168525146
in-drivable-lane_median6.899999999999767


other stats
agent_compute-ego0_max0.01638311033542706
agent_compute-ego0_mean0.01579124708159778
agent_compute-ego0_median0.01569488860486846
agent_compute-ego0_min0.01539210078122713
complete-iteration_max0.20004610634167724
complete-iteration_mean0.17331667928076305
complete-iteration_median0.16967927704842065
complete-iteration_min0.15386205668453373
deviation-center-line_max5.017299361748488
deviation-center-line_mean4.170962240486661
deviation-center-line_min3.436157263147865
deviation-heading_max11.579922391028576
deviation-heading_mean9.37945693529428
deviation-heading_median9.876028233896516
deviation-heading_min6.185848882355508
driven_any_max7.921111915777655
driven_any_mean7.919346567269306
driven_any_median7.920912984434405
driven_any_min7.91444838443076
driven_lanedir_consec_max7.098564515865305
driven_lanedir_consec_mean6.090986871346279
driven_lanedir_consec_min3.9748225485739312
driven_lanedir_max7.098564515865305
driven_lanedir_mean6.740991854571659
driven_lanedir_median6.667721234969038
driven_lanedir_min6.529960432483255
get_duckie_state_max1.614933506237478e-06
get_duckie_state_mean1.58892781609401e-06
get_duckie_state_median1.5972655182774122e-06
get_duckie_state_min1.5462467215837388e-06
get_robot_state_max0.003549692334977911
get_robot_state_mean0.003512400870120694
get_robot_state_median0.0035100549980563783
get_robot_state_min0.0034798011493921083
get_state_dump_max0.00427276149181204
get_state_dump_mean0.0042540019596744635
get_state_dump_median0.004259143145654124
get_state_dump_min0.004224960055577567
get_ui_image_max0.03593647192161744
get_ui_image_mean0.030362157053395573
get_ui_image_median0.029963498806377737
get_ui_image_min0.025585158679209383
in-drivable-lane_max9.349999999999714
in-drivable-lane_mean6.9999999999997495
in-drivable-lane_min4.849999999999749
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.91444838443076, "get_ui_image": 0.027728868463851333, "step_physics": 0.09038329481780775, "survival_time": 59.99999999999873, "driven_lanedir": 6.529960432483255, "get_state_dump": 0.004224960055577567, "get_robot_state": 0.003549692334977911, "sim_render-ego0": 0.0035828315248894356, "get_duckie_state": 1.5462467215837388e-06, "in-drivable-lane": 9.349999999999714, "deviation-heading": 6.185848882355508, "agent_compute-ego0": 0.01541027935418757, "complete-iteration": 0.15808495792322214, "set_robot_commands": 0.0021082157894137697, "deviation-center-line": 4.2865174916747, "driven_lanedir_consec": 3.9748225485739312, "sim_compute_sim_state": 0.0091625095704116, "sim_compute_performance-ego0": 0.001864332640597862}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.9209732640574355, "get_ui_image": 0.03593647192161744, "step_physics": 0.11986060225894112, "survival_time": 59.99999999999873, "driven_lanedir": 6.699197336548373, "get_state_dump": 0.00427276149181204, "get_robot_state": 0.0034798011493921083, "sim_render-ego0": 0.003625352019374317, "get_duckie_state": 1.6103676217084722e-06, "in-drivable-lane": 6.9499999999997275, "deviation-heading": 11.235318475447585, "agent_compute-ego0": 0.01638311033542706, "complete-iteration": 0.20004610634167724, "set_robot_commands": 0.002108011118676839, "deviation-center-line": 3.943874845375592, "driven_lanedir_consec": 6.699197336548373, "sim_compute_sim_state": 0.012438473951608115, "sim_compute_performance-ego0": 0.0018676500534832627}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921111915777655, "get_ui_image": 0.03219812914890413, "step_physics": 0.10502807861760095, "survival_time": 59.99999999999873, "driven_lanedir": 7.098564515865305, "get_state_dump": 0.00426697949386457, "get_robot_state": 0.003527902742905184, "sim_render-ego0": 0.003595238224255056, "get_duckie_state": 1.584163414846352e-06, "in-drivable-lane": 4.849999999999749, "deviation-heading": 8.516737992345448, "agent_compute-ego0": 0.01539210078122713, "complete-iteration": 0.18127359617361916, "set_robot_commands": 0.002099921363875034, "deviation-center-line": 3.436157263147865, "driven_lanedir_consec": 7.098564515865305, "sim_compute_sim_state": 0.013229139440760426, "sim_compute_performance-ego0": 0.001865172167801043}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920852704811376, "get_ui_image": 0.025585158679209383, "step_physics": 0.09094994332172988, "survival_time": 59.99999999999873, "driven_lanedir": 6.636245133389704, "get_state_dump": 0.004251306797443679, "get_robot_state": 0.0034922072532075727, "sim_render-ego0": 0.003573198898150264, "get_duckie_state": 1.614933506237478e-06, "in-drivable-lane": 6.849999999999806, "deviation-heading": 11.579922391028576, "agent_compute-ego0": 0.015979497855549352, "complete-iteration": 0.15386205668453373, "set_robot_commands": 0.0020785704937505284, "deviation-center-line": 5.017299361748488, "driven_lanedir_consec": 6.591363084397506, "sim_compute_sim_state": 0.006016984371023313, "sim_compute_performance-ego0": 0.0018631026310090915}}
set_robot_commands_max0.0021082157894137697
set_robot_commands_mean0.002098679691429043
set_robot_commands_median0.0021039662412759364
set_robot_commands_min0.0020785704937505284
sim_compute_performance-ego0_max0.0018676500534832627
sim_compute_performance-ego0_mean0.001865064373222815
sim_compute_performance-ego0_median0.0018647524041994525
sim_compute_performance-ego0_min0.0018631026310090915
sim_compute_sim_state_max0.013229139440760426
sim_compute_sim_state_mean0.010211776833450864
sim_compute_sim_state_median0.010800491761009858
sim_compute_sim_state_min0.006016984371023313
sim_render-ego0_max0.003625352019374317
sim_render-ego0_mean0.003594155166667268
sim_render-ego0_median0.003589034874572246
sim_render-ego0_min0.003573198898150264
simulation-passed1
step_physics_max0.11986060225894112
step_physics_mean0.10155547975401992
step_physics_median0.09798901096966542
step_physics_min0.09038329481780775
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6179213320Raphael Jeanproject_both_linesaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6179111772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6179011772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178911772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178811772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178711772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178611772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178511772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178411772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178310933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6178110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6177913319Raphael Jeanproject_both_linesaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6177811012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6177611012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6177311012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6176911010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:01:32
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6170113250Andras Beres202-1aido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-011:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.398907506434838
survival_time_median20.10000000000015
deviation-center-line_median1.5671049462018256
in-drivable-lane_median0.3749999999999989


other stats
agent_compute-ego0_max0.016065363903122253
agent_compute-ego0_mean0.015131835613164096
agent_compute-ego0_median0.014788037037273728
agent_compute-ego0_min0.014675845579237264
agent_compute-ego1_max0.015377384591772854
agent_compute-ego1_mean0.01483929354034117
agent_compute-ego1_median0.014802680122053652
agent_compute-ego1_min0.01445580680205562
agent_compute-ego2_max0.01587479181557774
agent_compute-ego2_mean0.014662307235029782
agent_compute-ego2_median0.01416067982429902
agent_compute-ego2_min0.013951450065212584
agent_compute-ego3_max0.01572377231705141
agent_compute-ego3_mean0.014866943691021137
agent_compute-ego3_median0.014586005381600842
agent_compute-ego3_min0.014291053374411156
complete-iteration_max1.2962204825926018
complete-iteration_mean0.9549186178212572
complete-iteration_median0.9852972207319528
complete-iteration_min0.3282095077302721
deviation-center-line_max4.182413368754524
deviation-center-line_mean2.1251365937942155
deviation-center-line_min0.357887996188914
deviation-heading_max9.627892435906524
deviation-heading_mean4.752917934745189
deviation-heading_median3.3060076887908445
deviation-heading_min1.89705676504107
driven_any_max28.39892337331051
driven_any_mean12.184313875550597
driven_any_median9.642692966448996
driven_any_min0.5132501693561905
driven_lanedir_consec_max26.72308232966128
driven_lanedir_consec_mean11.5414023255884
driven_lanedir_consec_min0.4933655047332506
driven_lanedir_max26.72308232966128
driven_lanedir_mean11.5414023255884
driven_lanedir_median9.398907506434838
driven_lanedir_min0.4933655047332506
get_duckie_state_max1.3050784068892758e-06
get_duckie_state_mean1.255119829910073e-06
get_duckie_state_median1.261970780473466e-06
get_duckie_state_min1.209576924641927e-06
get_robot_state_max0.01419495291499249
get_robot_state_mean0.012880892391256707
get_robot_state_median0.0139153174417005
get_robot_state_min0.006883590486314562
get_state_dump_max0.009271806502437975
get_state_dump_mean0.008716585330697023
get_state_dump_median0.00923153502458736
get_state_dump_min0.005874186091952853
get_ui_image_max0.04989568296685276
get_ui_image_mean0.044025812680681016
get_ui_image_median0.046877230930884216
get_ui_image_min0.02929230584038629
in-drivable-lane_max4.64999999999986
in-drivable-lane_mean1.1535714285714025
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.493517613916708, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.166617178482266, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.5500000000000007, "deviation-heading": 2.7405524093202556, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.3686085467289304, "driven_lanedir_consec": 9.166617178482266, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.2388008766824794, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 2.9194499038438773, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.5865430672266743, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2369476251878697, "driven_lanedir_consec": 2.9194499038438773, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.4634410727910163, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 3.4141966865801687, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.104748324979441, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2194255506254925, "driven_lanedir_consec": 3.4141966865801687, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.791868318981283, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.652664810782866, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.6764542927150776, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.2187613539963786, "driven_lanedir_consec": 9.652664810782866, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.2744148606514525, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.993356391273899, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.4499999999999989, "deviation-heading": 2.1886548795496132, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.7609525839948686, "driven_lanedir_consec": 4.993356391273899, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.2683724535747025, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.057498553336585, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 1.89705676504107, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.764810998767303, "driven_lanedir_consec": 4.057498553336585, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.5132501693561905, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.4933655047332506, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.008341826230814, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.357887996188914, "driven_lanedir_consec": 0.4933655047332506, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6407977537520776, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.624954549718247, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.990371604431699, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 1.6061171092454496, "driven_lanedir_consec": 0.624954549718247, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 28.39892337331051, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.697153056659246, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.299999999999915, "deviation-heading": 9.233645184143096, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 3.9585946498045086, "driven_lanedir_consec": 26.697153056659246, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 28.11139009415567, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 25.914074013200757, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 4.64999999999986, "deviation-heading": 8.922783796519258, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.044790066759096, "driven_lanedir_consec": 25.914074013200757, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.35762199606153, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.662441724477063, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.2999999999999297, "deviation-heading": 8.95418148482855, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.182413368754524, "driven_lanedir_consec": 26.662441724477063, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 28.32396059392905, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.72308232966128, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 2.899999999999934, "deviation-heading": 9.627892435906524, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.086355625157938, "driven_lanedir_consec": 26.72308232966128, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.829211963265012, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 10.629580021100676, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.507267052602248, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.5280927831582016, "driven_lanedir_consec": 10.629580021100676, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.87482311728065, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 9.63119783438741, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.102357962938321, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.4181540547495373, "driven_lanedir_consec": 9.63119783438741, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}}
set_robot_commands_max0.002293376080003608
set_robot_commands_mean0.002217625054544921
set_robot_commands_median0.002206440075152522
set_robot_commands_min0.002174518836047454
sim_compute_performance-ego0_max0.002017482696288082
sim_compute_performance-ego0_mean0.0019307023474043864
sim_compute_performance-ego0_median0.001929421905276182
sim_compute_performance-ego0_min0.0018698678123152289
sim_compute_performance-ego1_max0.0019899573192060233
sim_compute_performance-ego1_mean0.001902177109149234
sim_compute_performance-ego1_median0.0018679643054488897
sim_compute_performance-ego1_min0.0018620035488611415
sim_compute_performance-ego2_max0.0019690214869487717
sim_compute_performance-ego2_mean0.0019037601896390048
sim_compute_performance-ego2_median0.0018850011801897148
sim_compute_performance-ego2_min0.0018572579017785268
sim_compute_performance-ego3_max0.002012623361794345
sim_compute_performance-ego3_mean0.0019151027122016472
sim_compute_performance-ego3_median0.0018717160000102989
sim_compute_performance-ego3_min0.0018609687748002968
sim_compute_sim_state_max0.043414650114251614
sim_compute_sim_state_mean0.026147954676086296
sim_compute_sim_state_median0.022657280466163977
sim_compute_sim_state_min0.009862181345621744
sim_render-ego0_max0.0037735169192394578
sim_render-ego0_mean0.003655944388505184
sim_render-ego0_median0.003631874087648924
sim_render-ego0_min0.0035805672629003783
sim_render-ego1_max0.0037148400961634622
sim_render-ego1_mean0.0036372072127619183
sim_render-ego1_median0.0036493164138226
sim_render-ego1_min0.0035496679941813152
sim_render-ego2_max0.003774793272516335
sim_render-ego2_mean0.003620347916262966
sim_render-ego2_median0.003564079109551593
sim_render-ego2_min0.0035221713667209697
sim_render-ego3_max0.003750002527811441
sim_render-ego3_mean0.003603141215959451
sim_render-ego3_median0.0035327599007201845
sim_render-ego3_min0.0035266612193467317
simulation-passed1
step_physics_max1.1047662874780984
step_physics_mean0.7788584835172674
step_physics_median0.7833969350857699
step_physics_min0.23146332422892252
survival_time_max59.99999999999873
survival_time_mean29.635714285714005
survival_time_min12.40000000000004
No reset possible
6169813316Raphael Jeanreal-exercise-2aido5-LF-real-validationeval1-videossuccessyesgpu-prod-010:02:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6167713316Raphael Jeanreal-exercise-2aido5-LF-real-validationeval0-videossuccessyesgpu-prod-010:01:32
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6167313317Raphael Jeanreal-exercise-2aido5-LFP-real-validationeval0-videossuccessyesgpu-prod-010:02:46
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6165113290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval2-visualizehost-erroryesgpu-prod-010:02:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6164913290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval2-videoshost-erroryesgpu-prod-010:03:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6163213290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval1-visualizehost-erroryesgpu-prod-010:03:50
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6162713288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval0-visualizehost-erroryesgpu-prod-010:01:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6161613160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval2-videossuccessyesgpu-prod-010:08:25
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6160213288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval0-videoshost-erroryesgpu-prod-010:01:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6159413019Márton Tim 🇭🇺3626aido5-LF-real-validationeval1-visualizesuccessyesgpu-prod-010:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.19881645554967187
survival_time7.146024465560913
deviation-center-line0.13910504477439903
in-drivable-lane6.155230283737183


other stats
deviation-heading0.2354786240897828
driven_any0.7439652402427961
driven_lanedir0.19881645554967187
visualized-eval1-passed1
No reset possible
6158512909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval0-videossuccessyesgpu-prod-010:03:59
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6157213277Andras Beres102-1-realaido5-LF-real-validationeval2-videossuccessyesgpu-prod-010:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6156713284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessyesgpu-prod-010:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6155913289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval2-videoshost-erroryesgpu-prod-010:02:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6155613309Robert Moni 🇭🇺speedRLaido5-LFV_multi-real-validationeval2-visualizesuccessyesgpu-prod-010:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.9230007584823658
survival_time18.52392578125
deviation-center-line0.563383601868976
in-drivable-lane12.17961057027181


other stats
deviation-heading2.5730963369549777
driven_any1.737597858985345
driven_lanedir0.9223660693910491
visualized-eval2-passed1
No reset possible
6154613289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval2-visualizesuccessyesgpu-prod-010:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec4.756799016064964
survival_time50.39810085296631
deviation-center-line2.493155812625366
in-drivable-lane0.19785523414611816


other stats
deviation-heading11.107014061295883
driven_any5.483843882970924
driven_lanedir4.756799016064964
visualized-eval2-passed1
No reset possible
6153713302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval1-videossuccessyesgpu-prod-010:02:47
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6152713303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval1-videossuccessyesgpu-prod-010:04:23
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6151813289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval0-visualizeerroryesgpu-prod-010:00:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139726603725120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6151613289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval0-visualizeabortedyesgpu-prod-010:00:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The job has been aborted.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6149713288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval1-visualizehost-errornogpu-prod-010:01:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6149613288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval2-visualizehost-errornogpu-prod-010:02:14
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6148913288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval2-videoshost-errornogpu-prod-010:02:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6148313288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval1-videoshost-errornogpu-prod-010:02:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6148013288Bea Baselines 🐤baseline-duckietownaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:07:50
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6146813290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:04:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.3674558658897027
survival_time22.798027515411377
deviation-center-line0.946841898300072
in-drivable-lane3.0018957455952964


other stats
deviation-heading4.186793112337633
driven_any1.648105784346581
driven_lanedir1.3674558658897027
visualized-eval0-passed1
No reset possible
6146213019Márton Tim 🇭🇺3626aido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5625782726878432
survival_time7.996758460998535
deviation-center-line0.26429259273712497
in-drivable-lane3.4309241771698


other stats
deviation-heading1.3180922464915057
driven_any0.8738887690704109
driven_lanedir0.5625782726878432
visualized-eval2-passed1
No reset possible
6145613309Robert Moni 🇭🇺speedRLaido5-LFV_multi-real-validationeval1-visualizeerrornogpu-prod-010:02:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140357336661008
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6145313306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval2-videossuccessyesgpu-prod-010:01:26
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6144213309Robert Moni 🇭🇺speedRLaido5-LFV_multi-real-validationeval0-videossuccessnogpu-prod-010:05:09
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6143513303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.4263790947438664
survival_time7.606874704360962
deviation-center-line0.26885602635013406
in-drivable-lane4.336622397104899


other stats
deviation-heading1.5955197918692836
driven_any1.3675905362741132
driven_lanedir0.6241012271440511
visualized-eval0-passed1
No reset possible
6142813303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval1-videossuccessnogpu-prod-010:03:49
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6142013305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval0-videossuccessyesgpu-prod-010:02:30
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6141713304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval2-videossuccessyesgpu-prod-010:01:46
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6141413304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval2-visualizesuccessyesgpu-prod-010:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.21554030521856693
survival_time7.035998821258545
deviation-center-line0.5425264832634085
in-drivable-lane1.927448272705078


other stats
deviation-heading4.366609026672145
driven_any0.4699700375589887
driven_lanedir0.21554030521856693
visualized-eval2-passed1
No reset possible
6141112909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3944917484164685
survival_time6.404664039611816
deviation-center-line0.19616329502548113
in-drivable-lane2.9645609855651855


other stats
deviation-heading2.2718592812376985
driven_any0.6062791161677499
driven_lanedir0.3944917484164685
visualized-eval2-passed1
No reset possible
6140912909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.19787301936556775
survival_time6.201350688934326
deviation-center-line0.3035517867644619
in-drivable-lane4.020295858383179


other stats
deviation-heading1.1787668532802396
driven_any0.5150670563716394
driven_lanedir0.19787301936556775
visualized-eval1-passed1
No reset possible
6140613160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-videoshost-errornogpu-prod-010:01:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6140213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:33
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6139713277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6139313284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.538375804350982
survival_time12.901892185211182
deviation-center-line0.5271305418699314
in-drivable-lane7.605623722076416


other stats
deviation-heading1.874646830288386
driven_any2.3729383598200204
driven_lanedir1.538375804350982
visualized-eval2-passed1
No reset possible
6139213284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizeabortednogpu-prod-010:00:47
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6138813284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizeabortednogpu-prod-010:00:47
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6138613284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizeabortednogpu-prod-010:00:48
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6138313284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6138013284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6137813284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6137613284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6137113284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6136813277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:37
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6136313284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:35
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6135913284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:39
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6135412909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.49801086567438024
survival_time27.034405946731567
deviation-center-line1.1183575436854314
in-drivable-lane16.956703186035156


other stats
deviation-heading10.131819537025788
driven_any1.2897950650940726
driven_lanedir0.49801086567438024
visualized-eval0-passed1
No reset possible
6135112909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.49801086567438024
survival_time27.034405946731567
deviation-center-line1.1183575436854314
in-drivable-lane16.956703186035156


other stats
deviation-heading10.131819537025788
driven_any1.2897950650940726
driven_lanedir0.49801086567438024
visualized-eval0-passed1
No reset possible
6134613307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval2-videossuccessnogpu-prod-010:04:16
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6133813277Andras Beres102-1-realaido5-LF-real-validationeval2-videossuccessnogpu-prod-010:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6133413284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6133013284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6132713304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval2-videossuccessnogpu-prod-010:02:38
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6132013303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval2-visualizesuccessnogpu-prod-010:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.8808993997376025
survival_time21.955139636993408
deviation-center-line0.3606968420176515
in-drivable-lane16.262510299682617


other stats
deviation-heading2.577711256266747
driven_any2.1476539002601034
driven_lanedir1.0852682560297218
visualized-eval2-passed1
No reset possible
6131413289Bea Baselines 🐤baseline-duckietownaido5-LFP-real-validationeval0-visualizeerrornogpu-prod-010:01:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 184, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 319, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 368, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140550794702272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6131113019Márton Tim 🇭🇺3626aido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5625782726878432
survival_time7.996758460998535
deviation-center-line0.26429259273712497
in-drivable-lane3.4309241771698


other stats
deviation-heading1.3180922464915057
driven_any0.8738887690704109
driven_lanedir0.5625782726878432
visualized-eval2-passed1
No reset possible
6130613019Márton Tim 🇭🇺3626aido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5625782726878432
survival_time7.996758460998535
deviation-center-line0.26429259273712497
in-drivable-lane3.4309241771698


other stats
deviation-heading1.3180922464915057
driven_any0.8738887690704109
driven_lanedir0.5625782726878432
visualized-eval2-passed1
No reset possible
6130213306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.08145621207242604
survival_time3.429880142211914
deviation-center-line0.491877344900264
in-drivable-lane0.0


other stats
deviation-heading1.1112631577782264
driven_any0.09804600126281392
driven_lanedir0.08145621207242604
visualized-eval0-passed1
No reset possible
6130013306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-visualizesuccessnogpu-prod-010:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3431278612485853
survival_time5.93418025970459
deviation-center-line0.2564553856822106
in-drivable-lane3.4328765869140625


other stats
deviation-heading0.2690108937627419
driven_any0.5025292818337489
driven_lanedir0.3431278612485853
visualized-eval1-passed1
No reset possible
6129713306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-visualizesuccessnogpu-prod-010:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3431278612485853
survival_time5.93418025970459
deviation-center-line0.2564553856822106
in-drivable-lane3.4328765869140625


other stats
deviation-heading0.2690108937627419
driven_any0.5025292818337489
driven_lanedir0.3431278612485853
visualized-eval1-passed1
No reset possible
6129212909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.49801086567438024
survival_time27.034405946731567
deviation-center-line1.1183575436854314
in-drivable-lane16.956703186035156


other stats
deviation-heading10.131819537025788
driven_any1.2897950650940726
driven_lanedir0.49801086567438024
visualized-eval0-passed1
No reset possible
6128712909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.19787301936556775
survival_time6.201350688934326
deviation-center-line0.3035517867644619
in-drivable-lane4.020295858383179


other stats
deviation-heading1.1787668532802396
driven_any0.5150670563716394
driven_lanedir0.19787301936556775
visualized-eval1-passed1
No reset possible
6128412909Robert Moni 🇭🇺speedRLaido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3944917484164685
survival_time6.404664039611816
deviation-center-line0.19616329502548113
in-drivable-lane2.9645609855651855


other stats
deviation-heading2.2718592812376985
driven_any0.6062791161677499
driven_lanedir0.3944917484164685
visualized-eval2-passed1
No reset possible
6128013305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.1038437720824623
survival_time16.200223684310913
deviation-center-line1.0277399954516322
in-drivable-lane3.8811516761779785


other stats
deviation-heading3.550566524673593
driven_any2.9055638132660917
driven_lanedir2.1038437720824623
visualized-eval0-passed1
No reset possible
6127813284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6129078664816039
survival_time8.403920650482178
deviation-center-line0.10089285772150086
in-drivable-lane6.505793333053589


other stats
deviation-heading1.0347678980734258
driven_any1.3836701285671344
driven_lanedir0.6129078664816039
visualized-eval1-passed1
No reset possible
6127613284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6129078664816039
survival_time8.403920650482178
deviation-center-line0.10089285772150086
in-drivable-lane6.505793333053589


other stats
deviation-heading1.0347678980734258
driven_any1.3836701285671344
driven_lanedir0.6129078664816039
visualized-eval1-passed1
No reset possible
6127213160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizehost-errornogpu-prod-010:01:31
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6126013160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval1-visualizehost-errornogpu-prod-010:01:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6124613303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.4263790947438664
survival_time7.606874704360962
deviation-center-line0.26885602635013406
in-drivable-lane4.336622397104899


other stats
deviation-heading1.5955197918692836
driven_any1.3675905362741132
driven_lanedir0.6241012271440511
visualized-eval0-passed1
No reset possible
6123713304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval1-visualizesuccessnogpu-prod-010:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.1070542175748206
survival_time13.102479934692385
deviation-center-line1.0121479366027664
in-drivable-lane4.088660478591919


other stats
deviation-heading1.5853752730396409
driven_any1.6186749452358702
driven_lanedir1.1070542175748206
visualized-eval1-passed1
No reset possible
6122413305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval2-visualizesuccessnogpu-prod-010:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.7941996535848654
survival_time14.187056303024292
deviation-center-line0.7895477747595027
in-drivable-lane2.7431042194366455


other stats
deviation-heading1.7260507571266963
driven_any2.112199287919068
driven_lanedir1.7941996535848654
visualized-eval2-passed1
No reset possible
6121113305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval2-visualizesuccessnogpu-prod-010:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.7941996535848654
survival_time14.187056303024292
deviation-center-line0.7895477747595027
in-drivable-lane2.7431042194366455


other stats
deviation-heading1.7260507571266963
driven_any2.112199287919068
driven_lanedir1.7941996535848654
visualized-eval2-passed1
No reset possible
6119613277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6118913277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6118013284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6117213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeabortednogpu-prod-010:01:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1137, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 596, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6115213302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval2-visualizesuccessnogpu-prod-010:05:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.15118484463586382
survival_time22.894289016723633
deviation-center-line1.5132658664225922
in-drivable-lane4.36734398206075


other stats
deviation-heading8.262752520622564
driven_any1.336708023021263
driven_lanedir0.346309079357585
visualized-eval2-passed1
No reset possible
6115113307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.777483697436823
survival_time4.9920432567596436
deviation-center-line0.2995008232780278
in-drivable-lane1.3513364791870115


other stats
deviation-heading0.3070266909391687
driven_any1.394873867445906
driven_lanedir0.777483697436823
visualized-eval0-passed1
No reset possible
6115013307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.777483697436823
survival_time4.9920432567596436
deviation-center-line0.2995008232780278
in-drivable-lane1.3513364791870115


other stats
deviation-heading0.3070266909391687
driven_any1.394873867445906
driven_lanedir0.777483697436823
visualized-eval0-passed1
No reset possible
6114413304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.26308287420287746
survival_time4.500941514968872
deviation-center-line0.21271012257987515
in-drivable-lane2.499216079711914


other stats
deviation-heading0.7667712757924765
driven_any0.6813217791736349
driven_lanedir0.26308287420287746
visualized-eval0-passed1
No reset possible
6114113307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6102555669036639
survival_time5.013919115066528
deviation-center-line0.16715708680970978
in-drivable-lane2.0051920413970947


other stats
deviation-heading0.6095703826604912
driven_any0.9239625106600752
driven_lanedir0.6102555669036639
visualized-eval1-passed1
No reset possible
6113913307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.6102555669036639
survival_time5.013919115066528
deviation-center-line0.16715708680970978
in-drivable-lane2.0051920413970947


other stats
deviation-heading0.6095703826604912
driven_any0.9239625106600752
driven_lanedir0.6102555669036639
visualized-eval1-passed1
No reset possible
6113413304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval2-visualizesuccessnogpu-prod-010:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.21554030521856693
survival_time7.035998821258545
deviation-center-line0.5425264832634085
in-drivable-lane1.927448272705078


other stats
deviation-heading4.366609026672145
driven_any0.4699700375589887
driven_lanedir0.21554030521856693
visualized-eval2-passed1
No reset possible
6112613284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6111913307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139752360006800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6111313307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140672530478944
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6109613277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6107913277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 178, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 311, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 360, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140334773045472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6107113277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6106013277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 137, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6105813303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval0-videossuccessnogpu-prod-010:02:20
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6105513303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval0-videossuccessnogpu-prod-010:01:25
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6105413303Márton Tim 🇭🇺3626aido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.4263790947438664
survival_time7.606874704360962
deviation-center-line0.26885602635013406
in-drivable-lane4.336622397104899


other stats
deviation-heading1.5955197918692836
driven_any1.3675905362741132
driven_lanedir0.6241012271440511
visualized-eval0-passed1
No reset possible
6105313306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval0-visualizeerrornogpu-prod-010:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 140627394164288
- M:pair_couple:cmdline(in:/;out:/) 140627394163136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6105213306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval0-visualizeerrornogpu-prod-010:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 139747255674864
- M:pair_couple:cmdline(in:/;out:/) 139747255673472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6105013306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval2-visualizeerrornogpu-prod-010:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 139642758524880
- M:pair_couple:cmdline(in:/;out:/) 139642758523776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6104813302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval1-visualizesuccessnogpu-prod-010:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.12920555441624548
survival_time7.576616843541463
deviation-center-line0.49097684612569575
in-drivable-lane2.8011531829833984


other stats
deviation-heading4.027590395165573
driven_any0.37603115000445425
driven_lanedir0.12920555441624548
visualized-eval1-passed1
No reset possible
6104113302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval1-videossuccessnogpu-prod-010:02:34
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6102713309Robert Moni 🇭🇺speedRLaido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:04:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.7489199681917635
survival_time23.238643566767376
deviation-center-line0.48211640028023495
in-drivable-lane15.951054652531942


other stats
deviation-heading3.20263144624829
driven_any2.005860417048193
driven_lanedir0.7683443781223148
visualized-eval0-passed1
No reset possible
6102413306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-visualizeerrornogpu-prod-010:01:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
    self.read_next_frame()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
    rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
OSError: obtaining file position failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 216, in evaluate_robotarium_log
    make_video_join(out_together, out_robot, out_pair)
  File "/project/evaluate_robotarium_log.py", line 402, in make_video_join
    pg('pair_couple', params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'mplayer'.
- B:MPlayer:mplayer(in:/;out:video) 140201265669936
- M:pair_couple:cmdline(in:/;out:/) 140201265670416
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 165, in update
>     self.read_next_frame()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mplayer.py", line 207, in read_next_frame
>     rgbs = numpy.fromfile(self.stream, dtype=dtype, count=1)
> OSError: obtaining file position failed

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6101513302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval0-videossuccessnogpu-prod-010:03:13
all ok, 10 bags proc [...]
all ok, 10 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6101413302Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LFV_multi-real-validationeval0-visualizesuccessnogpu-prod-010:03:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.2923680686807156
survival_time19.091280062993366
deviation-center-line0.4185537045157377
in-drivable-lane12.89194679260254


other stats
deviation-heading4.193005098797843
driven_any1.0042979637595664
driven_lanedir0.44544785334929454
visualized-eval0-passed1
No reset possible
6100913019Márton Tim 🇭🇺3626aido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:02:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5625782726878432
survival_time7.996758460998535
deviation-center-line0.26429259273712497
in-drivable-lane3.4309241771698


other stats
deviation-heading1.3180922464915057
driven_any0.8738887690704109
driven_lanedir0.5625782726878432
visualized-eval2-passed1
No reset possible
6100813019Márton Tim 🇭🇺3626aido5-LF-real-validationeval2-videossuccessnogpu-prod-010:02:32
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6100313019Márton Tim 🇭🇺3626aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:02:07
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6100213019Márton Tim 🇭🇺3626aido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.19881645554967187
survival_time7.146024465560913
deviation-center-line0.13910504477439903
in-drivable-lane6.155230283737183


other stats
deviation-heading0.2354786240897828
driven_any0.7439652402427961
driven_lanedir0.19881645554967187
visualized-eval1-passed1
No reset possible
6099613019Márton Tim 🇭🇺3626aido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:16
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6099513019Márton Tim 🇭🇺3626aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.12611220943414514
survival_time7.185366868972778
deviation-center-line0.38411318415791623
in-drivable-lane0.0


other stats
deviation-heading0.18053528194980464
driven_any0.1261129102913613
driven_lanedir0.12611220943414514
visualized-eval0-passed1
No reset possible
6099413306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval2-videossuccessnogpu-prod-010:01:33
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6099113306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval2-videossuccessnogpu-prod-010:01:32
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6099013306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval2-visualizesuccessnogpu-prod-010:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.23387222230022875
survival_time4.014149188995361
deviation-center-line0.25706490193900877
in-drivable-lane0.0


other stats
deviation-heading0.20968088550139355
driven_any0.23447803362005917
driven_lanedir0.23387222230022875
visualized-eval2-passed1
No reset possible
6098713306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-visualizesuccessnogpu-prod-010:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3431278612485853
survival_time5.93418025970459
deviation-center-line0.2564553856822106
in-drivable-lane3.4328765869140625


other stats
deviation-heading0.2690108937627419
driven_any0.5025292818337489
driven_lanedir0.3431278612485853
visualized-eval1-passed1
No reset possible
6098513306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-visualizesuccessnogpu-prod-010:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3431278612485853
survival_time5.93418025970459
deviation-center-line0.2564553856822106
in-drivable-lane3.4328765869140625


other stats
deviation-heading0.2690108937627419
driven_any0.5025292818337489
driven_lanedir0.3431278612485853
visualized-eval1-passed1
No reset possible
6098413306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval1-videossuccessnogpu-prod-010:01:49
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6098213160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval2-visualizehost-errornogpu-prod-010:01:48
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6097713160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval2-videossuccessnogpu-prod-010:08:33
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6096913160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.08915526791875128
survival_time58.09003043174744
deviation-center-line1.4025308498025488
in-drivable-lane45.78380465507507


other stats
deviation-heading9.65036873355296
driven_any1.9431153415374451
driven_lanedir0.08915526791875128
visualized-eval1-passed1
No reset possible
6096813160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval1-videoshost-errornogpu-prod-010:01:50
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6096613306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval0-videossuccessnogpu-prod-010:01:53
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6096513306Márton Tim 🇭🇺test_submitaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.08145621207242604
survival_time3.429880142211914
deviation-center-line0.491877344900264
in-drivable-lane0.0


other stats
deviation-heading1.1112631577782264
driven_any0.09804600126281392
driven_lanedir0.08145621207242604
visualized-eval0-passed1
No reset possible
6094813160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:24
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6094713160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.07127758437080345
survival_time7.931733846664429
deviation-center-line0.33611286877187174
in-drivable-lane3.573780059814453


other stats
deviation-heading4.290011818077239
driven_any0.19201602245270716
driven_lanedir0.07127758437080345
visualized-eval0-passed1
No reset possible
6094613160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.07127758437080345
survival_time7.931733846664429
deviation-center-line0.33611286877187174
in-drivable-lane3.573780059814453


other stats
deviation-heading4.290011818077239
driven_any0.19201602245270716
driven_lanedir0.07127758437080345
visualized-eval0-passed1
No reset possible
6094513307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:36
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6094413307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:44
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6094313307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 174, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 301, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 350, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139853700597888
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6093913307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval2-videossuccessnogpu-prod-010:04:24
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6093213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.777483697436823
survival_time4.9920432567596436
deviation-center-line0.2995008232780278
in-drivable-lane1.3513364791870115


other stats
deviation-heading0.3070266909391687
driven_any1.394873867445906
driven_lanedir0.777483697436823
visualized-eval0-passed1
No reset possible
6093013307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:38
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6092213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:01:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6090513277Andras Beres102-1-realaido5-LF-real-validationeval2-videossuccessnogpu-prod-010:03:58
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6087913277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 174, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 301, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 350, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140545170508096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6086713277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6085313277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:28
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6083513277Andras Beres102-1-realaido5-LF-real-validationeval1-videossuccessnogpu-prod-010:02:15
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6082513277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6082113160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.07127758437080345
survival_time7.931733846664429
deviation-center-line0.33611286877187174
in-drivable-lane3.573780059814453


other stats
deviation-heading4.290011818077239
driven_any0.19201602245270716
driven_lanedir0.07127758437080345
visualized-eval0-passed1
No reset possible
6081913160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.07127758437080345
survival_time7.931733846664429
deviation-center-line0.33611286877187174
in-drivable-lane3.573780059814453


other stats
deviation-heading4.290011818077239
driven_any0.19201602245270716
driven_lanedir0.07127758437080345
visualized-eval0-passed1
No reset possible
6081613307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.777483697436823
survival_time4.9920432567596436
deviation-center-line0.2995008232780278
in-drivable-lane1.3513364791870115


other stats
deviation-heading0.3070266909391687
driven_any1.394873867445906
driven_lanedir0.777483697436823
visualized-eval0-passed1
No reset possible
6080813304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval0-visualizeerrornogpu-prod-010:01:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140353783306512
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6080213284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6079613307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:00:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6078713307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:00:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6077613277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:01:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 140393600600528
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6077413277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 209, in evaluate_robotarium_log
    make_video_robot(dirname=dirname, robot_name=robot_name, t0=t0, t1=t1, outd=outd, out=out_robot)
  File "/project/evaluate_robotarium_log.py", line 378, in make_video_robot
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139886718100624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6076413277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
    block.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
    raise Exception(msg)
Exception: Finish() before starting to encode.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 173, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name,
  File "/project/evaluate_robotarium_log.py", line 299, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 348, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=fn2, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 293, in pg
    model.finish()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 229, in finish
    raise BadMethodCall("finish", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling finish() in block 'mencoder'.
- B:MEncoder:mencoder(in:image;out:/) 139635810154672
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 227, in finish
>     block.finish()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_mplayer/mencoder.py", line 256, in finish
>     raise Exception(msg)
> Exception: Finish() before starting to encode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6076313277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6075813307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:05
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6075713307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-videossuccessnogpu-prod-010:01:06
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6075613307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:00:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6075313307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:00:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6075213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:00:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 132, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE3value] = read_trajectory_SE3(trajfile)
  File "/project/evaluate_robotarium_log.py", line 44, in read_trajectory_SE3
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6074513160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:23
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6074213307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-videossuccessnogpu-prod-010:00:59
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6073813307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:00
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6073413307Zoltan Lorinczlzoltan_drfe1aido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval0/watchtowers/watchtower126/watchtower.bag', 'topic': '/watchtower126/camera_node/image/compressed', 't0': 10.120168685913086, 't1': 10.51915192604065, 'out': '/challenges/tmp/tmpg5pmdzuc/visualization/tmp/ego0-0-watchtower126-00000-00039.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f664c7d5970>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6072413160Anastasiya Nikolskaya 🇷🇺JetBrains Research0 real2sim v0.1.0 --REALaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval0/watchtowers/watchtower07/watchtower.bag', 'topic': '/watchtower07/camera_node/image/compressed', 't0': 17.52481484413147, 't1': 26.034072875976562, 'out': '/challenges/tmp/tmpfjx76xg6/visualization/tmp/ego0-0-watchtower07-00000-00850.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f4af56889d0>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6071813277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:31
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6070813277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:33
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6069113277Andras Beres102-1-realaido5-LF-real-validationeval2-videossuccessnogpu-prod-010:03:34
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6068413277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval2/watchtowers/watchtower03/watchtower.bag', 'topic': '/watchtower03/camera_node/image/compressed', 't0': 12.730477571487427, 't1': 17.32998538017273, 'out': '/challenges/tmp/tmpm_2tycty/visualization/tmp/ego0-0-watchtower03-00000-00459.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f8359fd03d0>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6068113277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizeerrornogpu-prod-010:00:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 133, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6065813277Andras Beres102-1-realaido5-LF-real-validationeval1-videossuccessnogpu-prod-010:02:18
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6064613277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizeerrornogpu-prod-010:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 44, in instance
    block = generator(name=name, config=config, library=library)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_loader.py", line 57, in __call__
    model = create_from_parsing_results(parsed_model, name, config, library=sandbox)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model_instantiation.py", line 312, in create_from_parsing_results
    raise SemanticError(msg, element)
procgraph.core.exceptions.SemanticError: Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
In file /project/evaluate_robotarium_log.py:
 line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
 line 13 >
 line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
          ^
          |
          here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 172, in evaluate_robotarium_log
    make_video(dirname=dirname, seq=closest, outd=outd, robot_name=robot_name)
  File "/project/evaluate_robotarium_log.py", line 294, in make_video
    make_video_cut(dirname, chunk.wt, chunk.t0, chunk.t1, outd, outfile)
  File "/project/evaluate_robotarium_log.py", line 345, in make_video_cut
    pg('bag2mp4_fixfps_limit_robotarium', dict(bag=bag_filename, topic=topic, t0=t0use, t1=t1use, out=out))
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 245, in pg
    model = library.instance(filename, name="cmdline", config=config)
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/registrar.py", line 56, in instance
    raise ModelInstantionError(msg) from e  # TODO: use Procgraph own exception
procgraph.core.exceptions.ModelInstantionError: Could not instance block from generator.
        name: cmdline  
      config: {'bag': '/challenges/previous-steps/eval1/watchtowers/watchtower01/watchtower.bag', 'topic': '/watchtower01/camera_node/image/compressed', 't0': 10.461296081542969, 't1': 24.953604698181152, 'out': '/challenges/tmp/tmprn9t13cc/visualization/tmp/ego0-0-watchtower01-00000-01449.mp4'}  
   generator: <procgraph.core.model_loader.ModelSpec object at 0x7f72728e8be0>  
     of type: <class 'procgraph.core.model_loader.ModelSpec'>  
Because of this exception:
| Could not find block type 'bagread' in 164 options. (Did you mean 'bagread_test'?)
| In file /project/evaluate_robotarium_log.py:
|  line 12 >config t1     """ Time end, relative to physical bag initial timestamp """
|  line 13 >
|  line 14 >|bagread file=$bag topics=$topic t0=$t0 t1=$t1| --> cam
|           ^
|           |
|           here or nearby

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6064013284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval2-videossuccessnogpu-prod-010:02:45
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6062913305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval1-visualizeerrornogpu-prod-010:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 67, in evaluate_robotarium_log
    seq_raw: SampledSequence[SE2value] = read_trajectory(trajfile)
  File "/project/evaluate_robotarium_log.py", line 26, in read_trajectory
    contents = read_ustring_from_utf8_file(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 32, in read_ustring_from_utf8_file
    _check_exists(filename)
  File "/usr/local/lib/python3.8/site-packages/zuper_commons/fs/zc_fileutils.py", line 61, in _check_exists
    raise ValueError(msg)
ValueError: Could not find file '/challenges/previous-steps/eval1/watchtowers/watchtower130/trajectory.yaml' from directory /project

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6062513305Melisande Tengexercise_state_estimationaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.1038437720824623
survival_time16.200223684310913
deviation-center-line1.0277399954516322
in-drivable-lane3.8811516761779785


other stats
deviation-heading3.550566524673593
driven_any2.9055638132660917
driven_lanedir2.1038437720824623
visualized-eval0-passed1
No reset possible
6061513277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.528507341980895
survival_time26.080227851867676
deviation-center-line0.7794176911610061
in-drivable-lane16.56039595603943


other stats
deviation-heading2.990060812855902
driven_any6.312330471831122
driven_lanedir2.528507341980895
visualized-eval2-passed1
No reset possible
6061413277Andras Beres102-1-realaido5-LF-real-validationeval2-visualizesuccessnogpu-prod-010:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec2.528507341980895
survival_time26.080227851867676
deviation-center-line0.7794176911610061
in-drivable-lane16.56039595603943


other stats
deviation-heading2.990060812855902
driven_any6.312330471831122
driven_lanedir2.528507341980895
visualized-eval2-passed1
No reset possible
6061213277Andras Beres102-1-realaido5-LF-real-validationeval2-videossuccessnogpu-prod-010:04:14
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6060013277Andras Beres102-1-realaido5-LF-real-validationeval1-videossuccessnogpu-prod-010:02:31
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6059913277Andras Beres102-1-realaido5-LF-real-validationeval1-visualizesuccessnogpu-prod-010:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.3733493915222952
survival_time14.000820636749268
deviation-center-line0.43859357318289344
in-drivable-lane6.757620811462402


other stats
deviation-heading1.0368942078522922
driven_any1.2214628274290389
driven_lanedir0.3733493915222952
visualized-eval1-passed1
No reset possible
6059713304Raphael Jeanexercise_state_estimationaido5-LFP-real-validationeval0-visualizesuccessnogpu-prod-010:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.26308287420287746
survival_time4.500941514968872
deviation-center-line0.21271012257987515
in-drivable-lane2.499216079711914


other stats
deviation-heading0.7667712757924765
driven_any0.6813217791736349
driven_lanedir0.26308287420287746
visualized-eval0-passed1
No reset possible
6058913284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval2-visualizeerrornogpu-prod-010:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "main.py", line 19, in wrap
    stats = evaluate_robotarium_log(d_step, outd=outd)
  File "/project/evaluate_robotarium_log.py", line 67, in evaluate_robotarium_log
    pose = seq_raw.values[0]
IndexError: list index out of range

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "main.py", line 34, in <module>
    wrap(_)
  File "main.py", line 24, in wrap
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6058013284András Kalapos 🇭🇺real-v1.0-3092-363aido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.5095739644743909
survival_time5.999385833740234
deviation-center-line0.18664647817264143
in-drivable-lane1.9999778270721436


other stats
deviation-heading1.093488464947737
driven_any0.6315599174515889
driven_lanedir0.5095739644743909
visualized-eval0-passed1
No reset possible
6057313277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.010015950365367
survival_time5.209685564041138
deviation-center-line0.2939029143348458
in-drivable-lane1.207838535308838


other stats
deviation-heading0.9440969846552648
driven_any1.2392733340933495
driven_lanedir1.010015950365367
visualized-eval0-passed1
No reset possible
6057213277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.010015950365367
survival_time5.209685564041138
deviation-center-line0.2939029143348458
in-drivable-lane1.207838535308838


other stats
deviation-heading0.9440969846552648
driven_any1.2392733340933495
driven_lanedir1.010015950365367
visualized-eval0-passed1
No reset possible
6057113277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec1.010015950365367
survival_time5.209685564041138
deviation-center-line0.2939029143348458
in-drivable-lane1.207838535308838


other stats
deviation-heading0.9440969846552648
driven_any1.2392733340933495
driven_lanedir1.010015950365367
visualized-eval0-passed1
No reset possible
6057013277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:01:07
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6055913277Andras Beres102-1-realaido5-LF-real-validationeval0-videossuccessnogpu-prod-010:02:08
all ok, 8 bags proce [...]
all ok, 8 bags processed
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6055813277Andras Beres102-1-realaido5-LF-real-validationeval0-visualizesuccessnogpu-prod-010:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec0.0
survival_time4.997756004333496
deviation-center-line0.26259257502259803
in-drivable-lane0.0


other stats
deviation-heading0.7312775696761561
driven_any0.0
driven_lanedir0.0
visualized-eval0-passed1
No reset possible
6053213290Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-real-validationeval0-videoshost-errornogpu-prod-010:02:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible