Duckietown Challenges Home Challenges Submissions

Evaluator 4887

ID4887
evaluatornogpu-prod-01
ownerI don't have one 😀
machinenogpu-prod_e442d6230f60
processnogpu-prod-01_e442d6230f60
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success18 53920
# timeout1 57573
# failed3 55412
# error1 54073
# aborted
# host-error33 54383
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5757310889Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-01----No reset possible
5740910940Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:41:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013487638978537275
agent_compute-ego0_mean0.011912403555337238
agent_compute-ego0_median0.011397336940781265
agent_compute-ego0_min0.01136730136124915
complete-iteration_max0.3419672100867558
complete-iteration_mean0.2880329612292021
complete-iteration_median0.2847782005179832
complete-iteration_min0.24060823379408608
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.854543185650955e-06
get_duckie_state_mean1.8399025776503384e-06
get_duckie_state_median1.8440217995623763e-06
get_duckie_state_min1.8170235258256469e-06
get_robot_state_max0.003719201195150688
get_robot_state_mean0.0036288054162119943
get_robot_state_median0.0036345272635937135
get_robot_state_min0.003526965942509863
get_state_dump_max0.004563057452415447
get_state_dump_mean0.004539038219817175
get_state_dump_median0.004540539998793781
get_state_dump_min0.004512015429265692
get_ui_image_max0.035201013534888935
get_ui_image_mean0.0302193700324288
get_ui_image_median0.02950640860247076
get_ui_image_min0.02666364938988475
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02741352961918992, "step_physics": 0.20525348335380456, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004521313158300497, "get_robot_state": 0.003526965942509863, "sim_render-ego0": 0.0038160630606493286, "get_duckie_state": 1.8170235258256469e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.01142605774408574, "complete-iteration": 0.26847862462814803, "set_robot_commands": 0.0021475645822847415, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008368550887413565, "sim_compute_performance-ego0": 0.0019192584448313335}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035201013534888935, "step_physics": 0.26507472515503233, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004559766839287065, "get_robot_state": 0.003719201195150688, "sim_render-ego0": 0.004015674400488403, "get_duckie_state": 1.8406470153452851e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013487638978537275, "complete-iteration": 0.3419672100867558, "set_robot_commands": 0.002253185005410327, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011527548820946636, "sim_compute_performance-ego0": 0.002041092323919418}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0315992875857516, "step_physics": 0.23311959853478015, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004512015429265692, "get_robot_state": 0.003620320414623353, "sim_render-ego0": 0.0038344518628148218, "get_duckie_state": 1.8473965837794675e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.011368616137476783, "complete-iteration": 0.3010777764078183, "set_robot_commands": 0.0021760289019887194, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008801273660397749, "sim_compute_performance-ego0": 0.0019567326443280706}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02666364938988475, "step_physics": 0.18004047741600118, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004563057452415447, "get_robot_state": 0.003648734112564074, "sim_render-ego0": 0.0038842215923147335, "get_duckie_state": 1.854543185650955e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01136730136124915, "complete-iteration": 0.24060823379408608, "set_robot_commands": 0.0022358493344372854, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006123030413993689, "sim_compute_performance-ego0": 0.001996319260227988}}
set_robot_commands_max0.002253185005410327
set_robot_commands_mean0.0022031569560302684
set_robot_commands_median0.0022059391182130024
set_robot_commands_min0.0021475645822847415
sim_compute_performance-ego0_max0.002041092323919418
sim_compute_performance-ego0_mean0.001978350668326703
sim_compute_performance-ego0_median0.0019765259522780292
sim_compute_performance-ego0_min0.0019192584448313335
sim_compute_sim_state_max0.011527548820946636
sim_compute_sim_state_mean0.00870510094568791
sim_compute_sim_state_median0.008584912273905657
sim_compute_sim_state_min0.006123030413993689
sim_render-ego0_max0.004015674400488403
sim_render-ego0_mean0.0038876027290668217
sim_render-ego0_median0.003859336727564777
sim_render-ego0_min0.0038160630606493286
simulation-passed1
step_physics_max0.26507472515503233
step_physics_mean0.22087207111490456
step_physics_median0.2191865409442924
step_physics_min0.18004047741600118
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5730710998Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:23:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9179670941368365
survival_time_median51.02499999999924
deviation-center-line_median0.9962162605799758
in-drivable-lane_median13.17499999999988


other stats
agent_compute-ego0_max0.02315817784508698
agent_compute-ego0_mean0.0156109392546526
agent_compute-ego0_median0.013471449762885812
agent_compute-ego0_min0.012342679647751795
complete-iteration_max0.22390812120319883
complete-iteration_mean0.18382741425048
complete-iteration_median0.17545180328236437
complete-iteration_min0.16049792923399253
deviation-center-line_max3.3161115418329254
deviation-center-line_mean1.3650258889991211
deviation-center-line_min0.1515594930036075
deviation-heading_max10.889350700158062
deviation-heading_mean5.128800541793854
deviation-heading_median3.7954042674755017
deviation-heading_min2.0350429320663515
driven_any_max7.80322434251251
driven_any_mean5.219977080043412
driven_any_median6.40170190435853
driven_any_min0.2732801689440764
driven_lanedir_consec_max7.6357933008798256
driven_lanedir_consec_mean3.3917568528624815
driven_lanedir_consec_min0.09529992229642748
driven_lanedir_max7.6357933008798256
driven_lanedir_mean3.3936510644526896
driven_lanedir_median2.921755517317252
driven_lanedir_min0.09529992229642748
get_duckie_state_max1.5767819727470264e-06
get_duckie_state_mean1.3543222480607343e-06
get_duckie_state_median1.287414071391956e-06
get_duckie_state_min1.2656788767119984e-06
get_robot_state_max0.004013550958054873
get_robot_state_mean0.003759465812877971
get_robot_state_median0.003704894779800952
get_robot_state_min0.003614522733855109
get_state_dump_max0.005106447027620737
get_state_dump_mean0.004885161832120683
get_state_dump_median0.004900639953076458
get_state_dump_min0.004632920394709081
get_ui_image_max0.0331240407174814
get_ui_image_mean0.029573088176472025
get_ui_image_median0.029985033281350992
get_ui_image_min0.025198245425704716
in-drivable-lane_max37.149999999999224
in-drivable-lane_mean15.874999999999746
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.8343335722098875, "get_ui_image": 0.027067852300481393, "step_physics": 0.09380056201886244, "survival_time": 50.99999999999924, "driven_lanedir": 4.05251494368235, "get_state_dump": 0.004845410672971481, "get_robot_state": 0.0037826688469448705, "sim_render-ego0": 0.003984745756068963, "get_duckie_state": 1.2971745415369049e-06, "in-drivable-lane": 24.74999999999977, "deviation-heading": 3.9978490322286486, "agent_compute-ego0": 0.012760853790746495, "complete-iteration": 0.16127883021908573, "set_robot_commands": 0.002282847853762396, "deviation-center-line": 1.144716646500511, "driven_lanedir_consec": 4.05251494368235, "sim_compute_sim_state": 0.010550888465036958, "sim_compute_performance-ego0": 0.0021110926038721517}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2732801689440764, "get_ui_image": 0.03290221426222059, "step_physics": 0.15320947729511025, "survival_time": 3.999999999999994, "driven_lanedir": 0.09529992229642748, "get_state_dump": 0.004632920394709081, "get_robot_state": 0.003627120712657034, "sim_render-ego0": 0.003680888517403308, "get_duckie_state": 1.2656788767119984e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 2.0350429320663515, "agent_compute-ego0": 0.012342679647751795, "complete-iteration": 0.22390812120319883, "set_robot_commands": 0.002042181697892554, "deviation-center-line": 0.1515594930036075, "driven_lanedir_consec": 0.09529992229642748, "sim_compute_sim_state": 0.009500630107926731, "sim_compute_performance-ego0": 0.001883035824622637}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.969070236507173, "get_ui_image": 0.0331240407174814, "step_physics": 0.11372975080680474, "survival_time": 51.04999999999924, "driven_lanedir": 1.7909960909521545, "get_state_dump": 0.005106447027620737, "get_robot_state": 0.004013550958054873, "sim_render-ego0": 0.0042105292620724195, "get_duckie_state": 1.5767819727470264e-06, "in-drivable-lane": 37.149999999999224, "deviation-heading": 3.5929595027223544, "agent_compute-ego0": 0.014182045735025128, "complete-iteration": 0.18962477634564304, "set_robot_commands": 0.002410479721024545, "deviation-center-line": 0.8477158746594408, "driven_lanedir_consec": 1.7834192445913226, "sim_compute_sim_state": 0.010556426066941712, "sim_compute_performance-ego0": 0.0021835346277912534}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.80322434251251, "get_ui_image": 0.025198245425704716, "step_physics": 0.08933230125338311, "survival_time": 59.99999999999873, "driven_lanedir": 7.6357933008798256, "get_state_dump": 0.004955869233181435, "get_robot_state": 0.003614522733855109, "sim_render-ego0": 0.0038196562132569375, "get_duckie_state": 1.2776536012470075e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.889350700158062, "agent_compute-ego0": 0.02315817784508698, "complete-iteration": 0.16049792923399253, "set_robot_commands": 0.0022300562195535704, "deviation-center-line": 3.3161115418329254, "driven_lanedir_consec": 7.6357933008798256, "sim_compute_sim_state": 0.006131633731546648, "sim_compute_performance-ego0": 0.0019667384824983087}}
set_robot_commands_max0.002410479721024545
set_robot_commands_mean0.0022413913730582663
set_robot_commands_median0.002256452036657983
set_robot_commands_min0.002042181697892554
sim_compute_performance-ego0_max0.0021835346277912534
sim_compute_performance-ego0_mean0.0020361003846960874
sim_compute_performance-ego0_median0.00203891554318523
sim_compute_performance-ego0_min0.001883035824622637
sim_compute_sim_state_max0.010556426066941712
sim_compute_sim_state_mean0.009184894592863011
sim_compute_sim_state_median0.010025759286481846
sim_compute_sim_state_min0.006131633731546648
sim_render-ego0_max0.0042105292620724195
sim_render-ego0_mean0.003923954937200407
sim_render-ego0_median0.0039022009846629503
sim_render-ego0_min0.003680888517403308
simulation-passed1
step_physics_max0.15320947729511025
step_physics_mean0.11251802284354012
step_physics_median0.10376515641283358
step_physics_min0.08933230125338311
survival_time_max59.99999999999873
survival_time_mean41.5124999999993
survival_time_min3.999999999999994
No reset possible
5710111020Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:47:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013858979588047254
agent_compute-ego0_mean0.012818674858563353
agent_compute-ego0_median0.012739014367477585
agent_compute-ego0_min0.01193769111125098
complete-iteration_max0.35005202003561586
complete-iteration_mean0.289962095781528
complete-iteration_median0.29145283971003544
complete-iteration_min0.2268906836704251
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.3187465620080596e-06
get_duckie_state_mean1.2528390114154545e-06
get_duckie_state_median1.24142430009294e-06
get_duckie_state_min1.2097608834678785e-06
get_robot_state_max0.003743770219801268
get_robot_state_mean0.003663792350111555
get_robot_state_median0.003654147464965007
get_robot_state_min0.00360310425071494
get_state_dump_max0.0047432925679304514
get_state_dump_mean0.00461686794009435
get_state_dump_median0.004604812764208283
get_state_dump_min0.004514553664030381
get_ui_image_max0.03543498136915831
get_ui_image_mean0.03002574019983945
get_ui_image_median0.029892644417673028
get_ui_image_min0.02488269059485341
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027914625321895654, "step_physics": 0.20890844314918233, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00459383985184313, "get_robot_state": 0.003743770219801268, "sim_render-ego0": 0.003931128115181522, "get_duckie_state": 1.2669336984397767e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.01286401796301239, "complete-iteration": 0.27482005638643464, "set_robot_commands": 0.002298861518688345, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00843706138922114, "sim_compute_performance-ego0": 0.002044152856170883}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03543498136915831, "step_physics": 0.27227692977276374, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0047432925679304514, "get_robot_state": 0.003700273221577335, "sim_render-ego0": 0.0040259490302956965, "get_duckie_state": 1.3187465620080596e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013858979588047254, "complete-iteration": 0.35005202003561586, "set_robot_commands": 0.002230577127423314, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011667031630389796, "sim_compute_performance-ego0": 0.002026577575518428}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0318706635134504, "step_physics": 0.238634250840974, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004615785676573437, "get_robot_state": 0.003608021708352679, "sim_render-ego0": 0.0038360461505823193, "get_duckie_state": 1.2097608834678785e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012614010771942774, "complete-iteration": 0.3080856230336363, "set_robot_commands": 0.002135645042946694, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0087495409975838, "sim_compute_performance-ego0": 0.0019368589371070576}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02488269059485341, "step_physics": 0.16825507622178051, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004514553664030381, "get_robot_state": 0.00360310425071494, "sim_render-ego0": 0.003718383901819996, "get_duckie_state": 1.2159149017461035e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01193769111125098, "complete-iteration": 0.2268906836704251, "set_robot_commands": 0.0021073431099185736, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005861094948850404, "sim_compute_performance-ego0": 0.0019250545374658284}}
set_robot_commands_max0.002298861518688345
set_robot_commands_mean0.0021931066997442315
set_robot_commands_median0.002183111085185004
set_robot_commands_min0.0021073431099185736
sim_compute_performance-ego0_max0.002044152856170883
sim_compute_performance-ego0_mean0.0019831609765655492
sim_compute_performance-ego0_median0.0019817182563127427
sim_compute_performance-ego0_min0.0019250545374658284
sim_compute_sim_state_max0.011667031630389796
sim_compute_sim_state_mean0.008678682241511285
sim_compute_sim_state_median0.00859330119340247
sim_compute_sim_state_min0.005861094948850404
sim_render-ego0_max0.0040259490302956965
sim_render-ego0_mean0.0038778767994698832
sim_render-ego0_median0.0038835871328819207
sim_render-ego0_min0.003718383901819996
simulation-passed1
step_physics_max0.27227692977276374
step_physics_mean0.2220186749961751
step_physics_median0.22377134699507817
step_physics_min0.16825507622178051
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5709211313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5705711032Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:04:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5700111040Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3093546107094631
survival_time_median15.350000000000083
deviation-center-line_median0.29415707227180643
in-drivable-lane_median7.4500000000000846


other stats
agent_compute-ego0_max0.01407322585582733
agent_compute-ego0_mean0.012980399871479573
agent_compute-ego0_median0.01281876482255908
agent_compute-ego0_min0.012210843984972792
complete-iteration_max0.22374581098556515
complete-iteration_mean0.177155625195402
complete-iteration_median0.16646269957448023
complete-iteration_min0.1519512906470823
deviation-center-line_max0.5137677670579192
deviation-center-line_mean0.29563629271124237
deviation-center-line_min0.08046325924343728
deviation-heading_max1.9671995886552536
deviation-heading_mean1.1933765145276185
deviation-heading_median1.0408520982899283
deviation-heading_min0.724602272875363
driven_any_max4.4505841332594205
driven_any_mean2.797368070181718
driven_any_median3.067454399808218
driven_any_min0.6039793478510129
driven_lanedir_consec_max2.0568513876331447
driven_lanedir_consec_mean1.209079968131744
driven_lanedir_consec_min0.160759263474906
driven_lanedir_max2.0568513876331447
driven_lanedir_mean1.209079968131744
driven_lanedir_median1.3093546107094631
driven_lanedir_min0.160759263474906
get_duckie_state_max1.3887882232666016e-06
get_duckie_state_mean1.275703882426967e-06
get_duckie_state_median1.2487028752660295e-06
get_duckie_state_min1.2166215559092078e-06
get_robot_state_max0.003671911358833313
get_robot_state_mean0.0036235823750442047
get_robot_state_median0.003647226042746536
get_robot_state_min0.0035279660558504332
get_state_dump_max0.0046781528411537964
get_state_dump_mean0.004601014574412559
get_state_dump_median0.0046404603571718
get_state_dump_min0.004444984742152838
get_ui_image_max0.03755610585212708
get_ui_image_mean0.030626850323450777
get_ui_image_median0.029371832470799233
get_ui_image_min0.02620763050007756
in-drivable-lane_max14.350000000000136
in-drivable-lane_mean7.8875000000000846
in-drivable-lane_min2.3000000000000327
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4107014891740817, "get_ui_image": 0.02659590548448602, "step_physics": 0.09029799822426628, "survival_time": 12.100000000000035, "driven_lanedir": 2.0568513876331447, "get_state_dump": 0.004444984742152838, "get_robot_state": 0.0035279660558504332, "sim_render-ego0": 0.003693771950992537, "get_duckie_state": 1.2166215559092078e-06, "in-drivable-lane": 2.3000000000000327, "deviation-heading": 1.255087747901546, "agent_compute-ego0": 0.012210843984972792, "complete-iteration": 0.1538096877282539, "set_robot_commands": 0.002077125227500382, "deviation-center-line": 0.4463375548644525, "driven_lanedir_consec": 2.0568513876331447, "sim_compute_sim_state": 0.00901853891066563, "sim_compute_performance-ego0": 0.0018598297495900848}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6039793478510129, "get_ui_image": 0.03755610585212708, "step_physics": 0.14538716971874238, "survival_time": 3.949999999999994, "driven_lanedir": 0.160759263474906, "get_state_dump": 0.004642066359519958, "get_robot_state": 0.003671911358833313, "sim_render-ego0": 0.003958764672279358, "get_duckie_state": 1.3887882232666016e-06, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.8266164486783104, "agent_compute-ego0": 0.01407322585582733, "complete-iteration": 0.22374581098556515, "set_robot_commands": 0.002182483673095703, "deviation-center-line": 0.08046325924343728, "driven_lanedir_consec": 0.160759263474906, "sim_compute_sim_state": 0.010206136107444762, "sim_compute_performance-ego0": 0.0019754499197006227}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.4505841332594205, "get_ui_image": 0.03214775945711244, "step_physics": 0.1055050743467987, "survival_time": 21.900000000000176, "driven_lanedir": 1.8202366111375712, "get_state_dump": 0.0046388543548236405, "get_robot_state": 0.003662529187213315, "sim_render-ego0": 0.0039059029624782552, "get_duckie_state": 1.2241354835875217e-06, "in-drivable-lane": 12.350000000000176, "deviation-heading": 1.9671995886552536, "agent_compute-ego0": 0.013199581372167635, "complete-iteration": 0.17911571142070656, "set_robot_commands": 0.0021803384489785024, "deviation-center-line": 0.5137677670579192, "driven_lanedir_consec": 1.8202366111375712, "sim_compute_sim_state": 0.011806371271746031, "sim_compute_performance-ego0": 0.001980884200076579}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.724207310442355, "get_ui_image": 0.02620763050007756, "step_physics": 0.09091599249648025, "survival_time": 18.60000000000013, "driven_lanedir": 0.7984726102813549, "get_state_dump": 0.0046781528411537964, "get_robot_state": 0.0036319228982797575, "sim_render-ego0": 0.003812452423668419, "get_duckie_state": 1.2732702669445375e-06, "in-drivable-lane": 14.350000000000136, "deviation-heading": 0.724602272875363, "agent_compute-ego0": 0.012437948272950528, "complete-iteration": 0.1519512906470823, "set_robot_commands": 0.002131387311715543, "deviation-center-line": 0.14197658967916044, "driven_lanedir_consec": 0.7984726102813549, "sim_compute_sim_state": 0.006139367259539484, "sim_compute_performance-ego0": 0.0019091338957922068}}
set_robot_commands_max0.002182483673095703
set_robot_commands_mean0.0021428336653225325
set_robot_commands_median0.0021558628803470224
set_robot_commands_min0.002077125227500382
sim_compute_performance-ego0_max0.001980884200076579
sim_compute_performance-ego0_mean0.0019313244412898737
sim_compute_performance-ego0_median0.0019422919077464148
sim_compute_performance-ego0_min0.0018598297495900848
sim_compute_sim_state_max0.011806371271746031
sim_compute_sim_state_mean0.009292603387348978
sim_compute_sim_state_median0.009612337509055196
sim_compute_sim_state_min0.006139367259539484
sim_render-ego0_max0.003958764672279358
sim_render-ego0_mean0.0038427230023546422
sim_render-ego0_median0.003859177693073337
sim_render-ego0_min0.003693771950992537
simulation-passed1
step_physics_max0.14538716971874238
step_physics_mean0.1080265586965719
step_physics_median0.09821053342163948
step_physics_min0.09029799822426628
survival_time_max21.900000000000176
survival_time_mean14.137500000000085
survival_time_min3.949999999999994
No reset possible
5686111073Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:31:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4240230936539913
survival_time_median57.37499999999888
deviation-center-line_median2.7832888110175817
in-drivable-lane_median12.575000000000037


other stats
agent_compute-ego0_max0.03391040493109939
agent_compute-ego0_mean0.024597654065154975
agent_compute-ego0_median0.0260315458092198
agent_compute-ego0_min0.012417119711080915
complete-iteration_max0.22275422676636356
complete-iteration_mean0.18197470915234276
complete-iteration_median0.1724166559666025
complete-iteration_min0.16031129790980253
deviation-center-line_max3.1905488772538573
deviation-center-line_mean2.4175241015765563
deviation-center-line_min0.9129699070172044
deviation-heading_max16.727119337898003
deviation-heading_mean12.0422264937054
deviation-heading_median13.225535693870174
deviation-heading_min4.990715249183248
driven_any_max11.538838028610364
driven_any_mean9.272885093171
driven_any_median10.19632238861038
driven_any_min5.160057566852878
driven_lanedir_consec_max10.621944839935242
driven_lanedir_consec_mean4.875308063797976
driven_lanedir_consec_min2.031241227948681
driven_lanedir_max10.621944839935242
driven_lanedir_mean6.476346678209467
driven_lanedir_median6.618336945618545
driven_lanedir_min2.046767981665535
get_duckie_state_max1.263757430941338e-06
get_duckie_state_mean1.221648384793643e-06
get_duckie_state_median1.2343965184472157e-06
get_duckie_state_min1.1540430713388023e-06
get_robot_state_max0.003573957232015516
get_robot_state_mean0.003477262791811605
get_robot_state_median0.0034562282345208173
get_robot_state_min0.003422637466189268
get_state_dump_max0.004570933801744701
get_state_dump_mean0.004375143378688278
get_state_dump_median0.004337801459632402
get_state_dump_min0.0042540367937436065
get_ui_image_max0.032308347686363835
get_ui_image_mean0.028101870758142692
get_ui_image_median0.027864822108456103
get_ui_image_min0.02436949112929472
in-drivable-lane_max23.499999999999453
in-drivable-lane_mean13.024999999999872
in-drivable-lane_min3.449999999999971
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.538838028610364, "get_ui_image": 0.025985095225007807, "step_physics": 0.09176104571003402, "survival_time": 59.99999999999873, "driven_lanedir": 10.621944839935242, "get_state_dump": 0.004390636947530196, "get_robot_state": 0.003422637466189268, "sim_render-ego0": 0.0035543163849054826, "get_duckie_state": 1.255816762195241e-06, "in-drivable-lane": 3.449999999999971, "deviation-heading": 10.70301313053342, "agent_compute-ego0": 0.018775392630812925, "complete-iteration": 0.16031129790980253, "set_robot_commands": 0.001964481744440668, "deviation-center-line": 3.1578809200498337, "driven_lanedir_consec": 10.621944839935242, "sim_compute_sim_state": 0.008573504510668295, "sim_compute_performance-ego0": 0.0018050013533440555}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.46339644442208, "get_ui_image": 0.032308347686363835, "step_physics": 0.13031475278582885, "survival_time": 54.74999999999903, "driven_lanedir": 4.546514138667691, "get_state_dump": 0.0042540367937436065, "get_robot_state": 0.003424981214704305, "sim_render-ego0": 0.003618553607133183, "get_duckie_state": 1.2129762746991903e-06, "in-drivable-lane": 23.499999999999453, "deviation-heading": 16.727119337898003, "agent_compute-ego0": 0.03328769898762668, "complete-iteration": 0.22275422676636356, "set_robot_commands": 0.002060133610328619, "deviation-center-line": 2.40869670198533, "driven_lanedir_consec": 2.8117999472620316, "sim_compute_sim_state": 0.011547954413142518, "sim_compute_performance-ego0": 0.0018579957694032769}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.160057566852878, "get_ui_image": 0.0297445489919044, "step_physics": 0.10772284020389888, "survival_time": 29.400000000000283, "driven_lanedir": 2.046767981665535, "get_state_dump": 0.0042849659717346085, "get_robot_state": 0.00348747525433733, "sim_render-ego0": 0.0037700959903477407, "get_duckie_state": 1.1540430713388023e-06, "in-drivable-lane": 16.0000000000002, "deviation-heading": 4.990715249183248, "agent_compute-ego0": 0.012417119711080915, "complete-iteration": 0.17542783311348414, "set_robot_commands": 0.0020540072274329506, "deviation-center-line": 0.9129699070172044, "driven_lanedir_consec": 2.031241227948681, "sim_compute_sim_state": 0.009969889004485514, "sim_compute_performance-ego0": 0.0018969448393998205}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.929248332798675, "get_ui_image": 0.02436949112929472, "step_physics": 0.08925811118825488, "survival_time": 59.99999999999873, "driven_lanedir": 8.690159752569398, "get_state_dump": 0.004570933801744701, "get_robot_state": 0.003573957232015516, "sim_render-ego0": 0.0037302494446105703, "get_duckie_state": 1.263757430941338e-06, "in-drivable-lane": 9.14999999999987, "deviation-heading": 15.74805825720693, "agent_compute-ego0": 0.03391040493109939, "complete-iteration": 0.16940547881972084, "set_robot_commands": 0.002162568277363773, "deviation-center-line": 3.1905488772538573, "driven_lanedir_consec": 4.036246240045951, "sim_compute_sim_state": 0.005859066703535933, "sim_compute_performance-ego0": 0.0018903943124559896}}
set_robot_commands_max0.002162568277363773
set_robot_commands_mean0.0020602977148915028
set_robot_commands_median0.0020570704188807845
set_robot_commands_min0.001964481744440668
sim_compute_performance-ego0_max0.0018969448393998205
sim_compute_performance-ego0_mean0.0018625840686507856
sim_compute_performance-ego0_median0.001874195040929633
sim_compute_performance-ego0_min0.0018050013533440555
sim_compute_sim_state_max0.011547954413142518
sim_compute_sim_state_mean0.008987603657958065
sim_compute_sim_state_median0.009271696757576903
sim_compute_sim_state_min0.005859066703535933
sim_render-ego0_max0.0037700959903477407
sim_render-ego0_mean0.003668303856749245
sim_render-ego0_median0.0036744015258718767
sim_render-ego0_min0.0035543163849054826
simulation-passed1
step_physics_max0.13031475278582885
step_physics_mean0.10476418747200417
step_physics_median0.09974194295696644
step_physics_min0.08925811118825488
survival_time_max59.99999999999873
survival_time_mean51.03749999999919
survival_time_min29.400000000000283
No reset possible
5682911425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-010:02:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5681911278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5675111087Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3649202717185025
survival_time_median12.625000000000044
deviation-center-line_median0.3786386120517136
in-drivable-lane_median6.575000000000049


other stats
agent_compute-ego0_max0.01278337085520038
agent_compute-ego0_mean0.012532848849722132
agent_compute-ego0_median0.012618620707182934
agent_compute-ego0_min0.012110783129322284
complete-iteration_max0.1885316290174212
complete-iteration_mean0.1684989652857698
complete-iteration_median0.17023778949459764
complete-iteration_min0.1449886531364627
deviation-center-line_max1.7922510009548849
deviation-center-line_mean0.6795647744173773
deviation-center-line_min0.16873087261119746
deviation-heading_max6.585638569988409
deviation-heading_mean2.477362271131713
deviation-heading_median1.3644400164642887
deviation-heading_min0.5949304816098644
driven_any_max6.129330061964926
driven_any_mean2.9757330375027164
driven_any_median2.3517362258220293
driven_any_min1.0701296364018809
driven_lanedir_consec_max2.382149186246405
driven_lanedir_consec_mean1.4402784670549151
driven_lanedir_consec_min0.649124138536251
driven_lanedir_max4.5594261746880225
driven_lanedir_mean1.985641323858441
driven_lanedir_median1.3649202717185025
driven_lanedir_min0.6532985773087367
get_duckie_state_max1.3971328735351563e-06
get_duckie_state_mean1.3284660083276796e-06
get_duckie_state_median1.3456007561602896e-06
get_duckie_state_min1.225529647454983e-06
get_robot_state_max0.003658502156497868
get_robot_state_mean0.0035361871836447657
get_robot_state_median0.0035001024479870435
get_robot_state_min0.003486041682107108
get_state_dump_max0.004615305034258894
get_state_dump_mean0.004521025246557887
get_state_dump_median0.004562278242222422
get_state_dump_min0.004344239467527808
get_ui_image_max0.03287318059376308
get_ui_image_mean0.027841342785858467
get_ui_image_median0.027359193303064896
get_ui_image_min0.02377380394354099
in-drivable-lane_max11.699999999999928
in-drivable-lane_mean7.075000000000004
in-drivable-lane_min3.4499999999999877
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.1831742467877384, "get_ui_image": 0.025387765367246577, "step_physics": 0.09527864053019976, "survival_time": 17.100000000000108, "driven_lanedir": 2.053121243086689, "get_state_dump": 0.004585838873949412, "get_robot_state": 0.0035134654698497003, "sim_render-ego0": 0.0036366361223226385, "get_duckie_state": 1.3116497340077214e-06, "in-drivable-lane": 8.100000000000115, "deviation-heading": 1.5431368487202877, "agent_compute-ego0": 0.012110783129322284, "complete-iteration": 0.157897231877719, "set_robot_commands": 0.0020214079420351077, "deviation-center-line": 0.567387222474124, "driven_lanedir_consec": 2.053121243086689, "sim_compute_sim_state": 0.009377961256066146, "sim_compute_performance-ego0": 0.001897682601439362}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.129330061964926, "get_ui_image": 0.03287318059376308, "step_physics": 0.11658629689897808, "survival_time": 34.95000000000015, "driven_lanedir": 4.5594261746880225, "get_state_dump": 0.004538717610495431, "get_robot_state": 0.003486041682107108, "sim_render-ego0": 0.00364858763558524, "get_duckie_state": 1.3971328735351563e-06, "in-drivable-lane": 11.699999999999928, "deviation-heading": 6.585638569988409, "agent_compute-ego0": 0.012732697214399066, "complete-iteration": 0.1885316290174212, "set_robot_commands": 0.0020703067098345076, "deviation-center-line": 1.7922510009548849, "driven_lanedir_consec": 2.382149186246405, "sim_compute_sim_state": 0.010567306109837124, "sim_compute_performance-ego0": 0.0019366233689444405}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0701296364018809, "get_ui_image": 0.029330621238883216, "step_physics": 0.11660282848445512, "survival_time": 6.499999999999985, "driven_lanedir": 0.6532985773087367, "get_state_dump": 0.004615305034258894, "get_robot_state": 0.003658502156497868, "sim_render-ego0": 0.0036912565012924546, "get_duckie_state": 1.3795517783128578e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 1.18574318420829, "agent_compute-ego0": 0.01278337085520038, "complete-iteration": 0.18257834711147627, "set_robot_commands": 0.0021645531399559427, "deviation-center-line": 0.16873087261119746, "driven_lanedir_consec": 0.649124138536251, "sim_compute_sim_state": 0.007710955525172576, "sim_compute_performance-ego0": 0.0019350470477388104}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.52029820485632, "get_ui_image": 0.02377380394354099, "step_physics": 0.08829837601359297, "survival_time": 8.14999999999998, "driven_lanedir": 0.6767193003503156, "get_state_dump": 0.004344239467527808, "get_robot_state": 0.003486739426124386, "sim_render-ego0": 0.003568637661817597, "get_duckie_state": 1.225529647454983e-06, "in-drivable-lane": 5.049999999999984, "deviation-heading": 0.5949304816098644, "agent_compute-ego0": 0.012504544199966805, "complete-iteration": 0.1449886531364627, "set_robot_commands": 0.0020277936284135026, "deviation-center-line": 0.1898900016293031, "driven_lanedir_consec": 0.6767193003503156, "sim_compute_sim_state": 0.005094820406378769, "sim_compute_performance-ego0": 0.001809508335299608}}
set_robot_commands_max0.0021645531399559427
set_robot_commands_mean0.0020710153550597653
set_robot_commands_median0.002049050169124005
set_robot_commands_min0.0020214079420351077
sim_compute_performance-ego0_max0.0019366233689444405
sim_compute_performance-ego0_mean0.001894715338355555
sim_compute_performance-ego0_median0.0019163648245890863
sim_compute_performance-ego0_min0.001809508335299608
sim_compute_sim_state_max0.010567306109837124
sim_compute_sim_state_mean0.008187760824363654
sim_compute_sim_state_median0.008544458390619361
sim_compute_sim_state_min0.005094820406378769
sim_render-ego0_max0.0036912565012924546
sim_render-ego0_mean0.003636279480254482
sim_render-ego0_median0.003642611878953939
sim_render-ego0_min0.003568637661817597
simulation-passed1
step_physics_max0.11660282848445512
step_physics_mean0.1041915354818065
step_physics_median0.10593246871458892
step_physics_min0.08829837601359297
survival_time_max34.95000000000015
survival_time_mean16.675000000000058
survival_time_min6.499999999999985
No reset possible
5674311286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5672011281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669311284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5637511420Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-010:34:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.699242061385539
survival_time_median33.64999999999935
deviation-center-line_median1.6113918751975642
in-drivable-lane_median0.6749999999999976


other stats
agent_compute-ego0_max0.0490106319894596
agent_compute-ego0_mean0.0462070826829917
agent_compute-ego0_median0.0462070826829917
agent_compute-ego0_min0.04340353337652379
agent_compute-npc0_max0.041184113087205466
agent_compute-npc0_mean0.039649482055540294
agent_compute-npc0_median0.039649482055540294
agent_compute-npc0_min0.03811485102387513
agent_compute-npc1_max0.04352186502366141
agent_compute-npc1_mean0.04092439833608766
agent_compute-npc1_median0.04092439833608766
agent_compute-npc1_min0.0383269316485139
agent_compute-npc2_max0.042536741490169526
agent_compute-npc2_mean0.04049869919467139
agent_compute-npc2_median0.04049869919467139
agent_compute-npc2_min0.038460656899173246
complete-iteration_max1.305956402603461
complete-iteration_mean1.1783461971824547
complete-iteration_median1.1783461971824547
complete-iteration_min1.0507359917614485
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.6113918751975642
deviation-center-line_min0.3922829941343432
deviation-heading_max10.829028225443134
deviation-heading_mean6.452009420831732
deviation-heading_median6.452009420831732
deviation-heading_min2.0749906162203295
driven_any_max14.590269734375006
driven_any_mean8.060581239889531
driven_any_median8.060581239889531
driven_any_min1.5308927454040566
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.699242061385539
driven_lanedir_consec_min1.1132631631891798
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.699952379115072
driven_lanedir_median7.699952379115072
driven_lanedir_min1.1146836933606394
get_duckie_state_max1.493765383350606e-06
get_duckie_state_mean1.4440734075826198e-06
get_duckie_state_median1.4440734075826198e-06
get_duckie_state_min1.3943814318146335e-06
get_robot_state_max0.014940196965016476
get_robot_state_mean0.014533956600494023
get_robot_state_median0.014533956600494023
get_robot_state_min0.01412771623597157
get_state_dump_max0.009979900048703564
get_state_dump_mean0.009684996577856335
get_state_dump_median0.009684996577856335
get_state_dump_min0.009390093107009112
get_ui_image_max0.05213805283007979
get_ui_image_mean0.05150617787764882
get_ui_image_median0.05150617787764882
get_ui_image_min0.05087430292521786
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.6749999999999976
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.05087430292521786, "step_physics": 0.7319630780486044, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.009390093107009112, "get_robot_state": 0.01412771623597157, "sim_render-ego0": 0.003937299602930988, "sim_render-npc0": 0.003870021889946244, "sim_render-npc1": 0.0038459741701988457, "sim_render-npc2": 0.003914459460383152, "get_duckie_state": 1.3943814318146335e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.04340353337652379, "agent_compute-npc0": 0.041184113087205466, "agent_compute-npc1": 0.04352186502366141, "agent_compute-npc2": 0.042536741490169526, "complete-iteration": 1.0507359917614485, "set_robot_commands": 0.002270697554779688, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.04104001357295333, "sim_compute_performance-ego0": 0.0020881908124531436, "sim_compute_performance-npc0": 0.00195194501662433, "sim_compute_performance-npc1": 0.0019327798155721876, "sim_compute_performance-npc2": 0.0019648194213790957}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.5308927454040566, "get_ui_image": 0.05213805283007979, "step_physics": 0.9866156091495436, "survival_time": 7.299999999999982, "driven_lanedir": 1.1146836933606394, "get_state_dump": 0.009979900048703564, "get_robot_state": 0.014940196965016476, "sim_render-ego0": 0.004074643258334828, "sim_render-npc0": 0.004125053379811397, "sim_render-npc1": 0.004058946557596427, "sim_render-npc2": 0.004039311895565111, "get_duckie_state": 1.493765383350606e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 2.0749906162203295, "agent_compute-ego0": 0.0490106319894596, "agent_compute-npc0": 0.03811485102387513, "agent_compute-npc1": 0.0383269316485139, "agent_compute-npc2": 0.038460656899173246, "complete-iteration": 1.305956402603461, "set_robot_commands": 0.0023806743881329387, "deviation-center-line": 0.3922829941343432, "driven_lanedir_consec": 1.1132631631891798, "sim_compute_sim_state": 0.04391206851621874, "sim_compute_performance-ego0": 0.0022602081298828125, "sim_compute_performance-npc0": 0.0020450296856108167, "sim_compute_performance-npc1": 0.0020133183926952128, "sim_compute_performance-npc2": 0.0020596932391731106}}
set_robot_commands_max0.0023806743881329387
set_robot_commands_mean0.002325685971456313
set_robot_commands_median0.002325685971456313
set_robot_commands_min0.002270697554779688
sim_compute_performance-ego0_max0.0022602081298828125
sim_compute_performance-ego0_mean0.002174199471167978
sim_compute_performance-ego0_median0.002174199471167978
sim_compute_performance-ego0_min0.0020881908124531436
sim_compute_performance-npc0_max0.0020450296856108167
sim_compute_performance-npc0_mean0.0019984873511175736
sim_compute_performance-npc0_median0.0019984873511175736
sim_compute_performance-npc0_min0.00195194501662433
sim_compute_performance-npc1_max0.0020133183926952128
sim_compute_performance-npc1_mean0.0019730491041337
sim_compute_performance-npc1_median0.0019730491041337
sim_compute_performance-npc1_min0.0019327798155721876
sim_compute_performance-npc2_max0.0020596932391731106
sim_compute_performance-npc2_mean0.002012256330276103
sim_compute_performance-npc2_median0.002012256330276103
sim_compute_performance-npc2_min0.0019648194213790957
sim_compute_sim_state_max0.04391206851621874
sim_compute_sim_state_mean0.042476041044586035
sim_compute_sim_state_median0.042476041044586035
sim_compute_sim_state_min0.04104001357295333
sim_render-ego0_max0.004074643258334828
sim_render-ego0_mean0.004005971430632908
sim_render-ego0_median0.004005971430632908
sim_render-ego0_min0.003937299602930988
sim_render-npc0_max0.004125053379811397
sim_render-npc0_mean0.00399753763487882
sim_render-npc0_median0.00399753763487882
sim_render-npc0_min0.003870021889946244
sim_render-npc1_max0.004058946557596427
sim_render-npc1_mean0.0039524603638976365
sim_render-npc1_median0.0039524603638976365
sim_render-npc1_min0.0038459741701988457
sim_render-npc2_max0.004039311895565111
sim_render-npc2_mean0.003976885677974131
sim_render-npc2_median0.003976885677974131
sim_render-npc2_min0.003914459460383152
simulation-passed1
step_physics_max0.9866156091495436
step_physics_mean0.859289343599074
step_physics_median0.859289343599074
step_physics_min0.7319630780486044
survival_time_max59.99999999999873
survival_time_mean33.64999999999935
survival_time_min7.299999999999982
No reset possible
5633411287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5628111296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:59
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5623611303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:20
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5621511303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614311427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:05:26
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5581011420Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-010:32:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.665155402812414
survival_time_median33.74999999999935
deviation-center-line_median1.6090880741690232
in-drivable-lane_median0.8749999999999969


other stats
agent_compute-ego0_max0.04768930997280096
agent_compute-ego0_mean0.04586975220686658
agent_compute-ego0_median0.04586975220686658
agent_compute-ego0_min0.0440501944409322
agent_compute-npc0_max0.0400297286409224
agent_compute-npc0_mean0.03755298394603275
agent_compute-npc0_median0.03755298394603275
agent_compute-npc0_min0.035076239251143095
agent_compute-npc1_max0.04148680125545403
agent_compute-npc1_mean0.038362797304807385
agent_compute-npc1_median0.038362797304807385
agent_compute-npc1_min0.03523879335416074
agent_compute-npc2_max0.04213087743366886
agent_compute-npc2_mean0.03879863605536815
agent_compute-npc2_median0.03879863605536815
agent_compute-npc2_min0.035466394677067435
complete-iteration_max1.184266137760996
complete-iteration_mean1.0991736227238478
complete-iteration_median1.0991736227238478
complete-iteration_min1.0140811076866996
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.6090880741690232
deviation-center-line_min0.3876753920772613
deviation-heading_max10.829028225443134
deviation-heading_mean6.632123016152777
deviation-heading_median6.632123016152777
deviation-heading_min2.43521780686242
driven_any_max14.590269734375006
driven_any_mean8.085035335078556
driven_any_median8.085035335078556
driven_any_min1.5798009357821077
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.665155402812414
driven_lanedir_consec_min1.0450898460429292
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.665317055922134
driven_lanedir_median7.665317055922134
driven_lanedir_min1.045413046974765
get_duckie_state_max1.454333480847666e-06
get_duckie_state_mean1.4511065981593722e-06
get_duckie_state_median1.4511065981593722e-06
get_duckie_state_min1.4478797154710782e-06
get_robot_state_max0.014379018189891284
get_robot_state_mean0.014266350702623092
get_robot_state_median0.014266350702623092
get_robot_state_min0.0141536832153549
get_state_dump_max0.009450259157064851
get_state_dump_mean0.009342159046487756
get_state_dump_median0.009342159046487756
get_state_dump_min0.00923405893591066
get_ui_image_max0.04977488914794668
get_ui_image_mean0.04884094395745763
get_ui_image_median0.04884094395745763
get_ui_image_min0.047906998766968585
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.8749999999999969
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.04977488914794668, "step_physics": 0.7005468856087335, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.009450259157064851, "get_robot_state": 0.0141536832153549, "sim_render-ego0": 0.0039516620890087725, "sim_render-npc0": 0.00391054411514117, "sim_render-npc1": 0.003898714305359954, "sim_render-npc2": 0.004020702630455151, "get_duckie_state": 1.454333480847666e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.0440501944409322, "agent_compute-npc0": 0.0400297286409224, "agent_compute-npc1": 0.04148680125545403, "agent_compute-npc2": 0.04213087743366886, "complete-iteration": 1.0140811076866996, "set_robot_commands": 0.0022639148340534905, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.03966125362024617, "sim_compute_performance-ego0": 0.0021127250966779597, "sim_compute_performance-npc0": 0.001967376316715339, "sim_compute_performance-npc1": 0.001958750765289891, "sim_compute_performance-npc2": 0.0019806830908833295}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.5798009357821077, "get_ui_image": 0.047906998766968585, "step_physics": 0.8887001741800876, "survival_time": 7.499999999999981, "driven_lanedir": 1.045413046974765, "get_state_dump": 0.00923405893591066, "get_robot_state": 0.014379018189891284, "sim_render-ego0": 0.00395323582832387, "sim_render-npc0": 0.0038274550280034143, "sim_render-npc1": 0.003827423449383666, "sim_render-npc2": 0.0037581794309300303, "get_duckie_state": 1.4478797154710782e-06, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 2.43521780686242, "agent_compute-ego0": 0.04768930997280096, "agent_compute-npc0": 0.035076239251143095, "agent_compute-npc1": 0.03523879335416074, "agent_compute-npc2": 0.035466394677067435, "complete-iteration": 1.184266137760996, "set_robot_commands": 0.002147889295161165, "deviation-center-line": 0.3876753920772613, "driven_lanedir_consec": 1.0450898460429292, "sim_compute_sim_state": 0.03860953627832678, "sim_compute_performance-ego0": 0.002055856565765987, "sim_compute_performance-npc0": 0.001877001579234142, "sim_compute_performance-npc1": 0.0019512650192968104, "sim_compute_performance-npc2": 0.0018905472281752832}}
set_robot_commands_max0.0022639148340534905
set_robot_commands_mean0.002205902064607328
set_robot_commands_median0.002205902064607328
set_robot_commands_min0.002147889295161165
sim_compute_performance-ego0_max0.0021127250966779597
sim_compute_performance-ego0_mean0.002084290831221973
sim_compute_performance-ego0_median0.002084290831221973
sim_compute_performance-ego0_min0.002055856565765987
sim_compute_performance-npc0_max0.001967376316715339
sim_compute_performance-npc0_mean0.0019221889479747408
sim_compute_performance-npc0_median0.0019221889479747408
sim_compute_performance-npc0_min0.001877001579234142
sim_compute_performance-npc1_max0.001958750765289891
sim_compute_performance-npc1_mean0.0019550078922933507
sim_compute_performance-npc1_median0.0019550078922933507
sim_compute_performance-npc1_min0.0019512650192968104
sim_compute_performance-npc2_max0.0019806830908833295
sim_compute_performance-npc2_mean0.0019356151595293063
sim_compute_performance-npc2_median0.0019356151595293063
sim_compute_performance-npc2_min0.0018905472281752832
sim_compute_sim_state_max0.03966125362024617
sim_compute_sim_state_mean0.03913539494928647
sim_compute_sim_state_median0.03913539494928647
sim_compute_sim_state_min0.03860953627832678
sim_render-ego0_max0.00395323582832387
sim_render-ego0_mean0.003952448958666321
sim_render-ego0_median0.003952448958666321
sim_render-ego0_min0.0039516620890087725
sim_render-npc0_max0.00391054411514117
sim_render-npc0_mean0.0038689995715722927
sim_render-npc0_median0.0038689995715722927
sim_render-npc0_min0.0038274550280034143
sim_render-npc1_max0.003898714305359954
sim_render-npc1_mean0.00386306887737181
sim_render-npc1_median0.00386306887737181
sim_render-npc1_min0.003827423449383666
sim_render-npc2_max0.004020702630455151
sim_render-npc2_mean0.0038894410306925904
sim_render-npc2_median0.0038894410306925904
sim_render-npc2_min0.0037581794309300303
simulation-passed1
step_physics_max0.8887001741800876
step_physics_mean0.7946235298944105
step_physics_median0.7946235298944105
step_physics_min0.7005468856087335
survival_time_max59.99999999999873
survival_time_mean33.74999999999935
survival_time_min7.499999999999981
No reset possible
5579511285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5574311160Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5572011299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5569411308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5567311450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-010:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5565411450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-010:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5562711289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5557511310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5554211290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:06
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5550511282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5547011291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5541211224Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5536311311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5534011305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5528411306Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5525311283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5521211302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5520211301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5517311307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5483411357Bhavya Patwa 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:31:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.052996671565389
survival_time_median57.62499999999886
deviation-center-line_median3.3248008638699815
in-drivable-lane_median20.824999999999797


other stats
agent_compute-ego0_max0.012771555823549245
agent_compute-ego0_mean0.01243498688430452
agent_compute-ego0_median0.012559500406123398
agent_compute-ego0_min0.011849390901422032
complete-iteration_max0.19720635297716635
complete-iteration_mean0.17676850730768884
complete-iteration_median0.17843848221817593
complete-iteration_min0.15299071181723717
deviation-center-line_max3.8991900612264865
deviation-center-line_mean2.8516707628154996
deviation-center-line_min0.8578912622955495
deviation-heading_max19.26247552651446
deviation-heading_mean10.460898558422402
deviation-heading_median10.328952986838775
deviation-heading_min1.923212733497597
driven_any_max8.211329003346226
driven_any_mean7.251003434352658
driven_any_median7.699013219212486
driven_any_min5.394658295639436
driven_lanedir_consec_max6.101565294544656
driven_lanedir_consec_mean4.085816011239055
driven_lanedir_consec_min2.135705407280786
driven_lanedir_max6.387568205751865
driven_lanedir_mean4.6610688174837085
driven_lanedir_median5.060500828451091
driven_lanedir_min2.135705407280786
get_duckie_state_max1.4136971444376555e-06
get_duckie_state_mean1.2573016469998253e-06
get_duckie_state_median1.2254059276139337e-06
get_duckie_state_min1.1646975883337778e-06
get_robot_state_max0.0037856647377635
get_robot_state_mean0.003615032996766608
get_robot_state_median0.003634343415139017
get_robot_state_min0.003405780419024897
get_state_dump_max0.005006976766848346
get_state_dump_mean0.004824359596002784
get_state_dump_median0.00486648127919939
get_state_dump_min0.00455749905876401
get_ui_image_max0.03306369757672135
get_ui_image_mean0.02907762932325511
get_ui_image_median0.028916002528548937
get_ui_image_min0.025414814659201236
in-drivable-lane_max33.3499999999995
in-drivable-lane_mean21.774999999999743
in-drivable-lane_min12.09999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.394658295639436, "get_ui_image": 0.02629785085322423, "step_physics": 0.10296634135355476, "survival_time": 45.799999999999535, "driven_lanedir": 2.135705407280786, "get_state_dump": 0.00455749905876401, "get_robot_state": 0.00362054628270273, "sim_render-ego0": 0.003734083706056019, "get_duckie_state": 1.1926128924087974e-06, "in-drivable-lane": 33.3499999999995, "deviation-heading": 1.923212733497597, "agent_compute-ego0": 0.011849390901422032, "complete-iteration": 0.16768227564729546, "set_robot_commands": 0.002178606056205059, "deviation-center-line": 0.8578912622955495, "driven_lanedir_consec": 2.135705407280786, "sim_compute_sim_state": 0.010414951630221068, "sim_compute_performance-ego0": 0.001978083551255021}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.332453614428545, "get_ui_image": 0.03306369757672135, "step_physics": 0.11664894379545113, "survival_time": 59.99999999999873, "driven_lanedir": 4.899455598493713, "get_state_dump": 0.005006976766848346, "get_robot_state": 0.003405780419024897, "sim_render-ego0": 0.00362152580813901, "get_duckie_state": 1.1646975883337778e-06, "in-drivable-lane": 18.399999999999604, "deviation-heading": 19.26247552651446, "agent_compute-ego0": 0.012771555823549245, "complete-iteration": 0.1891946887890564, "set_robot_commands": 0.002059670511034506, "deviation-center-line": 3.5206941586721694, "driven_lanedir_consec": 2.88444728472231, "sim_compute_sim_state": 0.010711328870152356, "sim_compute_performance-ego0": 0.001824219161326641}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.211329003346226, "get_ui_image": 0.03153415420387365, "step_physics": 0.12466700878971092, "survival_time": 55.249999999999, "driven_lanedir": 6.387568205751865, "get_state_dump": 0.004872095089062213, "get_robot_state": 0.0037856647377635, "sim_render-ego0": 0.0038838364978810978, "get_duckie_state": 1.4136971444376555e-06, "in-drivable-lane": 12.09999999999989, "deviation-heading": 10.945578111571525, "agent_compute-ego0": 0.0125859421804197, "complete-iteration": 0.19720635297716635, "set_robot_commands": 0.002290340918528883, "deviation-center-line": 3.128907569067793, "driven_lanedir_consec": 6.101565294544656, "sim_compute_sim_state": 0.011383248065306956, "sim_compute_performance-ego0": 0.0021051681494411033}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.065572823996428, "get_ui_image": 0.025414814659201236, "step_physics": 0.09257942333904332, "survival_time": 59.99999999999873, "driven_lanedir": 5.221546058408469, "get_state_dump": 0.0048608674693365675, "get_robot_state": 0.003648140547575303, "sim_render-ego0": 0.003718812300898848, "get_duckie_state": 1.25819896281907e-06, "in-drivable-lane": 23.249999999999982, "deviation-heading": 9.71232786210603, "agent_compute-ego0": 0.012533058631827096, "complete-iteration": 0.15299071181723717, "set_robot_commands": 0.0021914504747605145, "deviation-center-line": 3.8991900612264865, "driven_lanedir_consec": 5.221546058408469, "sim_compute_sim_state": 0.006038457924479946, "sim_compute_performance-ego0": 0.001921955095937508}}
set_robot_commands_max0.002290340918528883
set_robot_commands_mean0.0021800169901322404
set_robot_commands_median0.0021850282654827867
set_robot_commands_min0.002059670511034506
sim_compute_performance-ego0_max0.0021051681494411033
sim_compute_performance-ego0_mean0.001957356489490068
sim_compute_performance-ego0_median0.001950019323596265
sim_compute_performance-ego0_min0.001824219161326641
sim_compute_sim_state_max0.011383248065306956
sim_compute_sim_state_mean0.00963699662254008
sim_compute_sim_state_median0.010563140250186712
sim_compute_sim_state_min0.006038457924479946
sim_render-ego0_max0.0038838364978810978
sim_render-ego0_mean0.003739564578243744
sim_render-ego0_median0.0037264480034774334
sim_render-ego0_min0.00362152580813901
simulation-passed1
step_physics_max0.12466700878971092
step_physics_mean0.10921542931944005
step_physics_median0.10980764257450291
step_physics_min0.09257942333904332
survival_time_max59.99999999999873
survival_time_mean55.262499999998994
survival_time_min45.799999999999535
No reset possible
5482811424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5482211436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5481111436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5469111386Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:17:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3883120925527406
survival_time_median27.75000000000026
deviation-center-line_median0.36948245850564226
in-drivable-lane_median20.3500000000002


other stats
agent_compute-ego0_max0.012370042051699276
agent_compute-ego0_mean0.012038592986558232
agent_compute-ego0_median0.012069626569508787
agent_compute-ego0_min0.011645076755516069
complete-iteration_max0.2125562369823456
complete-iteration_mean0.1818469291975556
complete-iteration_median0.18263627556677411
complete-iteration_min0.1495589286743286
deviation-center-line_max0.6898254114400566
deviation-center-line_mean0.393119997226063
deviation-center-line_min0.14368966045291093
deviation-heading_max4.624430490402431
deviation-heading_mean2.066362081256106
deviation-heading_median1.431048305209981
deviation-heading_min0.7789212242020314
driven_any_max10.813324680706552
driven_any_mean5.775476251239182
driven_any_median5.4754387080527955
driven_any_min1.3377029081445826
driven_lanedir_consec_max2.2337192061364632
driven_lanedir_consec_mean1.4276713252843052
driven_lanedir_consec_min0.7003419098952763
driven_lanedir_max2.253400928845423
driven_lanedir_mean1.432591755961545
driven_lanedir_median1.3883120925527406
driven_lanedir_min0.7003419098952763
get_duckie_state_max2.036721201813448e-06
get_duckie_state_mean1.9276671331767888e-06
get_duckie_state_median1.9073315611057313e-06
get_duckie_state_min1.8592842086822448e-06
get_robot_state_max0.0038272589445114136
get_robot_state_mean0.003687080084494251
get_robot_state_median0.003689254590117291
get_robot_state_min0.003542552213231009
get_state_dump_max0.004728488563125535
get_state_dump_mean0.004591227089885477
get_state_dump_median0.004592423510168835
get_state_dump_min0.004451572776078702
get_ui_image_max0.03469722867012024
get_ui_image_mean0.02988439799671564
get_ui_image_median0.030057802382499083
get_ui_image_min0.024724758551744167
in-drivable-lane_max40.99999999999932
in-drivable-lane_mean21.374999999999925
in-drivable-lane_min3.7999999999999865
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.813324680706552, "get_ui_image": 0.027649299311661792, "step_physics": 0.10602847838712672, "survival_time": 49.79999999999931, "driven_lanedir": 2.009414352865498, "get_state_dump": 0.004559723281095117, "get_robot_state": 0.0035908363288718694, "sim_render-ego0": 0.003742520524601759, "get_duckie_state": 2.036721201813448e-06, "in-drivable-lane": 40.99999999999932, "deviation-heading": 1.8063418322275593, "agent_compute-ego0": 0.012142340182779784, "complete-iteration": 0.17121366655814613, "set_robot_commands": 0.0021645398651704627, "deviation-center-line": 0.4982725472377107, "driven_lanedir_consec": 2.009414352865498, "sim_compute_sim_state": 0.009316932712658238, "sim_compute_performance-ego0": 0.001933716005882026}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3377029081445826, "get_ui_image": 0.03469722867012024, "step_physics": 0.1390368953347206, "survival_time": 7.94999999999998, "driven_lanedir": 0.767209832239983, "get_state_dump": 0.0046251237392425535, "get_robot_state": 0.0038272589445114136, "sim_render-ego0": 0.003814920783042908, "get_duckie_state": 1.9162893295288085e-06, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 1.0557547781924028, "agent_compute-ego0": 0.011996912956237792, "complete-iteration": 0.2125562369823456, "set_robot_commands": 0.0022927090525627137, "deviation-center-line": 0.24069236977357375, "driven_lanedir_consec": 0.767209832239983, "sim_compute_sim_state": 0.01006009876728058, "sim_compute_performance-ego0": 0.0021182745695114136}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.647484972541695, "get_ui_image": 0.032466305453336376, "step_physics": 0.12059236782467309, "survival_time": 30.5000000000003, "driven_lanedir": 2.253400928845423, "get_state_dump": 0.004728488563125535, "get_robot_state": 0.003787672851362712, "sim_render-ego0": 0.0038539056106792146, "get_duckie_state": 1.898373792682654e-06, "in-drivable-lane": 18.900000000000176, "deviation-heading": 4.624430490402431, "agent_compute-ego0": 0.012370042051699276, "complete-iteration": 0.1940588845754021, "set_robot_commands": 0.0023091202281695926, "deviation-center-line": 0.6898254114400566, "driven_lanedir_consec": 2.2337192061364632, "sim_compute_sim_state": 0.011757341422347896, "sim_compute_performance-ego0": 0.0021041820950672007}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.303392443563896, "get_ui_image": 0.024724758551744167, "step_physics": 0.09150201260686634, "survival_time": 25.00000000000022, "driven_lanedir": 0.7003419098952763, "get_state_dump": 0.004451572776078702, "get_robot_state": 0.003542552213231009, "sim_render-ego0": 0.003640527972680128, "get_duckie_state": 1.8592842086822448e-06, "in-drivable-lane": 21.800000000000225, "deviation-heading": 0.7789212242020314, "agent_compute-ego0": 0.011645076755516069, "complete-iteration": 0.1495589286743286, "set_robot_commands": 0.0021190576686592635, "deviation-center-line": 0.14368966045291093, "driven_lanedir_consec": 0.7003419098952763, "sim_compute_sim_state": 0.005997648258171158, "sim_compute_performance-ego0": 0.001851672897795717}}
set_robot_commands_max0.0023091202281695926
set_robot_commands_mean0.002221356703640508
set_robot_commands_median0.002228624458866588
set_robot_commands_min0.0021190576686592635
sim_compute_performance-ego0_max0.0021182745695114136
sim_compute_performance-ego0_mean0.002001961392064089
sim_compute_performance-ego0_median0.002018949050474613
sim_compute_performance-ego0_min0.001851672897795717
sim_compute_sim_state_max0.011757341422347896
sim_compute_sim_state_mean0.009283005290114468
sim_compute_sim_state_median0.009688515739969409
sim_compute_sim_state_min0.005997648258171158
sim_render-ego0_max0.0038539056106792146
sim_render-ego0_mean0.0037629687227510025
sim_render-ego0_median0.003778720653822333
sim_render-ego0_min0.003640527972680128
simulation-passed1
step_physics_max0.1390368953347206
step_physics_mean0.1142899385383467
step_physics_median0.1133104231058999
step_physics_min0.09150201260686634
survival_time_max49.79999999999931
survival_time_mean28.31249999999995
survival_time_min7.94999999999998
No reset possible
5463711404Marton Moro 🇭🇺template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:04:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01374986105495029
agent_compute-ego0_mean0.01258497481661904
agent_compute-ego0_median0.012493131543885368
agent_compute-ego0_min0.011603775123755137
complete-iteration_max0.20199314925981604
complete-iteration_mean0.18015782775011444
complete-iteration_median0.17893184245722538
complete-iteration_min0.16077447682619095
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.483493381076389e-06
get_duckie_state_mean1.2876918222870234e-06
get_duckie_state_median1.247956531460275e-06
get_duckie_state_min1.1713608451511548e-06
get_robot_state_max0.004249385640591006
get_robot_state_mean0.003971843268647804
get_robot_state_median0.003999243179957072
get_robot_state_min0.003639501074086065
get_state_dump_max0.010063547122327588
get_state_dump_mean0.006817231153525877
get_state_dump_median0.006129403081205156
get_state_dump_min0.004946571329365606
get_ui_image_max0.03565746545791626
get_ui_image_mean0.030594208740148537
get_ui_image_median0.030239848103033675
get_ui_image_min0.026239673296610515
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02898878085462353, "step_physics": 0.09142412716829323, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.010063547122327588, "get_robot_state": 0.004249385640591006, "sim_render-ego0": 0.003845109215265588, "get_duckie_state": 1.26905079129376e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.013345543342300608, "complete-iteration": 0.16575353055060665, "set_robot_commands": 0.002790790569933155, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009048111831085592, "sim_compute_performance-ego0": 0.001919258998919137}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03565746545791626, "step_physics": 0.12903790370277737, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004946571329365606, "get_robot_state": 0.003639501074086065, "sim_render-ego0": 0.0037907465644504714, "get_duckie_state": 1.1713608451511548e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011640719745470127, "complete-iteration": 0.20199314925981604, "set_robot_commands": 0.0021876407706219216, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008916525737099026, "sim_compute_performance-ego0": 0.002090062784112018}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03149091535144382, "step_physics": 0.11883705854415894, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.007281704081429375, "get_robot_state": 0.00417599081993103, "sim_render-ego0": 0.004639880524741279, "get_duckie_state": 1.483493381076389e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01374986105495029, "complete-iteration": 0.19211015436384413, "set_robot_commands": 0.0027247567971547446, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007222304741541545, "sim_compute_performance-ego0": 0.0019038915634155271}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.026239673296610515, "step_physics": 0.100522776444753, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004977102080980937, "get_robot_state": 0.0038224955399831138, "sim_render-ego0": 0.003950489064057668, "get_duckie_state": 1.2268622716267905e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011603775123755137, "complete-iteration": 0.16077447682619095, "set_robot_commands": 0.0022595797975858054, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.00512553999821345, "sim_compute_performance-ego0": 0.0021862139304478965}}
set_robot_commands_max0.002790790569933155
set_robot_commands_mean0.002490691983823906
set_robot_commands_median0.002492168297370275
set_robot_commands_min0.0021876407706219216
sim_compute_performance-ego0_max0.0021862139304478965
sim_compute_performance-ego0_mean0.002024856819223645
sim_compute_performance-ego0_median0.0020046608915155776
sim_compute_performance-ego0_min0.0019038915634155271
sim_compute_sim_state_max0.009048111831085592
sim_compute_sim_state_mean0.007578120576984903
sim_compute_sim_state_median0.008069415239320286
sim_compute_sim_state_min0.00512553999821345
sim_render-ego0_max0.004639880524741279
sim_render-ego0_mean0.004056556342128752
sim_render-ego0_median0.003897799139661628
sim_render-ego0_min0.0037907465644504714
simulation-passed1
step_physics_max0.12903790370277737
step_physics_mean0.10995546646499564
step_physics_median0.10967991749445596
step_physics_min0.09142412716829323
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5460511439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5449111490Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:38:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.422477213562413
survival_time_median59.99999999999873
deviation-center-line_median2.781501601908247
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.0130822708167998
agent_compute-ego0_mean0.012775067485043846
agent_compute-ego0_median0.012786428299077246
agent_compute-ego0_min0.012445142525221088
complete-iteration_max0.24156587745228175
complete-iteration_mean0.20956119599687767
complete-iteration_median0.2131816616264807
complete-iteration_min0.17031558328226742
deviation-center-line_max2.92446885396997
deviation-center-line_mean2.6538103761604352
deviation-center-line_min2.127769446855277
deviation-heading_max12.199101698530743
deviation-heading_mean10.23043030398243
deviation-heading_median10.202391717937656
deviation-heading_min8.31783608152367
driven_any_max11.673212531935349
driven_any_mean11.670536717913516
driven_any_median11.67291300448995
driven_any_min11.663108330738815
driven_lanedir_consec_max11.497027892448044
driven_lanedir_consec_mean11.366936641401889
driven_lanedir_consec_min11.125764246034688
driven_lanedir_max11.497027892448044
driven_lanedir_mean11.366936641401889
driven_lanedir_median11.422477213562413
driven_lanedir_min11.125764246034688
get_duckie_state_max2.2231887321885084e-06
get_duckie_state_mean2.038369667123101e-06
get_duckie_state_median2.0373770835298383e-06
get_duckie_state_min1.855535769244217e-06
get_robot_state_max0.004097994916345753
get_robot_state_mean0.003935772413814396
get_robot_state_median0.003949477710295081
get_robot_state_min0.0037461393183216662
get_state_dump_max0.0051353186195240135
get_state_dump_mean0.004978230950437319
get_state_dump_median0.004977837788076027
get_state_dump_min0.004821929606073206
get_ui_image_max0.03585432629898923
get_ui_image_mean0.031129221386159093
get_ui_image_median0.03139990434162226
get_ui_image_min0.025862750562402628
in-drivable-lane_max0.949999999999946
in-drivable-lane_mean0.2374999999999865
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.673212531935349, "get_ui_image": 0.029018382644970947, "step_physics": 0.1190323287700237, "survival_time": 59.99999999999873, "driven_lanedir": 11.497027892448044, "get_state_dump": 0.0051353186195240135, "get_robot_state": 0.004021622556929386, "sim_render-ego0": 0.004006056265469693, "get_duckie_state": 2.2231887321885084e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.31783608152367, "agent_compute-ego0": 0.012952595725841664, "complete-iteration": 0.18865028051015836, "set_robot_commands": 0.0023837131227085135, "deviation-center-line": 2.7355549774603687, "driven_lanedir_consec": 11.497027892448044, "sim_compute_sim_state": 0.009845468424242006, "sim_compute_performance-ego0": 0.0021615326156425637}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.6728705639903, "get_ui_image": 0.03585432629898923, "step_physics": 0.1622016854726901, "survival_time": 59.99999999999873, "driven_lanedir": 11.3595556988325, "get_state_dump": 0.004830678634897656, "get_robot_state": 0.003877332863660776, "sim_render-ego0": 0.003876630908543621, "get_duckie_state": 1.950426760760076e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.430898295559585, "agent_compute-ego0": 0.012445142525221088, "complete-iteration": 0.24156587745228175, "set_robot_commands": 0.0022561859826461957, "deviation-center-line": 2.92446885396997, "driven_lanedir_consec": 11.3595556988325, "sim_compute_sim_state": 0.014000705437894468, "sim_compute_performance-ego0": 0.0021359856976359017}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.663108330738815, "get_ui_image": 0.03378142603827357, "step_physics": 0.15916883657615846, "survival_time": 59.99999999999873, "driven_lanedir": 11.125764246034688, "get_state_dump": 0.005124996941254399, "get_robot_state": 0.004097994916345753, "sim_render-ego0": 0.004158822424108043, "get_duckie_state": 2.1243274062996005e-06, "in-drivable-lane": 0.949999999999946, "deviation-heading": 12.199101698530743, "agent_compute-ego0": 0.0130822708167998, "complete-iteration": 0.23771304274280303, "set_robot_commands": 0.002445129431058326, "deviation-center-line": 2.827448226356125, "driven_lanedir_consec": 11.125764246034688, "sim_compute_sim_state": 0.01339392578671318, "sim_compute_performance-ego0": 0.0023632655036538767}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.672955444989595, "get_ui_image": 0.025862750562402628, "step_physics": 0.10945452004050732, "survival_time": 59.99999999999873, "driven_lanedir": 11.485398728292322, "get_state_dump": 0.004821929606073206, "get_robot_state": 0.0037461393183216662, "sim_render-ego0": 0.003615345585653923, "get_duckie_state": 1.855535769244217e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.973885140315726, "agent_compute-ego0": 0.012620260872312827, "complete-iteration": 0.17031558328226742, "set_robot_commands": 0.0021029094375241905, "deviation-center-line": 2.127769446855277, "driven_lanedir_consec": 11.485398728292322, "sim_compute_sim_state": 0.006118194943760754, "sim_compute_performance-ego0": 0.001893588644975826}}
set_robot_commands_max0.002445129431058326
set_robot_commands_mean0.0022969844934843065
set_robot_commands_median0.0023199495526773544
set_robot_commands_min0.0021029094375241905
sim_compute_performance-ego0_max0.0023632655036538767
sim_compute_performance-ego0_mean0.0021385931154770423
sim_compute_performance-ego0_median0.002148759156639233
sim_compute_performance-ego0_min0.001893588644975826
sim_compute_sim_state_max0.014000705437894468
sim_compute_sim_state_mean0.010839573648152604
sim_compute_sim_state_median0.011619697105477594
sim_compute_sim_state_min0.006118194943760754
sim_render-ego0_max0.004158822424108043
sim_render-ego0_mean0.00391421379594382
sim_render-ego0_median0.003941343587006657
sim_render-ego0_min0.003615345585653923
simulation-passed1
step_physics_max0.1622016854726901
step_physics_mean0.1374643427148449
step_physics_median0.13910058267309108
step_physics_min0.10945452004050732
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5440111551Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:38:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.039144432084091
survival_time_median59.99999999999873
deviation-center-line_median3.670433777350011
in-drivable-lane_median2.0999999999999925


other stats
agent_compute-ego0_max0.0132758595564284
agent_compute-ego0_mean0.013044268165798012
agent_compute-ego0_median0.013136449205587548
agent_compute-ego0_min0.012628314695588555
complete-iteration_max0.23559942253424068
complete-iteration_mean0.2072577606033624
complete-iteration_median0.20864758344613743
complete-iteration_min0.176136452986934
deviation-center-line_max4.345952126353925
deviation-center-line_mean3.768349692109795
deviation-center-line_min3.3865790873852326
deviation-heading_max14.25204333962627
deviation-heading_mean12.3954587355142
deviation-heading_median11.922591673384597
deviation-heading_min11.484608255661346
driven_any_max12.424321274887031
driven_any_mean11.383414442316171
driven_any_median11.331532890687196
driven_any_min10.446270713003267
driven_lanedir_consec_max12.06667124560267
driven_lanedir_consec_mean10.403482287506844
driven_lanedir_consec_min9.468969040256516
driven_lanedir_max12.06667124560267
driven_lanedir_mean10.403482287506844
driven_lanedir_median10.039144432084091
driven_lanedir_min9.468969040256516
get_duckie_state_max1.6419317799742076e-06
get_duckie_state_mean1.47964436247585e-06
get_duckie_state_median1.4895701984084713e-06
get_duckie_state_min1.29750527311225e-06
get_robot_state_max0.004185837770282577
get_robot_state_mean0.004010652274910755
get_robot_state_median0.004017024611950318
get_robot_state_min0.0038227221054598056
get_state_dump_max0.005218783981297832
get_state_dump_mean0.005081937573136735
get_state_dump_median0.005102629963305471
get_state_dump_min0.0049037063846381675
get_ui_image_max0.037161346875459925
get_ui_image_mean0.03253755273668097
get_ui_image_median0.0327586085472774
get_ui_image_min0.027471646976709167
in-drivable-lane_max9.049999999999946
in-drivable-lane_mean3.3124999999999822
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.424321274887031, "get_ui_image": 0.030954567220784743, "step_physics": 0.12444587214404002, "survival_time": 59.99999999999873, "driven_lanedir": 12.06667124560267, "get_state_dump": 0.005218783981297832, "get_robot_state": 0.004185837770282577, "sim_render-ego0": 0.004230737884673945, "get_duckie_state": 1.6419317799742076e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.044135665817684, "agent_compute-ego0": 0.01322124443085962, "complete-iteration": 0.197580204915246, "set_robot_commands": 0.0025328752103197286, "deviation-center-line": 3.4515254464077683, "driven_lanedir_consec": 12.06667124560267, "sim_compute_sim_state": 0.010311978147190676, "sim_compute_performance-ego0": 0.0023739069923572396}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.446270713003267, "get_ui_image": 0.037161346875459925, "step_physics": 0.15468876645725832, "survival_time": 59.99999999999873, "driven_lanedir": 9.940131374641435, "get_state_dump": 0.0049037063846381675, "get_robot_state": 0.0038227221054598056, "sim_render-ego0": 0.003968974533525732, "get_duckie_state": 1.29750527311225e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 14.25204333962627, "agent_compute-ego0": 0.012628314695588555, "complete-iteration": 0.23559942253424068, "set_robot_commands": 0.0023064619297786717, "deviation-center-line": 4.345952126353925, "driven_lanedir_consec": 9.940131374641435, "sim_compute_sim_state": 0.0138938538140798, "sim_compute_performance-ego0": 0.0021325537406038384}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.51028320855683, "get_ui_image": 0.03456264987377005, "step_physics": 0.13976874617513868, "survival_time": 59.99999999999873, "driven_lanedir": 9.468969040256516, "get_state_dump": 0.005162759387026619, "get_robot_state": 0.004079317669388059, "sim_render-ego0": 0.004144509368693203, "get_duckie_state": 1.5041611772294246e-06, "in-drivable-lane": 9.049999999999946, "deviation-heading": 11.801047680951504, "agent_compute-ego0": 0.0132758595564284, "complete-iteration": 0.21971496197702883, "set_robot_commands": 0.002431182043439244, "deviation-center-line": 3.3865790873852326, "driven_lanedir_consec": 9.468969040256516, "sim_compute_sim_state": 0.013909766120180102, "sim_compute_performance-ego0": 0.002275781170910939}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.15278257281756, "get_ui_image": 0.027471646976709167, "step_physics": 0.1113235305290635, "survival_time": 59.99999999999873, "driven_lanedir": 10.138157489526751, "get_state_dump": 0.005042500539584323, "get_robot_state": 0.003954731554512577, "sim_render-ego0": 0.004029397067181971, "get_duckie_state": 1.474979219587518e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 11.484608255661346, "agent_compute-ego0": 0.013051653980315476, "complete-iteration": 0.176136452986934, "set_robot_commands": 0.002380050092215939, "deviation-center-line": 3.8893421082922544, "driven_lanedir_consec": 10.138157489526751, "sim_compute_sim_state": 0.006670780324816803, "sim_compute_performance-ego0": 0.0021200446066113932}}
set_robot_commands_max0.0025328752103197286
set_robot_commands_mean0.002412642318938396
set_robot_commands_median0.002405616067827592
set_robot_commands_min0.0023064619297786717
sim_compute_performance-ego0_max0.0023739069923572396
sim_compute_performance-ego0_mean0.002225571627620853
sim_compute_performance-ego0_median0.002204167455757389
sim_compute_performance-ego0_min0.0021200446066113932
sim_compute_sim_state_max0.013909766120180102
sim_compute_sim_state_mean0.011196594601566846
sim_compute_sim_state_median0.012102915980635238
sim_compute_sim_state_min0.006670780324816803
sim_render-ego0_max0.004230737884673945
sim_render-ego0_mean0.004093404713518713
sim_render-ego0_median0.004086953217937587
sim_render-ego0_min0.003968974533525732
simulation-passed1
step_physics_max0.15468876645725832
step_physics_mean0.13255672882637512
step_physics_median0.13210730915958935
step_physics_min0.1113235305290635
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5438311624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:21
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5435211569Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5944737601128893
survival_time_median7.224999999999987
deviation-center-line_median0.1515570322433221
in-drivable-lane_median4.075000000000009


other stats
agent_compute-ego0_max0.012200504819923472
agent_compute-ego0_mean0.011651250401967524
agent_compute-ego0_median0.011604944759507184
agent_compute-ego0_min0.011194607268932254
complete-iteration_max0.20247379236443097
complete-iteration_mean0.16503395169143775
complete-iteration_median0.15851352078815523
complete-iteration_min0.1406349728250096
deviation-center-line_max0.3973957254453753
deviation-center-line_mean0.19447652948818284
deviation-center-line_min0.07739632802071192
deviation-heading_max2.0439027315160097
deviation-heading_mean0.9986265562185188
deviation-heading_median0.7969591539095413
deviation-heading_min0.3566851855389831
driven_any_max2.4261230730019374
driven_any_mean1.9432120076572008
driven_any_median1.9402138866026373
driven_any_min1.46629718442159
driven_lanedir_consec_max1.2311585508159248
driven_lanedir_consec_mean0.6935693662962646
driven_lanedir_consec_min0.35417139414335524
driven_lanedir_max1.2311585508159248
driven_lanedir_mean0.6935693662962646
driven_lanedir_median0.5944737601128893
driven_lanedir_min0.35417139414335524
get_duckie_state_max2.013312445746528e-06
get_duckie_state_mean1.8242556350209875e-06
get_duckie_state_median1.7780035442844448e-06
get_duckie_state_min1.727703005768532e-06
get_robot_state_max0.0035170996300527982
get_robot_state_mean0.0034073565362451284
get_robot_state_median0.0034251232598368634
get_robot_state_min0.0032620799952539905
get_state_dump_max0.004714852181550498
get_state_dump_mean0.004496032538793195
get_state_dump_median0.0044972082038353175
get_state_dump_min0.004274861565951644
get_ui_image_max0.03197407944257869
get_ui_image_mean0.02724518485540584
get_ui_image_median0.02670560842016763
get_ui_image_min0.023595443138709433
in-drivable-lane_max6.849999999999991
in-drivable-lane_mean4.4625
in-drivable-lane_min2.84999999999999
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4261230730019374, "get_ui_image": 0.024982049547392745, "step_physics": 0.09195728959708378, "survival_time": 8.649999999999988, "driven_lanedir": 0.35417139414335524, "get_state_dump": 0.004274861565951644, "get_robot_state": 0.0032620799952539905, "sim_render-ego0": 0.0034264887886485836, "get_duckie_state": 1.7333304745027388e-06, "in-drivable-lane": 6.849999999999991, "deviation-heading": 1.1741890578616334, "agent_compute-ego0": 0.011425629429433535, "complete-iteration": 0.1512737438596528, "set_robot_commands": 0.0018713775722459815, "deviation-center-line": 0.18384602625697183, "driven_lanedir_consec": 0.35417139414335524, "sim_compute_sim_state": 0.00824920473427608, "sim_compute_performance-ego0": 0.001748526233366166}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.3360258114775707, "get_ui_image": 0.03197407944257869, "step_physics": 0.1353247975194177, "survival_time": 10.700000000000015, "driven_lanedir": 1.2311585508159248, "get_state_dump": 0.004343699300011923, "get_robot_state": 0.003339125389276549, "sim_render-ego0": 0.003382693889529206, "get_duckie_state": 1.727703005768532e-06, "in-drivable-lane": 4.300000000000032, "deviation-heading": 2.0439027315160097, "agent_compute-ego0": 0.011194607268932254, "complete-iteration": 0.20247379236443097, "set_robot_commands": 0.0020575911499733147, "deviation-center-line": 0.3973957254453753, "driven_lanedir_consec": 1.2311585508159248, "sim_compute_sim_state": 0.0090401993241421, "sim_compute_performance-ego0": 0.0017337555109068405}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.46629718442159, "get_ui_image": 0.028429167292942512, "step_physics": 0.10139222902672312, "survival_time": 5.299999999999989, "driven_lanedir": 0.6651664085628455, "get_state_dump": 0.004714852181550498, "get_robot_state": 0.0035170996300527982, "sim_render-ego0": 0.0037436552136857937, "get_duckie_state": 1.8226766140661507e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.4197292499574492, "agent_compute-ego0": 0.012200504819923472, "complete-iteration": 0.1657532977166577, "set_robot_commands": 0.0020836224065762816, "deviation-center-line": 0.07739632802071192, "driven_lanedir_consec": 0.6651664085628455, "sim_compute_sim_state": 0.007641388991168726, "sim_compute_performance-ego0": 0.0019435682029367608}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5444019617277038, "get_ui_image": 0.023595443138709433, "step_physics": 0.08476861521729037, "survival_time": 5.799999999999987, "driven_lanedir": 0.5237811116629332, "get_state_dump": 0.004650717107658712, "get_robot_state": 0.0035111211303971773, "sim_render-ego0": 0.0035819762792342748, "get_duckie_state": 2.013312445746528e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.3566851855389831, "agent_compute-ego0": 0.01178426008958083, "complete-iteration": 0.1406349728250096, "set_robot_commands": 0.002089025627853524, "deviation-center-line": 0.1192680382296723, "driven_lanedir_consec": 0.5237811116629332, "sim_compute_sim_state": 0.00471595209887904, "sim_compute_performance-ego0": 0.0018520375602265708}}
set_robot_commands_max0.002089025627853524
set_robot_commands_mean0.002025404189162275
set_robot_commands_median0.002070606778274798
set_robot_commands_min0.0018713775722459815
sim_compute_performance-ego0_max0.0019435682029367608
sim_compute_performance-ego0_mean0.0018194718768590845
sim_compute_performance-ego0_median0.0018002818967963684
sim_compute_performance-ego0_min0.0017337555109068405
sim_compute_sim_state_max0.0090401993241421
sim_compute_sim_state_mean0.007411686287116487
sim_compute_sim_state_median0.007945296862722403
sim_compute_sim_state_min0.00471595209887904
sim_render-ego0_max0.0037436552136857937
sim_render-ego0_mean0.0035337035427744647
sim_render-ego0_median0.003504232533941429
sim_render-ego0_min0.003382693889529206
simulation-passed1
step_physics_max0.1353247975194177
step_physics_mean0.10336073284012876
step_physics_median0.09667475931190345
step_physics_min0.08476861521729037
survival_time_max10.700000000000015
survival_time_mean7.612499999999995
survival_time_min5.299999999999989
No reset possible
5422312728Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:38:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.215897232206814
survival_time_median59.99999999999873
deviation-center-line_median3.2211386167745317
in-drivable-lane_median2.224999999999967


other stats
agent_compute-ego0_max0.053939698836289275
agent_compute-ego0_mean0.035108410003340196
agent_compute-ego0_median0.03671275368340307
agent_compute-ego0_min0.013068433810265356
complete-iteration_max0.28382056102863856
complete-iteration_mean0.2322744632833233
complete-iteration_median0.22802808292579585
complete-iteration_min0.18922112625306295
deviation-center-line_max3.459288286614277
deviation-center-line_mean3.0909126748396103
deviation-center-line_min2.4620851791951
deviation-heading_max12.118068965149874
deviation-heading_mean11.011845814837317
deviation-heading_median11.128572305729731
deviation-heading_min9.672169682739918
driven_any_max16.497711810425404
driven_any_mean13.43552944173726
driven_any_median14.022090393969892
driven_any_min9.200225168583854
driven_lanedir_consec_max16.086584059104013
driven_lanedir_consec_mean12.646574055279196
driven_lanedir_consec_min8.067917697599148
driven_lanedir_max16.086584059104013
driven_lanedir_mean12.648469251258335
driven_lanedir_median13.215897232206814
driven_lanedir_min8.075498481515712
get_duckie_state_max2.122881345876367e-06
get_duckie_state_mean1.82132715360817e-06
get_duckie_state_median1.74198420617503e-06
get_duckie_state_min1.678458856206254e-06
get_robot_state_max0.0038828919319162103
get_robot_state_mean0.003789548523672528
get_robot_state_median0.003793696281217119
get_robot_state_min0.0036879096003396626
get_state_dump_max0.005090211170701761
get_state_dump_mean0.0048568545323832155
get_state_dump_median0.0048458692334672985
get_state_dump_min0.004645468491896503
get_ui_image_max0.03597689389586945
get_ui_image_mean0.03109259058433852
get_ui_image_median0.030715234272471012
get_ui_image_min0.026962999896542616
in-drivable-lane_max3.5499999999998693
in-drivable-lane_mean1.9999999999999507
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.497711810425404, "get_ui_image": 0.028563969141239924, "step_physics": 0.11457887239797626, "survival_time": 59.99999999999873, "driven_lanedir": 16.086584059104013, "get_state_dump": 0.004927477570596484, "get_robot_state": 0.0036879096003396626, "sim_render-ego0": 0.003881528514509495, "get_duckie_state": 1.678458856206254e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.059040208280935, "agent_compute-ego0": 0.01961674241598798, "complete-iteration": 0.18922112625306295, "set_robot_commands": 0.0021916982236253927, "deviation-center-line": 3.01481732327005, "driven_lanedir_consec": 16.086584059104013, "sim_compute_sim_state": 0.009698260733725924, "sim_compute_performance-ego0": 0.001989248491743026}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.11099682998846, "get_ui_image": 0.03597689389586945, "step_physics": 0.16326192793103678, "survival_time": 59.99999999999873, "driven_lanedir": 13.535033516124642, "get_state_dump": 0.004645468491896503, "get_robot_state": 0.003729374581431469, "sim_render-ego0": 0.003867478096713432, "get_duckie_state": 1.7294776528999271e-06, "in-drivable-lane": 0.949999999999946, "deviation-heading": 12.118068965149874, "agent_compute-ego0": 0.05380876495081817, "complete-iteration": 0.28382056102863856, "set_robot_commands": 0.002341453082158504, "deviation-center-line": 3.4274599102790133, "driven_lanedir_consec": 13.535033516124642, "sim_compute_sim_state": 0.014036051935200689, "sim_compute_performance-ego0": 0.0020605300884262707}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.200225168583854, "get_ui_image": 0.0328664994037021, "step_physics": 0.15211778596713504, "survival_time": 41.0999999999998, "driven_lanedir": 8.075498481515712, "get_state_dump": 0.005090211170701761, "get_robot_state": 0.0038828919319162103, "sim_render-ego0": 0.0040607878243503134, "get_duckie_state": 2.122881345876367e-06, "in-drivable-lane": 3.5499999999998693, "deviation-heading": 9.672169682739918, "agent_compute-ego0": 0.013068433810265356, "complete-iteration": 0.229631922224747, "set_robot_commands": 0.002385684091004827, "deviation-center-line": 2.4620851791951, "driven_lanedir_consec": 8.067917697599148, "sim_compute_sim_state": 0.01381685609226528, "sim_compute_performance-ego0": 0.002237386286331121}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.933183957951323, "get_ui_image": 0.026962999896542616, "step_physics": 0.12214182616272735, "survival_time": 59.99999999999873, "driven_lanedir": 12.896760948288987, "get_state_dump": 0.004764260896338114, "get_robot_state": 0.0038580179810027695, "sim_render-ego0": 0.003885700144835257, "get_duckie_state": 1.7544907594501327e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 11.198104403178531, "agent_compute-ego0": 0.053939698836289275, "complete-iteration": 0.22642424362684468, "set_robot_commands": 0.0024110415297483624, "deviation-center-line": 3.459288286614277, "driven_lanedir_consec": 12.896760948288987, "sim_compute_sim_state": 0.006294579231967338, "sim_compute_performance-ego0": 0.0020744554406895823}}
set_robot_commands_max0.0024110415297483624
set_robot_commands_mean0.002332469231634271
set_robot_commands_median0.002363568586581665
set_robot_commands_min0.0021916982236253927
sim_compute_performance-ego0_max0.002237386286331121
sim_compute_performance-ego0_mean0.0020904050767975
sim_compute_performance-ego0_median0.0020674927645579263
sim_compute_performance-ego0_min0.001989248491743026
sim_compute_sim_state_max0.014036051935200689
sim_compute_sim_state_mean0.010961436998289806
sim_compute_sim_state_median0.011757558412995604
sim_compute_sim_state_min0.006294579231967338
sim_render-ego0_max0.0040607878243503134
sim_render-ego0_mean0.003923873645102124
sim_render-ego0_median0.003883614329672376
sim_render-ego0_min0.003867478096713432
simulation-passed1
step_physics_max0.16326192793103678
step_physics_mean0.13802510311471886
step_physics_median0.1371298060649312
step_physics_min0.11457887239797626
survival_time_max59.99999999999873
survival_time_mean55.274999999999
survival_time_min41.0999999999998
No reset possible
5410711458Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-010:45:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.728251446319533
survival_time_median59.99999999999873
deviation-center-line_median7.126651875906103
in-drivable-lane_median1.274999999999987


other stats
agent_compute-ego0_max0.06564123148128055
agent_compute-ego0_mean0.051752523865727554
agent_compute-ego0_median0.04848543700330164
agent_compute-ego0_min0.044397989975026406
complete-iteration_max0.3310489880850075
complete-iteration_mean0.28387052058975065
complete-iteration_median0.29263583240064356
complete-iteration_min0.21916142947270809
deviation-center-line_max8.536035099736788
deviation-center-line_mean6.8259927654366095
deviation-center-line_min4.514632210197447
deviation-heading_max16.258693334426425
deviation-heading_mean10.307797267681313
deviation-heading_median9.383704525546335
deviation-heading_min6.205086685206157
driven_any_max23.719351310378062
driven_any_mean13.234189057809512
driven_any_median10.622860098638574
driven_any_min7.971684723582841
driven_lanedir_consec_max23.102822469610587
driven_lanedir_consec_mean12.585873444911172
driven_lanedir_consec_min7.784168417395035
driven_lanedir_max23.102822469610587
driven_lanedir_mean12.585873444911172
driven_lanedir_median9.728251446319533
driven_lanedir_min7.784168417395035
get_duckie_state_max1.485103572238792e-06
get_duckie_state_mean1.3898651764652908e-06
get_duckie_state_median1.413538295164593e-06
get_duckie_state_min1.2472805432931866e-06
get_robot_state_max0.004020918815161763
get_robot_state_mean0.003887356320189794
get_robot_state_median0.0038562478074225456
get_robot_state_min0.003816010850752323
get_state_dump_max0.005106508086662706
get_state_dump_mean0.004986463637276554
get_state_dump_median0.005037020684082641
get_state_dump_min0.004765305094278226
get_ui_image_max0.03662229973906581
get_ui_image_mean0.03112549433402475
get_ui_image_median0.030802809725593863
get_ui_image_min0.026274058145845464
in-drivable-lane_max4.949999999999926
in-drivable-lane_mean1.9249999999999747
in-drivable-lane_min0.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 23.719351310378062, "get_ui_image": 0.028801419752821335, "step_physics": 0.11855450557927905, "survival_time": 59.99999999999873, "driven_lanedir": 23.102822469610587, "get_state_dump": 0.00506047920620908, "get_robot_state": 0.004020918815161763, "sim_render-ego0": 0.004105335270534646, "get_duckie_state": 1.3892199971296706e-06, "in-drivable-lane": 1.2499999999999556, "deviation-heading": 8.107910378534271, "agent_compute-ego0": 0.044397989975026406, "complete-iteration": 0.21916142947270809, "set_robot_commands": 0.0024501872400161527, "deviation-center-line": 4.514632210197447, "driven_lanedir_consec": 23.102822469610587, "sim_compute_sim_state": 0.0093435258492145, "sim_compute_performance-ego0": 0.002323971501397253}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.372164081391883, "get_ui_image": 0.03662229973906581, "step_physics": 0.21263452255160087, "survival_time": 59.99999999999873, "driven_lanedir": 11.054175687966234, "get_state_dump": 0.005106508086662706, "get_robot_state": 0.003894328475494766, "sim_render-ego0": 0.004070354639540902, "get_duckie_state": 1.485103572238792e-06, "in-drivable-lane": 4.949999999999926, "deviation-heading": 16.258693334426425, "agent_compute-ego0": 0.05128946411520317, "complete-iteration": 0.3310489880850075, "set_robot_commands": 0.0023297407942747296, "deviation-center-line": 6.449971420383782, "driven_lanedir_consec": 11.054175687966234, "sim_compute_sim_state": 0.012846909792198925, "sim_compute_performance-ego0": 0.0021538653044180507}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.873556115885265, "get_ui_image": 0.03280419969836639, "step_physics": 0.20410376524151017, "survival_time": 59.99999999999873, "driven_lanedir": 8.402327204672833, "get_state_dump": 0.005013562161956203, "get_robot_state": 0.003816010850752323, "sim_render-ego0": 0.003974383121525417, "get_duckie_state": 1.4378565931995148e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 10.6594986725584, "agent_compute-ego0": 0.04568140989140011, "complete-iteration": 0.31185814919420124, "set_robot_commands": 0.002277135451965586, "deviation-center-line": 7.803332331428424, "driven_lanedir_consec": 8.402327204672833, "sim_compute_sim_state": 0.011964492456402806, "sim_compute_performance-ego0": 0.0021222902277327894}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.971684723582841, "get_ui_image": 0.026274058145845464, "step_physics": 0.15783281469225982, "survival_time": 59.99999999999873, "driven_lanedir": 7.784168417395035, "get_state_dump": 0.004765305094278226, "get_robot_state": 0.003818167139350326, "sim_render-ego0": 0.003818891923890126, "get_duckie_state": 1.2472805432931866e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 6.205086685206157, "agent_compute-ego0": 0.06564123148128055, "complete-iteration": 0.2734135156070859, "set_robot_commands": 0.0022598791876800054, "deviation-center-line": 8.536035099736788, "driven_lanedir_consec": 7.784168417395035, "sim_compute_sim_state": 0.006860707026536419, "sim_compute_performance-ego0": 0.002052407181332451}}
set_robot_commands_max0.0024501872400161527
set_robot_commands_mean0.0023292356684841186
set_robot_commands_median0.002303438123120158
set_robot_commands_min0.0022598791876800054
sim_compute_performance-ego0_max0.002323971501397253
sim_compute_performance-ego0_mean0.002163133553720136
sim_compute_performance-ego0_median0.00213807776607542
sim_compute_performance-ego0_min0.002052407181332451
sim_compute_sim_state_max0.012846909792198925
sim_compute_sim_state_mean0.010253908781088162
sim_compute_sim_state_median0.010654009152808654
sim_compute_sim_state_min0.006860707026536419
sim_render-ego0_max0.004105335270534646
sim_render-ego0_mean0.003992241238872773
sim_render-ego0_median0.0040223688805331595
sim_render-ego0_min0.003818891923890126
simulation-passed1
step_physics_max0.21263452255160087
step_physics_mean0.1732814020161625
step_physics_median0.180968289966885
step_physics_min0.11855450557927905
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5407311674Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-010:10:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5400411694Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:20:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.8931868846879487
survival_time_median28.625000000000007
deviation-center-line_median1.125343079766703
in-drivable-lane_median11.399999999999878


other stats
agent_compute-ego0_max0.013432638745912363
agent_compute-ego0_mean0.012756785883052844
agent_compute-ego0_median0.012714981340476704
agent_compute-ego0_min0.0121645421053456
complete-iteration_max0.3057536656936903
complete-iteration_mean0.25161352786963986
complete-iteration_median0.24448069880460013
complete-iteration_min0.21173904817566885
deviation-center-line_max2.3475387625896924
deviation-center-line_mean1.1790575899845188
deviation-center-line_min0.1180054378149764
deviation-heading_max14.61570517956334
deviation-heading_mean6.50448650575918
deviation-heading_median5.360215048217599
deviation-heading_min0.6818107470381845
driven_any_max15.840109268220626
driven_any_mean8.01771303860366
driven_any_median7.32414503478063
driven_any_min1.5824528166327516
driven_lanedir_consec_max5.731057593873108
driven_lanedir_consec_mean3.5985814631814605
driven_lanedir_consec_min0.8768944894768351
driven_lanedir_max6.762696438598922
driven_lanedir_mean3.9903668965718166
driven_lanedir_median4.160938329105755
driven_lanedir_min0.8768944894768351
get_duckie_state_max1.4946323747341084e-06
get_duckie_state_mean1.4671362024625231e-06
get_duckie_state_median1.486017651564714e-06
get_duckie_state_min1.4018771319865575e-06
get_robot_state_max0.003982287057688538
get_robot_state_mean0.0038051063045182938
get_robot_state_median0.00384501723067276
get_robot_state_min0.003548103699039117
get_state_dump_max0.005075375015815992
get_state_dump_mean0.004848255436497287
get_state_dump_median0.004904954125125126
get_state_dump_min0.004507738479922906
get_ui_image_max0.03935695096348109
get_ui_image_mean0.03259112526435293
get_ui_image_median0.031778744019278625
get_ui_image_min0.02745006205537337
in-drivable-lane_max29.09999999999975
in-drivable-lane_mean13.774999999999874
in-drivable-lane_min3.1999999999999886
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.211704478758785, "get_ui_image": 0.027615286155536715, "step_physics": 0.14753801662912863, "survival_time": 39.49999999999989, "driven_lanedir": 5.731057593873108, "get_state_dump": 0.004507738479922906, "get_robot_state": 0.003548103699039117, "sim_render-ego0": 0.003675638046939816, "get_duckie_state": 1.4018771319865575e-06, "in-drivable-lane": 15.999999999999694, "deviation-heading": 7.244712874493337, "agent_compute-ego0": 0.0121645421053456, "complete-iteration": 0.21291433574276236, "set_robot_commands": 0.0021211395673595094, "deviation-center-line": 1.6958662824136863, "driven_lanedir_consec": 5.731057593873108, "sim_compute_sim_state": 0.009712679799076276, "sim_compute_performance-ego0": 0.0019397410068439625}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.436585590802475, "get_ui_image": 0.03935695096348109, "step_physics": 0.22437598799051864, "survival_time": 17.750000000000117, "driven_lanedir": 2.5908190643384024, "get_state_dump": 0.005075375015815992, "get_robot_state": 0.0038622718178824094, "sim_render-ego0": 0.004027802622720097, "get_duckie_state": 1.479400677627392e-06, "in-drivable-lane": 6.800000000000059, "deviation-heading": 3.47571722194186, "agent_compute-ego0": 0.012717413768339693, "complete-iteration": 0.3057536656936903, "set_robot_commands": 0.002346368987908524, "deviation-center-line": 0.5548198771197199, "driven_lanedir_consec": 2.5908190643384024, "sim_compute_sim_state": 0.011749323834194228, "sim_compute_performance-ego0": 0.00214528568675009}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5824528166327516, "get_ui_image": 0.03594220188302054, "step_physics": 0.1993632333379396, "survival_time": 7.049999999999983, "driven_lanedir": 0.8768944894768351, "get_state_dump": 0.004938696471738144, "get_robot_state": 0.003982287057688538, "sim_render-ego0": 0.004065162698987504, "get_duckie_state": 1.4926346255020356e-06, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.6818107470381845, "agent_compute-ego0": 0.013432638745912363, "complete-iteration": 0.2760470618664379, "set_robot_commands": 0.0023763364469501333, "deviation-center-line": 0.1180054378149764, "driven_lanedir_consec": 0.8768944894768351, "sim_compute_sim_state": 0.00965277913590552, "sim_compute_performance-ego0": 0.00219295730053539}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.840109268220626, "get_ui_image": 0.02745006205537337, "step_physics": 0.14800542617816909, "survival_time": 59.99999999999873, "driven_lanedir": 6.762696438598922, "get_state_dump": 0.004871211778512108, "get_robot_state": 0.00382776264346311, "sim_render-ego0": 0.003926739506082273, "get_duckie_state": 1.4946323747341084e-06, "in-drivable-lane": 29.09999999999975, "deviation-heading": 14.61570517956334, "agent_compute-ego0": 0.012712548912613716, "complete-iteration": 0.21173904817566885, "set_robot_commands": 0.0023639208073421483, "deviation-center-line": 2.3475387625896924, "driven_lanedir_consec": 5.1955547050374955, "sim_compute_sim_state": 0.006407781802645135, "sim_compute_performance-ego0": 0.002079701046463254}}
set_robot_commands_max0.0023763364469501333
set_robot_commands_mean0.0023019414523900786
set_robot_commands_median0.002355144897625336
set_robot_commands_min0.0021211395673595094
sim_compute_performance-ego0_max0.00219295730053539
sim_compute_performance-ego0_mean0.002089421260148174
sim_compute_performance-ego0_median0.002112493366606672
sim_compute_performance-ego0_min0.0019397410068439625
sim_compute_sim_state_max0.011749323834194228
sim_compute_sim_state_mean0.00938064114295529
sim_compute_sim_state_median0.0096827294674909
sim_compute_sim_state_min0.006407781802645135
sim_render-ego0_max0.004065162698987504
sim_render-ego0_mean0.003923835718682422
sim_render-ego0_median0.003977271064401185
sim_render-ego0_min0.003675638046939816
simulation-passed1
step_physics_max0.22437598799051864
step_physics_mean0.17982066603393898
step_physics_median0.17368432975805437
step_physics_min0.14753801662912863
survival_time_max59.99999999999873
survival_time_mean31.074999999999683
survival_time_min7.049999999999983
No reset possible
5392011381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:36:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.889910309868486
survival_time_median42.37499999999973
deviation-center-line_median1.9429518723902952
in-drivable-lane_median20.800000000000026


other stats
agent_compute-ego0_max0.09199063065764192
agent_compute-ego0_mean0.08188537292159484
agent_compute-ego0_median0.08081131274096907
agent_compute-ego0_min0.07392823554679928
complete-iteration_max0.3303085214951459
complete-iteration_mean0.2968809392517011
complete-iteration_median0.2992771285138681
complete-iteration_min0.2586609784839223
deviation-center-line_max3.791642116573936
deviation-center-line_mean2.0695372021886698
deviation-center-line_min0.6006029474001522
deviation-heading_max10.861771989194777
deviation-heading_mean7.496386875687572
deviation-heading_median7.438914232530456
deviation-heading_min4.245947048494601
driven_any_max23.208184101912817
driven_any_mean14.921055441808246
driven_any_median13.648293172745856
driven_any_min9.179451319828454
driven_lanedir_consec_max17.727708952992003
driven_lanedir_consec_mean8.455432298798675
driven_lanedir_consec_min2.3141996224657237
driven_lanedir_max17.727708952992003
driven_lanedir_mean8.455432298798675
driven_lanedir_median6.889910309868486
driven_lanedir_min2.3141996224657237
get_duckie_state_max1.4523483136611417e-06
get_duckie_state_mean1.4130372026573068e-06
get_duckie_state_median1.4266956845160384e-06
get_duckie_state_min1.3464091279360084e-06
get_robot_state_max0.004069895604077507
get_robot_state_mean0.003838966771226362
get_robot_state_median0.0037891701802119735
get_robot_state_min0.0037076311204039935
get_state_dump_max0.005071112688849954
get_state_dump_mean0.0048307771221104585
get_state_dump_median0.0047649308665446855
get_state_dump_min0.00472213406650251
get_ui_image_max0.03681235127634817
get_ui_image_mean0.03215017881169772
get_ui_image_median0.032423901596166024
get_ui_image_min0.026940560778110672
in-drivable-lane_max25.19999999999959
in-drivable-lane_mean20.09999999999982
in-drivable-lane_min13.599999999999644
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 23.208184101912817, "get_ui_image": 0.030252827692786224, "step_physics": 0.12717446240656183, "survival_time": 59.99999999999873, "driven_lanedir": 17.727708952992003, "get_state_dump": 0.004789386363351077, "get_robot_state": 0.003788543283492699, "sim_render-ego0": 0.003885477607593648, "get_duckie_state": 1.4523483136611417e-06, "in-drivable-lane": 13.599999999999644, "deviation-heading": 10.861771989194777, "agent_compute-ego0": 0.08625406647204956, "complete-iteration": 0.27054641189225803, "set_robot_commands": 0.002298354705505625, "deviation-center-line": 3.791642116573936, "driven_lanedir_consec": 17.727708952992003, "sim_compute_sim_state": 0.009954406855803148, "sim_compute_performance-ego0": 0.002056907356827583}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.665215633400871, "get_ui_image": 0.03681235127634817, "step_physics": 0.1685539926801409, "survival_time": 38.44999999999995, "driven_lanedir": 6.96637888548171, "get_state_dump": 0.004740475369738294, "get_robot_state": 0.003789797076931247, "sim_render-ego0": 0.0038857230892429106, "get_duckie_state": 1.4298922055727476e-06, "in-drivable-lane": 17.149999999999906, "deviation-heading": 6.710619663840967, "agent_compute-ego0": 0.09199063065764192, "complete-iteration": 0.3280078451354782, "set_robot_commands": 0.0022778111618834656, "deviation-center-line": 1.808943869663848, "driven_lanedir_consec": 6.96637888548171, "sim_compute_sim_state": 0.013750118094605284, "sim_compute_performance-ego0": 0.0021151675806417095}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.179451319828454, "get_ui_image": 0.03459497549954583, "step_physics": 0.1876631680656882, "survival_time": 33.95000000000021, "driven_lanedir": 2.3141996224657237, "get_state_dump": 0.005071112688849954, "get_robot_state": 0.004069895604077507, "sim_render-ego0": 0.004127603769302368, "get_duckie_state": 1.423499163459329e-06, "in-drivable-lane": 24.450000000000134, "deviation-heading": 4.245947048494601, "agent_compute-ego0": 0.07536855900988859, "complete-iteration": 0.3303085214951459, "set_robot_commands": 0.0025041289189282586, "deviation-center-line": 0.6006029474001522, "driven_lanedir_consec": 2.3141996224657237, "sim_compute_sim_state": 0.014592277653077069, "sim_compute_performance-ego0": 0.002220391876557294}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.63137071209084, "get_ui_image": 0.026940560778110672, "step_physics": 0.1351763294224086, "survival_time": 46.29999999999951, "driven_lanedir": 6.813441734255262, "get_state_dump": 0.00472213406650251, "get_robot_state": 0.0037076311204039935, "sim_render-ego0": 0.003761917513422467, "get_duckie_state": 1.3464091279360084e-06, "in-drivable-lane": 25.19999999999959, "deviation-heading": 8.167208801219944, "agent_compute-ego0": 0.07392823554679928, "complete-iteration": 0.2586609784839223, "set_robot_commands": 0.0022555616681243997, "deviation-center-line": 2.076959875116742, "driven_lanedir_consec": 6.813441734255262, "sim_compute_sim_state": 0.0060980721199010955, "sim_compute_performance-ego0": 0.0019810238316606936}}
set_robot_commands_max0.0025041289189282586
set_robot_commands_mean0.002333964113610437
set_robot_commands_median0.0022880829336945456
set_robot_commands_min0.0022555616681243997
sim_compute_performance-ego0_max0.002220391876557294
sim_compute_performance-ego0_mean0.00209337266142182
sim_compute_performance-ego0_median0.0020860374687346464
sim_compute_performance-ego0_min0.0019810238316606936
sim_compute_sim_state_max0.014592277653077069
sim_compute_sim_state_mean0.01109871868084665
sim_compute_sim_state_median0.011852262475204217
sim_compute_sim_state_min0.0060980721199010955
sim_render-ego0_max0.004127603769302368
sim_render-ego0_mean0.003915180494890348
sim_render-ego0_median0.003885600348418279
sim_render-ego0_min0.003761917513422467
simulation-passed1
step_physics_max0.1876631680656882
step_physics_mean0.1546419881436999
step_physics_median0.15186516105127473
step_physics_min0.12717446240656183
survival_time_max59.99999999999873
survival_time_mean44.6749999999996
survival_time_min33.95000000000021
No reset possible