Duckietown Challenges Home Challenges Submissions

Evaluator 4892

ID4892
evaluatornogpu-prod-01
ownerI don't have one 😀
machinenogpu-prod_6300a5ea4132
processnogpu-prod-01_6300a5ea4132
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success18 53980
# timeout1 57533
# failed7 53959
# error
# aborted2 57181
# host-error43 53939
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5753310900Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-01----No reset possible
5751210908Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:08:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0804561066415836
survival_time_median13.80000000000006
deviation-center-line_median0.40050782034170584
in-drivable-lane_median3.400000000000022


other stats
agent_compute-ego0_max0.0129466306246244
agent_compute-ego0_mean0.012212387908482348
agent_compute-ego0_median0.012088149088428065
agent_compute-ego0_min0.01172662283244886
complete-iteration_max0.20592622756958007
complete-iteration_mean0.17077388082796446
complete-iteration_median0.16535626604006842
complete-iteration_min0.14645676366214094
deviation-center-line_max0.7684520415676495
deviation-center-line_mean0.4220516764437984
deviation-center-line_min0.11873902352413214
deviation-heading_max4.979514066423704
deviation-heading_mean2.0716796212521293
deviation-heading_median1.3176667985918864
deviation-heading_min0.6718708214010406
driven_any_max3.0650444101460903
driven_any_mean2.156149049469786
driven_any_median2.4427299856778486
driven_any_min0.6740918163773578
driven_lanedir_consec_max2.1481714399018323
driven_lanedir_consec_mean1.139427073441148
driven_lanedir_consec_min0.24862464057959244
driven_lanedir_max2.1481714399018323
driven_lanedir_mean1.1523227142828951
driven_lanedir_median1.1062473883250783
driven_lanedir_min0.24862464057959244
get_duckie_state_max1.3195235153724407e-06
get_duckie_state_mean1.2095940650212696e-06
get_duckie_state_median1.218592648183827e-06
get_duckie_state_min1.0816674483449836e-06
get_robot_state_max0.003689105887162058
get_robot_state_mean0.0035991631564986117
get_robot_state_median0.003589776373687602
get_robot_state_min0.003527993991457183
get_state_dump_max0.004855181041516755
get_state_dump_mean0.004560734411348721
get_state_dump_median0.004488727599035054
get_state_dump_min0.004410301405808021
get_ui_image_max0.032656042199385796
get_ui_image_mean0.029562652337721273
get_ui_image_median0.03002615026799671
get_ui_image_min0.025542266615505876
in-drivable-lane_max12.400000000000102
in-drivable-lane_mean5.275000000000043
in-drivable-lane_min1.900000000000027
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.434305639882012, "get_ui_image": 0.027757970672665225, "step_physics": 0.09120969158230406, "survival_time": 13.150000000000052, "driven_lanedir": 2.1481714399018323, "get_state_dump": 0.004462157235001073, "get_robot_state": 0.0035629886569398823, "sim_render-ego0": 0.0038002621043812146, "get_duckie_state": 1.239957231463808e-06, "in-drivable-lane": 1.900000000000027, "deviation-heading": 1.851035135167941, "agent_compute-ego0": 0.01220941362958966, "complete-iteration": 0.15640908479690552, "set_robot_commands": 0.002152629873969338, "deviation-center-line": 0.7684520415676495, "driven_lanedir_consec": 2.1481714399018323, "sim_compute_sim_state": 0.009283482125311188, "sim_compute_performance-ego0": 0.0018833586663910835}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6740918163773578, "get_ui_image": 0.032656042199385796, "step_physics": 0.13602359169407896, "survival_time": 4.699999999999991, "driven_lanedir": 0.24862464057959244, "get_state_dump": 0.004855181041516755, "get_robot_state": 0.003689105887162058, "sim_render-ego0": 0.00353967265078896, "get_duckie_state": 1.0816674483449836e-06, "in-drivable-lane": 2.9999999999999902, "deviation-heading": 0.7842984620158319, "agent_compute-ego0": 0.01172662283244886, "complete-iteration": 0.20592622756958007, "set_robot_commands": 0.0023497330515008224, "deviation-center-line": 0.11873902352413214, "driven_lanedir_consec": 0.24862464057959244, "sim_compute_sim_state": 0.009248879081324528, "sim_compute_performance-ego0": 0.0017566028394197164}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0650444101460903, "get_ui_image": 0.0322943298633282, "step_physics": 0.10292570407573992, "survival_time": 16.200000000000095, "driven_lanedir": 0.6852229700080567, "get_state_dump": 0.004515297963069036, "get_robot_state": 0.0036165640904353216, "sim_render-ego0": 0.003917479881873498, "get_duckie_state": 1.197228064903846e-06, "in-drivable-lane": 12.400000000000102, "deviation-heading": 0.6718708214010406, "agent_compute-ego0": 0.0129466306246244, "complete-iteration": 0.1743034472832313, "set_robot_commands": 0.002195308391864483, "deviation-center-line": 0.1607749621437001, "driven_lanedir_consec": 0.6852229700080567, "sim_compute_sim_state": 0.009873246413010815, "sim_compute_performance-ego0": 0.0019317084092360275}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.451154331473685, "get_ui_image": 0.025542266615505876, "step_physics": 0.08797492158824, "survival_time": 14.45000000000007, "driven_lanedir": 1.5272718066421, "get_state_dump": 0.004410301405808021, "get_robot_state": 0.003527993991457183, "sim_render-ego0": 0.0037164178387872103, "get_duckie_state": 1.3195235153724407e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 4.979514066423704, "agent_compute-ego0": 0.011966884547266469, "complete-iteration": 0.14645676366214094, "set_robot_commands": 0.002093896372564908, "deviation-center-line": 0.6402406785397116, "driven_lanedir_consec": 1.4756892432751108, "sim_compute_sim_state": 0.005316776242749444, "sim_compute_performance-ego0": 0.001824753859947468}}
set_robot_commands_max0.0023497330515008224
set_robot_commands_mean0.0021978919224748877
set_robot_commands_median0.0021739691329169105
set_robot_commands_min0.002093896372564908
sim_compute_performance-ego0_max0.0019317084092360275
sim_compute_performance-ego0_mean0.0018491059437485736
sim_compute_performance-ego0_median0.0018540562631692756
sim_compute_performance-ego0_min0.0017566028394197164
sim_compute_sim_state_max0.009873246413010815
sim_compute_sim_state_mean0.008430595965598992
sim_compute_sim_state_median0.009266180603317856
sim_compute_sim_state_min0.005316776242749444
sim_render-ego0_max0.003917479881873498
sim_render-ego0_mean0.00374345811895772
sim_render-ego0_median0.0037583399715842127
sim_render-ego0_min0.00353967265078896
simulation-passed1
step_physics_max0.13602359169407896
step_physics_mean0.10453347723509074
step_physics_median0.097067697829022
step_physics_min0.08797492158824
survival_time_max16.200000000000095
survival_time_mean12.125000000000052
survival_time_min4.699999999999991
No reset possible
5743710925Philippe Reddy 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:12:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.502278470777112
survival_time_median13.450000000000056
deviation-center-line_median0.35129083202399347
in-drivable-lane_median5.425000000000038


other stats
agent_compute-ego0_max0.013415192658046507
agent_compute-ego0_mean0.013072749102954886
agent_compute-ego0_median0.013169757406514906
agent_compute-ego0_min0.012536288940743224
complete-iteration_max0.23905405353472456
complete-iteration_mean0.18641634974771903
complete-iteration_median0.17367446498760564
complete-iteration_min0.1592624154809403
deviation-center-line_max2.3978827975287595
deviation-center-line_mean0.8071239762416029
deviation-center-line_min0.12803144338966532
deviation-heading_max8.001249767895967
deviation-heading_mean2.6726008877833403
deviation-heading_median1.0049545681096124
deviation-heading_min0.6792446470181696
driven_any_max6.825326577038877
driven_any_mean3.3640718524167603
driven_any_median2.60165044452509
driven_any_min1.427659943577983
driven_lanedir_consec_max5.122557968480434
driven_lanedir_consec_mean2.208448440116507
driven_lanedir_consec_min0.7066788504313696
driven_lanedir_max5.122557968480434
driven_lanedir_mean2.208448440116507
driven_lanedir_median1.502278470777112
driven_lanedir_min0.7066788504313696
get_duckie_state_max1.392056865076865e-06
get_duckie_state_mean1.3258448194278843e-06
get_duckie_state_median1.3302206871673472e-06
get_duckie_state_min1.2508810382999786e-06
get_robot_state_max0.003971172831565097
get_robot_state_mean0.003813650531766452
get_robot_state_median0.003798961705251231
get_robot_state_min0.0036855058849982495
get_state_dump_max0.0051748965151419786
get_state_dump_mean0.004966272401299479
get_state_dump_median0.005009090800333803
get_state_dump_min0.004672011489388328
get_ui_image_max0.03769927499552893
get_ui_image_mean0.030884876470910295
get_ui_image_median0.029125956616287516
get_ui_image_min0.027588317655537223
in-drivable-lane_max7.200000000000051
in-drivable-lane_mean5.512500000000028
in-drivable-lane_min3.999999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8322719211047267, "get_ui_image": 0.027588317655537223, "step_physics": 0.09205907011685306, "survival_time": 14.550000000000072, "driven_lanedir": 2.0267918949853456, "get_state_dump": 0.004875729345295527, "get_robot_state": 0.00370843769752816, "sim_render-ego0": 0.004201824534429263, "get_duckie_state": 1.2508810382999786e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 1.136170429177896, "agent_compute-ego0": 0.012536288940743224, "complete-iteration": 0.1592624154809403, "set_robot_commands": 0.0022965996232751297, "deviation-center-line": 0.40804611238408456, "driven_lanedir_consec": 2.0267918949853456, "sim_compute_sim_state": 0.009798764365993131, "sim_compute_performance-ego0": 0.0021126131488852307}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.825326577038877, "get_ui_image": 0.03769927499552893, "step_physics": 0.1576205111187599, "survival_time": 33.60000000000023, "driven_lanedir": 5.122557968480434, "get_state_dump": 0.0051748965151419786, "get_robot_state": 0.003971172831565097, "sim_render-ego0": 0.004253268419013512, "get_duckie_state": 1.321398662776862e-06, "in-drivable-lane": 6.4500000000000135, "deviation-heading": 8.001249767895967, "agent_compute-ego0": 0.013274473740122824, "complete-iteration": 0.23905405353472456, "set_robot_commands": 0.0022851616631291067, "deviation-center-line": 2.3978827975287595, "driven_lanedir_consec": 5.122557968480434, "sim_compute_sim_state": 0.012467109785037444, "sim_compute_performance-ego0": 0.0022164166947884864}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.427659943577983, "get_ui_image": 0.03036365269115136, "step_physics": 0.10769302290190692, "survival_time": 7.89999999999998, "driven_lanedir": 0.7066788504313696, "get_state_dump": 0.004672011489388328, "get_robot_state": 0.0036855058849982495, "sim_render-ego0": 0.0039892676491407476, "get_duckie_state": 1.3390427115578322e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 0.6792446470181696, "agent_compute-ego0": 0.013415192658046507, "complete-iteration": 0.17635259088480248, "set_robot_commands": 0.002294144540462854, "deviation-center-line": 0.12803144338966532, "driven_lanedir_consec": 0.7066788504313696, "sim_compute_sim_state": 0.00810327170030126, "sim_compute_performance-ego0": 0.002044655242056217}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.3710289679454535, "get_ui_image": 0.027888260541423675, "step_physics": 0.1063262983675926, "survival_time": 12.35000000000004, "driven_lanedir": 0.9777650465688784, "get_state_dump": 0.005142452255372078, "get_robot_state": 0.0038894857129743022, "sim_render-ego0": 0.004103840358795658, "get_duckie_state": 1.392056865076865e-06, "in-drivable-lane": 7.200000000000051, "deviation-heading": 0.8737387070413289, "agent_compute-ego0": 0.013065041072906987, "complete-iteration": 0.17099633909040882, "set_robot_commands": 0.0023337179614651587, "deviation-center-line": 0.29453555166390244, "driven_lanedir_consec": 0.9777650465688784, "sim_compute_sim_state": 0.006050188695230792, "sim_compute_performance-ego0": 0.0021071933930920015}}
set_robot_commands_max0.0023337179614651587
set_robot_commands_mean0.002302405947083062
set_robot_commands_median0.002295372081868992
set_robot_commands_min0.0022851616631291067
sim_compute_performance-ego0_max0.0022164166947884864
sim_compute_performance-ego0_mean0.002120219619705484
sim_compute_performance-ego0_median0.002109903270988616
sim_compute_performance-ego0_min0.002044655242056217
sim_compute_sim_state_max0.012467109785037444
sim_compute_sim_state_mean0.009104833636640658
sim_compute_sim_state_median0.008951018033147197
sim_compute_sim_state_min0.006050188695230792
sim_render-ego0_max0.004253268419013512
sim_render-ego0_mean0.004137050240344795
sim_render-ego0_median0.004152832446612461
sim_render-ego0_min0.0039892676491407476
simulation-passed1
step_physics_max0.1576205111187599
step_physics_mean0.11592472562627812
step_physics_median0.10700966063474976
step_physics_min0.09205907011685306
survival_time_max33.60000000000023
survival_time_mean17.10000000000008
survival_time_min7.89999999999998
No reset possible
5742311426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5738610949Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20985411662090192
survival_time_median12.40000000000004
deviation-center-line_median0.09122853825571024
in-drivable-lane_median10.10000000000003


other stats
agent_compute-ego0_max0.050679395111595714
agent_compute-ego0_mean0.02245597788848245
agent_compute-ego0_median0.0132419980124922
agent_compute-ego0_min0.01266052041734968
complete-iteration_max0.2715681989987691
complete-iteration_mean0.2129756421536264
complete-iteration_median0.20161055132279412
complete-iteration_min0.17711326697014815
deviation-center-line_max0.3440073463210169
deviation-center-line_mean0.14882782409703207
deviation-center-line_min0.0688468735556909
deviation-heading_max1.7036204134556758
deviation-heading_mean0.958366444344687
deviation-heading_median0.7718755689627972
deviation-heading_min0.5860942259974778
driven_any_max3.209572231363311
driven_any_mean2.0591904608119123
driven_any_median2.3762726815086697
driven_any_min0.2746442488669994
driven_lanedir_consec_max0.45262600847993784
driven_lanedir_consec_mean0.24544004423469923
driven_lanedir_consec_min0.10942593521705524
driven_lanedir_max0.45262600847993784
driven_lanedir_mean0.24544004423469923
driven_lanedir_median0.20985411662090192
driven_lanedir_min0.10942593521705524
get_duckie_state_max1.678379570565573e-06
get_duckie_state_mean1.5030334038631255e-06
get_duckie_state_median1.5556253081652238e-06
get_duckie_state_min1.2225034285564813e-06
get_robot_state_max0.0040390342473983765
get_robot_state_mean0.003922810852273665
get_robot_state_median0.003959828413971174
get_robot_state_min0.003732552333753936
get_state_dump_max0.005066582342473472
get_state_dump_mean0.004891386750190131
get_state_dump_median0.004911295510417316
get_state_dump_min0.004676373637452417
get_ui_image_max0.036149625976880394
get_ui_image_mean0.03128315336713457
get_ui_image_median0.030539141094093305
get_ui_image_min0.027904705303471264
in-drivable-lane_max14.750000000000096
in-drivable-lane_mean9.03750000000004
in-drivable-lane_min1.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.937078488330224, "get_ui_image": 0.029581049420186224, "step_physics": 0.10646659017398656, "survival_time": 15.05000000000008, "driven_lanedir": 0.45262600847993784, "get_state_dump": 0.004798162851902033, "get_robot_state": 0.0038905514786575016, "sim_render-ego0": 0.00410665502611375, "get_duckie_state": 1.5962992282892694e-06, "in-drivable-lane": 11.950000000000056, "deviation-heading": 1.7036204134556758, "agent_compute-ego0": 0.01312993299092678, "complete-iteration": 0.17711326697014815, "set_robot_commands": 0.0022777847896348563, "deviation-center-line": 0.3440073463210169, "driven_lanedir_consec": 0.45262600847993784, "sim_compute_sim_state": 0.010609902293476836, "sim_compute_performance-ego0": 0.0021575618263901465}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2746442488669994, "get_ui_image": 0.036149625976880394, "step_physics": 0.1941594978173574, "survival_time": 2.3499999999999996, "driven_lanedir": 0.10942593521705524, "get_state_dump": 0.005024428168932597, "get_robot_state": 0.0040390342473983765, "sim_render-ego0": 0.004225596785545349, "get_duckie_state": 1.5149513880411785e-06, "in-drivable-lane": 1.1999999999999993, "deviation-heading": 0.8566578031087703, "agent_compute-ego0": 0.013354063034057615, "complete-iteration": 0.2715681989987691, "set_robot_commands": 0.0025406132141749063, "deviation-center-line": 0.0688468735556909, "driven_lanedir_consec": 0.10942593521705524, "sim_compute_sim_state": 0.00973999003569285, "sim_compute_performance-ego0": 0.002242604891459147}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.8154668746871152, "get_ui_image": 0.031497232768000386, "step_physics": 0.1224148455931216, "survival_time": 9.750000000000004, "driven_lanedir": 0.18341685693845688, "get_state_dump": 0.004676373637452417, "get_robot_state": 0.003732552333753936, "sim_render-ego0": 0.003869258627599599, "get_duckie_state": 1.2225034285564813e-06, "in-drivable-lane": 8.250000000000004, "deviation-heading": 0.6870933348168242, "agent_compute-ego0": 0.01266052041734968, "complete-iteration": 0.19083431788853236, "set_robot_commands": 0.0021811906172304737, "deviation-center-line": 0.07815545013284414, "driven_lanedir_consec": 0.18341685693845688, "sim_compute_sim_state": 0.007727350507463727, "sim_compute_performance-ego0": 0.001991133300625548}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.209572231363311, "get_ui_image": 0.027904705303471264, "step_physics": 0.1101968353841363, "survival_time": 16.350000000000097, "driven_lanedir": 0.23629137630334696, "get_state_dump": 0.005066582342473472, "get_robot_state": 0.0040291053492848465, "sim_render-ego0": 0.004119406386119563, "get_duckie_state": 1.678379570565573e-06, "in-drivable-lane": 14.750000000000096, "deviation-heading": 0.5860942259974778, "agent_compute-ego0": 0.050679395111595714, "complete-iteration": 0.21238678475705589, "set_robot_commands": 0.002411776199573424, "deviation-center-line": 0.10430162637857632, "driven_lanedir_consec": 0.23629137630334696, "sim_compute_sim_state": 0.005717813241772536, "sim_compute_performance-ego0": 0.002158135175704956}}
set_robot_commands_max0.0025406132141749063
set_robot_commands_mean0.0023528412051534147
set_robot_commands_median0.00234478049460414
set_robot_commands_min0.0021811906172304737
sim_compute_performance-ego0_max0.002242604891459147
sim_compute_performance-ego0_mean0.002137358798544949
sim_compute_performance-ego0_median0.002157848501047551
sim_compute_performance-ego0_min0.001991133300625548
sim_compute_sim_state_max0.010609902293476836
sim_compute_sim_state_mean0.008448764019601488
sim_compute_sim_state_median0.008733670271578288
sim_compute_sim_state_min0.005717813241772536
sim_render-ego0_max0.004225596785545349
sim_render-ego0_mean0.004080229206344565
sim_render-ego0_median0.004113030706116657
sim_render-ego0_min0.003869258627599599
simulation-passed1
step_physics_max0.1941594978173574
step_physics_mean0.13330944224215047
step_physics_median0.11630584048862894
step_physics_min0.10646659017398656
survival_time_max16.350000000000097
survival_time_mean10.875000000000046
survival_time_min2.3499999999999996
No reset possible
5735311012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5719610995Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:43:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012942217470307237
agent_compute-ego0_mean0.012241421244126572
agent_compute-ego0_median0.012196658949967128
agent_compute-ego0_min0.011630149606264798
complete-iteration_max0.334220495152533
complete-iteration_mean0.2931023197408322
complete-iteration_median0.29890728503043806
complete-iteration_min0.2403742137499197
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4271366903922838e-06
get_duckie_state_mean1.297803048190229e-06
get_duckie_state_median1.2657425981278623e-06
get_duckie_state_min1.2325903061129072e-06
get_robot_state_max0.0038497048948924807
get_robot_state_mean0.003734649518050322
get_robot_state_median0.003721962066415347
get_robot_state_min0.003644969044478112
get_state_dump_max0.004720072265866396
get_state_dump_mean0.004644238234161834
get_state_dump_median0.004655170003937047
get_state_dump_min0.0045465406629068466
get_ui_image_max0.03429171266801947
get_ui_image_mean0.03030595721849097
get_ui_image_median0.030327381539801378
get_ui_image_min0.026277353126341656
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028580646729290633, "step_physics": 0.22235533597566604, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004720072265866396, "get_robot_state": 0.0038497048948924807, "sim_render-ego0": 0.003950129142907339, "get_duckie_state": 1.4271366903922838e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011988368856222007, "complete-iteration": 0.28872681160354297, "set_robot_commands": 0.0022968205683038794, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008793413787956143, "sim_compute_performance-ego0": 0.002102424659697241}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03429171266801947, "step_physics": 0.25918780715141965, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004710317154311816, "get_robot_state": 0.003644969044478112, "sim_render-ego0": 0.0038784546816378806, "get_duckie_state": 1.2325903061129072e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012942217470307237, "complete-iteration": 0.334220495152533, "set_robot_commands": 0.002132962486527544, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01140672261272243, "sim_compute_performance-ego0": 0.0019413751924564}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03207411635031212, "step_physics": 0.2400839763517483, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004600022853562278, "get_robot_state": 0.003719497580611637, "sim_render-ego0": 0.0038481284736296617, "get_duckie_state": 1.249265710479711e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.011630149606264798, "complete-iteration": 0.3090877584573331, "set_robot_commands": 0.0021873479282528436, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008872712680838885, "sim_compute_performance-ego0": 0.0019860581295575628}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026277353126341656, "step_physics": 0.1790064294371974, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0045465406629068466, "get_robot_state": 0.0037244265522190577, "sim_render-ego0": 0.003906792546192077, "get_duckie_state": 1.2822194857760135e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012404949043712253, "complete-iteration": 0.2403742137499197, "set_robot_commands": 0.0022612963985344653, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006139855301449638, "sim_compute_performance-ego0": 0.002023129340115435}}
set_robot_commands_max0.0022968205683038794
set_robot_commands_mean0.002219606845404683
set_robot_commands_median0.0022243221633936544
set_robot_commands_min0.002132962486527544
sim_compute_performance-ego0_max0.002102424659697241
sim_compute_performance-ego0_mean0.00201324683045666
sim_compute_performance-ego0_median0.0020045937348364988
sim_compute_performance-ego0_min0.0019413751924564
sim_compute_sim_state_max0.01140672261272243
sim_compute_sim_state_mean0.008803176095741773
sim_compute_sim_state_median0.008833063234397514
sim_compute_sim_state_min0.006139855301449638
sim_render-ego0_max0.003950129142907339
sim_render-ego0_mean0.003895876211091739
sim_render-ego0_median0.003892623613914979
sim_render-ego0_min0.0038481284736296617
simulation-passed1
step_physics_max0.25918780715141965
step_physics_mean0.22515838722900783
step_physics_median0.23121965616370715
step_physics_min0.1790064294371974
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5718111010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-010:02:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5716211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-010:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5714911313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5712611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-010:02:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5695211050Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:33:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7339420137519002
survival_time_median58.32499999999882
deviation-center-line_median0.7018504894043393
in-drivable-lane_median36.2499999999993


other stats
agent_compute-ego0_max0.0124627332901776
agent_compute-ego0_mean0.012152655875828188
agent_compute-ego0_median0.012140007008655827
agent_compute-ego0_min0.011867876195823494
complete-iteration_max0.21285758426370233
complete-iteration_mean0.1799622063424442
complete-iteration_median0.17507097376017672
complete-iteration_min0.15684929358572092
deviation-center-line_max2.5756281947063404
deviation-center-line_mean1.1005907272787092
deviation-center-line_min0.4230337355998178
deviation-heading_max16.759746885714296
deviation-heading_mean7.438391142718045
deviation-heading_median5.219871605298782
deviation-heading_min2.5540744745603146
driven_any_max7.760776207571088
driven_any_mean6.5515928625185795
driven_any_median6.950625867330159
driven_any_min4.5443435078429095
driven_lanedir_consec_max3.4452854128930075
driven_lanedir_consec_mean1.9926675058981869
driven_lanedir_consec_min1.0575005831959392
driven_lanedir_max5.117484233581599
driven_lanedir_mean2.4202566167597084
driven_lanedir_median1.7530208251306478
driven_lanedir_min1.0575005831959392
get_duckie_state_max1.3035230956170084e-06
get_duckie_state_mean1.2553285349888998e-06
get_duckie_state_median1.2504417794996126e-06
get_duckie_state_min1.2169074853393655e-06
get_robot_state_max0.003830928588092178
get_robot_state_mean0.003671632633297346
get_robot_state_median0.0036609663442743025
get_robot_state_min0.0035336692565486
get_state_dump_max0.004748157021604311
get_state_dump_mean0.004657450476451854
get_state_dump_median0.0047147093601305765
get_state_dump_min0.004452226163941954
get_ui_image_max0.03571078428305436
get_ui_image_mean0.030184964377220173
get_ui_image_median0.029488492567870735
get_ui_image_min0.026052088090084864
in-drivable-lane_max44.69999999999886
in-drivable-lane_mean31.737499999999308
in-drivable-lane_min9.749999999999792
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.760776207571088, "get_ui_image": 0.02672361076920356, "step_physics": 0.0931645827329129, "survival_time": 59.99999999999873, "driven_lanedir": 2.021210395327367, "get_state_dump": 0.004452226163941954, "get_robot_state": 0.0035336692565486, "sim_render-ego0": 0.003850731027811195, "get_duckie_state": 1.2169074853393655e-06, "in-drivable-lane": 43.84999999999863, "deviation-heading": 3.28794073752406, "agent_compute-ego0": 0.01203247152895455, "complete-iteration": 0.15684929358572092, "set_robot_commands": 0.002108680517052135, "deviation-center-line": 0.5150340538801874, "driven_lanedir_consec": 2.021210395327367, "sim_compute_sim_state": 0.008976371560267465, "sim_compute_performance-ego0": 0.0019244685161123663}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.764104106634361, "get_ui_image": 0.03571078428305436, "step_physics": 0.13736479812198216, "survival_time": 56.64999999999892, "driven_lanedir": 5.117484233581599, "get_state_dump": 0.0046850857070303885, "get_robot_state": 0.003651990671847442, "sim_render-ego0": 0.00384935563203519, "get_duckie_state": 1.3035230956170084e-06, "in-drivable-lane": 9.749999999999792, "deviation-heading": 16.759746885714296, "agent_compute-ego0": 0.011867876195823494, "complete-iteration": 0.21285758426370233, "set_robot_commands": 0.002181555648749888, "deviation-center-line": 2.5756281947063404, "driven_lanedir_consec": 3.4452854128930075, "sim_compute_sim_state": 0.011475886617388045, "sim_compute_performance-ego0": 0.0019837443370247223}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.137147628025958, "get_ui_image": 0.03225337436653791, "step_physics": 0.11544967868941512, "survival_time": 59.99999999999873, "driven_lanedir": 1.4848312549339289, "get_state_dump": 0.004748157021604311, "get_robot_state": 0.003830928588092178, "sim_render-ego0": 0.00404177001870542, "get_duckie_state": 1.2452953761066623e-06, "in-drivable-lane": 44.69999999999886, "deviation-heading": 7.151802473073505, "agent_compute-ego0": 0.0124627332901776, "complete-iteration": 0.1907538224219482, "set_robot_commands": 0.002286838949173317, "deviation-center-line": 0.8886669249284911, "driven_lanedir_consec": 1.4466736321764335, "sim_compute_sim_state": 0.013481752362279074, "sim_compute_performance-ego0": 0.002107534678552074}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.5443435078429095, "get_ui_image": 0.026052088090084864, "step_physics": 0.09793376798106858, "survival_time": 38.249999999999964, "driven_lanedir": 1.0575005831959392, "get_state_dump": 0.0047443330132307645, "get_robot_state": 0.003669942016701163, "sim_render-ego0": 0.003956180328488661, "get_duckie_state": 1.2555881828925629e-06, "in-drivable-lane": 28.649999999999963, "deviation-heading": 2.5540744745603146, "agent_compute-ego0": 0.012247542488357103, "complete-iteration": 0.15938812509840525, "set_robot_commands": 0.0021663820152183115, "deviation-center-line": 0.4230337355998178, "driven_lanedir_consec": 1.0575005831959392, "sim_compute_sim_state": 0.0065756538206852445, "sim_compute_performance-ego0": 0.0019523910691781705}}
set_robot_commands_max0.002286838949173317
set_robot_commands_mean0.0021858642825484127
set_robot_commands_median0.0021739688319841
set_robot_commands_min0.002108680517052135
sim_compute_performance-ego0_max0.002107534678552074
sim_compute_performance-ego0_mean0.0019920346502168332
sim_compute_performance-ego0_median0.0019680677031014464
sim_compute_performance-ego0_min0.0019244685161123663
sim_compute_sim_state_max0.013481752362279074
sim_compute_sim_state_mean0.010127416090154957
sim_compute_sim_state_median0.010226129088827756
sim_compute_sim_state_min0.0065756538206852445
sim_render-ego0_max0.00404177001870542
sim_render-ego0_mean0.003924509251760117
sim_render-ego0_median0.003903455678149928
sim_render-ego0_min0.00384935563203519
simulation-passed1
step_physics_max0.13736479812198216
step_physics_mean0.11097820688134467
step_physics_median0.10669172333524184
step_physics_min0.0931645827329129
survival_time_max59.99999999999873
survival_time_mean53.724999999999085
survival_time_min38.249999999999964
No reset possible
5692211056Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:05:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 477 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5687111067Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3717510363584944
survival_time_median11.900000000000034
deviation-center-line_median0.2441162885962289
in-drivable-lane_median8.675000000000013


other stats
agent_compute-ego0_max0.04573091398483204
agent_compute-ego0_mean0.021581007094146107
agent_compute-ego0_median0.013822410067174534
agent_compute-ego0_min0.012948294257403311
complete-iteration_max0.22453483872943455
complete-iteration_mean0.1960532436895037
complete-iteration_median0.1965400066819875
complete-iteration_min0.1665981226646052
deviation-center-line_max0.3865574729495145
deviation-center-line_mean0.24815861030728617
deviation-center-line_min0.11784439108717236
deviation-heading_max2.688364737568526
deviation-heading_mean1.45052977309475
deviation-heading_median1.279662809618742
deviation-heading_min0.5544287355729901
driven_any_max4.106876860215783
driven_any_mean2.4333049176759243
driven_any_median2.0486788467587385
driven_any_min1.528985116970438
driven_lanedir_consec_max0.6162719989483961
driven_lanedir_consec_mean0.4227051789571069
driven_lanedir_consec_min0.33104664416304286
driven_lanedir_max0.6781503994912401
driven_lanedir_mean0.4921148313431115
driven_lanedir_median0.4796311408590816
driven_lanedir_min0.33104664416304286
get_duckie_state_max2.6477707756890192e-06
get_duckie_state_mean2.241955381406197e-06
get_duckie_state_median2.1368593874017003e-06
get_duckie_state_min2.046331975132368e-06
get_robot_state_max0.00445642868677775
get_robot_state_mean0.003898725699433389
get_robot_state_median0.00377972539295401
get_robot_state_min0.003579023325047786
get_state_dump_max0.005518564913007948
get_state_dump_mean0.004926262256752106
get_state_dump_median0.004781424214363046
get_state_dump_min0.004623635685274386
get_ui_image_max0.03689382645846925
get_ui_image_mean0.03194892697630414
get_ui_image_median0.03201835492576999
get_ui_image_min0.02686517159520732
in-drivable-lane_max18.350000000000176
in-drivable-lane_mean10.637500000000047
in-drivable-lane_min6.849999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4164871658915437, "get_ui_image": 0.028663248605049502, "step_physics": 0.0982689250274544, "survival_time": 13.300000000000054, "driven_lanedir": 0.6162719989483961, "get_state_dump": 0.004809976070561213, "get_robot_state": 0.003767239467035072, "sim_render-ego0": 0.004001520992664809, "get_duckie_state": 2.1314799562375643e-06, "in-drivable-lane": 8.950000000000014, "deviation-heading": 1.923972732291042, "agent_compute-ego0": 0.012948294257403311, "complete-iteration": 0.1665981226646052, "set_robot_commands": 0.002237277084522033, "deviation-center-line": 0.3865574729495145, "driven_lanedir_consec": 0.6162719989483961, "sim_compute_sim_state": 0.00977769862400012, "sim_compute_performance-ego0": 0.002033482776598984}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.106876860215783, "get_ui_image": 0.03689382645846925, "step_physics": 0.12368690791140148, "survival_time": 23.6000000000002, "driven_lanedir": 0.6781503994912401, "get_state_dump": 0.004752872358164878, "get_robot_state": 0.003792211318872948, "sim_render-ego0": 0.0040636617083882175, "get_duckie_state": 2.142238818565836e-06, "in-drivable-lane": 18.350000000000176, "deviation-heading": 2.688364737568526, "agent_compute-ego0": 0.013168683767822782, "complete-iteration": 0.2016184818921079, "set_robot_commands": 0.0023070304136699653, "deviation-center-line": 0.3545327653578934, "driven_lanedir_consec": 0.4005117899472217, "sim_compute_sim_state": 0.010736500738035044, "sim_compute_performance-ego0": 0.002128560749723342}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.528985116970438, "get_ui_image": 0.035373461246490476, "step_physics": 0.1446601947148641, "survival_time": 8.949999999999992, "driven_lanedir": 0.33104664416304286, "get_state_dump": 0.005518564913007948, "get_robot_state": 0.00445642868677775, "sim_render-ego0": 0.0046623905499776205, "get_duckie_state": 2.6477707756890192e-06, "in-drivable-lane": 6.849999999999992, "deviation-heading": 0.6353528869464421, "agent_compute-ego0": 0.014476136366526286, "complete-iteration": 0.22453483872943455, "set_robot_commands": 0.00265735387802124, "deviation-center-line": 0.11784439108717236, "driven_lanedir_consec": 0.33104664416304286, "sim_compute_sim_state": 0.010179514355129666, "sim_compute_performance-ego0": 0.0024389465649922687}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.680870527625933, "get_ui_image": 0.02686517159520732, "step_physics": 0.09752625876693365, "survival_time": 10.500000000000014, "driven_lanedir": 0.34299028276976706, "get_state_dump": 0.004623635685274386, "get_robot_state": 0.003579023325047786, "sim_render-ego0": 0.003742171689797352, "get_duckie_state": 2.046331975132368e-06, "in-drivable-lane": 8.400000000000013, "deviation-heading": 0.5544287355729901, "agent_compute-ego0": 0.04573091398483204, "complete-iteration": 0.19146153147186712, "set_robot_commands": 0.0023067460805883903, "deviation-center-line": 0.1336998118345643, "driven_lanedir_consec": 0.34299028276976706, "sim_compute_sim_state": 0.005090746269406866, "sim_compute_performance-ego0": 0.0019108842334476129}}
set_robot_commands_max0.00265735387802124
set_robot_commands_mean0.002377101864200407
set_robot_commands_median0.002306888247129178
set_robot_commands_min0.002237277084522033
sim_compute_performance-ego0_max0.0024389465649922687
sim_compute_performance-ego0_mean0.0021279685811905515
sim_compute_performance-ego0_median0.002081021763161163
sim_compute_performance-ego0_min0.0019108842334476129
sim_compute_sim_state_max0.010736500738035044
sim_compute_sim_state_mean0.008946114996642924
sim_compute_sim_state_median0.009978606489564891
sim_compute_sim_state_min0.005090746269406866
sim_render-ego0_max0.0046623905499776205
sim_render-ego0_mean0.004117436235207
sim_render-ego0_median0.004032591350526513
sim_render-ego0_min0.003742171689797352
simulation-passed1
step_physics_max0.1446601947148641
step_physics_mean0.1160355716051634
step_physics_median0.11097791646942792
step_physics_min0.09752625876693365
survival_time_max23.6000000000002
survival_time_mean14.087500000000066
survival_time_min8.949999999999992
No reset possible
5658511102Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:37:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.1384815412864
survival_time_median59.99999999999873
deviation-center-line_median2.8602712433356388
in-drivable-lane_median2.5749999999999815


other stats
agent_compute-ego0_max0.012554247313792462
agent_compute-ego0_mean0.012252743545916557
agent_compute-ego0_median0.01238112842709099
agent_compute-ego0_min0.011694470015691778
complete-iteration_max0.21228191120042889
complete-iteration_mean0.1833179567775361
complete-iteration_median0.17714522780228614
complete-iteration_min0.1666994603051433
deviation-center-line_max3.259738878342652
deviation-center-line_mean2.8717369181721546
deviation-center-line_min2.5066663076746907
deviation-heading_max16.041544149770456
deviation-heading_mean14.159218514196253
deviation-heading_median13.658634889770653
deviation-heading_min13.278060127473248
driven_any_max9.407579900223263
driven_any_mean9.29907318007659
driven_any_median9.350384011717278
driven_any_min9.087944796648546
driven_lanedir_consec_max6.327423445764906
driven_lanedir_consec_mean5.152274398954221
driven_lanedir_consec_min4.004711067479178
driven_lanedir_max8.931390277988726
driven_lanedir_mean8.486144194962861
driven_lanedir_median8.583331611472468
driven_lanedir_min7.846523278917779
get_duckie_state_max1.3931903315027192e-06
get_duckie_state_mean1.3218235711471722e-06
get_duckie_state_median1.311897735214551e-06
get_duckie_state_min1.270308482656868e-06
get_robot_state_max0.003712133602933225
get_robot_state_mean0.0036039923152558313
get_robot_state_median0.003625648702610343
get_robot_state_min0.0034525382528694144
get_state_dump_max0.004787427598888134
get_state_dump_mean0.00458912284646205
get_state_dump_median0.004609093578729304
get_state_dump_min0.004350876629501457
get_ui_image_max0.03568284199894914
get_ui_image_mean0.03021490603660564
get_ui_image_median0.02920098090350479
get_ui_image_min0.02677482034046386
in-drivable-lane_max4.749999999999961
in-drivable-lane_mean2.6374999999999824
in-drivable-lane_min0.6500000000000048
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.399182819260105, "get_ui_image": 0.026820448812695963, "step_physics": 0.10483648100066048, "survival_time": 59.99999999999873, "driven_lanedir": 8.663587853517612, "get_state_dump": 0.004350876629501457, "get_robot_state": 0.0034525382528694144, "sim_render-ego0": 0.003631358341213865, "get_duckie_state": 1.270308482656868e-06, "in-drivable-lane": 2.4499999999999247, "deviation-heading": 13.278060127473248, "agent_compute-ego0": 0.011694470015691778, "complete-iteration": 0.1682759661360843, "set_robot_commands": 0.0020322928718484313, "deviation-center-line": 2.5066663076746907, "driven_lanedir_consec": 6.169954924955189, "sim_compute_sim_state": 0.009531208120913032, "sim_compute_performance-ego0": 0.0018460208629192064}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.087944796648546, "get_ui_image": 0.03568284199894914, "step_physics": 0.13640403985778657, "survival_time": 59.99999999999873, "driven_lanedir": 7.846523278917779, "get_state_dump": 0.004538641682671667, "get_robot_state": 0.003649068613235004, "sim_render-ego0": 0.0039036754366757968, "get_duckie_state": 1.2881749873355862e-06, "in-drivable-lane": 4.749999999999961, "deviation-heading": 16.041544149770456, "agent_compute-ego0": 0.012474004473912528, "complete-iteration": 0.21228191120042889, "set_robot_commands": 0.002221900358684454, "deviation-center-line": 2.9246483641389713, "driven_lanedir_consec": 4.004711067479178, "sim_compute_sim_state": 0.011274492611595237, "sim_compute_performance-ego0": 0.0020478069534111184}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.407579900223263, "get_ui_image": 0.03158151299431362, "step_physics": 0.1145798838406578, "survival_time": 59.99999999999873, "driven_lanedir": 8.931390277988726, "get_state_dump": 0.004787427598888134, "get_robot_state": 0.003602228791985682, "sim_render-ego0": 0.0039028809727677497, "get_duckie_state": 1.3931903315027192e-06, "in-drivable-lane": 0.6500000000000048, "deviation-heading": 13.635832124364256, "agent_compute-ego0": 0.012554247313792462, "complete-iteration": 0.186014489468488, "set_robot_commands": 0.002174106267568571, "deviation-center-line": 3.259738878342652, "driven_lanedir_consec": 6.327423445764906, "sim_compute_sim_state": 0.010722617920391964, "sim_compute_performance-ego0": 0.002017742985988239}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.301585204174453, "get_ui_image": 0.02677482034046386, "step_physics": 0.104826796362541, "survival_time": 59.99999999999873, "driven_lanedir": 8.503075369427325, "get_state_dump": 0.004679545474786941, "get_robot_state": 0.003712133602933225, "sim_render-ego0": 0.004000405090039814, "get_duckie_state": 1.335620483093516e-06, "in-drivable-lane": 2.7000000000000384, "deviation-heading": 13.681437655177051, "agent_compute-ego0": 0.012288252380269453, "complete-iteration": 0.1666994603051433, "set_robot_commands": 0.002260953758678071, "deviation-center-line": 2.7958941225323057, "driven_lanedir_consec": 4.107008157617612, "sim_compute_sim_state": 0.006064733200327343, "sim_compute_performance-ego0": 0.00200552606860565}}
set_robot_commands_max0.002260953758678071
set_robot_commands_mean0.002172313314194882
set_robot_commands_median0.002198003313126512
set_robot_commands_min0.0020322928718484313
sim_compute_performance-ego0_max0.0020478069534111184
sim_compute_performance-ego0_mean0.0019792742177310533
sim_compute_performance-ego0_median0.0020116345272969444
sim_compute_performance-ego0_min0.0018460208629192064
sim_compute_sim_state_max0.011274492611595237
sim_compute_sim_state_mean0.009398262963306894
sim_compute_sim_state_median0.010126913020652498
sim_compute_sim_state_min0.006064733200327343
sim_render-ego0_max0.004000405090039814
sim_render-ego0_mean0.0038595799601743065
sim_render-ego0_median0.003903278204721773
sim_render-ego0_min0.003631358341213865
simulation-passed1
step_physics_max0.13640403985778657
step_physics_mean0.11516180026541144
step_physics_median0.10970818242065912
step_physics_min0.104826796362541
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5651411427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:07:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5644911119Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:04:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5630911126Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:05:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5627511284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5624811430Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-010:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5618611429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-010:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614911289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5613611289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5610011280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5606411287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5605311286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5602811281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5600311281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5592611291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:04:02
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5590511291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5586911296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5584711296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5579611303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:25
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5574111159Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5572411305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5569611305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5567111308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:29
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5564911290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5563211301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5559111310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5556411310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553811282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:41
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5550011299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5543511276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5535311283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5532311311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5530311450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-010:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5527411278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5523911285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5521711307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5515011309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:29
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5512511424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5509311302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5496411332Olga (Ge Ya) Xu 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:06:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5482011360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:20:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3298502558116767
survival_time_median30.15000000000014
deviation-center-line_median1.1308372933967576
in-drivable-lane_median8.625000000000107


other stats
agent_compute-ego0_max0.03313518086639074
agent_compute-ego0_mean0.01742821010007423
agent_compute-ego0_median0.012467976752166054
agent_compute-ego0_min0.011641706029574076
complete-iteration_max0.20402772029787508
complete-iteration_mean0.19029686464202136
complete-iteration_median0.1940868836812732
complete-iteration_min0.16898597090766393
deviation-center-line_max4.978820474955828
deviation-center-line_mean2.04858175452848
deviation-center-line_min0.9538319563645772
deviation-heading_max11.958198477818012
deviation-heading_mean5.22976997642385
deviation-heading_median3.4016577992820705
deviation-heading_min2.1575658293132487
driven_any_max10.3612413806023
driven_any_mean5.577958821265657
driven_any_median4.4119430200760625
driven_any_min3.1267078643082007
driven_lanedir_consec_max9.876603984888623
driven_lanedir_consec_mean4.103960887174446
driven_lanedir_consec_min1.879539052185805
driven_lanedir_max9.876603984888623
driven_lanedir_mean4.1052092391155774
driven_lanedir_median2.3298502558116767
driven_lanedir_min1.884532459950333
get_duckie_state_max1.465704237844741e-06
get_duckie_state_mean1.2923087139311457e-06
get_duckie_state_median1.2567122719322706e-06
get_duckie_state_min1.1901060740152994e-06
get_robot_state_max0.003939904733733921
get_robot_state_mean0.003690753517065341
get_robot_state_median0.003673084802558995
get_robot_state_min0.003476939729409452
get_state_dump_max0.004977654230151904
get_state_dump_mean0.004718848662295123
get_state_dump_median0.004738653736968032
get_state_dump_min0.004420432945092519
get_ui_image_max0.03435023725032806
get_ui_image_mean0.03022624604385016
get_ui_image_median0.030790253882347636
get_ui_image_min0.02497423916037732
in-drivable-lane_max24.650000000000045
in-drivable-lane_mean10.987500000000065
in-drivable-lane_min2.0500000000000007
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.5958481785337817, "get_ui_image": 0.028482567991387573, "step_physics": 0.124411964614773, "survival_time": 24.00000000000021, "driven_lanedir": 2.320370088307274, "get_state_dump": 0.004937714697665335, "get_robot_state": 0.0038380840959767047, "sim_render-ego0": 0.0038376241116910366, "get_duckie_state": 1.465704237844741e-06, "in-drivable-lane": 10.100000000000144, "deviation-heading": 2.1575658293132487, "agent_compute-ego0": 0.012254274808443507, "complete-iteration": 0.1927216365282848, "set_robot_commands": 0.002217680401712842, "deviation-center-line": 0.9589862157040524, "driven_lanedir_consec": 2.320370088307274, "sim_compute_sim_state": 0.010559891464804414, "sim_compute_performance-ego0": 0.0020899698293134726}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.1267078643082007, "get_ui_image": 0.03435023725032806, "step_physics": 0.12314824710289636, "survival_time": 23.950000000000205, "driven_lanedir": 2.339330423316079, "get_state_dump": 0.004420432945092519, "get_robot_state": 0.003508085509141286, "sim_render-ego0": 0.003572812179724375, "get_duckie_state": 1.1901060740152994e-06, "in-drivable-lane": 7.150000000000069, "deviation-heading": 3.632351370393129, "agent_compute-ego0": 0.011641706029574076, "complete-iteration": 0.1954521308342616, "set_robot_commands": 0.002068631847699483, "deviation-center-line": 1.3026883710894628, "driven_lanedir_consec": 2.339330423316079, "sim_compute_sim_state": 0.01081864188114802, "sim_compute_performance-ego0": 0.001837793986002604}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.228037861618343, "get_ui_image": 0.0330979397733077, "step_physics": 0.1304708068275714, "survival_time": 36.300000000000075, "driven_lanedir": 1.884532459950333, "get_state_dump": 0.004977654230151904, "get_robot_state": 0.003939904733733921, "sim_render-ego0": 0.003982918462530291, "get_duckie_state": 1.3108102622681505e-06, "in-drivable-lane": 24.650000000000045, "deviation-heading": 3.170964228171012, "agent_compute-ego0": 0.0126816786958886, "complete-iteration": 0.20402772029787508, "set_robot_commands": 0.0022867178490598066, "deviation-center-line": 0.9538319563645772, "driven_lanedir_consec": 1.879539052185805, "sim_compute_sim_state": 0.010384037537292732, "sim_compute_performance-ego0": 0.0021056761603899803}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.3612413806023, "get_ui_image": 0.02497423916037732, "step_physics": 0.08923480711213556, "survival_time": 59.99999999999873, "driven_lanedir": 9.876603984888623, "get_state_dump": 0.00453959277627073, "get_robot_state": 0.003476939729409452, "sim_render-ego0": 0.0036112311281431327, "get_duckie_state": 1.202614281596391e-06, "in-drivable-lane": 2.0500000000000007, "deviation-heading": 11.958198477818012, "agent_compute-ego0": 0.03313518086639074, "complete-iteration": 0.16898597090766393, "set_robot_commands": 0.002124823102546076, "deviation-center-line": 4.978820474955828, "driven_lanedir_consec": 9.876603984888623, "sim_compute_sim_state": 0.005976134196209173, "sim_compute_performance-ego0": 0.0018276116135316925}}
set_robot_commands_max0.0022867178490598066
set_robot_commands_mean0.002174463300254552
set_robot_commands_median0.002171251752129459
set_robot_commands_min0.002068631847699483
sim_compute_performance-ego0_max0.0021056761603899803
sim_compute_performance-ego0_mean0.0019652628973094374
sim_compute_performance-ego0_median0.0019638819076580384
sim_compute_performance-ego0_min0.0018276116135316925
sim_compute_sim_state_max0.01081864188114802
sim_compute_sim_state_mean0.009434676269863586
sim_compute_sim_state_median0.010471964501048573
sim_compute_sim_state_min0.005976134196209173
sim_render-ego0_max0.003982918462530291
sim_render-ego0_mean0.003751146470522209
sim_render-ego0_median0.003724427619917085
sim_render-ego0_min0.003572812179724375
simulation-passed1
step_physics_max0.1304708068275714
step_physics_mean0.11681645641434409
step_physics_median0.12378010585883469
step_physics_min0.08923480711213556
survival_time_max59.99999999999873
survival_time_mean36.0624999999998
survival_time_min23.950000000000205
No reset possible
5481211436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5473811383Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:13:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.752835145237749
survival_time_median21.425000000000168
deviation-center-line_median0.43110934295888137
in-drivable-lane_median13.875000000000142


other stats
agent_compute-ego0_max0.05012882407590405
agent_compute-ego0_mean0.04033807566066554
agent_compute-ego0_median0.04398512903630379
agent_compute-ego0_min0.0232532204941505
complete-iteration_max0.25040357172702804
complete-iteration_mean0.21216037755303055
complete-iteration_median0.20117045422682228
complete-iteration_min0.1958970300314498
deviation-center-line_max0.6105977142190445
deviation-center-line_mean0.40356184851925064
deviation-center-line_min0.1414309939401954
deviation-heading_max2.495627791892969
deviation-heading_mean1.5901141906619702
deviation-heading_median1.6969347314326635
deviation-heading_min0.4709595078895841
driven_any_max6.236553205159161
driven_any_mean4.711546401749689
driven_any_median4.868346863383382
driven_any_min2.8729386750728296
driven_lanedir_consec_max2.0264642331971565
driven_lanedir_consec_mean1.5532650853042729
driven_lanedir_consec_min0.6809258175444357
driven_lanedir_max2.0264642331971565
driven_lanedir_mean1.5532650853042729
driven_lanedir_median1.752835145237749
driven_lanedir_min0.6809258175444357
get_duckie_state_max1.2860930521428371e-06
get_duckie_state_mean1.219837297133126e-06
get_duckie_state_median1.2075218872983358e-06
get_duckie_state_min1.1782123617929957e-06
get_robot_state_max0.0038147949310670414
get_robot_state_mean0.003631848914616813
get_robot_state_median0.003658933587168415
get_robot_state_min0.003394733553063379
get_state_dump_max0.0050942641432567305
get_state_dump_mean0.004751367797563591
get_state_dump_median0.004785793185935733
get_state_dump_min0.004339620675126167
get_ui_image_max0.03627679083082411
get_ui_image_mean0.030009653022465888
get_ui_image_median0.02913928122073886
get_ui_image_min0.02548325881756172
in-drivable-lane_max25.600000000000268
in-drivable-lane_mean14.93750000000016
in-drivable-lane_min6.400000000000091
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.50067647648282, "get_ui_image": 0.026842642320345524, "step_physics": 0.10831347230362566, "survival_time": 14.550000000000072, "driven_lanedir": 2.0264642331971565, "get_state_dump": 0.004339620675126167, "get_robot_state": 0.003394733553063379, "sim_render-ego0": 0.0034984325709408277, "get_duckie_state": 1.1782123617929957e-06, "in-drivable-lane": 6.400000000000091, "deviation-heading": 1.6313717657123463, "agent_compute-ego0": 0.04502541316698675, "complete-iteration": 0.20477577349910997, "set_robot_commands": 0.0021299229909295904, "deviation-center-line": 0.4157580651986639, "driven_lanedir_consec": 2.0264642331971565, "sim_compute_sim_state": 0.009306358964475866, "sim_compute_performance-ego0": 0.001838198263351231}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.8729386750728296, "get_ui_image": 0.03627679083082411, "step_physics": 0.1440832529443994, "survival_time": 13.900000000000064, "driven_lanedir": 1.5285528022621675, "get_state_dump": 0.0050942641432567305, "get_robot_state": 0.003680358223590372, "sim_render-ego0": 0.0037648694916865306, "get_duckie_state": 1.2860930521428371e-06, "in-drivable-lane": 6.65000000000008, "deviation-heading": 1.7624976971529809, "agent_compute-ego0": 0.04294484490562084, "complete-iteration": 0.25040357172702804, "set_robot_commands": 0.002259578328833358, "deviation-center-line": 0.44646062071909887, "driven_lanedir_consec": 1.5285528022621675, "sim_compute_sim_state": 0.010240325791006874, "sim_compute_performance-ego0": 0.0019657962211144012}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.236553205159161, "get_ui_image": 0.0314359201211322, "step_physics": 0.11354467667729022, "survival_time": 29.000000000000277, "driven_lanedir": 1.9771174882133304, "get_state_dump": 0.005038004528840109, "get_robot_state": 0.0038147949310670414, "sim_render-ego0": 0.004012411514781223, "get_duckie_state": 1.2195869485195245e-06, "in-drivable-lane": 21.100000000000204, "deviation-heading": 2.495627791892969, "agent_compute-ego0": 0.0232532204941505, "complete-iteration": 0.1975651349545346, "set_robot_commands": 0.0022555329097938208, "deviation-center-line": 0.6105977142190445, "driven_lanedir_consec": 1.9771174882133304, "sim_compute_sim_state": 0.012024430112461217, "sim_compute_performance-ego0": 0.002096573785332107}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.236017250283944, "get_ui_image": 0.02548325881756172, "step_physics": 0.09811106939164418, "survival_time": 28.300000000000267, "driven_lanedir": 0.6809258175444357, "get_state_dump": 0.004533581843031357, "get_robot_state": 0.003637508950746459, "sim_render-ego0": 0.0037265038364148015, "get_duckie_state": 1.1954568260771468e-06, "in-drivable-lane": 25.600000000000268, "deviation-heading": 0.4709595078895841, "agent_compute-ego0": 0.05012882407590405, "complete-iteration": 0.1958970300314498, "set_robot_commands": 0.00218093290110324, "deviation-center-line": 0.1414309939401954, "driven_lanedir_consec": 0.6809258175444357, "sim_compute_sim_state": 0.006066193235824558, "sim_compute_performance-ego0": 0.0019385995478016149}}
set_robot_commands_max0.002259578328833358
set_robot_commands_mean0.0022064917826650023
set_robot_commands_median0.0022182329054485305
set_robot_commands_min0.0021299229909295904
sim_compute_performance-ego0_max0.002096573785332107
sim_compute_performance-ego0_mean0.0019597919543998385
sim_compute_performance-ego0_median0.001952197884458008
sim_compute_performance-ego0_min0.001838198263351231
sim_compute_sim_state_max0.012024430112461217
sim_compute_sim_state_mean0.009409327025942127
sim_compute_sim_state_median0.00977334237774137
sim_compute_sim_state_min0.006066193235824558
sim_render-ego0_max0.004012411514781223
sim_render-ego0_mean0.003750554353455846
sim_render-ego0_median0.003745686664050666
sim_render-ego0_min0.0034984325709408277
simulation-passed1
step_physics_max0.1440832529443994
step_physics_mean0.11601311782923988
step_physics_median0.11092907449045794
step_physics_min0.09811106939164418
survival_time_max29.000000000000277
survival_time_mean21.43750000000017
survival_time_min13.900000000000064
No reset possible
5465611402Marton Moro 🇭🇺template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011308011909325918
agent_compute-ego0_mean0.010918075667116384
agent_compute-ego0_median0.010836463940294482
agent_compute-ego0_min0.010691362878550652
complete-iteration_max0.1783591793931049
complete-iteration_mean0.1600562074059189
complete-iteration_median0.16436942871109844
complete-iteration_min0.13312679280837378
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.3344817691379123e-06
get_duckie_state_mean1.198773154503547e-06
get_duckie_state_median1.177018830544838e-06
get_duckie_state_min1.1065731877866e-06
get_robot_state_max0.003375848134358724
get_robot_state_mean0.003314711523575972
get_robot_state_median0.0033483475397495235
get_robot_state_min0.003186302880446116
get_state_dump_max0.004305912388695611
get_state_dump_mean0.0041496272649966135
get_state_dump_median0.004183004534894054
get_state_dump_min0.003926587601502736
get_ui_image_max0.03138648167900417
get_ui_image_mean0.027349292499685898
get_ui_image_median0.0276591914867047
get_ui_image_min0.02269230534633001
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.026402361785309223, "step_physics": 0.0902848092815544, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004234531257725969, "get_robot_state": 0.0033312613451028173, "sim_render-ego0": 0.0035195773160910304, "get_duckie_state": 1.204164722297765e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010696732545200784, "complete-iteration": 0.15108252477042283, "set_robot_commands": 0.0020293736759620378, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.008716872975796083, "sim_compute_performance-ego0": 0.0017817156224311152}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03138648167900417, "step_physics": 0.11300416873848956, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0041314778120621395, "get_robot_state": 0.0033654337343962297, "sim_render-ego0": 0.0035351851712102475, "get_duckie_state": 1.1065731877866e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010691362878550652, "complete-iteration": 0.1783591793931049, "set_robot_commands": 0.0020606284556181536, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008157229941824207, "sim_compute_performance-ego0": 0.001940081948819368}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.028916021188100174, "step_physics": 0.11558159854676987, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004305912388695611, "get_robot_state": 0.003375848134358724, "sim_render-ego0": 0.003500256273481581, "get_duckie_state": 1.3344817691379123e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.010976195335388184, "complete-iteration": 0.17765633265177408, "set_robot_commands": 0.001982483598921034, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007110966576470269, "sim_compute_performance-ego0": 0.0018190443515777588}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02269230534633001, "step_physics": 0.08082922796408336, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.003926587601502736, "get_robot_state": 0.003186302880446116, "sim_render-ego0": 0.003278923531373342, "get_duckie_state": 1.1498729387919109e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011308011909325918, "complete-iteration": 0.13312679280837378, "set_robot_commands": 0.0018087973197301228, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.0043564314643541975, "sim_compute_performance-ego0": 0.001655163864294688}}
set_robot_commands_max0.0020606284556181536
set_robot_commands_mean0.001970320762557837
set_robot_commands_median0.002005928637441536
set_robot_commands_min0.0018087973197301228
sim_compute_performance-ego0_max0.001940081948819368
sim_compute_performance-ego0_mean0.0017990014467807326
sim_compute_performance-ego0_median0.001800379987004437
sim_compute_performance-ego0_min0.001655163864294688
sim_compute_sim_state_max0.008716872975796083
sim_compute_sim_state_mean0.00708537523961119
sim_compute_sim_state_median0.007634098259147238
sim_compute_sim_state_min0.0043564314643541975
sim_render-ego0_max0.0035351851712102475
sim_render-ego0_mean0.00345848557303905
sim_render-ego0_median0.0035099167947863054
sim_render-ego0_min0.003278923531373342
simulation-passed1
step_physics_max0.11558159854676987
step_physics_mean0.0999249511327243
step_physics_median0.101644489010022
step_physics_min0.08082922796408336
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5461411439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:21
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5459811438Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5456011446Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.159478254881536
survival_time_median10.475000000000014
deviation-center-line_median0.3532304171334428
in-drivable-lane_median5.1499999999999915


other stats
agent_compute-ego0_max0.012787368128208515
agent_compute-ego0_mean0.012611617788184554
agent_compute-ego0_median0.01257151215016341
agent_compute-ego0_min0.012516078724202883
complete-iteration_max0.2142492211627639
complete-iteration_mean0.1935680173399952
complete-iteration_median0.19542015004558724
complete-iteration_min0.1691825481060424
deviation-center-line_max0.7570832731373587
deviation-center-line_mean0.3957526345607349
deviation-center-line_min0.119466430838695
deviation-heading_max5.594837670956218
deviation-heading_mean2.065636003581185
deviation-heading_median1.069050289390194
deviation-heading_min0.5296057645881347
driven_any_max5.254228642877662
driven_any_mean2.776501658653056
driven_any_median2.2121976733173065
driven_any_min1.42738264509995
driven_lanedir_consec_max2.2365615012586018
driven_lanedir_consec_mean1.307845179138857
driven_lanedir_consec_min0.6758627055337535
driven_lanedir_max2.2365615012586018
driven_lanedir_mean1.3088358801122153
driven_lanedir_median1.1614596568282527
driven_lanedir_min0.6758627055337535
get_duckie_state_max1.374719921587292e-06
get_duckie_state_mean1.3226378935494067e-06
get_duckie_state_median1.3269580866113896e-06
get_duckie_state_min1.2619154793875558e-06
get_robot_state_max0.003894514696938651
get_robot_state_mean0.003803785070090708
get_robot_state_median0.003780513230289711
get_robot_state_min0.0037595991228447584
get_state_dump_max0.004938201174709967
get_state_dump_mean0.004795420761452432
get_state_dump_median0.0047690470679467465
get_state_dump_min0.00470538773520627
get_ui_image_max0.03650532868574766
get_ui_image_mean0.031817044696538434
get_ui_image_median0.03196241184442985
get_ui_image_min0.026838026411546385
in-drivable-lane_max18.850000000000268
in-drivable-lane_mean7.83750000000007
in-drivable-lane_min2.2000000000000313
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.5116117775161246, "get_ui_image": 0.030150216166712655, "step_physics": 0.11771878474900704, "survival_time": 11.850000000000032, "driven_lanedir": 2.2365615012586018, "get_state_dump": 0.004770134677406119, "get_robot_state": 0.003781520018056661, "sim_render-ego0": 0.0039859018405946365, "get_duckie_state": 1.3263285660944065e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 1.5370858748793137, "agent_compute-ego0": 0.012562510346164225, "complete-iteration": 0.18744329344324703, "set_robot_commands": 0.002364884905454491, "deviation-center-line": 0.5810169780481036, "driven_lanedir_consec": 2.2365615012586018, "sim_compute_sim_state": 0.009907076338759991, "sim_compute_performance-ego0": 0.002115540143822422}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.254228642877662, "get_ui_image": 0.03650532868574766, "step_physics": 0.13680132270260692, "survival_time": 29.650000000000286, "driven_lanedir": 1.6448416923394502, "get_state_dump": 0.00470538773520627, "get_robot_state": 0.0037795064425227617, "sim_render-ego0": 0.0038865294922080505, "get_duckie_state": 1.374719921587292e-06, "in-drivable-lane": 18.850000000000268, "deviation-heading": 5.594837670956218, "agent_compute-ego0": 0.012516078724202883, "complete-iteration": 0.2142492211627639, "set_robot_commands": 0.002304505820226188, "deviation-center-line": 0.7570832731373587, "driven_lanedir_consec": 1.640878888446017, "sim_compute_sim_state": 0.011557999283376369, "sim_compute_performance-ego0": 0.0021078397930671872}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.42738264509995, "get_ui_image": 0.03377460752214704, "step_physics": 0.1306684340749468, "survival_time": 6.949999999999983, "driven_lanedir": 0.6758627055337535, "get_state_dump": 0.004767959458487374, "get_robot_state": 0.003894514696938651, "sim_render-ego0": 0.0040685994284493585, "get_duckie_state": 1.2619154793875558e-06, "in-drivable-lane": 4.099999999999985, "deviation-heading": 0.5296057645881347, "agent_compute-ego0": 0.012580513954162598, "complete-iteration": 0.20339700664792745, "set_robot_commands": 0.0023660693849836077, "deviation-center-line": 0.12544385621878196, "driven_lanedir_consec": 0.6758627055337535, "sim_compute_sim_state": 0.008972941126142229, "sim_compute_performance-ego0": 0.002215513161250523}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.912783569118488, "get_ui_image": 0.026838026411546385, "step_physics": 0.10745477546108224, "survival_time": 9.099999999999994, "driven_lanedir": 0.6780776213170552, "get_state_dump": 0.004938201174709967, "get_robot_state": 0.0037595991228447584, "sim_render-ego0": 0.003878936090104567, "get_duckie_state": 1.3275876071283723e-06, "in-drivable-lane": 6.199999999999997, "deviation-heading": 0.6010147039010743, "agent_compute-ego0": 0.012787368128208515, "complete-iteration": 0.1691825481060424, "set_robot_commands": 0.002211714051460308, "deviation-center-line": 0.119466430838695, "driven_lanedir_consec": 0.6780776213170552, "sim_compute_sim_state": 0.005229698504255117, "sim_compute_performance-ego0": 0.00199840889602411}}
set_robot_commands_max0.0023660693849836077
set_robot_commands_mean0.002311793540531149
set_robot_commands_median0.0023346953628403397
set_robot_commands_min0.002211714051460308
sim_compute_performance-ego0_max0.002215513161250523
sim_compute_performance-ego0_mean0.0021093254985410604
sim_compute_performance-ego0_median0.0021116899684448043
sim_compute_performance-ego0_min0.00199840889602411
sim_compute_sim_state_max0.011557999283376369
sim_compute_sim_state_mean0.008916928813133426
sim_compute_sim_state_median0.00944000873245111
sim_compute_sim_state_min0.005229698504255117
sim_render-ego0_max0.0040685994284493585
sim_render-ego0_mean0.003954991712839153
sim_render-ego0_median0.003936215666401344
sim_render-ego0_min0.003878936090104567
simulation-passed1
step_physics_max0.13680132270260692
step_physics_mean0.12316082924691074
step_physics_median0.12419360941197692
step_physics_min0.10745477546108224
survival_time_max29.650000000000286
survival_time_mean14.387500000000074
survival_time_min6.949999999999983
No reset possible
5454311460Peter-Newman Messantemplate-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6055036992592069
survival_time_median9.375000000000018
deviation-center-line_median0.18473804170694985
in-drivable-lane_median6.650000000000013


other stats
agent_compute-ego0_max0.014073698665387333
agent_compute-ego0_mean0.013587905482530655
agent_compute-ego0_median0.01365104023821681
agent_compute-ego0_min0.012975842788301665
complete-iteration_max0.22473660825540465
complete-iteration_mean0.20203372542841871
complete-iteration_median0.20937841957811945
complete-iteration_min0.16464145430203142
deviation-center-line_max0.2974361004130338
deviation-center-line_mean0.19222488691871129
deviation-center-line_min0.10198736384791166
deviation-heading_max1.4059369246311029
deviation-heading_mean0.9042299443853554
deviation-heading_median0.8871427006244775
deviation-heading_min0.436697451661364
driven_any_max4.279531771945556
driven_any_mean2.652329208032049
driven_any_median2.490898326317563
driven_any_min1.3479884075475128
driven_lanedir_consec_max0.7046475527181317
driven_lanedir_consec_mean0.6117224646840642
driven_lanedir_consec_min0.5312349074997109
driven_lanedir_max0.7046475527181317
driven_lanedir_mean0.6117224646840642
driven_lanedir_median0.6055036992592069
driven_lanedir_min0.5312349074997109
get_duckie_state_max1.6744109405868355e-06
get_duckie_state_mean1.5827790399119845e-06
get_duckie_state_median1.63262253172125e-06
get_duckie_state_min1.3914601556186018e-06
get_robot_state_max0.004254966498182985
get_robot_state_mean0.004074510708349952
get_robot_state_median0.0041681050189941215
get_robot_state_min0.003706866297228583
get_state_dump_max0.005248737517901308
get_state_dump_mean0.0051346071389301775
get_state_dump_median0.005141330201387455
get_state_dump_min0.005007030635044493
get_ui_image_max0.03768063581789644
get_ui_image_mean0.03188052893807483
get_ui_image_median0.03188471395800355
get_ui_image_min0.026072052018395787
in-drivable-lane_max13.10000000000009
in-drivable-lane_mean7.287500000000027
in-drivable-lane_min2.7499999999999902
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.5912561627868715, "get_ui_image": 0.03069142454885432, "step_physics": 0.13100852363411036, "survival_time": 13.00000000000005, "driven_lanedir": 0.7046475527181317, "get_state_dump": 0.005248737517901308, "get_robot_state": 0.004127632155728979, "sim_render-ego0": 0.004305622130061475, "get_duckie_state": 1.6744109405868355e-06, "in-drivable-lane": 9.85000000000004, "deviation-heading": 1.3235377179814911, "agent_compute-ego0": 0.013475478380575948, "complete-iteration": 0.20437185243628492, "set_robot_commands": 0.0024751310604285465, "deviation-center-line": 0.2974361004130338, "driven_lanedir_consec": 0.7046475527181317, "sim_compute_sim_state": 0.010602587484308586, "sim_compute_performance-ego0": 0.002330949023308882}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.279531771945556, "get_ui_image": 0.03768063581789644, "step_physics": 0.14244736650119574, "survival_time": 15.600000000000088, "driven_lanedir": 0.5403018799745729, "get_state_dump": 0.005138029305698772, "get_robot_state": 0.004254966498182985, "sim_render-ego0": 0.004316281205929887, "get_duckie_state": 1.624750253110648e-06, "in-drivable-lane": 13.10000000000009, "deviation-heading": 1.4059369246311029, "agent_compute-ego0": 0.014073698665387333, "complete-iteration": 0.22473660825540465, "set_robot_commands": 0.002524568630864445, "deviation-center-line": 0.215373376241435, "driven_lanedir_consec": 0.5403018799745729, "sim_compute_sim_state": 0.011689540296316909, "sim_compute_performance-ego0": 0.0024761605186584277}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3479884075475128, "get_ui_image": 0.03307800336715278, "step_physics": 0.14028259592318754, "survival_time": 5.399999999999989, "driven_lanedir": 0.670705518543841, "get_state_dump": 0.005144631097076136, "get_robot_state": 0.004208577882259264, "sim_render-ego0": 0.004218381479245807, "get_duckie_state": 1.640494810331852e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.4507476832674639, "agent_compute-ego0": 0.013826602095857673, "complete-iteration": 0.2143849867199539, "set_robot_commands": 0.002484236288508144, "deviation-center-line": 0.10198736384791166, "driven_lanedir_consec": 0.670705518543841, "sim_compute_sim_state": 0.008806530488740414, "sim_compute_performance-ego0": 0.002231121063232422}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.390540489848254, "get_ui_image": 0.026072052018395787, "step_physics": 0.10337953731931487, "survival_time": 5.749999999999988, "driven_lanedir": 0.5312349074997109, "get_state_dump": 0.005007030635044493, "get_robot_state": 0.003706866297228583, "sim_render-ego0": 0.003823354326445481, "get_duckie_state": 1.3914601556186018e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.436697451661364, "agent_compute-ego0": 0.012975842788301665, "complete-iteration": 0.16464145430203142, "set_robot_commands": 0.0022304551354770004, "deviation-center-line": 0.15410270717246466, "driven_lanedir_consec": 0.5312349074997109, "sim_compute_sim_state": 0.00527231241094655, "sim_compute_performance-ego0": 0.002078128272089465}}
set_robot_commands_max0.002524568630864445
set_robot_commands_mean0.002428597778819534
set_robot_commands_median0.002479683674468345
set_robot_commands_min0.0022304551354770004
sim_compute_performance-ego0_max0.0024761605186584277
sim_compute_performance-ego0_mean0.002279089719322299
sim_compute_performance-ego0_median0.0022810350432706517
sim_compute_performance-ego0_min0.002078128272089465
sim_compute_sim_state_max0.011689540296316909
sim_compute_sim_state_mean0.009092742670078114
sim_compute_sim_state_median0.0097045589865245
sim_compute_sim_state_min0.00527231241094655
sim_render-ego0_max0.004316281205929887
sim_render-ego0_mean0.004165909785420663
sim_render-ego0_median0.004262001804653641
sim_render-ego0_min0.003823354326445481
simulation-passed1
step_physics_max0.14244736650119574
step_physics_mean0.12927950584445214
step_physics_median0.13564555977864895
step_physics_min0.10337953731931487
survival_time_max15.600000000000088
survival_time_mean9.937500000000028
survival_time_min5.399999999999989
No reset possible
5448011501Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:21:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8774803257231485
survival_time_median40.09999999999986
deviation-center-line_median1.4349951158769438
in-drivable-lane_median10.000000000000078


other stats
agent_compute-ego0_max0.01310933184349674
agent_compute-ego0_mean0.012468838099540951
agent_compute-ego0_median0.012323846917148018
agent_compute-ego0_min0.01211832672037104
complete-iteration_max0.2051485804305679
complete-iteration_mean0.18372626795108005
complete-iteration_median0.18306976671912453
complete-iteration_min0.16361695793550318
deviation-center-line_max3.1837876816693957
deviation-center-line_mean1.562364274172923
deviation-center-line_min0.19567918326840783
deviation-heading_max10.47593497136392
deviation-heading_mean6.2323338412800595
deviation-heading_median6.851953442740831
deviation-heading_min0.7494935082746562
driven_any_max10.535807070255936
driven_any_mean5.757867922632837
driven_any_median5.533603533706172
driven_any_min1.4284575528630723
driven_lanedir_consec_max9.63225229274521
driven_lanedir_consec_mean3.5120981494989323
driven_lanedir_consec_min0.6611796538042198
driven_lanedir_max9.63225229274521
driven_lanedir_mean3.723905307764898
driven_lanedir_median2.30109464225508
driven_lanedir_min0.6611796538042198
get_duckie_state_max1.4773614202113473e-06
get_duckie_state_mean1.411019249901182e-06
get_duckie_state_median1.4112640365396997e-06
get_duckie_state_min1.3441875063139815e-06
get_robot_state_max0.004126010269954287
get_robot_state_mean0.0039005532312970225
get_robot_state_median0.003905059402536118
get_robot_state_min0.003666083850161567
get_state_dump_max0.0052029483619777635
get_state_dump_mean0.004927716779256981
get_state_dump_median0.00489648870036399
get_state_dump_min0.004714941354322184
get_ui_image_max0.03548980358383418
get_ui_image_mean0.031544195941761076
get_ui_image_median0.03178145500710183
get_ui_image_min0.02712407016900644
in-drivable-lane_max32.59999999999949
in-drivable-lane_mean14.262499999999864
in-drivable-lane_min4.4499999999998
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.535807070255936, "get_ui_image": 0.029190558378742106, "step_physics": 0.10244149788531733, "survival_time": 59.99999999999873, "driven_lanedir": 9.63225229274521, "get_state_dump": 0.004928008205785442, "get_robot_state": 0.003903670672274549, "sim_render-ego0": 0.003968225132912819, "get_duckie_state": 1.4773614202113473e-06, "in-drivable-lane": 4.4499999999998, "deviation-heading": 10.47593497136392, "agent_compute-ego0": 0.0123149443427093, "complete-iteration": 0.17083738904312984, "set_robot_commands": 0.0023328483749885144, "deviation-center-line": 3.1837876816693957, "driven_lanedir_consec": 9.63225229274521, "sim_compute_sim_state": 0.009524918912749406, "sim_compute_performance-ego0": 0.002144418489327538}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.388655945582423, "get_ui_image": 0.03548980358383418, "step_physics": 0.11934966466813812, "survival_time": 47.69999999999943, "driven_lanedir": 1.8517520135585124, "get_state_dump": 0.004714941354322184, "get_robot_state": 0.003666083850161567, "sim_render-ego0": 0.0038028632159008407, "get_duckie_state": 1.3843256765635223e-06, "in-drivable-lane": 32.59999999999949, "deviation-heading": 9.671281810800636, "agent_compute-ego0": 0.012332749491586735, "complete-iteration": 0.19530214439511925, "set_robot_commands": 0.002202360542656863, "deviation-center-line": 1.484345018174773, "driven_lanedir_consec": 1.0054538552692067, "sim_compute_sim_state": 0.01164483549707223, "sim_compute_performance-ego0": 0.002013935468583831}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4284575528630723, "get_ui_image": 0.03437235163546157, "step_physics": 0.13011982797206134, "survival_time": 8.649999999999988, "driven_lanedir": 0.6611796538042198, "get_state_dump": 0.0052029483619777635, "get_robot_state": 0.004126010269954287, "sim_render-ego0": 0.004247229674766804, "get_duckie_state": 1.3441875063139815e-06, "in-drivable-lane": 5.79999999999999, "deviation-heading": 0.7494935082746562, "agent_compute-ego0": 0.01310933184349674, "complete-iteration": 0.2051485804305679, "set_robot_commands": 0.0023502659523624114, "deviation-center-line": 0.19567918326840783, "driven_lanedir_consec": 0.6611796538042198, "sim_compute_sim_state": 0.009292424410239032, "sim_compute_performance-ego0": 0.0022371664814565375}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.67855112182992, "get_ui_image": 0.02712407016900644, "step_physics": 0.10058925118863855, "survival_time": 32.50000000000029, "driven_lanedir": 2.7504372709516476, "get_state_dump": 0.004864969194942539, "get_robot_state": 0.003906448132797687, "sim_render-ego0": 0.003942442379788869, "get_duckie_state": 1.438202396515877e-06, "in-drivable-lane": 14.200000000000166, "deviation-heading": 4.032625074681025, "agent_compute-ego0": 0.01211832672037104, "complete-iteration": 0.16361695793550318, "set_robot_commands": 0.0023913042885916574, "deviation-center-line": 1.3856452135791149, "driven_lanedir_consec": 2.7495067961770903, "sim_compute_sim_state": 0.006497552684192101, "sim_compute_performance-ego0": 0.00209364253804431}}
set_robot_commands_max0.0023913042885916574
set_robot_commands_mean0.0023191947896498617
set_robot_commands_median0.002341557163675463
set_robot_commands_min0.002202360542656863
sim_compute_performance-ego0_max0.0022371664814565375
sim_compute_performance-ego0_mean0.0021222907443530542
sim_compute_performance-ego0_median0.0021190305136859237
sim_compute_performance-ego0_min0.002013935468583831
sim_compute_sim_state_max0.01164483549707223
sim_compute_sim_state_mean0.009239932876063192
sim_compute_sim_state_median0.00940867166149422
sim_compute_sim_state_min0.006497552684192101
sim_render-ego0_max0.004247229674766804
sim_render-ego0_mean0.003990190100842333
sim_render-ego0_median0.003955333756350844
sim_render-ego0_min0.0038028632159008407
simulation-passed1
step_physics_max0.13011982797206134
step_physics_mean0.11312506042853884
step_physics_median0.11089558127672772
step_physics_min0.10058925118863855
survival_time_max59.99999999999873
survival_time_mean37.21249999999961
survival_time_min8.649999999999988
No reset possible
5436111562Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:43:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012823821503752771
agent_compute-ego0_mean0.012518877887805237
agent_compute-ego0_median0.01256628774981217
agent_compute-ego0_min0.012119114547843838
complete-iteration_max0.34785623772753765
complete-iteration_mean0.2980979750495866
complete-iteration_median0.2969684708029106
complete-iteration_min0.2505987208649876
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.336613066686778e-06
get_duckie_state_mean1.2555686162969257e-06
get_duckie_state_median1.2722936498433922e-06
get_duckie_state_min1.1410740988141393e-06
get_robot_state_max0.003875216873956659
get_robot_state_mean0.003730357586593056
get_robot_state_median0.003744884891176502
get_robot_state_min0.0035564436900625616
get_state_dump_max0.00491838292416486
get_state_dump_mean0.004693568844680088
get_state_dump_median0.0046980407811719905
get_state_dump_min0.004459810892211508
get_ui_image_max0.03545137329165088
get_ui_image_mean0.030530184234409508
get_ui_image_median0.029839972473004777
get_ui_image_min0.0269894186999776
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02854610223952777, "step_physics": 0.22305883475882524, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004728886805208002, "get_robot_state": 0.003875216873956659, "sim_render-ego0": 0.00394090863687609, "get_duckie_state": 1.2929393885832443e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012823821503752771, "complete-iteration": 0.2902903372203182, "set_robot_commands": 0.0023342945692838976, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008750667579962153, "sim_compute_performance-ego0": 0.002140177179633529}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03545137329165088, "step_physics": 0.2714227278167064, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.00491838292416486, "get_robot_state": 0.0037077209733110184, "sim_render-ego0": 0.003887118745306747, "get_duckie_state": 1.25164791110354e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012378750395318251, "complete-iteration": 0.34785623772753765, "set_robot_commands": 0.0022707154212843667, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011637826843325243, "sim_compute_performance-ego0": 0.002096738346808161}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03113384270648178, "step_physics": 0.23604608415862505, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004459810892211508, "get_robot_state": 0.0035564436900625616, "sim_render-ego0": 0.003607774356521238, "get_duckie_state": 1.1410740988141393e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012119114547843838, "complete-iteration": 0.303646604385503, "set_robot_commands": 0.0021424323295574205, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008611824391386491, "sim_compute_performance-ego0": 0.0018879156327068955}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0269894186999776, "step_physics": 0.1879727078119384, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00466719475713598, "get_robot_state": 0.003782048809041985, "sim_render-ego0": 0.003833124183000474, "get_duckie_state": 1.336613066686778e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012753825104306084, "complete-iteration": 0.2505987208649876, "set_robot_commands": 0.0022918229099118045, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006187399261500019, "sim_compute_performance-ego0": 0.00203479438102017}}
set_robot_commands_max0.0023342945692838976
set_robot_commands_mean0.002259816307509372
set_robot_commands_median0.0022812691655980854
set_robot_commands_min0.0021424323295574205
sim_compute_performance-ego0_max0.002140177179633529
sim_compute_performance-ego0_mean0.002039906385042189
sim_compute_performance-ego0_median0.0020657663639141654
sim_compute_performance-ego0_min0.0018879156327068955
sim_compute_sim_state_max0.011637826843325243
sim_compute_sim_state_mean0.008796929519043477
sim_compute_sim_state_median0.008681245985674322
sim_compute_sim_state_min0.006187399261500019
sim_render-ego0_max0.00394090863687609
sim_render-ego0_mean0.0038172314804261376
sim_render-ego0_median0.0038601214641536103
sim_render-ego0_min0.003607774356521238
simulation-passed1
step_physics_max0.2714227278167064
step_physics_mean0.22962508863652376
step_physics_median0.22955245945872516
step_physics_min0.1879727078119384
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5423911623Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:35:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.497044249752598
survival_time_median59.99999999999873
deviation-center-line_median3.881014379685132
in-drivable-lane_median7.150000000000045


other stats
agent_compute-ego0_max0.012805328678826706
agent_compute-ego0_mean0.01268894767861419
agent_compute-ego0_median0.012767578882161366
agent_compute-ego0_min0.012415304271307315
complete-iteration_max0.28035118776299844
complete-iteration_mean0.25352873368401974
complete-iteration_median0.26236878475678355
complete-iteration_min0.20902617745951352
deviation-center-line_max4.073388192987766
deviation-center-line_mean3.3083221865604315
deviation-center-line_min1.3978717938836975
deviation-heading_max29.7977337477961
deviation-heading_mean23.801771242477766
deviation-heading_median28.364808731001055
deviation-heading_min8.679733760112857
driven_any_max11.1664625005819
driven_any_mean9.65855436031205
driven_any_median10.866617999153895
driven_any_min5.73451894235851
driven_lanedir_consec_max8.54912747650131
driven_lanedir_consec_mean5.094383584381133
driven_lanedir_consec_min2.8343183615180294
driven_lanedir_max8.693061367871508
driven_lanedir_mean6.850557841394192
driven_lanedir_median7.803344604250036
driven_lanedir_min3.102480789205186
get_duckie_state_max2.0570302386764284e-06
get_duckie_state_mean1.9008642076693449e-06
get_duckie_state_median1.8913027733870771e-06
get_duckie_state_min1.7638210452267966e-06
get_robot_state_max0.00381457934669412
get_robot_state_mean0.003733867915957093
get_robot_state_median0.003730667834309701
get_robot_state_min0.0036595566485148486
get_state_dump_max0.0047937608777633015
get_state_dump_mean0.004726806152281569
get_state_dump_median0.004747406828528051
get_state_dump_min0.0046186500743068725
get_ui_image_max0.03596566104734849
get_ui_image_mean0.03085638026156091
get_ui_image_median0.030764461754759977
get_ui_image_min0.02593093648937521
in-drivable-lane_max11.09999999999987
in-drivable-lane_mean6.899999999999959
in-drivable-lane_min2.199999999999875
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.809818069425026, "get_ui_image": 0.028965010631094367, "step_physics": 0.1805868585540492, "survival_time": 59.99999999999873, "driven_lanedir": 8.693061367871508, "get_state_dump": 0.004745045272039434, "get_robot_state": 0.0037798831901582055, "sim_render-ego0": 0.0038656501547680807, "get_duckie_state": 2.0570302386764284e-06, "in-drivable-lane": 2.199999999999875, "deviation-heading": 29.134665427144675, "agent_compute-ego0": 0.012805328678826706, "complete-iteration": 0.2498614776144417, "set_robot_commands": 0.002291276591902073, "deviation-center-line": 3.918972944835955, "driven_lanedir_consec": 5.8916077103000095, "sim_compute_sim_state": 0.010596354736277304, "sim_compute_performance-ego0": 0.0021315532163418303}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.73451894235851, "get_ui_image": 0.03596566104734849, "step_physics": 0.2039105533975777, "survival_time": 30.900000000000304, "driven_lanedir": 3.102480789205186, "get_state_dump": 0.0047497683850166676, "get_robot_state": 0.003681452478461197, "sim_render-ego0": 0.003816813374952276, "get_duckie_state": 1.911585473475048e-06, "in-drivable-lane": 11.050000000000155, "deviation-heading": 8.679733760112857, "agent_compute-ego0": 0.012759747143130697, "complete-iteration": 0.28035118776299844, "set_robot_commands": 0.0022138062509465873, "deviation-center-line": 1.3978717938836975, "driven_lanedir_consec": 3.102480789205186, "sim_compute_sim_state": 0.011111405824035744, "sim_compute_performance-ego0": 0.0020495146657422978}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.1664625005819, "get_ui_image": 0.03256391287842559, "step_physics": 0.1991653482086156, "survival_time": 59.99999999999873, "driven_lanedir": 8.54912747650131, "get_state_dump": 0.0047937608777633015, "get_robot_state": 0.00381457934669412, "sim_render-ego0": 0.003926595978494687, "get_duckie_state": 1.7638210452267966e-06, "in-drivable-lane": 3.2499999999999325, "deviation-heading": 29.7977337477961, "agent_compute-ego0": 0.012775410621192036, "complete-iteration": 0.27487609189912543, "set_robot_commands": 0.002278880810955978, "deviation-center-line": 4.073388192987766, "driven_lanedir_consec": 8.54912747650131, "sim_compute_sim_state": 0.013409195494195206, "sim_compute_performance-ego0": 0.002055471882435007}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.923417928882763, "get_ui_image": 0.02593093648937521, "step_physics": 0.14821462011853423, "survival_time": 59.99999999999873, "driven_lanedir": 7.057561731998762, "get_state_dump": 0.0046186500743068725, "get_robot_state": 0.0036595566485148486, "sim_render-ego0": 0.003721898838840456, "get_duckie_state": 1.8710200732991064e-06, "in-drivable-lane": 11.09999999999987, "deviation-heading": 27.59495203485743, "agent_compute-ego0": 0.012415304271307315, "complete-iteration": 0.20902617745951352, "set_robot_commands": 0.0021676381958414376, "deviation-center-line": 3.843055814534309, "driven_lanedir_consec": 2.8343183615180294, "sim_compute_sim_state": 0.006251865183681771, "sim_compute_performance-ego0": 0.001957558672394383}}
set_robot_commands_max0.002291276591902073
set_robot_commands_mean0.002237900462411519
set_robot_commands_median0.0022463435309512825
set_robot_commands_min0.0021676381958414376
sim_compute_performance-ego0_max0.0021315532163418303
sim_compute_performance-ego0_mean0.00204852460922838
sim_compute_performance-ego0_median0.0020524932740886527
sim_compute_performance-ego0_min0.001957558672394383
sim_compute_sim_state_max0.013409195494195206
sim_compute_sim_state_mean0.010342205309547506
sim_compute_sim_state_median0.010853880280156524
sim_compute_sim_state_min0.006251865183681771
sim_render-ego0_max0.003926595978494687
sim_render-ego0_mean0.0038327395867638753
sim_render-ego0_median0.0038412317648601783
sim_render-ego0_min0.003721898838840456
simulation-passed1
step_physics_max0.2039105533975777
step_physics_mean0.18296934506969417
step_physics_median0.1898761033813324
step_physics_min0.14821462011853423
survival_time_max59.99999999999873
survival_time_mean52.72499999999912
survival_time_min30.900000000000304
No reset possible
5416011646Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:29:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.848782877356212
survival_time_median59.99999999999873
deviation-center-line_median2.186564963964602
in-drivable-lane_median11.72499999999978


other stats
agent_compute-ego0_max0.01293844406451909
agent_compute-ego0_mean0.01268486607092678
agent_compute-ego0_median0.012701535338229372
agent_compute-ego0_min0.012397949542729284
complete-iteration_max0.2910942957267998
complete-iteration_mean0.2432547931618468
complete-iteration_median0.23799299240906371
complete-iteration_min0.2059388921024599
deviation-center-line_max4.049032175076946
deviation-center-line_mean2.2337108880716134
deviation-center-line_min0.5126814492803035
deviation-heading_max15.892112255031208
deviation-heading_mean8.940342423024557
deviation-heading_median8.667286466442985
deviation-heading_min2.53468450418105
driven_any_max11.702532932444424
driven_any_mean8.427035736092101
driven_any_median10.419114318406043
driven_any_min1.1673813751118889
driven_lanedir_consec_max8.979115026303573
driven_lanedir_consec_mean4.892552506090151
driven_lanedir_consec_min0.8935292433446103
driven_lanedir_max8.979115026303573
driven_lanedir_mean4.892552506090151
driven_lanedir_median4.848782877356212
driven_lanedir_min0.8935292433446103
get_duckie_state_max1.3112029266992677e-06
get_duckie_state_mean1.2665422136064093e-06
get_duckie_state_median1.265147047971905e-06
get_duckie_state_min1.22467183178256e-06
get_robot_state_max0.003814364154571102
get_robot_state_mean0.003720342026035696
get_robot_state_median0.0037419440645063847
get_robot_state_min0.003583115820558915
get_state_dump_max0.004852443610897271
get_state_dump_mean0.004751042614080021
get_state_dump_median0.004765432641269961
get_state_dump_min0.004620861562882892
get_ui_image_max0.03601199795740732
get_ui_image_mean0.03138232636928038
get_ui_image_median0.03158373509120385
get_ui_image_min0.026349837337306496
in-drivable-lane_max51.54999999999872
in-drivable-lane_mean18.96249999999957
in-drivable-lane_min0.849999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.702532932444424, "get_ui_image": 0.02925731220610632, "step_physics": 0.13778645946620208, "survival_time": 59.99999999999873, "driven_lanedir": 8.979115026303573, "get_state_dump": 0.0047729730010528945, "get_robot_state": 0.0037356346076374545, "sim_render-ego0": 0.0037906963958232033, "get_duckie_state": 1.2923438384272871e-06, "in-drivable-lane": 10.199999999999832, "deviation-heading": 14.371024982730717, "agent_compute-ego0": 0.01278533010458966, "complete-iteration": 0.2059388921024599, "set_robot_commands": 0.002226349316866174, "deviation-center-line": 3.640869750730223, "driven_lanedir_consec": 8.979115026303573, "sim_compute_sim_state": 0.00948507104884774, "sim_compute_performance-ego0": 0.0020147088564603554}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1673813751118889, "get_ui_image": 0.03601199795740732, "step_physics": 0.21630517740427335, "survival_time": 7.99999999999998, "driven_lanedir": 0.8935292433446103, "get_state_dump": 0.004620861562882892, "get_robot_state": 0.003583115820558915, "sim_render-ego0": 0.0036799344957245063, "get_duckie_state": 1.22467183178256e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 2.963547950155251, "agent_compute-ego0": 0.012617740571869086, "complete-iteration": 0.2910942957267998, "set_robot_commands": 0.0021870032600734544, "deviation-center-line": 0.5126814492803035, "driven_lanedir_consec": 0.8935292433446103, "sim_compute_sim_state": 0.01006050731824792, "sim_compute_performance-ego0": 0.0019466388299598455}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.468595430549064, "get_ui_image": 0.03391015797630138, "step_physics": 0.17360044438872707, "survival_time": 59.99999999999873, "driven_lanedir": 8.260020598685989, "get_state_dump": 0.004852443610897271, "get_robot_state": 0.003814364154571102, "sim_render-ego0": 0.0039211204903608155, "get_duckie_state": 1.3112029266992677e-06, "in-drivable-lane": 13.24999999999973, "deviation-heading": 15.892112255031208, "agent_compute-ego0": 0.01293844406451909, "complete-iteration": 0.25071883995665994, "set_robot_commands": 0.0022990223172304532, "deviation-center-line": 4.049032175076946, "driven_lanedir_consec": 8.260020598685989, "sim_compute_sim_state": 0.0131979776758834, "sim_compute_performance-ego0": 0.0020975018421080984}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.36963320626302, "get_ui_image": 0.026349837337306496, "step_physics": 0.16355214905083726, "survival_time": 59.99999999999873, "driven_lanedir": 1.437545156026434, "get_state_dump": 0.004757892281487026, "get_robot_state": 0.003748253521375315, "sim_render-ego0": 0.0038463860923900494, "get_duckie_state": 1.2379502575165227e-06, "in-drivable-lane": 51.54999999999872, "deviation-heading": 2.53468450418105, "agent_compute-ego0": 0.012397949542729284, "complete-iteration": 0.22526714486146748, "set_robot_commands": 0.0023062929920510985, "deviation-center-line": 0.7322601771989817, "driven_lanedir_consec": 1.437545156026434, "sim_compute_sim_state": 0.006185617375433395, "sim_compute_performance-ego0": 0.0020403971183706976}}
set_robot_commands_max0.0023062929920510985
set_robot_commands_mean0.0022546669715552948
set_robot_commands_median0.002262685817048313
set_robot_commands_min0.0021870032600734544
sim_compute_performance-ego0_max0.0020975018421080984
sim_compute_performance-ego0_mean0.0020248116617247493
sim_compute_performance-ego0_median0.0020275529874155263
sim_compute_performance-ego0_min0.0019466388299598455
sim_compute_sim_state_max0.0131979776758834
sim_compute_sim_state_mean0.009732293354603114
sim_compute_sim_state_median0.00977278918354783
sim_compute_sim_state_min0.006185617375433395
sim_render-ego0_max0.0039211204903608155
sim_render-ego0_mean0.0038095343685746433
sim_render-ego0_median0.0038185412441066264
sim_render-ego0_min0.0036799344957245063
simulation-passed1
step_physics_max0.21630517740427335
step_physics_mean0.17281105757750995
step_physics_median0.16857629671978216
step_physics_min0.13778645946620208
survival_time_max59.99999999999873
survival_time_mean46.99999999999904
survival_time_min7.99999999999998
No reset possible
5409911663Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:23:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.180857118399625
survival_time_median36.72499999999939
deviation-center-line_median1.003290133321689
in-drivable-lane_median6.0749999999999265


other stats
agent_compute-ego0_max0.013374698603594744
agent_compute-ego0_mean0.01257450424825634
agent_compute-ego0_median0.012340001523831096
agent_compute-ego0_min0.012243315341768417
complete-iteration_max0.2519007364908854
complete-iteration_mean0.22910769102652576
complete-iteration_median0.23128684915857933
complete-iteration_min0.20195632929805912
deviation-center-line_max4.1820465187975175
deviation-center-line_mean1.6332544291933508
deviation-center-line_min0.34439093133250814
deviation-heading_max17.62909134890449
deviation-heading_mean7.278476538905422
deviation-heading_median4.848833150941557
deviation-heading_min1.7871485048340867
driven_any_max15.315275663331253
driven_any_mean8.030864024585448
driven_any_median7.620786272269436
driven_any_min1.566607890471666
driven_lanedir_consec_max7.58815498880071
driven_lanedir_consec_mean3.1392861612943292
driven_lanedir_consec_min0.6072754195773582
driven_lanedir_max13.067595326786307
driven_lanedir_mean4.7510202139446625
driven_lanedir_median2.664605054707492
driven_lanedir_min0.6072754195773582
get_duckie_state_max1.705134356463397e-06
get_duckie_state_mean1.5276400068809342e-06
get_duckie_state_median1.4867622897101988e-06
get_duckie_state_min1.431901091639942e-06
get_robot_state_max0.004253931398744936
get_robot_state_mean0.003968499545514001
get_robot_state_median0.003880487989128678
get_robot_state_min0.003859090805053711
get_state_dump_max0.005441079316315827
get_state_dump_mean0.005045928039456523
get_state_dump_median0.0049331050988251236
get_state_dump_min0.004876422643860016
get_ui_image_max0.03671467834048801
get_ui_image_mean0.03238046399284682
get_ui_image_median0.03269124925936147
get_ui_image_min0.02742467911217631
in-drivable-lane_max43.6499999999986
in-drivable-lane_mean15.299999999999612
in-drivable-lane_min5.399999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.566607890471666, "get_ui_image": 0.02893125745985243, "step_physics": 0.1547890239291721, "survival_time": 8.949999999999992, "driven_lanedir": 0.6072754195773582, "get_state_dump": 0.004959446854061551, "get_robot_state": 0.003859090805053711, "sim_render-ego0": 0.003950043519337972, "get_duckie_state": 1.5205807156032987e-06, "in-drivable-lane": 5.399999999999997, "deviation-heading": 1.7871485048340867, "agent_compute-ego0": 0.012402384810977512, "complete-iteration": 0.22246046596103244, "set_robot_commands": 0.0023516469531589083, "deviation-center-line": 0.34439093133250814, "driven_lanedir_consec": 0.6072754195773582, "sim_compute_sim_state": 0.00901738272772895, "sim_compute_performance-ego0": 0.0021022995313008624}, "LF-norm-zigzag-000-ego0": {"driven_any": 15.315275663331253, "get_ui_image": 0.036451241058870515, "step_physics": 0.15902986951315037, "survival_time": 59.99999999999873, "driven_lanedir": 13.067595326786307, "get_state_dump": 0.004876422643860016, "get_robot_state": 0.003863655657295779, "sim_render-ego0": 0.003981304208404516, "get_duckie_state": 1.431901091639942e-06, "in-drivable-lane": 6.3499999999998185, "deviation-heading": 17.62909134890449, "agent_compute-ego0": 0.012243315341768417, "complete-iteration": 0.24011323235612625, "set_robot_commands": 0.002301462484736129, "deviation-center-line": 4.1820465187975175, "driven_lanedir_consec": 7.58815498880071, "sim_compute_sim_state": 0.0150955592861382, "sim_compute_performance-ego0": 0.002174401461929207}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.5627758802018428, "get_ui_image": 0.03671467834048801, "step_physics": 0.17278985447353787, "survival_time": 13.450000000000056, "driven_lanedir": 1.583728340145449, "get_state_dump": 0.005441079316315827, "get_robot_state": 0.004253931398744936, "sim_render-ego0": 0.004356029298570421, "get_duckie_state": 1.705134356463397e-06, "in-drivable-lane": 5.8000000000000345, "deviation-heading": 3.4558052798414423, "agent_compute-ego0": 0.013374698603594744, "complete-iteration": 0.2519007364908854, "set_robot_commands": 0.00256412735691777, "deviation-center-line": 0.5814112002989054, "driven_lanedir_consec": 1.165803899308576, "sim_compute_sim_state": 0.009947057123537415, "sim_compute_performance-ego0": 0.002349090576171875}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.67879666433703, "get_ui_image": 0.02742467911217631, "step_physics": 0.13841156379864872, "survival_time": 59.99999999999873, "driven_lanedir": 3.745481769269534, "get_state_dump": 0.004906763343588696, "get_robot_state": 0.003897320320961577, "sim_render-ego0": 0.003977826791043881, "get_duckie_state": 1.452943863817099e-06, "in-drivable-lane": 43.6499999999986, "deviation-heading": 6.241861022041673, "agent_compute-ego0": 0.01227761823668468, "complete-iteration": 0.20195632929805912, "set_robot_commands": 0.002318428716095758, "deviation-center-line": 1.4251690663444727, "driven_lanedir_consec": 3.195910337490674, "sim_compute_sim_state": 0.006566652151865328, "sim_compute_performance-ego0": 0.002079628587860946}}
set_robot_commands_max0.00256412735691777
set_robot_commands_mean0.0023839163777271415
set_robot_commands_median0.0023350378346273333
set_robot_commands_min0.002301462484736129
sim_compute_performance-ego0_max0.002349090576171875
sim_compute_performance-ego0_mean0.0021763550393157226
sim_compute_performance-ego0_median0.0021383504966150345
sim_compute_performance-ego0_min0.002079628587860946
sim_compute_sim_state_max0.0150955592861382
sim_compute_sim_state_mean0.010156662822317471
sim_compute_sim_state_median0.009482219925633185
sim_compute_sim_state_min0.006566652151865328
sim_render-ego0_max0.004356029298570421
sim_render-ego0_mean0.004066300954339197
sim_render-ego0_median0.003979565499724199
sim_render-ego0_min0.003950043519337972
simulation-passed1
step_physics_max0.17278985447353787
step_physics_mean0.15625507792862725
step_physics_median0.15690944672116122
step_physics_min0.13841156379864872
survival_time_max59.99999999999873
survival_time_mean35.599999999999376
survival_time_min8.949999999999992
No reset possible
5398011710Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:36:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.3746786451755
survival_time_median59.99999999999873
deviation-center-line_median3.194121998657379
in-drivable-lane_median4.199999999999971


other stats
agent_compute-ego0_max0.013243365084775348
agent_compute-ego0_mean0.012875677230921355
agent_compute-ego0_median0.012921799330985317
agent_compute-ego0_min0.012415745176939445
complete-iteration_max0.24211054809158888
complete-iteration_mean0.20587756044181732
complete-iteration_median0.20409679144844228
complete-iteration_min0.17320611077879589
deviation-center-line_max3.399638674459415
deviation-center-line_mean3.0919654553782436
deviation-center-line_min2.5799791497388016
deviation-heading_max14.04099563515837
deviation-heading_mean12.492293288574398
deviation-heading_median12.954963940577858
deviation-heading_min10.018249637983503
driven_any_max12.390138494670923
driven_any_mean11.070958025605952
driven_any_median11.301254705203648
driven_any_min9.291184197345592
driven_lanedir_consec_max11.955577047258584
driven_lanedir_consec_mean8.813952450837316
driven_lanedir_consec_min4.5508754657396775
driven_lanedir_max11.955577047258584
driven_lanedir_mean10.030042338728649
driven_lanedir_median10.292723149323294
driven_lanedir_min7.579146009009422
get_duckie_state_max1.5732919481867537e-06
get_duckie_state_mean1.4740480033904904e-06
get_duckie_state_median1.5046574690260555e-06
get_duckie_state_min1.3135851273230966e-06
get_robot_state_max0.004162000955673694
get_robot_state_mean0.003983613325342528
get_robot_state_median0.004019943204747946
get_robot_state_min0.0037325659362005257
get_state_dump_max0.005431028131045072
get_state_dump_mean0.0051580682163802965
get_state_dump_median0.005168819363502868
get_state_dump_min0.004863606007470378
get_ui_image_max0.038255947089578704
get_ui_image_mean0.03188450649883584
get_ui_image_median0.03149742637446877
get_ui_image_min0.02628722615682711
in-drivable-lane_max9.899999999999435
in-drivable-lane_mean4.612499999999843
in-drivable-lane_min0.14999999999999147
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.390138494670923, "get_ui_image": 0.029347466787231852, "step_physics": 0.12059929865186755, "survival_time": 59.99999999999873, "driven_lanedir": 11.955577047258584, "get_state_dump": 0.005431028131045072, "get_robot_state": 0.0039898342732882916, "sim_render-ego0": 0.004089294722634093, "get_duckie_state": 1.5391001197122515e-06, "in-drivable-lane": 0.14999999999999147, "deviation-heading": 12.799317062978943, "agent_compute-ego0": 0.012619073345301848, "complete-iteration": 0.1907288533861095, "set_robot_commands": 0.002452163275433619, "deviation-center-line": 3.0852842217672967, "driven_lanedir_consec": 11.955577047258584, "sim_compute_sim_state": 0.0098654600503939, "sim_compute_performance-ego0": 0.0022362433901238106}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.291184197345592, "get_ui_image": 0.038255947089578704, "step_physics": 0.15856377291250814, "survival_time": 52.79999999999914, "driven_lanedir": 7.579146009009422, "get_state_dump": 0.005221270116410846, "get_robot_state": 0.004162000955673694, "sim_render-ego0": 0.004263304265580768, "get_duckie_state": 1.5732919481867537e-06, "in-drivable-lane": 9.899999999999435, "deviation-heading": 10.018249637983503, "agent_compute-ego0": 0.013243365084775348, "complete-iteration": 0.24211054809158888, "set_robot_commands": 0.0024867127724379555, "deviation-center-line": 2.5799791497388016, "driven_lanedir_consec": 7.579146009009422, "sim_compute_sim_state": 0.013430475399194177, "sim_compute_performance-ego0": 0.002385875021610603}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.742326338322105, "get_ui_image": 0.033647385961705696, "step_physics": 0.13934788795236147, "survival_time": 59.99999999999873, "driven_lanedir": 11.17021128134158, "get_state_dump": 0.00511636861059489, "get_robot_state": 0.0040500521362076, "sim_render-ego0": 0.004094117487797034, "get_duckie_state": 1.47021481833986e-06, "in-drivable-lane": 1.0999999999999377, "deviation-heading": 14.04099563515837, "agent_compute-ego0": 0.013224525316668788, "complete-iteration": 0.21746472951077503, "set_robot_commands": 0.0024020640081807436, "deviation-center-line": 3.3029597755474613, "driven_lanedir_consec": 11.17021128134158, "sim_compute_sim_state": 0.013186655870385214, "sim_compute_performance-ego0": 0.0022977714633862245}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.86018307208519, "get_ui_image": 0.02628722615682711, "step_physics": 0.11147315575617936, "survival_time": 59.99999999999873, "driven_lanedir": 9.415235017305006, "get_state_dump": 0.004863606007470378, "get_robot_state": 0.0037325659362005257, "sim_render-ego0": 0.003897932943555338, "get_duckie_state": 1.3135851273230966e-06, "in-drivable-lane": 7.300000000000004, "deviation-heading": 13.11061081817677, "agent_compute-ego0": 0.012415745176939445, "complete-iteration": 0.17320611077879589, "set_robot_commands": 0.002248040246129731, "deviation-center-line": 3.399638674459415, "driven_lanedir_consec": 4.5508754657396775, "sim_compute_sim_state": 0.006229057002325638, "sim_compute_performance-ego0": 0.001976225794999427}}
set_robot_commands_max0.0024867127724379555
set_robot_commands_mean0.002397245075545512
set_robot_commands_median0.002427113641807181
set_robot_commands_min0.002248040246129731
sim_compute_performance-ego0_max0.002385875021610603
sim_compute_performance-ego0_mean0.002224028917530016
sim_compute_performance-ego0_median0.0022670074267550173
sim_compute_performance-ego0_min0.001976225794999427
sim_compute_sim_state_max0.013430475399194177
sim_compute_sim_state_mean0.01067791208057473
sim_compute_sim_state_median0.011526057960389555
sim_compute_sim_state_min0.006229057002325638
sim_render-ego0_max0.004263304265580768
sim_render-ego0_mean0.004086162354891808
sim_render-ego0_median0.004091706105215563
sim_render-ego0_min0.003897932943555338
simulation-passed1
step_physics_max0.15856377291250814
step_physics_mean0.13249602881822914
step_physics_median0.12997359330211453
step_physics_min0.11147315575617936
survival_time_max59.99999999999873
survival_time_mean58.19999999999883
survival_time_min52.79999999999914
No reset possible
5395911735Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:20:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2475 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5395011705brian wongbaseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5393911732Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible